00010000:00010000:0.0:1746129729.360378:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f26400/0x48868a4e43945d4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129729.360390:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f26400/0x48868a4e43945d4a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129729.360397:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012bfca200) 00010000:00010000:0.0:1746129729.360398:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129729.360400:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094f26400/0x48868a4e43945d4a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129729.360405:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f26400/0x48868a4e43945d4a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129729.360434:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e43945d3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d49a expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129729.360445:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f26800/0x48868a4e43945d51 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d49a expref: 7 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129729.361092:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129729.361095:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129729.361097:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f26800, rc 0) 00000100:00100000:0.0:1746129729.362345:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6141239f-0c60-480d-830c-e22ba61457b0+7:27927:x1830949051613952:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 10751us (10977us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129729.362351:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9566 00000100:00100000:0.0:1746129729.397867:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.397915:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051614208 00000100:00100000:0.0:1746129729.397921:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051614208 00000100:00100000:0.0:1746129729.397963:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9485 00000100:00100000:0.0:1746129729.397970:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949051614208:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129729.397990:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129729.398002:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009faebe00/0x48868a4e43945d58 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d4a1 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129729.398019:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129729.398027:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009faebe00/0x48868a4e43945d58 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d4a1 expref: 9 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129729.398036:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faebe00/0x48868a4e43945d58 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d4a1 expref: 9 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129729.398048:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faebe00, rc 0) 00000100:00100000:0.0:1746129729.398065:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949051614208:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 97us (219us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129729.398070:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9485 00000100:00100000:0.0:1746129729.403005:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.404688:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.408237:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.411254:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.411602:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.411619:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051615488 00000100:00100000:0.0:1746129729.411621:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051615488 00000100:00100000:0.0:1746129729.411646:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3679 00000100:00100000:0.0:1746129729.411650:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6141239f-0c60-480d-830c-e22ba61457b0+7:27927:x1830949051615488:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:0.0:1746129729.412037:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6141239f-0c60-480d-830c-e22ba61457b0+8:27927:x1830949051615488:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 385us (433us total) trans 8589943287 rc 0/0 00000100:00100000:0.0:1746129729.412043:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3679 00000100:00100000:0.0:1746129729.424968:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.424996:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.425017:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051616128 00000100:00100000:0.0:1746129729.425023:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051616128 00010000:00010000:0.0:1746129729.425048:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c550e00/0x48868a4e43945be5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d3dd expref: 9 pid: 4589 timeout: 775 lvb_type: 1 00000100:00100000:0.0:1746129729.425068:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051616000 00000100:00100000:0.0:1746129729.425070:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051616000 00010000:00010000:0.0:1746129729.425078:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2400/0x48868a4e43945d12 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d470 expref: 15 pid: 1140 timeout: 775 lvb_type: 1 00000100:00100000:0.0:1746129729.425090:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4510 00000100:00100000:0.0:1746129729.425098:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c089880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949051616128:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129729.425107:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129729.425125:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c550e00/0x48868a4e43945be5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d3dd expref: 9 pid: 4589 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746129729.425134:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c550e00/0x48868a4e43945be5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d3dd expref: 9 pid: 4589 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746129729.425153:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129729.425183:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c089880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949051616128:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 86us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129729.425187:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4510 00000100:00100000:0.0:1746129729.425200:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4511 00000100:00100000:0.0:1746129729.425204:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c089180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949051616000:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129729.425217:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129729.425225:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2400/0x48868a4e43945d12 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d470 expref: 15 pid: 1140 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746129729.425232:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2400/0x48868a4e43945d12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d470 expref: 15 pid: 1140 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746129729.425242:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129729.425256:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c089180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949051616000:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 52us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129729.425260:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4511 00000100:00100000:0.0:1746129729.425295:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.425309:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051616256 00000100:00100000:0.0:1746129729.425311:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051616256 00010000:00010000:0.0:1746129729.425321:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801354cd000/0x48868a4e43945cb7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d431 expref: 8 pid: 20441 timeout: 775 lvb_type: 1 00000100:00100000:0.0:1746129729.425332:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4512 00000100:00100000:0.0:1746129729.425337:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c088000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1964:x1830949051616256:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129729.425342:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129729.425349:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801354cd000/0x48868a4e43945cb7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d431 expref: 8 pid: 20441 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746129729.425355:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801354cd000/0x48868a4e43945cb7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d431 expref: 8 pid: 20441 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746129729.425365:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129729.425371:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129729.425377:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bfac200/0x48868a4e43945d82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d4b6 expref: 14 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129729.425384:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bfac200/0x48868a4e43945d82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d4b6 expref: 14 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129729.425410:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bfac200/0x48868a4e43945d82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d4b6 expref: 14 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129729.425421:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c08ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053082880:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129729.425468:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49486c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129729.437316:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.437707:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.437724:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051617152 00000100:00100000:0.0:1746129729.437727:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051617152 00000100:00100000:0.0:1746129729.438296:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3680 00000100:00100000:0.0:1746129729.438301:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:27925:x1830949051617152:12345-192.168.204.31@tcp:35:multiop.0 00000001:00080000:0.0:1746129729.442515:0:14316:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589943288 00000100:00100000:0.0:1746129729.442593:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:27925:x1830949051617152:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 4291us (4886us total) trans 8589943289 rc 0/0 00000100:00100000:0.0:1746129729.442601:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3680 00000020:00080000:0.0:1746129729.442605:0:14316:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746129729.442648:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.444790:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051618048 00000100:00100000:0.0:1746129729.444799:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051618048 00002000:00100000:0.0:1746129729.444841:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012c08bb80 x1830949051618048/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:470/0 lens 488/0 e 0 to 0 dl 1746129740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129729.444876:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c08bb80 with x1830949051618048 ext(3145728->4194303) 00002000:00010000:0.0:1746129729.444881:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c08bb80 00000100:00100000:0.0:1746129729.444901:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3321 00000100:00100000:0.0:1746129729.444908:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1961:x1830949051618048:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129729.456299:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949051616896:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18468us (18978us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129729.456310:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3317 00002000:00100000:0.0:1746129729.456320:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012c08a300 x1830949051616896/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:470/0 lens 488/440 e 0 to 0 dl 1746129740 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129729.456330:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c08a300 with x1830949051616896 ext(0->1048575) 00002000:00010000:0.0:1746129729.456335:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c08a300 00000100:00100000:0.0:1746129729.467152:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.467876:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051618688 00000100:00100000:0.0:1746129729.467882:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051618688 00002000:00100000:0.0:1746129729.467903:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800a5492300 x1830949051618688/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:470/0 lens 488/0 e 0 to 0 dl 1746129740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129729.467911:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5492300 with x1830949051618688 ext(1048576->2097151) 00002000:00010000:0.0:1746129729.467914:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5492300 00000100:00100000:0.0:1746129729.467959:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3323 00000100:00100000:0.0:1746129729.467967:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949051618688:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129729.483702:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.495696:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949051618688:12345-192.168.204.31@tcp:3:cat.0 Request processed in 27722us (27976us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129729.495716:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3323 00002000:00100000:0.0:1746129729.495725:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800a5492300 x1830949051618688/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:470/0 lens 488/440 e 0 to 0 dl 1746129740 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129729.495734:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5492300 with x1830949051618688 ext(1048576->2097151) 00002000:00010000:0.0:1746129729.495739:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5492300 00002000:00010000:0.0:1746129729.517758:0:7975:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime: 1746129728 -> 1746129730 00002000:00010000:0.0:1746129729.517767:0:7975:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime: 1746129728 -> 1746129730 00002000:00010000:0.0:1746129729.517769:0:7975:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime: 1746129727 -> 1746129730 00000100:00100000:0.0:1746129729.517793:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5492680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053083136:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129729.517840:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135676000/0x48868a4e43945d90 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d4c4 expref: 8 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129729.517881:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135676000/0x48868a4e43945d90 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d4c4 expref: 8 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129729.518754:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135676000, rc 0) 00000100:00100000:0.0:1746129729.521019:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1962:x1830949051619200:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7762us (8092us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129729.521027:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9488 00000100:00100000:0.0:1746129729.529594:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.546468:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.546561:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.546576:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.546601:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.546619:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051619712 00000100:00100000:0.0:1746129729.546631:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051619712 00002000:00100000:0.0:1746129729.546660:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012c08b800 x1830949051619712/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:470/0 lens 488/0 e 0 to 0 dl 1746129740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129729.546666:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c08b800 with x1830949051619712 ext(2097152->3145727) 00002000:00010000:0.0:1746129729.546669:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c08b800 00000100:00100000:0.0:1746129729.546694:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051619968 00000100:00100000:0.0:1746129729.546696:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051619968 00002000:00100000:0.0:1746129729.546706:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012c088e00 x1830949051619968/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:470/0 lens 488/0 e 0 to 0 dl 1746129740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129729.546711:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c088e00 with x1830949051619968 ext(3145728->4194303) 00002000:00010000:0.0:1746129729.546713:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c088e00 00000100:00100000:0.0:1746129729.546725:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051620224 00000100:00100000:0.0:1746129729.546727:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051620224 00002000:00100000:0.0:1746129729.546739:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012c08b100 x1830949051620224/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:470/0 lens 488/0 e 0 to 0 dl 1746129740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129729.546743:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c08b100 with x1830949051620224 ext(2097152->3145727) 00002000:00010000:0.0:1746129729.546746:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c08b100 00000100:00100000:0.0:1746129729.546753:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051620480 00000100:00100000:0.0:1746129729.546755:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051620480 00002000:00100000:0.0:1746129729.546764:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012b8e4700 x1830949051620480/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:470/0 lens 488/0 e 0 to 0 dl 1746129740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129729.546769:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e4700 with x1830949051620480 ext(3145728->4194303) 00002000:00010000:0.0:1746129729.546771:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8e4700 00000100:00100000:0.0:1746129729.546780:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3326 00000100:00100000:0.0:1746129729.546785:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949051619712:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129729.547935:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3327 00000100:00100000:0.0:1746129729.547947:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949051619968:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129729.551154:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051620608 00000100:00100000:0.0:1746129729.551160:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051620608 00000100:00100000:0.0:1746129729.551192:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9489 00000100:00100000:0.0:1746129729.551199:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:27922:x1830949051620608:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129729.551211:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129729.551225:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013094b200/0x48868a4e43945d97 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d4cb expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129729.551248:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bfac200/0x48868a4e43945d82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d4b6 expref: 14 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129729.551255:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129729.551257:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129729.551260:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013094b200/0x48868a4e43945d97 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1949696->2097151] (req 1949696->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d4cb expref: 8 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129729.551285:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bfac200/0x48868a4e43945d82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d4b6 expref: 14 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129729.551295:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bfac200/0x48868a4e43945d82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d4b6 expref: 14 pid: 10930 timeout: 775 lvb_type: 0 00000100:00100000:0.0:1746129729.551306:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053083264:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129729.551368:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4948540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129729.558425:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051620736 00000100:00100000:0.0:1746129729.558434:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051620736 00000100:00100000:0.0:1746129729.558488:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9490 00000100:00100000:0.0:1746129729.558497:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1963:x1830949051620736:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129729.558516:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129729.558533:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800919ec600/0x48868a4e43945d9e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d4d2 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129729.558580:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053083392:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129729.559392:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49486c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129729.564824:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949051619712:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18037us (18356us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129729.564831:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3326 00002000:00100000:0.0:1746129729.564838:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012c08b800 x1830949051619712/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:470/0 lens 488/440 e 0 to 0 dl 1746129740 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129729.564863:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c08b800 with x1830949051619712 ext(2097152->3145727) 00002000:00010000:0.0:1746129729.564867:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c08b800 00000100:00100000:0.0:1746129729.565244:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.570082:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949051619968:12345-192.168.204.31@tcp:3:cat.0 Request processed in 22126us (23510us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129729.570092:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3327 00002000:00100000:0.0:1746129729.570102:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012c088e00 x1830949051619968/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:470/0 lens 488/440 e 0 to 0 dl 1746129740 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129729.570111:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c088e00 with x1830949051619968 ext(3145728->4194303) 00002000:00010000:0.0:1746129729.570116:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c088e00 00000100:00100000:0.0:1746129729.578894:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051620992 00000100:00100000:0.0:1746129729.578900:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051620992 00000100:00100000:0.0:1746129729.578934:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9491 00000100:00100000:0.0:1746129729.578939:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1963:x1830949051620992:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129729.578951:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129729.578962:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43945da5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d4d9 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129729.579000:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053083520:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129729.579058:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4948900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129729.584014:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.586339:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051621504 00000100:00100000:0.0:1746129729.586343:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051621504 00000100:00100000:0.0:1746129729.586368:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9492 00000100:00100000:0.0:1746129729.586373:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949051621504:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129729.586383:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129729.586392:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800919eda00/0x48868a4e43945dcf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d4e7 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129729.586433:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053083648:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129729.586483:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49486c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129729.586522:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053083520:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129729.586542:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43945da5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d4d9 expref: 9 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129729.586550:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43945da5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d4d9 expref: 9 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129729.586571:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919ece00, rc 0) 00000100:00100000:0.0:1746129729.586589:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1963:x1830949051620992:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7650us (7936us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129729.586593:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9491 00000100:00100000:0.0:1746129729.594726:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.598668:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.602904:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.606078:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.621092:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746129729.621110:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053084416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746129729.621161:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129729.621409:0:3299:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840020 gen 2 00000004:00080000:0.0:1746129729.621413:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ad8000, transno 21474839987 00000004:00080000:0.0:1746129729.621418:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ad9c00, transno 21474839988 00000004:00080000:0.0:1746129729.621421:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ad9500, transno 21474839989 00000004:00080000:0.0:1746129729.621423:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ad8700, transno 21474839990 00000004:00080000:0.0:1746129729.621425:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ada300, transno 21474839991 00000004:00080000:0.0:1746129729.621427:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009476b800, transno 21474839992 00000004:00080000:0.0:1746129729.621429:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ad9880, transno 21474839993 00000004:00080000:0.0:1746129729.621430:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094768000, transno 21474839994 00000004:00080000:0.0:1746129729.621432:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fbed180, transno 21474839995 00000004:00080000:0.0:1746129729.621434:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fbef100, transno 21474839996 00000004:00080000:0.0:1746129729.621436:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fbeea00, transno 21474839997 00000004:00080000:0.0:1746129729.621438:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013594b100, transno 21474839998 00000004:00080000:0.0:1746129729.621440:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013594ad80, transno 21474839999 00000004:00080000:0.0:1746129729.621442:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135949c00, transno 21474840000 00000004:00080000:0.0:1746129729.621452:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fbef800, transno 21474840001 00000004:00080000:0.0:1746129729.621454:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135948a80, transno 21474840002 00000004:00080000:0.0:1746129729.621456:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adac700, transno 21474840013 00000004:00080000:0.0:1746129729.621458:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adaca80, transno 21474840014 00000004:00080000:0.0:1746129729.621460:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adac000, transno 21474840015 00000004:00080000:0.0:1746129729.621461:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adad500, transno 21474840016 00000004:00080000:0.0:1746129729.621463:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adad180, transno 21474840017 00000004:00080000:0.0:1746129729.621464:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adad880, transno 21474840018 00000004:00080000:0.0:1746129729.621466:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adadc00, transno 21474840019 00000004:00080000:0.0:1746129729.621467:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adac380, transno 21474840020 00000100:00100000:0.0:1746129729.621472:0:3299:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009b00ea00 x1830949053079680/t21474840021(21474840021) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746129745 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000100:00100000:0.0:1746129729.621483:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053084416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746129729.623582:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.623667:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.626921:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.631593:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051623296 00000100:00100000:0.0:1746129729.631600:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051623296 00000100:00100000:0.0:1746129729.631632:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3681 00000100:00100000:0.0:1746129729.631638:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:27922:x1830949051623296:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:0.0:1746129729.632180:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:27922:x1830949051623296:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 537us (845us total) trans 8589943291 rc 0/0 00000100:00100000:0.0:1746129729.632187:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3681 00000100:00100000:0.0:1746129729.643208:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.657996:0:14311:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053085184 00000100:00100000:0.0:1746129729.658005:0:14311:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053085184 00000100:00100000:0.0:1746129729.658057:0:14311:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1746129729.658073:0:14311:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ea7f7eb-2f74-477e-bfed-16dc08365411+18:3296:x1830949053085184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746129729.658134:0:14311:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ea7f7eb-2f74-477e-bfed-16dc08365411+18:3296:x1830949053085184:12345-0@lo:400:kworker.0 Request processed in 62us (4508us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129729.658138:0:14311:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1746129729.658178:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3299:1830949053085568:0@lo:400:kworker.0 00000100:00080000:0.0:1746129729.659834:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129729.695109:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.695617:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.695658:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.695676:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051624064 00000100:00100000:0.0:1746129729.695681:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051624064 00010000:00010000:0.0:1746129729.695700:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c551800/0x48868a4e43945bec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d3f9 expref: 7 pid: 4589 timeout: 775 lvb_type: 1 00000100:00100000:0.0:1746129729.695716:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051624192 00000100:00100000:0.0:1746129729.695718:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051624192 00010000:00010000:0.0:1746129729.695726:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3000/0x48868a4e43945d27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d48c expref: 14 pid: 1140 timeout: 775 lvb_type: 1 00000100:00100000:0.0:1746129729.695736:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051624320 00000100:00100000:0.0:1746129729.695738:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051624320 00010000:00010000:0.0:1746129729.695745:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4400/0x48868a4e43945ce8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d44d expref: 8 pid: 7975 timeout: 775 lvb_type: 1 00000100:00100000:0.0:1746129729.695756:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4518 00000100:00100000:0.0:1746129729.695761:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+7:1962:x1830949051624064:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129729.695771:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129729.695797:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c551800/0x48868a4e43945bec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d3f9 expref: 7 pid: 4589 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746129729.695813:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c551800/0x48868a4e43945bec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d3f9 expref: 7 pid: 4589 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746129729.695831:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c551800/0x48868a4e43945bec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d3f9 expref: 7 pid: 4589 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746129729.695882:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129729.695901:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+6:1962:x1830949051624064:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 139us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129729.695906:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4518 00000100:00100000:0.0:1746129729.695917:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4519 00000100:00100000:0.0:1746129729.695921:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1963:x1830949051624192:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129729.695927:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129729.695933:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3000/0x48868a4e43945d27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d48c expref: 14 pid: 1140 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746129729.695940:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3000/0x48868a4e43945d27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d48c expref: 14 pid: 1140 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746129729.695949:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3000/0x48868a4e43945d27 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d48c expref: 14 pid: 1140 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746129729.695955:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129729.695967:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1963:x1830949051624192:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 46us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129729.695975:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4519 00000100:00100000:0.0:1746129729.695983:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4520 00000100:00100000:0.0:1746129729.695986:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1961:x1830949051624320:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129729.695991:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129729.695997:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4400/0x48868a4e43945ce8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d44d expref: 8 pid: 7975 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746129729.696005:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4400/0x48868a4e43945ce8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d44d expref: 8 pid: 7975 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746129729.696014:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4400/0x48868a4e43945ce8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d44d expref: 8 pid: 7975 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746129729.696021:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129729.696022:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129729.696027:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b69ac00/0x48868a4e43945df9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d511 expref: 12 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129729.696033:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b69ac00/0x48868a4e43945df9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d511 expref: 12 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129729.696058:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b69ac00/0x48868a4e43945df9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d511 expref: 12 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129729.696067:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053086080:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129729.696110:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4948840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129729.703289:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053086080:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129729.703308:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129729.703355:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1961:x1830949051624320:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7366us (7695us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129729.703364:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4520 00000100:00100000:0.0:1746129729.719509:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051624960 00000100:00100000:0.0:1746129729.719516:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051624960 00010000:00010000:0.0:1746129729.719540:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff5ac00/0x48868a4e43945c01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d3f2 expref: 8 pid: 10930 timeout: 775 lvb_type: 1 00000100:00100000:0.0:1746129729.719559:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051624832 00000100:00100000:0.0:1746129729.719561:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051624832 00010000:00010000:0.0:1746129729.719569:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b22c5200/0x48868a4e43945ce1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d446 expref: 8 pid: 7975 timeout: 775 lvb_type: 1 00000100:00100000:0.0:1746129729.719584:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4521 00000100:00100000:0.0:1746129729.719590:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130564450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949051624960:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129729.719600:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129729.719619:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ff5ac00/0x48868a4e43945c01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d3f2 expref: 8 pid: 10930 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746129729.719627:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ff5ac00/0x48868a4e43945c01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d3f2 expref: 8 pid: 10930 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746129729.719644:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff5ac00/0x48868a4e43945c01 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d3f2 expref: 8 pid: 10930 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746129729.720349:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129729.720385:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130564450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+7:1961:x1830949051624960:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 794us (3079us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129729.720392:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4521 00000100:00100000:0.0:1746129729.724771:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.735032:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.739212:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.760158:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.828198:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.828682:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.840555:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.851921:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.858540:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.858577:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.864209:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.876825:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.876956:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.876982:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051627520 00000100:00100000:0.0:1746129729.876988:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051627520 00010000:00010000:0.0:1746129729.877012:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba69600/0x48868a4e43945e00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d518 expref: 24 pid: 1877 timeout: 775 lvb_type: 0 00000100:00100000:0.0:1746129729.877034:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4524 00000100:00100000:0.0:1746129729.877042:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949051627520:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129729.877052:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129729.877075:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ba69600/0x48868a4e43945e00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d518 expref: 24 pid: 1877 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746129729.877085:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ba69600/0x48868a4e43945e00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3534847) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d518 expref: 24 pid: 1877 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746129729.877102:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ba69600/0x48868a4e43945e00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3534847) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d518 expref: 24 pid: 1877 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746129729.877117:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129729.877119:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129729.877124:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f4c5c00/0x48868a4e43945e38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2297856->2957311) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d534 expref: 8 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129729.877131:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f4c5c00/0x48868a4e43945e38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2297856->2957311) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d534 expref: 8 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129729.877156:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f4c5c00/0x48868a4e43945e38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2297856->2957311) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d534 expref: 8 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129729.877166:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b027480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053087104:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129729.877223:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49486c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129729.881338:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b027480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053087104:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129729.881352:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129729.881373:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949051627520:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4332us (4416us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129729.881380:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4524 00000100:00100000:0.0:1746129729.889237:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.898337:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.898379:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051627904 00000100:00100000:0.0:1746129729.898387:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051627904 00000100:00100000:0.0:1746129729.898421:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9503 00000100:00100000:0.0:1746129729.898428:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949051627904:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129729.898444:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129729.898457:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800919edc00/0x48868a4e43945e54 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d542 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129729.898501:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b025c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053087232:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129729.900048:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49486c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129729.900595:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051628032 00000100:00100000:0.0:1746129729.900600:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051628032 00000100:00100000:0.0:1746129729.900628:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051628160 00000100:00100000:0.0:1746129729.900630:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051628160 00000100:00100000:0.0:1746129729.900645:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9504 00000100:00100000:0.0:1746129729.900651:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949051628032:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129729.900660:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129729.900669:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800919ec600/0x48868a4e43945e5b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d549 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129729.900699:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b026680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053087360:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129729.900737:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129729.900753:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9505 00000100:00100000:0.0:1746129729.900759:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949051628160:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129729.900766:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129729.900781:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800919ed600/0x48868a4e43945e62 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d550 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129729.900815:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b026300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053087488:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129729.900835:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129729.904062:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b026300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053087488:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129729.904075:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800919ed600/0x48868a4e43945e62 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d550 expref: 24 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129729.904084:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800919ed600/0x48868a4e43945e62 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d550 expref: 24 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129729.904096:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919ed600, rc 0) 00000100:00100000:0.0:1746129729.904267:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949051628160:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3506us (4076us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129729.904272:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9505 00000100:00100000:0.0:1746129729.913945:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.917419:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.917460:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.924917:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.927095:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.937475:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.948774:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.948813:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051629696 00000100:00100000:0.0:1746129729.948821:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051629696 00000100:00100000:0.0:1746129729.948893:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9572 00000100:00100000:0.0:1746129729.948901:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:27947:x1830949051629696:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129729.948926:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129729.950206:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131848000/0x48868a4e43945e77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d565 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129729.950261:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131848200/0x48868a4e43945e7e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129729.950272:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131848200/0x48868a4e43945e7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129729.950281:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131848200/0x48868a4e43945e7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129729.950293:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131848e00/0x48868a4e43945e85 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129729.950298:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131848e00/0x48868a4e43945e85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129729.950303:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131848e00/0x48868a4e43945e85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129729.950392:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131849800/0x48868a4e43945e8c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129729.950399:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131849800/0x48868a4e43945e8c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129729.950405:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131849800/0x48868a4e43945e8c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:0.0:1746129729.950432:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:0.0:1746129729.950436:0:16808:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129729.950449:0:16808:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880131849800/0x48868a4e43945e8c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129729.950463:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131849800/0x48868a4e43945e8c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129729.950469:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131848200/0x48868a4e43945e7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129729.950473:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131848200/0x48868a4e43945e7e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129729.950478:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131848200/0x48868a4e43945e7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129729.950483:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131848200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129729.950486:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131848200/0x48868a4e43945e7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129729.950561:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131848200/0x48868a4e43945e7e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129729.950571:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:0.0:1746129729.950573:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129729.950576:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131848200/0x48868a4e43945e7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129729.950581:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131848200/0x48868a4e43945e7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129729.954645:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131848e00/0x48868a4e43945e85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129729.954661:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131848e00/0x48868a4e43945e85 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129729.954668:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131848e00/0x48868a4e43945e85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129729.954677:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131848e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129729.954680:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131848e00/0x48868a4e43945e85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129729.954686:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131848e00/0x48868a4e43945e85 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129729.954701:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f581100) 00010000:00010000:0.0:1746129729.954703:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129729.954706:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131848e00/0x48868a4e43945e85 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129729.954710:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131848e00/0x48868a4e43945e85 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129729.954751:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131848000/0x48868a4e43945e77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d565 expref: 10 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129729.954762:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131849800/0x48868a4e43945e8c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d565 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129729.954768:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129729.954769:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129729.954771:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131849800, rc 0) 00000100:00100000:0.0:1746129729.966278:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.966316:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.966340:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.966364:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.966378:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.966406:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.966433:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051629952 00000100:00100000:0.0:1746129729.966440:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051629952 00000100:00100000:0.0:1746129729.966472:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051630208 00000100:00100000:0.0:1746129729.966474:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051630208 00000100:00100000:0.0:1746129729.966489:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051629824 00000100:00100000:0.0:1746129729.966491:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051629824 00000100:00100000:0.0:1746129729.966499:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051630080 00000100:00100000:0.0:1746129729.966500:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051630080 00000100:00100000:0.0:1746129729.966508:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051630336 00000100:00100000:0.0:1746129729.966510:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051630336 00000100:00100000:0.0:1746129729.966517:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051630464 00000100:00100000:0.0:1746129729.966518:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051630464 00000100:00100000:0.0:1746129729.966529:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9508 00000100:00100000:0.0:1746129729.966535:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949051629952:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129729.966551:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129729.966565:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131849000/0x48868a4e43945e93 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d573 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129729.966582:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129729.966584:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129729.966590:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131849000/0x48868a4e43945e93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d573 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129729.966604:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131849000/0x48868a4e43945e93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d573 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129729.966613:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131849000, rc 0) 00000100:00100000:0.0:1746129729.966648:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949051629952:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 112us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129729.966654:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9508 00000100:00100000:0.0:1746129729.966671:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9509 00000100:00100000:0.0:1746129729.966675:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949051630208:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129729.966683:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129729.966691:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131849200/0x48868a4e43945e9a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d581 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129729.966721:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053088000:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129729.966770:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129729.966785:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9510 00000100:00100000:0.0:1746129729.966790:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949051629824:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129729.966796:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129729.966814:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131848e00/0x48868a4e43945ea1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d56c expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129729.966824:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129729.966825:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129729.966830:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131848e00/0x48868a4e43945ea1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d56c expref: 10 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129729.966840:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131848e00/0x48868a4e43945ea1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d56c expref: 10 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129729.966870:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131848e00, rc 0) 00000100:00100000:0.0:1746129729.966885:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949051629824:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 95us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129729.966890:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9510 00000100:00100000:0.0:1746129729.966904:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9511 00000100:00100000:0.0:1746129729.966908:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949051630080:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129729.966915:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129729.966921:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131849600/0x48868a4e43945ea8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d57a expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129729.966940:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053088128:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129729.966974:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129729.966986:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9512 00000100:00100000:0.0:1746129729.966990:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949051630336:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129729.966996:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129729.967001:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa78600/0x48868a4e43945eaf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d588 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129729.967019:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053088256:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129729.967037:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129729.967049:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9513 00000100:00100000:0.0:1746129729.967053:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:27945:x1830949051630464:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129729.967059:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129729.967065:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800919ede00/0x48868a4e43945eb6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d58f expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129729.967079:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa78c00/0x48868a4e43945dd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1892351) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d4ee expref: 8 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129729.967093:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129729.967094:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129729.967097:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800919ede00/0x48868a4e43945eb6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d58f expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129729.967111:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa78c00/0x48868a4e43945dd6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1892351) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d4ee expref: 8 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129729.967119:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa78c00/0x48868a4e43945dd6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1892351) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d4ee expref: 8 pid: 7975 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746129729.967127:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053088384:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129729.967142:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129729.972292:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053088128:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129729.972313:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131849600/0x48868a4e43945ea8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d57a expref: 10 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129729.972322:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131849600/0x48868a4e43945ea8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d57a expref: 10 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129729.973098:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131849600, rc 0) 00000100:00100000:0.0:1746129729.973117:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949051630080:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 6208us (6751us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129729.973123:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9511 00000100:00100000:0.0:1746129729.973146:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053088384:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129729.973166:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800919ede00/0x48868a4e43945eb6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d58f expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129729.973174:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919ede00, rc 0) 00000100:00100000:0.0:1746129729.973190:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:27945:x1830949051630464:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6136us (6788us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129729.973194:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9513 00010000:00010000:0.0:1746129729.973217:0:8435:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.31@tcp) returned -22 from glimpse AST (req@ffff88009423d880 x1830949053088256) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88009b69ac00/0x48868a4e43945df9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d511 expref: 17 pid: 7975 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746129729.973229:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b69ac00/0x48868a4e43945df9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d511 expref: 17 pid: 7975 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746129729.973237:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053088256:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129729.973249:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa78600/0x48868a4e43945eaf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d588 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129729.973256:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa78600/0x48868a4e43945eaf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d588 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129729.973260:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa78600, rc 0) 00000100:00100000:0.0:1746129729.973272:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+7:1962:x1830949051630336:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 6282us (6894us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129729.973276:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9512 00000100:00100000:0.0:1746129729.982599:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129729.997844:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3342 00000100:00100000:0.0:1746129729.997862:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1963:x1830949051631872:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129730.011206:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051632640 00000100:00100000:0.0:1746129730.011214:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051632640 00000100:00100000:0.0:1746129730.011250:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9575 00000100:00100000:0.0:1746129730.011257:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+10:27947:x1830949051632640:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129730.011277:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129730.011281:0:1851:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746129730.011303:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae7000/0x48868a4e43945ec4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d596 expref: 10 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.011344:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129730.011348:0:1851:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129730.011359:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43945ee7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d5a4 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.011431:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43945eee lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.011443:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae6600/0x48868a4e43945ed9 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x1f/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d59d expref: 290 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.011448:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43945eee lrc: 4/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.011474:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae6600/0x48868a4e43945ed9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x1f/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d59d expref: 290 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.011483:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae6600/0x48868a4e43945ed9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x1f/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d59d expref: 290 pid: 16808 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746129730.011499:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053089024:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129730.011551:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129730.021236:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.021328:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.021509:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4530 00000100:00100000:0.0:1746129730.021515:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1964:x1830949051632768:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129730.021525:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129730.021544:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa78c00/0x48868a4e43945dd6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d4ee expref: 15 pid: 7975 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746129730.021552:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa78c00/0x48868a4e43945dd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1892351) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d4ee expref: 15 pid: 7975 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746129730.021563:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa78c00/0x48868a4e43945dd6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1892351) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d4ee expref: 15 pid: 7975 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746129730.021577:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129730.021579:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129730.021585:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800919ede00/0x48868a4e43945eb6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d58f expref: 15 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.021592:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800919ede00/0x48868a4e43945eb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d58f expref: 15 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.021616:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800919ede00/0x48868a4e43945eb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d58f expref: 15 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129730.021632:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053089152:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129730.021684:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129730.037167:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.037205:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.041155:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.041199:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051633664 00000100:00100000:0.0:1746129730.041204:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051633664 00000100:00100000:0.0:1746129730.041232:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9576 00000100:00100000:0.0:1746129730.041238:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:27951:x1830949051633664:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129730.041254:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129730.041270:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e43945ef5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d5ab expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.041360:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec800/0x48868a4e43945efc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.041372:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec800/0x48868a4e43945efc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.041381:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec800/0x48868a4e43945efc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.041392:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43945f03 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.041396:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43945f03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.041400:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43945f03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.041490:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43945f0a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.041497:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43945f0a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.041502:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43945f0a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:0.0:1746129730.041510:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129730.041580:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec800/0x48868a4e43945efc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.041586:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec800/0x48868a4e43945efc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.041591:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec800/0x48868a4e43945efc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.041595:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800919ec800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129730.041598:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec800/0x48868a4e43945efc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.041603:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec800/0x48868a4e43945efc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.041611:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:0.0:1746129730.041613:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129730.041616:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec800/0x48868a4e43945efc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.041620:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec800/0x48868a4e43945efc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.043074:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43945f03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.043083:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43945f03 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.043088:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43945f03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.043092:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800919eda00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129730.043095:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43945f03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.043100:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43945f03 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.043109:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009baa2300) 00010000:00010000:0.0:1746129730.043111:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129730.043114:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43945f03 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.043118:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43945f03 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.043154:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e43945ef5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d5ab expref: 15 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.043165:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43945f0a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d5ab expref: 14 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.043170:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129730.043178:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129730.043181:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919ed000, rc 0) 00000100:00100000:0.0:1746129730.044827:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:27951:x1830949051633664:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3582us (3665us total) trans 8589943299 rc 0/0 00000100:00100000:0.0:1746129730.044837:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9576 00000100:00100000:0.0:1746129730.049987:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.050057:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.050074:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051633792 00000100:00100000:0.0:1746129730.050081:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051633792 00000100:00100000:0.0:1746129730.050106:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051633920 00000100:00100000:0.0:1746129730.050107:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051633920 00000100:00100000:0.0:1746129730.050285:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9514 00000100:00100000:0.0:1746129730.050292:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949051633792:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129730.050310:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129730.050323:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43945f18 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d5b2 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.050339:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129730.050341:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129730.050348:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43945f18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d5b2 expref: 13 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129730.050360:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43945f18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d5b2 expref: 13 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129730.050369:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919ece00, rc 0) 00000100:00100000:0.0:1746129730.052165:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1964:x1830949051633792:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1867us (2180us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129730.052183:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9514 00000100:00100000:0.0:1746129730.062788:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.072494:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.080390:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.080468:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.093449:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.096635:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949051634688:12345-192.168.204.31@tcp:4:cat.0 Request processed in 15913us (16245us total) trans 17179872853 rc 0/0 00000100:00100000:0.0:1746129730.096645:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 395 00002000:00100000:0.0:1746129730.096653:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (2297856->2957311) req@ffff88009423f480 x1830949051634688/t17179872853(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:471/0 lens 488/448 e 0 to 0 dl 1746129741 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129730.096662:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423f480 with x1830949051634688 ext(2297856->2957311) 00010000:00010000:0.0:1746129730.096670:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f4c5c00/0x48868a4e43945e38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2297856->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d534 expref: 11 pid: 7975 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746129730.096684:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f4c5c00/0x48868a4e43945e38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2297856->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d534 expref: 11 pid: 7975 timeout: 776 lvb_type: 0 00002000:00010000:0.0:1746129730.096690:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009423f480 00000100:00100000:0.0:1746129730.103412:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.112272:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.112300:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051635328 00000100:00100000:0.0:1746129730.112306:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051635328 00002000:00100000:0.0:1746129730.112341:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (4960256->4964351) req@ffff88009c1c7b80 x1830949051635328/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:471/0 lens 488/0 e 0 to 0 dl 1746129741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129730.112361:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c7b80 with x1830949051635328 ext(4960256->4964351) 00002000:00010000:0.0:1746129730.112366:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1c7b80 00000100:00100000:0.0:1746129730.112388:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3346 00000100:00100000:0.0:1746129730.112393:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1963:x1830949051635328:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129730.112520:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1963:x1830949051635328:12345-192.168.204.31@tcp:3:cat.0 Request processed in 126us (254us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129730.112525:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3346 00002000:00100000:0.0:1746129730.112530:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (4960256->4964351) req@ffff88009c1c7b80 x1830949051635328/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:471/0 lens 488/4536 e 0 to 0 dl 1746129741 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129730.112537:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c7b80 with x1830949051635328 ext(4960256->4964351) 00002000:00010000:0.0:1746129730.112540:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1c7b80 00000100:00100000:0.0:1746129730.118511:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.118548:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.118582:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.118604:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051635584 00000100:00100000:0.0:1746129730.118611:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051635584 00002000:00100000:0.0:1746129730.118648:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009c1c5c00 x1830949051635584/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:471/0 lens 488/0 e 0 to 0 dl 1746129741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129730.118657:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c5c00 with x1830949051635584 ext(2097152->3145727) 00002000:00010000:0.0:1746129730.118662:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1c5c00 00000100:00100000:0.0:1746129730.118675:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051635712 00000100:00100000:0.0:1746129730.118677:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051635712 00002000:00100000:0.0:1746129730.118688:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009c1c4a80 x1830949051635712/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:471/0 lens 488/0 e 0 to 0 dl 1746129741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129730.118705:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c4a80 with x1830949051635712 ext(3145728->4194303) 00002000:00010000:0.0:1746129730.118708:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1c4a80 00000100:00100000:0.0:1746129730.118729:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051636096 00000100:00100000:0.0:1746129730.118732:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051636096 00002000:00100000:0.0:1746129730.118745:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009c1c4700 x1830949051636096/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:471/0 lens 488/0 e 0 to 0 dl 1746129741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129730.118750:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c4700 with x1830949051636096 ext(2097152->3145727) 00002000:00010000:0.0:1746129730.118752:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1c4700 00000100:00100000:0.0:1746129730.118762:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3347 00000100:00100000:0.0:1746129730.118768:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949051635584:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129730.120706:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3348 00000100:00100000:0.0:1746129730.120720:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949051635712:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129730.144534:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949051635584:12345-192.168.204.31@tcp:3:cat.0 Request processed in 25758us (26022us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129730.144545:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3347 00002000:00100000:0.0:1746129730.144555:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009c1c5c00 x1830949051635584/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:471/0 lens 488/440 e 0 to 0 dl 1746129741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129730.144563:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c5c00 with x1830949051635584 ext(2097152->3145727) 00002000:00010000:0.0:1746129730.144568:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1c5c00 00000100:00100000:0.0:1746129730.149393:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949051636096:12345-192.168.204.31@tcp:3:cat.0 Request processed in 27833us (30801us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129730.149403:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3349 00002000:00100000:0.0:1746129730.149420:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009c1c4700 x1830949051636096/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:471/0 lens 488/440 e 0 to 0 dl 1746129741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129730.149430:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c4700 with x1830949051636096 ext(2097152->3145727) 00002000:00010000:0.0:1746129730.149435:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1c4700 00000100:00100000:0.0:1746129730.167386:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.167434:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.188049:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.194581:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.194617:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.194692:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.194724:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051637632 00000100:00100000:0.0:1746129730.194730:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051637632 00002000:00100000:0.0:1746129730.194763:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (3592192->3596287) req@ffff88012ba19180 x1830949051637632/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:471/0 lens 488/0 e 0 to 0 dl 1746129741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129730.194772:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba19180 with x1830949051637632 ext(3592192->3596287) 00002000:00010000:0.0:1746129730.194776:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba19180 00000100:00100000:0.0:1746129730.194810:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3352 00000100:00100000:0.0:1746129730.194816:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1963:x1830949051637632:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129730.194980:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1963:x1830949051637632:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 164us (288us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129730.194987:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3352 00002000:00100000:0.0:1746129730.194992:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (3592192->3596287) req@ffff88012ba19180 x1830949051637632/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:471/0 lens 488/4536 e 0 to 0 dl 1746129741 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129730.194999:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba19180 with x1830949051637632 ext(3592192->3596287) 00002000:00010000:0.0:1746129730.195001:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba19180 00000100:00100000:0.0:1746129730.202159:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.214182:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4536 00000100:00100000:0.0:1746129730.214189:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949051638272:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129730.214196:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129730.214205:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094da2e00/0x48868a4e43945f34 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d5ce expref: 24 pid: 8435 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746129730.214213:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094da2e00/0x48868a4e43945f34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d5ce expref: 24 pid: 8435 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746129730.214224:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129730.214226:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129730.214231:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093beec00/0x48868a4e43945f65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d5ff expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.214239:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093beec00/0x48868a4e43945f65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d5ff expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.214264:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093beec00/0x48868a4e43945f65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d5ff expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129730.214274:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053090816:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129730.214724:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129730.222892:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053090816:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129730.222913:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129730.222949:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949051638272:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8759us (9264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129730.222968:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4536 00000100:00100000:0.0:1746129730.224276:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.229009:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.231080:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.235229:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.250971:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.261901:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.264333:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.264665:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.265253:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9528 00000100:00100000:0.0:1746129730.265259:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1963:x1830949051639808:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129730.265272:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129730.265279:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc8e400/0x48868a4e43945f7a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d614 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129730.265310:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053091328:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129730.265348:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129730.268986:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.280449:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.283499:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.283545:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.312804:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.316446:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.327702:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.331698:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.359025:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.367208:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5490e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053091968:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129730.367230:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129730.367278:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949051641472:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5486us (8259us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129730.367287:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4539 00000100:00100000:0.0:1746129730.372185:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.380727:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.388326:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.388600:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.388629:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.398471:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.402099:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053092224:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129730.402125:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f400/0x48868a4e43945fc7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d64c expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.402140:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d6f400, rc 0) 00000100:00100000:0.0:1746129730.407109:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:27958:x1830949051642368:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8546us (8630us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129730.407119:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9535 00000100:00100000:0.0:1746129730.417578:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.418088:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.418108:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051642880 00000100:00100000:0.0:1746129730.418114:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051642880 00010000:00010000:0.0:1746129730.418137:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43945f0a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d5ab expref: 15 pid: 1851 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746129730.418154:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051643008 00000100:00100000:0.0:1746129730.418160:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051643008 00010000:00010000:0.0:1746129730.418169:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1600/0x48868a4e43945fab lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d630 expref: 13 pid: 1851 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746129730.418182:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4540 00000100:00100000:0.0:1746129730.418187:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949051642880:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129730.418196:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129730.418201:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43945f0a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d5ab expref: 15 pid: 1851 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746129730.418208:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43945f0a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d5ab expref: 15 pid: 1851 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746129730.418225:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43945f0a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d5ab expref: 15 pid: 1851 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746129730.418238:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129730.418243:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6fc00/0x48868a4e43945fd5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.418249:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6fc00/0x48868a4e43945fd5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.418253:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129730.418832:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949051642880:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 643us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129730.418839:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4540 00000100:00100000:0.0:1746129730.421628:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.425887:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053092608:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129730.425914:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135677800/0x48868a4e43945fea lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.428705:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135677800/0x48868a4e43945fea lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.428713:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135677800/0x48868a4e43945fea lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:0.0:1746129730.428747:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:0.0:1746129730.428751:0:1851:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129730.428950:0:1851:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135677800/0x48868a4e43945fea lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.428977:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135676800/0x48868a4e43945fe3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d65a expref: 13 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.429003:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135677800/0x48868a4e43945fea lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d65a expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.429009:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129730.429011:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129730.429014:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135677800, rc 0) 00000100:00100000:0.0:1746129730.429033:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+12:27961:x1830949051643136:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 7284us (7408us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129730.429039:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9579 00000100:00100000:0.0:1746129730.436826:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.442655:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.443740:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.449366:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051644544 00000100:00100000:0.0:1746129730.449380:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051644544 00000100:00100000:0.0:1746129730.449421:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9580 00000100:00100000:0.0:1746129730.449428:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:27964:x1830949051644544:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129730.449446:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129730.449459:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135caac00/0x48868a4e43945ff8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d668 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.449541:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135cabc00/0x48868a4e43945fff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.449550:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135cabc00/0x48868a4e43945fff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.449558:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135cabc00/0x48868a4e43945fff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.449566:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab400/0x48868a4e43946006 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.449571:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab400/0x48868a4e43946006 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.449575:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab400/0x48868a4e43946006 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.449643:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135caa000/0x48868a4e4394600d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.449649:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135caa000/0x48868a4e4394600d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.449653:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135caa000/0x48868a4e4394600d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:0.0:1746129730.449667:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129730.449723:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135cabc00/0x48868a4e43945fff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.449728:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135cabc00/0x48868a4e43945fff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.449732:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135cabc00/0x48868a4e43945fff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.449736:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135cabc00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129730.449739:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135cabc00/0x48868a4e43945fff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.449744:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135cabc00/0x48868a4e43945fff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.449751:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:0.0:1746129730.449753:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129730.449756:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135cabc00/0x48868a4e43945fff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.449760:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135cabc00/0x48868a4e43945fff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.449772:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab400/0x48868a4e43946006 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.449775:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab400/0x48868a4e43946006 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.449779:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab400/0x48868a4e43946006 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.449800:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135cab400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129730.449802:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab400/0x48868a4e43946006 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.449806:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab400/0x48868a4e43946006 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.449812:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009b251b00) 00010000:00010000:0.0:1746129730.449814:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129730.449816:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab400/0x48868a4e43946006 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.449820:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab400/0x48868a4e43946006 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.449867:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135caac00/0x48868a4e43945ff8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d668 expref: 294 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.449877:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135caa000/0x48868a4e4394600d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d668 expref: 293 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.449883:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129730.449885:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129730.449887:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135caa000, rc 0) 00000100:00100000:0.0:1746129730.449926:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:27964:x1830949051644544:12345-192.168.204.31@tcp:101:cat.0 Request processed in 498us (1707us total) trans 8589943304 rc 0/0 00000100:00100000:0.0:1746129730.449932:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9580 00000100:00100000:0.0:1746129730.449983:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.450003:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051644160 00000100:00100000:0.0:1746129730.450009:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051644160 00002000:00100000:0.0:1746129730.450032:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009207c380 x1830949051644160/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:471/0 lens 488/0 e 0 to 0 dl 1746129741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129730.450040:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207c380 with x1830949051644160 ext(3145728->4194303) 00002000:00010000:0.0:1746129730.450043:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207c380 00000100:00100000:0.0:1746129730.450053:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051644288 00000100:00100000:0.0:1746129730.450054:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051644288 00002000:00100000:0.0:1746129730.450064:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009207dc00 x1830949051644288/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:471/0 lens 488/0 e 0 to 0 dl 1746129741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129730.450070:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207dc00 with x1830949051644288 ext(3145728->4194303) 00002000:00010000:0.0:1746129730.450072:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207dc00 00000100:00100000:0.0:1746129730.450081:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3359 00000100:00100000:0.0:1746129730.450086:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949051644160:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129730.451994:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3360 00000100:00100000:0.0:1746129730.452004:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949051644288:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129730.461031:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.479809:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949051644160:12345-192.168.204.31@tcp:3:cat.0 Request processed in 29714us (36062us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129730.479819:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3359 00002000:00100000:0.0:1746129730.479828:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009207c380 x1830949051644160/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:471/0 lens 488/440 e 0 to 0 dl 1746129741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129730.479836:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207c380 with x1830949051644160 ext(3145728->4194303) 00002000:00010000:0.0:1746129730.479840:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207c380 00000100:00100000:0.0:1746129730.479895:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.479919:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051645312 00000100:00100000:0.0:1746129730.479924:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051645312 00000100:00100000:0.0:1746129730.479956:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9537 00000100:00100000:0.0:1746129730.479962:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949051645312:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129730.479973:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129730.479987:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013094ae00/0x48868a4e43946030 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d67d expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.480004:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129730.480005:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129730.480012:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013094ae00/0x48868a4e43946030 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d67d expref: 19 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129730.480025:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013094ae00/0x48868a4e43946030 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d67d expref: 19 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129730.480034:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013094ae00, rc 0) 00000100:00100000:0.0:1746129730.480049:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949051645312:12345-192.168.204.31@tcp:101:cat.0 Request processed in 88us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129730.480054:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9537 00000100:00100000:0.0:1746129730.480103:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.480113:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051645184 00000100:00100000:0.0:1746129730.480115:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051645184 00000100:00100000:0.0:1746129730.480127:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9538 00000100:00100000:0.0:1746129730.480131:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949051645184:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129730.480137:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129730.480144:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013094ba00/0x48868a4e43946037 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d676 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.480161:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129730.480162:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129730.480166:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013094ba00/0x48868a4e43946037 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d676 expref: 26 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129730.480174:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013094ba00/0x48868a4e43946037 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d676 expref: 26 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129730.480179:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013094ba00, rc 0) 00000100:00100000:0.0:1746129730.480191:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949051645184:12345-192.168.204.31@tcp:101:cat.0 Request processed in 60us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129730.480195:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9538 00000100:00100000:0.0:1746129730.488647:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051645568 00000100:00100000:0.0:1746129730.488654:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051645568 00000100:00100000:0.0:1746129730.488688:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9582 00000100:00100000:0.0:1746129730.488696:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:27966:x1830949051645568:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129730.488716:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129730.488730:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013094a000/0x48868a4e4394603e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d684 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.488824:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013094b200/0x48868a4e43946045 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.488834:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013094b200/0x48868a4e43946045 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.488842:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013094b200/0x48868a4e43946045 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.488876:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013094ac00/0x48868a4e4394604c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.488881:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013094ac00/0x48868a4e4394604c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.488885:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013094ac00/0x48868a4e4394604c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.488965:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013094b800/0x48868a4e43946053 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.488974:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87c400/0x48868a4e43946022 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d66f expref: 13 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.488980:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013094b800/0x48868a4e43946053 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129730.489005:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87c400/0x48868a4e43946022 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d66f expref: 13 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.489014:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87c400/0x48868a4e43946022 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d66f expref: 13 pid: 16808 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746129730.489024:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009476b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053092864:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129730.518353:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.518645:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.519254:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.519863:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.525963:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051646976 00000100:00100000:0.0:1746129730.525976:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051646976 00002000:00100000:0.0:1746129730.526001:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880094eb7800 x1830949051646976/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:471/0 lens 488/0 e 0 to 0 dl 1746129741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129730.526010:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb7800 with x1830949051646976 ext(3145728->4194303) 00010000:00010000:0.0:1746129730.526018:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88013094ba00/0x48868a4e43946037 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d676 expref: 28 pid: 8435 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746129730.526029:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88013094ba00/0x48868a4e43946037 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d676 expref: 28 pid: 8435 timeout: 776 lvb_type: 1 00002000:00010000:0.0:1746129730.526034:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094eb7800 00000100:00100000:0.0:1746129730.526049:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051647488 00000100:00100000:0.0:1746129730.526051:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051647488 00002000:00100000:0.0:1746129730.526061:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009f6a6680 x1830949051647488/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:471/0 lens 488/0 e 0 to 0 dl 1746129741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129730.526067:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a6680 with x1830949051647488 ext(3145728->4194303) 00010000:00010000:0.0:1746129730.526071:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013094ae00/0x48868a4e43946030 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d67d expref: 20 pid: 8435 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746129730.526078:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013094ae00/0x48868a4e43946030 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d67d expref: 20 pid: 8435 timeout: 776 lvb_type: 1 00002000:00010000:0.0:1746129730.526082:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f6a6680 00000100:00100000:0.0:1746129730.526223:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 402 00000100:00100000:0.0:1746129730.526229:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949051647232:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129730.538204:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.542808:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.554266:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.554306:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.554332:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.554396:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.554411:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.556815:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.556825:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051649152 00000100:00100000:0.0:1746129730.556827:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051649152 00010000:00010000:0.0:1746129730.556838:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f4c4600/0x48868a4e43945e69 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d557 expref: 22 pid: 7975 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746129730.556863:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4553 00000100:00100000:0.0:1746129730.556868:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949051649152:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129730.556874:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129730.556882:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f4c4600/0x48868a4e43945e69 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d557 expref: 22 pid: 7975 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746129730.556889:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f4c4600/0x48868a4e43945e69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d557 expref: 22 pid: 7975 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746129730.556900:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129730.556901:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129730.556905:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009330b200/0x48868a4e43946076 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.556911:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009330b200/0x48868a4e43946076 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.556933:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129730.556946:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949051649152:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 79us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129730.556951:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4553 00000100:00100000:0.0:1746129730.556973:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.556981:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051649280 00000100:00100000:0.0:1746129730.556983:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051649280 00010000:00010000:0.0:1746129730.556991:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4200/0x48868a4e43945cda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d43f expref: 13 pid: 7975 timeout: 776 lvb_type: 1 00000100:00100000:0.0:1746129730.557003:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4555 00000100:00100000:0.0:1746129730.557006:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1963:x1830949051649280:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129730.557011:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129730.557018:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4200/0x48868a4e43945cda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d43f expref: 13 pid: 7975 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746129730.557025:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4200/0x48868a4e43945cda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d43f expref: 13 pid: 7975 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746129730.557035:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4200/0x48868a4e43945cda lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d43f expref: 13 pid: 7975 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746129730.557045:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129730.557058:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1963:x1830949051649280:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 51us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129730.557070:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4555 00000100:00100000:0.0:1746129730.575509:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.575593:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.577157:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.589841:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.590433:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949051647232:12345-192.168.204.31@tcp:3:cat.0 Request processed in 64202us (67092us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129730.590444:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 402 00002000:00100000:0.0:1746129730.590455:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880094eb5880 x1830949051647232/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:471/0 lens 488/440 e 0 to 0 dl 1746129741 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129730.590464:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb5880 with x1830949051647232 ext(2097152->3145727) 00010000:00010000:0.0:1746129730.590473:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013094ae00/0x48868a4e43946030 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d67d expref: 18 pid: 8435 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746129730.590485:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013094ae00/0x48868a4e43946030 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d67d expref: 18 pid: 8435 timeout: 776 lvb_type: 1 00002000:00010000:0.0:1746129730.590492:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094eb5880 00000100:00100000:0.0:1746129730.617531:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.638422:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.638810:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.638842:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.638891:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.639744:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.648408:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.648445:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051651840 00000100:00100000:0.0:1746129730.648449:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051651840 00010000:00010000:0.0:1746129730.648463:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013094ba00/0x48868a4e43946037 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d676 expref: 25 pid: 8435 timeout: 776 lvb_type: 1 00000100:00100000:0.0:1746129730.654275:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4564 00000100:00100000:0.0:1746129730.654283:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1963:x1830949051651840:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129730.654291:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129730.654304:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013094ba00/0x48868a4e43946037 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d676 expref: 25 pid: 8435 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746129730.654314:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013094ba00/0x48868a4e43946037 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d676 expref: 25 pid: 8435 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746129730.654325:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013094ba00/0x48868a4e43946037 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d676 expref: 25 pid: 8435 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746129730.654340:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129730.654342:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129730.654344:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f96fa00/0x48868a4e43946068 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.654350:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f96fa00/0x48868a4e43946068 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.654362:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129730.654372:0:3623:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f96fa00/0x48868a4e43946068 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.654391:0:3623:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f96fa00/0x48868a4e43946068 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.654406:0:3623:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f96fa00/0x48868a4e43946068 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.654411:0:3623:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f96fa00/0x48868a4e43946068 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.654417:0:3623:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f96fa00/0x48868a4e43946068 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.654422:0:3623:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f96fa00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129730.654424:0:3623:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f96fa00/0x48868a4e43946068 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.654430:0:3623:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f96fa00/0x48868a4e43946068 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.654437:0:3623:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f96fa00/0x48868a4e43946068 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.654441:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f96fa00/0x48868a4e43946068 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129730.654473:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+6:1962:x1830949051646208:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 138229us (138816us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129730.654483:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9541 00000100:00100000:0.0:1746129730.654508:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949051651840:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 228us (6103us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129730.654512:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4564 00010000:00010000:0.0:1746129730.654535:0:1877:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa4c00/0x48868a4e43946084 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.654541:0:1877:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa4c00/0x48868a4e43946084 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.654552:0:1877:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa4c00/0x48868a4e43946084 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.654557:0:1877:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa4c00/0x48868a4e43946084 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.654562:0:1877:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa4c00/0x48868a4e43946084 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.654566:0:1877:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8fa4c00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129730.654568:0:1877:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa4c00/0x48868a4e43946084 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.654572:0:1877:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa4c00/0x48868a4e43946084 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.654578:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129730.654583:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129730.654588:0:1877:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dae7000/0x48868a4e43946099 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d692 expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.654594:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dae7000/0x48868a4e43946099 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d692 expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.654614:0:1877:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dae7000/0x48868a4e43946099 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d692 expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129730.654623:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053095680:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129730.654657:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129730.655596:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.658237:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053095680:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129730.658253:0:1877:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa4c00/0x48868a4e43946084 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129730.658260:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa4c00/0x48868a4e43946084 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129730.658289:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+6:1962:x1830949051646336:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 136286us (139035us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129730.658294:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9544 00000100:00100000:0.0:1746129730.658942:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.669947:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.674775:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.674919:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.685235:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.685274:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.703003:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.711372:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051654400 00000100:00100000:0.0:1746129730.711379:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051654400 00000100:00100000:0.0:1746129730.711412:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3690 00000100:00100000:0.0:1746129730.711419:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6141239f-0c60-480d-830c-e22ba61457b0+13:27961:x1830949051654400:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:0.0:1746129730.711575:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6141239f-0c60-480d-830c-e22ba61457b0+14:27961:x1830949051654400:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 157us (267us total) trans 8589943310 rc 0/0 00000100:00100000:0.0:1746129730.711581:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3690 00000100:00100000:0.0:1746129730.744428:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.744467:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.745936:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.752707:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.815739:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.828076:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.828458:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.830286:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.846678:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.851309:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.855601:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.863055:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.869059:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.908817:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.911551:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.923415:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.929699:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.935295:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.943161:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129730.949686:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.025627:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:0.0:1746129731.031512:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129731.038109:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.048268:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:0.0:1746129731.048431:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129731.049474:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.058166:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.059574:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.063347:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.064647:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.065419:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:0.0:1746129731.066366:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129731.071283:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.077379:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.104756:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.108455:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.113805:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.120575:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.120619:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.133195:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.135245:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.136135:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.136150:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051661696 00000100:00100000:0.0:1746129731.136155:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051661696 00002000:00100000:0.0:1746129731.136180:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88008fad0a80 x1830949051661696/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:472/0 lens 488/0 e 0 to 0 dl 1746129742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129731.136199:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad0a80 with x1830949051661696 ext(0->1048575) 00002000:00010000:0.0:1746129731.136203:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fad0a80 00000100:00100000:0.0:1746129731.136215:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051662080 00000100:00100000:0.0:1746129731.136216:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051662080 00002000:00100000:0.0:1746129731.136225:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88008fad1500 x1830949051662080/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:472/0 lens 488/0 e 0 to 0 dl 1746129742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129731.136230:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad1500 with x1830949051662080 ext(1048576->2097151) 00010000:00010000:0.0:1746129731.136236:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f400/0x48868a4e439460ae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d6a7 expref: 15 pid: 8436 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746129731.136245:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f400/0x48868a4e439460ae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d6a7 expref: 15 pid: 8436 timeout: 777 lvb_type: 1 00002000:00010000:0.0:1746129731.136250:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fad1500 00000100:00100000:0.0:1746129731.136555:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3375 00000100:00100000:0.0:1746129731.136560:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949051661696:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129731.138588:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.144127:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.156090:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.159019:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.163426:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.168256:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.173538:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.178147:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.181710:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.181760:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.181807:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.197434:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.205985:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.206044:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.229391:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.235210:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.238824:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.254499:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1963:x1830949051666048:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15187us (15678us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129731.254507:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3381 00002000:00100000:0.0:1746129731.254512:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880093289c00 x1830949051666048/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:472/0 lens 488/440 e 0 to 0 dl 1746129742 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129731.254520:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289c00 with x1830949051666048 ext(2097152->3145727) 00002000:00010000:0.0:1746129731.254524:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093289c00 00000100:00100000:0.0:1746129731.256355:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.259954:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.262825:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.265651:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.275165:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.279558:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.283536:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.283561:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.283574:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.283596:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.283817:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3383 00000100:00100000:0.0:1746129731.283822:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949051667584:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129731.328468:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.328520:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.331370:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.338974:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.341827:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.376992:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.385241:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.403896:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.412698:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.412763:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.439232:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.441920:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.450141:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.451259:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.453994:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.455275:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:0.0:1746129731.458110:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880094eb7480 x1830949051671680/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:472/0 lens 488/0 e 0 to 0 dl 1746129742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129731.458119:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb7480 with x1830949051671680 ext(4194304->4964351) 00002000:00010000:0.0:1746129731.458123:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb7480 00000100:00100000:0.0:1746129731.458147:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3391 00000100:00100000:0.0:1746129731.458153:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1963:x1830949051671680:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129731.465626:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.467265:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.470674:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.472611:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.474041:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.528565:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.533405:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.534620:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.540500:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.542705:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.548197:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:0.0:1746129731.548524:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129731.560980:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.561012:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051674112 00000100:00100000:0.0:1746129731.561019:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051674112 00000100:00100000:0.0:1746129731.561050:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3699 00000100:00100000:0.0:1746129731.561056:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fdc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+304:27192:x1830949051674112:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746129731.577628:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.587160:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.590646:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.608034:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.609674:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.612735:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.614462:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.623921:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.628621:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.628962:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.629314:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.636935:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fdc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949051676416:12345-192.168.204.31@tcp:4:cat.0 Request processed in 23613us (24192us total) trans 21474840038 rc 0/0 00000100:00100000:0.0:1746129731.636958:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 414 00002000:00100000:0.0:1746129731.636968:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->3731455) req@ffff88009fdc5500 x1830949051676416/t21474840038(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:472/0 lens 488/448 e 0 to 0 dl 1746129742 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129731.636976:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fdc5500 with x1830949051676416 ext(3145728->3731455) 00010000:00010000:0.0:1746129731.636984:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fa7ac00/0x48868a4e43946298 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3731455) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d7c6 expref: 23 pid: 10930 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746129731.636997:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fa7ac00/0x48868a4e43946298 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3731455) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d7c6 expref: 23 pid: 10930 timeout: 777 lvb_type: 0 00002000:00010000:0.0:1746129731.637003:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fdc5500 00000100:00100000:0.0:1746129731.642481:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.642521:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.646259:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.651825:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.656678:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.666439:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051678336 00000100:00100000:0.0:1746129731.666446:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051678336 00010000:00010000:0.0:1746129731.666479:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ece5800/0x48868a4e439462fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2412544->4083711] (req 2412544->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d7f7 expref: 17 pid: 7976 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746129731.666503:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4585 00000100:00100000:0.0:1746129731.666510:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949051678336:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129731.666521:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746129731.666537:0:7107:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129730 -> 1746129732 00010000:00010000:0.0:1746129731.666554:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ece5800/0x48868a4e439462fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2412544->4083711] (req 2412544->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d7f7 expref: 17 pid: 7976 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746129731.666565:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ece5800/0x48868a4e439462fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2412544->4083711] (req 2412544->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d7f7 expref: 17 pid: 7976 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746129731.666583:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ece5800/0x48868a4e439462fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2412544->4083711] (req 2412544->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d7f7 expref: 17 pid: 7976 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746129731.666694:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129731.666696:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129731.666703:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c57b800/0x48868a4e43946363 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d84b expref: 16 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129731.666710:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c57b800/0x48868a4e43946363 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d84b expref: 16 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129731.666739:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c57b800/0x48868a4e43946363 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d84b expref: 16 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129731.666750:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095242680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053101440:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129731.667757:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129731.678324:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.720427:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.730172:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.730198:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.730703:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.730742:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.735637:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.758019:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.758103:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.776058:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.786788:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.786837:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.787488:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3402 00000100:00100000:0.0:1746129731.787495:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949051681280:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129731.804284:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.806111:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949051681280:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18612us (19270us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129731.806119:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3402 00002000:00100000:0.0:1746129731.806127:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880131461c00 x1830949051681280/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:472/0 lens 488/440 e 0 to 0 dl 1746129742 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129731.806135:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131461c00 with x1830949051681280 ext(3145728->4194303) 00010000:00010000:0.0:1746129731.806142:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c57b600/0x48868a4e4394632b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d82f expref: 18 pid: 1877 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746129731.806152:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c57b600/0x48868a4e4394632b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d82f expref: 18 pid: 1877 timeout: 777 lvb_type: 0 00002000:00010000:0.0:1746129731.806158:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131461c00 00000100:00100000:0.0:1746129731.809938:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051682048 00000100:00100000:0.0:1746129731.809942:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051682048 00010000:00010000:0.0:1746129731.809959:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ece4600/0x48868a4e43946252 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d79c expref: 17 pid: 7976 timeout: 777 lvb_type: 1 00000100:00100000:0.0:1746129731.809988:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051681920 00000100:00100000:0.0:1746129731.809990:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051681920 00010000:00010000:0.0:1746129731.809999:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c57ac00/0x48868a4e43946301 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d813 expref: 8 pid: 1877 timeout: 777 lvb_type: 1 00000100:00100000:0.0:1746129731.810011:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051682432 00000100:00100000:0.0:1746129731.810013:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051682432 00010000:00010000:0.0:1746129731.810021:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8f44800/0x48868a4e4394621a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d780 expref: 33 pid: 7976 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746129731.810033:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4588 00000100:00100000:0.0:1746129731.810038:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1963:x1830949051682048:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129731.810047:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129731.810064:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ece4600/0x48868a4e43946252 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d79c expref: 17 pid: 7976 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746129731.810072:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ece4600/0x48868a4e43946252 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d79c expref: 17 pid: 7976 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746129731.810085:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129731.810101:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1963:x1830949051682048:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 63us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129731.810105:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4588 00000100:00100000:0.0:1746129731.810113:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4589 00000100:00100000:0.0:1746129731.810117:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949051681920:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129731.810128:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129731.810134:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c57ac00/0x48868a4e43946301 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d813 expref: 8 pid: 1877 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746129731.810140:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c57ac00/0x48868a4e43946301 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d813 expref: 8 pid: 1877 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746129731.810147:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129731.810157:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949051681920:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 39us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129731.810161:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4589 00000100:00100000:0.0:1746129731.810167:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4590 00000100:00100000:0.0:1746129731.810170:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949051682432:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129731.810174:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129731.810178:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8f44800/0x48868a4e4394621a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d780 expref: 33 pid: 7976 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746129731.810184:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8f44800/0x48868a4e4394621a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d780 expref: 33 pid: 7976 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746129731.810193:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129731.810194:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129731.810199:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8f30600/0x48868a4e439463be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d87c expref: 33 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129731.810205:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8f30600/0x48868a4e439463be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d87c expref: 33 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129731.810231:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8f30600/0x48868a4e439463be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d87c expref: 33 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129731.810240:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053102592:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129731.810279:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129731.810296:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051682176 00000100:00100000:0.0:1746129731.810298:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051682176 00002000:00100000:0.0:1746129731.810316:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->2310143) req@ffff88009f6a7800 x1830949051682176/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:472/0 lens 488/0 e 0 to 0 dl 1746129742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129731.810323:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a7800 with x1830949051682176 ext(2097152->2310143) 00010000:00010000:0.0:1746129731.810328:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c57b600/0x48868a4e4394632b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d82f expref: 19 pid: 1877 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746129731.810336:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c57b600/0x48868a4e4394632b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d82f expref: 19 pid: 1877 timeout: 777 lvb_type: 0 00002000:00010000:0.0:1746129731.810341:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f6a7800 00000100:00100000:0.0:1746129731.810350:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 417 00000100:00100000:0.0:1746129731.810353:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1963:x1830949051682176:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129731.812364:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051682560 00000100:00100000:0.0:1746129731.812370:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051682560 00000100:00100000:0.0:1746129731.812501:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 522 00000100:00100000:0.0:1746129731.812510:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+27:1961:x1830949051682560:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129731.812521:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129731.812550:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c57ba00/0x48868a4e439463e1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d883 expref: 27 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129731.812919:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129731.812924:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129731.812976:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1961:x1830949051682560:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 466us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129731.812982:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 522 00000100:00100000:0.0:1746129731.815739:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053102592:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129731.815756:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129731.815809:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949051682432:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5635us (6060us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129731.815817:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4590 00000100:00100000:0.0:1746129731.823930:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.823954:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.824112:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.824493:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9606 00000100:00100000:0.0:1746129731.824499:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28010:x1830949051683072:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129731.824505:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129731.824512:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8f45e00/0x48868a4e439463fd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d89f expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129731.824524:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131849600/0x48868a4e439461a3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d741 expref: 17 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129731.824530:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c57a600/0x48868a4e4394630f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d7fe expref: 6 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129731.824546:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131848200/0x48868a4e439461aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d748 expref: 32 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129731.824552:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129731.824553:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129731.824555:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8f45e00/0x48868a4e439463fd lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [147456->462847] (req 147456->462847) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d89f expref: 17 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129731.824567:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131848200/0x48868a4e439461aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d748 expref: 32 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129731.824573:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131848200/0x48868a4e439461aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d748 expref: 32 pid: 8435 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746129731.824580:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131463b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053103360:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129731.824600:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c57a600/0x48868a4e4394630f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d7fe expref: 6 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129731.824607:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c57a600/0x48868a4e4394630f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d7fe expref: 6 pid: 7975 timeout: 777 lvb_type: 1 00000100:00100000:0.0:1746129731.824612:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053103488:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129731.824625:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131849600/0x48868a4e439461a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d741 expref: 17 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129731.824635:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131849600/0x48868a4e439461a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d741 expref: 17 pid: 7976 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746129731.824641:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131462d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053103616:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129731.824650:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129731.829135:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131463b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053103360:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129731.830060:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053103488:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129731.830103:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131462d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053103616:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129731.830120:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8f45e00/0x48868a4e439463fd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [147456->462847] (req 147456->462847) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d89f expref: 17 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129731.830128:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8f45e00, rc 0) 00000100:00100000:0.0:1746129731.830143:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28010:x1830949051683072:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5645us (6187us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129731.830148:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9606 00000100:00100000:0.0:1746129731.830189:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.830230:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051683584 00000100:00100000:0.0:1746129731.830235:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051683584 00002000:00100000:0.0:1746129731.830262:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880131462d80 x1830949051683584/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:472/0 lens 488/0 e 0 to 0 dl 1746129742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129731.830269:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131462d80 with x1830949051683584 ext(2097152->3145727) 00002000:00010000:0.0:1746129731.830273:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131462d80 00000100:00100000:0.0:1746129731.830284:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3404 00000100:00100000:0.0:1746129731.830290:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949051683584:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129731.842434:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.842731:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.852900:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.863202:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.863236:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.863256:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.863275:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051685120 00000100:00100000:0.0:1746129731.863282:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051685120 00002000:00100000:0.0:1746129731.863314:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2633728->2637823) req@ffff880131462300 x1830949051685120/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:472/0 lens 488/0 e 0 to 0 dl 1746129742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129731.863322:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131462300 with x1830949051685120 ext(2633728->2637823) 00002000:00010000:0.0:1746129731.863327:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131462300 00000100:00100000:0.0:1746129731.863349:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051684992 00000100:00100000:0.0:1746129731.863352:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051684992 00002000:00100000:0.0:1746129731.863362:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009fbed180 x1830949051684992/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:472/0 lens 488/0 e 0 to 0 dl 1746129742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129731.863367:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbed180 with x1830949051684992 ext(3145728->4194303) 00002000:00010000:0.0:1746129731.863370:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbed180 00000100:00100000:0.0:1746129731.863376:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051685504 00000100:00100000:0.0:1746129731.863377:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051685504 00002000:00100000:0.0:1746129731.863385:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (458752->462847) req@ffff88009fbef100 x1830949051685504/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:472/0 lens 488/0 e 0 to 0 dl 1746129742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129731.863391:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbef100 with x1830949051685504 ext(458752->462847) 00002000:00010000:0.0:1746129731.863393:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbef100 00000100:00100000:0.0:1746129731.863401:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3407 00000100:00100000:0.0:1746129731.863408:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949051685120:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129731.863525:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949051685120:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 117us (330us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129731.863530:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3407 00002000:00100000:0.0:1746129731.863534:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2633728->2637823) req@ffff880131462300 x1830949051685120/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:472/0 lens 488/4536 e 0 to 0 dl 1746129742 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129731.863539:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131462300 with x1830949051685120 ext(2633728->2637823) 00002000:00010000:0.0:1746129731.863542:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131462300 00000100:00100000:0.0:1746129731.863552:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3408 00000100:00100000:0.0:1746129731.863556:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1963:x1830949051684992:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129731.864534:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.864553:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051685632 00000100:00100000:0.0:1746129731.864555:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051685632 00000100:00100000:0.0:1746129731.864576:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9607 00000100:00100000:0.0:1746129731.864580:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1963:x1830949051685632:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129731.864588:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129731.864602:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d5dfa00/0x48868a4e43946404 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d8a6 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129731.864638:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053104000:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129731.864691:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129731.873224:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00010000:0.0:1746129731.875682:0:10930:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime: 1746129731 -> 1746129732 00002000:00010000:0.0:1746129731.875685:0:10930:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime: 1746129731 -> 1746129732 00002000:00010000:0.0:1746129731.875687:0:10930:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime: 1746129731 -> 1746129732 00000100:00100000:0.0:1746129731.875702:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053104000:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129731.875722:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d5dfa00/0x48868a4e43946404 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d8a6 expref: 16 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129731.875729:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d5dfa00/0x48868a4e43946404 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d8a6 expref: 16 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129731.878071:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d5dfa00, rc 0) 00000100:00100000:0.0:1746129731.878097:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1963:x1830949051685632:12345-192.168.204.31@tcp:101:cat.0 Request processed in 13515us (13563us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129731.878103:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9607 00000100:00100000:0.0:1746129731.879809:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1963:x1830949051684992:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 16248us (16568us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129731.879816:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3408 00002000:00100000:0.0:1746129731.879823:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009fbed180 x1830949051684992/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:472/0 lens 488/440 e 0 to 0 dl 1746129742 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129731.879831:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbed180 with x1830949051684992 ext(3145728->4194303) 00002000:00010000:0.0:1746129731.879835:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbed180 00000100:00100000:0.0:1746129731.891079:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051686400 00000100:00100000:0.0:1746129731.891087:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051686400 00000100:00100000:0.0:1746129731.891130:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9609 00000100:00100000:0.0:1746129731.891137:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28000:x1830949051686400:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129731.891151:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129731.891164:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f809600/0x48868a4e43946412 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d8b4 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129731.891183:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129731.891185:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129731.891191:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f809600/0x48868a4e43946412 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d8b4 expref: 15 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129731.891202:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f809600/0x48868a4e43946412 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d8b4 expref: 15 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129731.891209:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f809600, rc 0) 00000100:00100000:0.0:1746129731.891254:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28000:x1830949051686400:12345-192.168.204.31@tcp:101:cat.0 Request processed in 117us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129731.891259:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9609 00000100:00100000:0.0:1746129731.899467:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.899501:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.899538:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.911937:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.911986:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.913429:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.913712:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129731.916201:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9617 00000100:00100000:0.0:1746129731.916206:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949051687680:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129731.916212:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129731.916217:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009caeb600/0x48868a4e4394644a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d8ec expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129731.916228:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009caeb600/0x48868a4e4394644a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d8ec expref: 33 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129731.916235:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009caeb600/0x48868a4e4394644a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d8ec expref: 33 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129731.916244:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009caeb600, rc 0) 00000100:00100000:0.0:1746129731.916265:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949051687680:12345-192.168.204.31@tcp:101:cat.0 Request processed in 59us (318us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129731.916270:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9617 00000100:00100000:0.0:1746129732.010439:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.015306:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.113729:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.129310:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.140391:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.140616:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.141034:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.141065:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051688832 00000100:00100000:0.0:1746129732.141071:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051688832 00010000:00010000:0.0:1746129732.141099:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093cb4600/0x48868a4e439461e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d764 expref: 21 pid: 7976 timeout: 778 lvb_type: 0 00000100:00100000:0.0:1746129732.141118:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051689088 00000100:00100000:0.0:1746129732.141120:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051689088 00010000:00010000:0.0:1746129732.141128:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131848400/0x48868a4e439461db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d75d expref: 23 pid: 8435 timeout: 778 lvb_type: 0 00000100:00100000:0.0:1746129732.141138:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051688960 00000100:00100000:0.0:1746129732.141140:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051688960 00010000:00010000:0.0:1746129732.141148:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f87c400/0x48868a4e43946324 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d805 expref: 8 pid: 10930 timeout: 778 lvb_type: 1 00000100:00100000:0.0:1746129732.141177:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4598 00000100:00100000:0.0:1746129732.141184:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1964:x1830949051688832:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129732.141196:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129732.141214:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093cb4600/0x48868a4e439461e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d764 expref: 21 pid: 7976 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746129732.141223:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093cb4600/0x48868a4e439461e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d764 expref: 21 pid: 7976 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746129732.141241:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093cb4600/0x48868a4e439461e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d764 expref: 21 pid: 7976 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746129732.141266:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129732.141299:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949051688832:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 116us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129732.141305:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4598 00000100:00100000:0.0:1746129732.141317:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4599 00000100:00100000:0.0:1746129732.141322:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949051689088:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129732.141328:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129732.141334:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131848400/0x48868a4e439461db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d75d expref: 23 pid: 8435 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746129732.141341:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131848400/0x48868a4e439461db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d75d expref: 23 pid: 8435 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746129732.141351:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131848400/0x48868a4e439461db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d75d expref: 23 pid: 8435 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746129732.141359:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129732.141372:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1964:x1830949051689088:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 51us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129732.141377:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4599 00000100:00100000:0.0:1746129732.141386:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4600 00000100:00100000:0.0:1746129732.141390:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:1964:x1830949051688960:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129732.141396:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129732.141402:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f87c400/0x48868a4e43946324 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d805 expref: 8 pid: 10930 timeout: 778 lvb_type: 1 00010000:00010000:0.0:1746129732.141410:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f87c400/0x48868a4e43946324 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d805 expref: 8 pid: 10930 timeout: 778 lvb_type: 1 00010000:00010000:0.0:1746129732.141420:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f87c400/0x48868a4e43946324 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d805 expref: 8 pid: 10930 timeout: 778 lvb_type: 1 00010000:00010000:0.0:1746129732.141427:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129732.141429:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129732.141435:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0090400/0x48868a4e43946482 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d908 expref: 19 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.141441:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0090400/0x48868a4e43946482 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d908 expref: 19 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.141466:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0090400/0x48868a4e43946482 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d908 expref: 19 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129732.141476:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053105152:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129732.141523:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129732.148588:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.153615:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.153652:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.153678:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.153713:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.153747:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051689728 00000100:00100000:0.0:1746129732.153750:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051689728 00000100:00100000:0.0:1746129732.153783:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9622 00000100:00100000:0.0:1746129732.153790:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949051689600:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129732.153800:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129732.153812:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x48868a4e439464b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d91d expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129732.153863:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053105280:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129732.153911:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129732.154393:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.154448:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051690240 00000100:00100000:0.0:1746129732.154451:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051690240 00000100:00100000:0.0:1746129732.154483:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3704 00000100:00100000:0.0:1746129732.154489:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+30:28024:x1830949051690240:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:0.0:1746129732.155045:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+31:28024:x1830949051690240:12345-192.168.204.31@tcp:35:cat.0 Request processed in 556us (652us total) trans 8589943338 rc 0/0 00000100:00100000:0.0:1746129732.155051:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3704 00000100:00100000:0.0:1746129732.155990:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.185137:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053105536:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129732.185158:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135473000/0x48868a4e439464c1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d92b expref: 16 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129732.185169:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135473000/0x48868a4e439464c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d92b expref: 16 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129732.185181:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135473000, rc 0) 00000100:00100000:0.0:1746129732.185202:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949051690752:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2994us (3071us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129732.185208:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9624 00000100:00100000:0.0:1746129732.185231:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051691008 00000100:00100000:0.0:1746129732.185235:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051691008 00000100:00100000:0.0:1746129732.185253:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9626 00000100:00100000:0.0:1746129732.185257:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:28018:x1830949051691008:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129732.185265:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129732.185273:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009caeb000/0x48868a4e439464cf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d939 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.185288:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8f31400/0x48868a4e439463c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d88a expref: 23 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.185300:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8f31800/0x48868a4e439463ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d891 expref: 19 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.185305:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129732.185306:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129732.185309:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009caeb000/0x48868a4e439464cf lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3907584->4194303] (req 3907584->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d939 expref: 23 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.185328:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8f31800/0x48868a4e439463ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d891 expref: 19 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.185337:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8f31800/0x48868a4e439463ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d891 expref: 19 pid: 10930 timeout: 778 lvb_type: 0 00000100:00100000:0.0:1746129732.185345:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053105664:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129732.185386:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8f31400/0x48868a4e439463c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d88a expref: 23 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.185392:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8f31400/0x48868a4e439463c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d88a expref: 23 pid: 10930 timeout: 778 lvb_type: 0 00000100:00100000:0.0:1746129732.185398:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053105792:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129732.185409:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129732.190286:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.190319:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.195205:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.195238:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.195260:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.195930:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.203425:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.229624:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051692672 00000100:00100000:0.0:1746129732.229632:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051692672 00010000:00010000:0.0:1746129732.229658:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa7be00/0x48868a4e43946291 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d7bf expref: 32 pid: 10930 timeout: 778 lvb_type: 0 00000100:00100000:0.0:1746129732.229690:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051692544 00000100:00100000:0.0:1746129732.229693:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051692544 00010000:00010000:0.0:1746129732.229702:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f809600/0x48868a4e43946412 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d8b4 expref: 17 pid: 10930 timeout: 778 lvb_type: 0 00000100:00100000:0.0:1746129732.229716:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4603 00000100:00100000:0.0:1746129732.229722:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949051692672:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129732.229732:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129732.229747:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa7be00/0x48868a4e43946291 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d7bf expref: 32 pid: 10930 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746129732.229771:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa7be00/0x48868a4e43946291 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d7bf expref: 32 pid: 10930 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746129732.230542:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa7be00/0x48868a4e43946291 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d7bf expref: 32 pid: 10930 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746129732.230553:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129732.230555:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129732.230560:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0091200/0x48868a4e439464dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4513791) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d947 expref: 31 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.230566:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0091200/0x48868a4e439464dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4513791) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d947 expref: 31 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.230582:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0091200/0x48868a4e439464dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4513791) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d947 expref: 31 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129732.230588:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d636a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053106560:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129732.230611:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129732.232680:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.239524:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949051692928:12345-192.168.204.31@tcp:4:cat.0 Request processed in 6595us (6837us total) trans 17179872861 rc 0/0 00000100:00100000:0.0:1746129732.239534:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 420 00002000:00100000:0.0:1746129732.239543:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (2068480->2097151) req@ffff88012d635f80 x1830949051692928/t17179872861(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:473/0 lens 488/448 e 0 to 0 dl 1746129743 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129732.239550:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d635f80 with x1830949051692928 ext(2068480->2097151) 00010000:00010000:0.0:1746129732.239559:0:21600:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8f30600/0x48868a4e439463be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d87c expref: 33 pid: 7976 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746129732.239569:0:21600:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8f30600/0x48868a4e439463be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d87c expref: 33 pid: 7976 timeout: 778 lvb_type: 0 00002000:00010000:0.0:1746129732.239575:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d635f80 00000100:00100000:0.0:1746129732.241878:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051693056 00000100:00100000:0.0:1746129732.241888:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051693056 00010000:00010000:0.0:1746129732.241913:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8f45e00/0x48868a4e439463fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 147456->462847) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d89f expref: 17 pid: 10930 timeout: 778 lvb_type: 0 00000100:00100000:0.0:1746129732.241949:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4605 00000100:00100000:0.0:1746129732.241959:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949051693056:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129732.241973:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129732.242199:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051693312 00000100:00100000:0.0:1746129732.242202:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051693312 00002000:00100000:0.0:1746129732.242228:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (4509696->4513791) req@ffff880136885c00 x1830949051693312/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:473/0 lens 488/0 e 0 to 0 dl 1746129743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129732.242236:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136885c00 with x1830949051693312 ext(4509696->4513791) 00002000:00010000:0.0:1746129732.242240:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136885c00 00000100:00100000:0.0:1746129732.242251:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3416 00000100:00100000:0.0:1746129732.242256:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949051693312:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129732.242411:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949051693312:12345-192.168.204.31@tcp:3:cat.0 Request processed in 154us (328us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129732.242417:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3416 00002000:00100000:0.0:1746129732.242421:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (4509696->4513791) req@ffff880136885c00 x1830949051693312/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:473/0 lens 488/4536 e 0 to 0 dl 1746129743 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129732.242427:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136885c00 with x1830949051693312 ext(4509696->4513791) 00002000:00010000:0.0:1746129732.242430:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136885c00 00000100:00100000:0.0:1746129732.242892:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051693440 00000100:00100000:0.0:1746129732.242895:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051693440 00010000:00010000:0.0:1746129732.242908:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8f30600/0x48868a4e439463be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d87c expref: 33 pid: 7976 timeout: 778 lvb_type: 0 00000100:00100000:0.0:1746129732.242936:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4606 00000100:00100000:0.0:1746129732.242941:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1964:x1830949051693440:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129732.242947:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129732.242957:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8f30600/0x48868a4e439463be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d87c expref: 33 pid: 7976 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746129732.242966:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8f30600/0x48868a4e439463be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d87c expref: 33 pid: 7976 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746129732.242977:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8f30600/0x48868a4e439463be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d87c expref: 33 pid: 7976 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746129732.242997:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129732.242998:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129732.243003:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0091400/0x48868a4e439464e4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d94e expref: 16 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.243009:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0091400/0x48868a4e439464e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d94e expref: 16 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.243025:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0091400/0x48868a4e439464e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d94e expref: 16 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129732.243033:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d634a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053106816:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129732.243568:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129732.248999:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d634a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053106816:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129732.249010:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129732.249026:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949051693440:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6084us (6489us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129732.249031:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4606 00000100:00100000:0.0:1746129732.250254:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.250334:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.273341:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.275127:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.275155:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.275181:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.275203:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051694336 00000100:00100000:0.0:1746129732.275207:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051694336 00000100:00100000:0.0:1746129732.275233:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051694208 00000100:00100000:0.0:1746129732.275235:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051694208 00000100:00100000:0.0:1746129732.275242:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051694464 00000100:00100000:0.0:1746129732.275244:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051694464 00000100:00100000:0.0:1746129732.275255:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9631 00000100:00100000:0.0:1746129732.275260:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949051694336:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129732.275269:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129732.275277:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f809600/0x48868a4e439464f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d963 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129732.275305:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d636680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053107072:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129732.275344:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129732.275356:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9633 00000100:00100000:0.0:1746129732.275361:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1964:x1830949051694464:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129732.275793:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129732.275801:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x48868a4e43946500 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d96a expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129732.275825:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d637100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053107200:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129732.275843:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129732.277733:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.279187:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d637100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053107200:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129732.279201:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x48868a4e43946500 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d96a expref: 22 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129732.279211:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x48868a4e43946500 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d96a expref: 22 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129732.279221:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009caeb800, rc 0) 00000100:00100000:0.0:1746129732.279237:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1964:x1830949051694464:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3875us (4055us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129732.279243:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9633 00000100:00100000:0.0:1746129732.284798:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.288751:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.289963:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.298030:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.326038:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.330808:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.340265:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053107584:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129732.340280:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129732.340328:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949051695616:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 9387us (9527us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129732.340337:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4608 00000100:00100000:0.0:1746129732.340359:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051696128 00000100:00100000:0.0:1746129732.340363:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051696128 00000100:00100000:0.0:1746129732.340389:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 525 00000100:00100000:0.0:1746129732.340393:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+33:1963:x1830949051696128:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129732.340402:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129732.340420:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d628e00/0x48868a4e43946523 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d978 expref: 33 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.340436:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129732.340439:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129732.340450:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+32:1963:x1830949051696128:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 56us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129732.340454:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 525 00000100:00100000:0.0:1746129732.362376:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.377468:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.378531:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.382251:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.383826:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.390950:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.392074:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.392132:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.396876:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.396914:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.413624:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.416328:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.416394:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.420198:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.420417:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.425137:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.434749:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.439212:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.441282:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.450082:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.450116:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.462229:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.462997:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1962:x1830949051699968:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 11826us (12879us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129732.463005:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 425 00002000:00100000:0.0:1746129732.463012:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8800a8fd3800 x1830949051699968/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:473/0 lens 488/440 e 0 to 0 dl 1746129743 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129732.463020:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd3800 with x1830949051699968 ext(3145728->4194303) 00010000:00010000:0.0:1746129732.463028:0:21600:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fb66e00/0x48868a4e43946554 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9a2 expref: 24 pid: 3623 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746129732.463038:0:21600:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fb66e00/0x48868a4e43946554 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9a2 expref: 24 pid: 3623 timeout: 778 lvb_type: 0 00002000:00010000:0.0:1746129732.463045:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a8fd3800 00000100:00100000:0.0:1746129732.464556:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.467460:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.469793:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.469843:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.469952:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9644 00000100:00100000:0.0:1746129732.469958:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+7:1963:x1830949051701248:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129732.469964:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129732.469971:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d628600/0x48868a4e4394659a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d9cc expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.469981:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129732.469982:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129732.469986:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d628600/0x48868a4e4394659a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9cc expref: 8 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129732.469993:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d628600/0x48868a4e4394659a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9cc expref: 8 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129732.469999:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d628600, rc 0) 00000100:00100000:0.0:1746129732.470013:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+8:1963:x1830949051701248:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 56us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129732.470018:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9644 00000100:00100000:0.0:1746129732.470072:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.470082:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051701376 00000100:00100000:0.0:1746129732.470085:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051701376 00000100:00100000:0.0:1746129732.470110:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9645 00000100:00100000:0.0:1746129732.470115:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+7:1964:x1830949051701376:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129732.470121:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129732.470128:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d628800/0x48868a4e439465a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d9d3 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.470137:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129732.470138:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129732.470142:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d628800/0x48868a4e439465a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9d3 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129732.470150:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d628800/0x48868a4e439465a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9d3 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129732.470156:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d628800, rc 0) 00000100:00100000:0.0:1746129732.470170:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+8:1964:x1830949051701376:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 55us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129732.470174:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9645 00000100:00100000:0.0:1746129732.470182:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051701504 00000100:00100000:0.0:1746129732.470184:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051701504 00000100:00100000:0.0:1746129732.470195:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051701632 00000100:00100000:0.0:1746129732.470196:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051701632 00000100:00100000:0.0:1746129732.470212:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9646 00000100:00100000:0.0:1746129732.470217:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+8:1964:x1830949051701504:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129732.470222:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129732.470227:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d628a00/0x48868a4e439465a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34d9da expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129732.470248:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053109376:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129732.470283:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129732.477307:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.478124:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.478148:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.478174:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.478192:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.484905:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.507578:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.510156:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.517198:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.517996:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.518017:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.518045:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.523358:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051704832 00000100:00100000:0.0:1746129732.523365:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051704832 00000100:00100000:0.0:1746129732.523402:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9606 00000100:00100000:0.0:1746129732.523410:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+19:28031:x1830949051704832:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129732.523428:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129732.523442:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67e00/0x48868a4e43946603 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34da19 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.523515:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67600/0x48868a4e4394660a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129732.523530:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a138c00/0x48868a4e4394658c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9be expref: 309 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.523536:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67600/0x48868a4e4394660a lrc: 4/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129732.523561:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a138c00/0x48868a4e4394658c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9be expref: 309 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.523575:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a138c00/0x48868a4e4394658c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9be expref: 309 pid: 1851 timeout: 778 lvb_type: 0 00000100:00100000:0.0:1746129732.523585:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be64700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053110144:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129732.523642:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129732.526057:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.526085:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.526099:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.526124:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.528516:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.529362:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.530516:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9657 00000100:00100000:0.0:1746129732.530522:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949051706112:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:0.0:1746129732.530536:0:7976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e4394663b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.530544:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c0fee00/0x48868a4e439464eb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d955 expref: 24 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.530550:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131496a00/0x48868a4e439465f5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9fd expref: 23 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129732.530557:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d628600/0x48868a4e4394659a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9cc expref: 10 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129732.530565:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129732.530566:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129732.530568:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e4394663b lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.530581:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d628600/0x48868a4e4394659a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9cc expref: 10 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129732.530588:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d628600/0x48868a4e4394659a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9cc expref: 10 pid: 8435 timeout: 778 lvb_type: 1 00000100:00100000:0.0:1746129732.530595:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be65180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053111424:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129732.530618:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131496a00/0x48868a4e439465f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9fd expref: 23 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129732.530625:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131496a00/0x48868a4e439465f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9fd expref: 23 pid: 20441 timeout: 778 lvb_type: 1 00000100:00100000:0.0:1746129732.530632:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be64700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053111680:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129732.530651:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c0fee00/0x48868a4e439464eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d955 expref: 24 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.530658:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c0fee00/0x48868a4e439464eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d955 expref: 24 pid: 10930 timeout: 778 lvb_type: 0 00000100:00100000:0.0:1746129732.530669:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053111808:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129732.530682:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129732.530695:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051705856 00000100:00100000:0.0:1746129732.530698:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051705856 00002000:00100000:0.0:1746129732.530712:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88013631b100 x1830949051705856/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:473/0 lens 488/0 e 0 to 0 dl 1746129743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129732.530720:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631b100 with x1830949051705856 ext(4194304->4964351) 00010000:00010000:0.0:1746129732.530724:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a138200/0x48868a4e43946611 lrc: 6/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34da12 expref: 20 pid: 20441 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746129732.530732:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a138200/0x48868a4e43946611 lrc: 6/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34da12 expref: 20 pid: 20441 timeout: 778 lvb_type: 0 00002000:00010000:0.0:1746129732.530737:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013631b100 00000100:00100000:0.0:1746129732.530748:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 428 00000100:00100000:0.0:1746129732.530766:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949051705856:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129732.531621:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051706368 00000100:00100000:0.0:1746129732.531625:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051706368 00000100:00100000:0.0:1746129732.531640:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9658 00000100:00100000:0.0:1746129732.531645:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949051706368:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:0.0:1746129732.531659:0:3623:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008fb66c00/0x48868a4e43946642 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.531667:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0091400/0x48868a4e439464e4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d94e expref: 21 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.531675:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d628800/0x48868a4e439465a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9d3 expref: 10 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129732.531680:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d629000/0x48868a4e43946531 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d97f expref: 37 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.531686:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129732.531687:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129732.531689:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fb66c00/0x48868a4e43946642 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.531704:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d629000/0x48868a4e43946531 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d97f expref: 37 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.531712:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d629000/0x48868a4e43946531 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d97f expref: 37 pid: 3623 timeout: 778 lvb_type: 0 00000100:00100000:0.0:1746129732.531719:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053112064:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129732.531739:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d628800/0x48868a4e439465a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9d3 expref: 10 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129732.531746:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d628800/0x48868a4e439465a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9d3 expref: 10 pid: 8435 timeout: 778 lvb_type: 1 00000100:00100000:0.0:1746129732.531762:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053112192:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129732.531782:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0091400/0x48868a4e439464e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d94e expref: 21 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.531789:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0091400/0x48868a4e439464e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d94e expref: 21 pid: 10930 timeout: 778 lvb_type: 0 00000100:00100000:0.0:1746129732.531796:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053112320:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129732.531809:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129732.531819:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051706624 00000100:00100000:0.0:1746129732.531822:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051706624 00000100:00100000:0.0:1746129732.531838:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9659 00000100:00100000:0.0:1746129732.531842:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949051706624:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:0.0:1746129732.531883:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800949e9a00/0x48868a4e43946649 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.531892:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c549600/0x48868a4e4394655b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9a9 expref: 24 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.531899:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094569800/0x48868a4e439465af lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9e1 expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129732.531905:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c549a00/0x48868a4e43946569 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9b0 expref: 23 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.531909:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129732.531911:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129732.531912:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800949e9a00/0x48868a4e43946649 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.531925:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c549a00/0x48868a4e43946569 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9b0 expref: 23 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.531932:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c549a00/0x48868a4e43946569 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9b0 expref: 23 pid: 3623 timeout: 778 lvb_type: 0 00000100:00100000:0.0:1746129732.531939:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053112448:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129732.531978:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094569800/0x48868a4e439465af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9e1 expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129732.531986:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094569800/0x48868a4e439465af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9e1 expref: 11 pid: 3624 timeout: 778 lvb_type: 1 00000100:00100000:0.0:1746129732.531993:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053112576:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129732.532012:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c549600/0x48868a4e4394655b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9a9 expref: 24 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.532020:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c549600/0x48868a4e4394655b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9a9 expref: 24 pid: 3623 timeout: 778 lvb_type: 0 00000100:00100000:0.0:1746129732.532027:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c089500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053112704:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129732.532038:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129732.539700:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053112448:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129732.539711:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053112576:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129732.539717:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c089500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053112704:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129732.539728:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800949e9a00/0x48868a4e43946649 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.539746:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d628600/0x48868a4e4394659a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9cc expref: 11 pid: 8435 timeout: 778 lvb_type: 1 00000100:00100000:0.0:1746129732.539773:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be65180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053111424:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129732.539780:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be64700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053111680:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129732.539786:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053111808:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129732.539795:0:7976:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e4394663b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129732.539811:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053110784:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129732.539816:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053111168:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129732.539822:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053111936:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129732.539832:0:3624:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c549e00/0x48868a4e43946634 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129732.543208:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.543242:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.543271:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.543299:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.543317:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129732.544615:0:7976:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e4394663b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.544623:0:7976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e4394663b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.544640:0:7976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e4394663b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.544646:0:7976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e4394663b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.544652:0:7976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e4394663b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.544657:0:7976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fb66400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129732.544661:0:7976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e4394663b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.544667:0:7976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e4394663b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.544675:0:7976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e4394663b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.544681:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e4394663b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129732.544712:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949051706112:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 14190us (14407us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129732.544718:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9657 00000100:00100000:0.0:1746129732.544747:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.544785:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.544802:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.544820:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.544876:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.544885:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.544906:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.544929:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129732.545880:0:3624:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c549e00/0x48868a4e43946634 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.545887:0:3624:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c549e00/0x48868a4e43946634 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.545898:0:3624:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c549e00/0x48868a4e43946634 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.545909:0:3624:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c549e00/0x48868a4e43946634 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.545914:0:3624:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c549e00/0x48868a4e43946634 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.545925:0:3624:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c549e00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129732.545928:0:3624:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c549e00/0x48868a4e43946634 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.545933:0:3624:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c549e00/0x48868a4e43946634 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.545941:0:3624:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c549e00/0x48868a4e43946634 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.545949:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c549e00/0x48868a4e43946634 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129732.545973:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+7:1962:x1830949051706240:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 15644us (15954us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129732.545977:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9655 00000100:00100000:0.0:1746129732.562644:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053112832:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129732.562661:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129732.562694:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949051708544:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 17240us (17873us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129732.562702:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4631 00000100:00100000:0.0:1746129732.563631:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051708672 00000100:00100000:0.0:1746129732.563634:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051708672 00010000:00010000:0.0:1746129732.563648:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c549600/0x48868a4e4394655b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9a9 expref: 23 pid: 3623 timeout: 778 lvb_type: 0 00000100:00100000:0.0:1746129732.563673:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4635 00000100:00100000:0.0:1746129732.563678:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949051708672:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129732.563687:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129732.563696:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c549600/0x48868a4e4394655b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9a9 expref: 23 pid: 3623 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746129732.563705:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c549600/0x48868a4e4394655b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9a9 expref: 23 pid: 3623 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746129732.563717:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c549600/0x48868a4e4394655b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34d9a9 expref: 23 pid: 3623 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746129732.563726:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129732.563728:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129732.563731:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800949e9a00/0x48868a4e43946649 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.563736:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800949e9a00/0x48868a4e43946649 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.563761:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129732.563777:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949051708672:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 98us (1830us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129732.563782:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4635 00010000:00010000:0.0:1746129732.563798:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800949e9a00/0x48868a4e43946649 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.563806:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800949e9a00/0x48868a4e43946649 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.563821:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800949e9a00/0x48868a4e43946649 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.563827:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800949e9a00/0x48868a4e43946649 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.563833:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800949e9a00/0x48868a4e43946649 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.563838:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800949e9a00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129732.563841:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800949e9a00/0x48868a4e43946649 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.563862:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800949e9a00/0x48868a4e43946649 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.563870:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800949e9a00/0x48868a4e43946649 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.563875:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800949e9a00/0x48868a4e43946649 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129732.563909:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+6:1962:x1830949051706624:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 32066us (32252us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129732.563914:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9659 00000100:00100000:0.0:1746129732.568079:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.572087:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.577797:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.581630:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.585088:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.587288:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.599626:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051711232 00000100:00100000:0.0:1746129732.599633:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051711232 00002000:00100000:0.0:1746129732.599665:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (4960256->4964351) req@ffff88009206d500 x1830949051711232/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:473/0 lens 488/0 e 0 to 0 dl 1746129743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129732.599674:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206d500 with x1830949051711232 ext(4960256->4964351) 00002000:00010000:0.0:1746129732.599678:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009206d500 00000100:00100000:0.0:1746129732.599780:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3434 00000100:00100000:0.0:1746129732.599790:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949051711232:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129732.600476:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949051711232:12345-192.168.204.31@tcp:3:cat.0 Request processed in 687us (906us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129732.600483:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3434 00002000:00100000:0.0:1746129732.600489:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (4960256->4964351) req@ffff88009206d500 x1830949051711232/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:473/0 lens 488/4536 e 0 to 0 dl 1746129743 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129732.600495:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206d500 with x1830949051711232 ext(4960256->4964351) 00002000:00010000:0.0:1746129732.600498:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009206d500 00000100:00100000:0.0:1746129732.604639:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.607144:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.609231:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.609608:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.612234:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.612270:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.612293:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.612318:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.612673:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9673 00000100:00100000:0.0:1746129732.612678:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949051712640:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129732.612684:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129732.612692:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800949e9200/0x48868a4e439466c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34da89 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129732.612703:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129732.612705:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129732.612708:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800949e9200/0x48868a4e439466c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34da89 expref: 36 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129732.612715:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800949e9200/0x48868a4e439466c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34da89 expref: 36 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129732.612721:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800949e9200, rc 0) 00000100:00100000:0.0:1746129732.612735:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949051712640:12345-192.168.204.31@tcp:101:cat.0 Request processed in 58us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129732.612740:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9673 00000100:00100000:0.0:1746129732.619669:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.645034:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.649436:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.649474:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.655947:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.658445:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.663158:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.663889:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.677816:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.680531:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.752659:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.757971:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.758048:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.758101:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9676 00000100:00100000:0.0:1746129732.758110:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1963:x1830949051714816:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129732.758124:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129732.758136:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800949e9c00/0x48868a4e439466f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34daa5 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129732.758173:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053114112:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129732.758248:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129732.776626:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.776666:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.776703:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.781481:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.781520:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.781648:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051715968 00000100:00100000:0.0:1746129732.781655:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051715968 00002000:00100000:0.0:1746129732.781685:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009fd47800 x1830949051715968/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:473/0 lens 488/0 e 0 to 0 dl 1746129743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129732.781699:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd47800 with x1830949051715968 ext(1048576->2097151) 00002000:00010000:0.0:1746129732.781703:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd47800 00000100:00100000:0.0:1746129732.781726:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3441 00000100:00100000:0.0:1746129732.781733:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1963:x1830949051715968:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129732.797477:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.797517:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051716224 00000100:00100000:0.0:1746129732.797522:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051716224 00002000:00100000:0.0:1746129732.797546:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (4165632->4194303) req@ffff88009fd46300 x1830949051716224/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:473/0 lens 488/0 e 0 to 0 dl 1746129743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129732.797555:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd46300 with x1830949051716224 ext(4165632->4194303) 00010000:00010000:0.0:1746129732.797561:0:21600:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fb66200/0x48868a4e439466d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34da90 expref: 24 pid: 3623 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746129732.797572:0:21600:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fb66200/0x48868a4e439466d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34da90 expref: 24 pid: 3623 timeout: 778 lvb_type: 0 00002000:00010000:0.0:1746129732.797578:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fd46300 00000100:00100000:0.0:1746129732.802692:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1962:x1830949051716224:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 5024us (5207us total) trans 21474840043 rc 0/0 00000100:00100000:0.0:1746129732.802703:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 430 00002000:00100000:0.0:1746129732.802712:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (4165632->4194303) req@ffff88009fd46300 x1830949051716224/t21474840043(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:473/0 lens 488/448 e 0 to 0 dl 1746129743 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129732.802721:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd46300 with x1830949051716224 ext(4165632->4194303) 00010000:00010000:0.0:1746129732.802729:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fb66200/0x48868a4e439466d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34da90 expref: 26 pid: 3623 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746129732.802743:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fb66200/0x48868a4e439466d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34da90 expref: 26 pid: 3623 timeout: 778 lvb_type: 0 00002000:00010000:0.0:1746129732.802759:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fd46300 00000100:00100000:0.0:1746129732.812633:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.817896:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.822801:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.829354:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.834147:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.840837:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.842055:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.844008:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.846706:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053114752:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129732.846729:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d5dfa00/0x48868a4e43946745 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dad6 expref: 26 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129732.846739:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d5dfa00/0x48868a4e43946745 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dad6 expref: 26 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129732.846763:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d5dfa00, rc 0) 00000100:00100000:0.0:1746129732.846792:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:1961:x1830949051717888:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4298us (4736us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129732.846797:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9682 00000100:00100000:0.0:1746129732.852629:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.859254:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.859288:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.859315:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.859388:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.859410:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051718656 00000100:00100000:0.0:1746129732.859417:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051718656 00002000:00100000:0.0:1746129732.859450:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009a04f800 x1830949051718656/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:473/0 lens 488/0 e 0 to 0 dl 1746129743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129732.859459:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04f800 with x1830949051718656 ext(0->1048575) 00002000:00010000:0.0:1746129732.859463:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04f800 00000100:00100000:0.0:1746129732.859477:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051718784 00000100:00100000:0.0:1746129732.859479:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051718784 00002000:00100000:0.0:1746129732.859488:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009a04f100 x1830949051718784/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:473/0 lens 488/0 e 0 to 0 dl 1746129743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129732.859495:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04f100 with x1830949051718784 ext(1048576->2097151) 00002000:00010000:0.0:1746129732.859498:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04f100 00000100:00100000:0.0:1746129732.859505:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051719168 00000100:00100000:0.0:1746129732.859507:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051719168 00002000:00100000:0.0:1746129732.859517:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009a04fb80 x1830949051719168/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:473/0 lens 488/0 e 0 to 0 dl 1746129743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129732.859522:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04fb80 with x1830949051719168 ext(1048576->2097151) 00002000:00010000:0.0:1746129732.859525:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a04fb80 00000100:00100000:0.0:1746129732.859531:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051719040 00000100:00100000:0.0:1746129732.859533:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051719040 00002000:00100000:0.0:1746129732.859540:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009a04f480 x1830949051719040/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:473/0 lens 488/0 e 0 to 0 dl 1746129743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129732.859545:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04f480 with x1830949051719040 ext(1048576->2097151) 00002000:00010000:0.0:1746129732.859548:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a04f480 00000100:00100000:0.0:1746129732.859558:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3444 00000100:00100000:0.0:1746129732.859563:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949051718656:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129732.860661:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3445 00000100:00100000:0.0:1746129732.860668:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1962:x1830949051718784:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129732.861620:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3446 00000100:00100000:0.0:1746129732.861626:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1962:x1830949051719168:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129732.877047:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3450 00000100:00100000:0.0:1746129732.877056:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949051720064:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129732.909568:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.916522:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051720832 00000100:00100000:0.0:1746129732.916526:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051720832 00000100:00100000:0.0:1746129732.916565:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9684 00000100:00100000:0.0:1746129732.916570:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:1961:x1830949051720832:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129732.916577:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129732.916588:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8f45600/0x48868a4e43946776 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34daeb expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129732.916623:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053115136:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129732.916792:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129732.920129:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053115136:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129732.920156:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8f45600/0x48868a4e43946776 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34daeb expref: 26 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129732.920173:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8f45600/0x48868a4e43946776 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34daeb expref: 26 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129732.920196:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8f45600, rc 0) 00000100:00100000:0.0:1746129732.920226:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:1961:x1830949051720832:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3655us (3754us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129732.920237:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9684 00000100:00100000:0.0:1746129732.921767:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1963:x1830949051720064:12345-192.168.204.31@tcp:3:cat.0 Request processed in 44711us (47535us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129732.921774:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3450 00002000:00100000:0.0:1746129732.921779:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009206ea00 x1830949051720064/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:473/0 lens 488/440 e 0 to 0 dl 1746129743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129732.921787:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206ea00 with x1830949051720064 ext(2097152->3145727) 00002000:00010000:0.0:1746129732.921790:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009206ea00 00000100:00100000:0.0:1746129732.929350:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.929715:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.934816:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.936809:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.950056:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.970794:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.970845:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.975946:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.982174:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.990991:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.991339:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129732.992098:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.005636:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.005933:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.006515:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3455 00000100:00100000:0.0:1746129733.006523:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1963:x1830949051723264:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129733.013487:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.021419:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.025418:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.037542:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.047380:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.047449:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.047542:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3457 00000100:00100000:0.0:1746129733.047552:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1964:x1830949051724416:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129733.084184:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.090385:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.111346:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051725568 00000100:00100000:0.0:1746129733.111349:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051725568 00000100:00100000:0.0:1746129733.111367:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051725824 00000100:00100000:0.0:1746129733.111369:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051725824 00000100:00100000:0.0:1746129733.111390:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9695 00000100:00100000:0.0:1746129733.111394:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1962:x1830949051725568:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129733.111402:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129733.111413:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8f44600/0x48868a4e439467bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34db38 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129733.111447:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053117056:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129733.111490:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129733.114834:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.121318:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.121353:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.140076:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.147439:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.154071:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.154120:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.161335:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.174163:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.203957:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.203987:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.204024:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.242201:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.250137:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.250172:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.250205:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.252154:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.264894:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.269264:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051729792 00000100:00100000:0.0:1746129733.269270:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051729792 00010000:00010000:0.0:1746129733.269289:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131496400/0x48868a4e4394666c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34da3c expref: 25 pid: 7976 timeout: 779 lvb_type: 1 00000100:00100000:0.0:1746129733.269311:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051729920 00000100:00100000:0.0:1746129733.269313:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051729920 00010000:00010000:0.0:1746129733.269321:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fb67800/0x48868a4e439466ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34da82 expref: 41 pid: 3624 timeout: 779 lvb_type: 1 00000100:00100000:0.0:1746129733.269337:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4655 00000100:00100000:0.0:1746129733.269340:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1962:x1830949051729920:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129733.269345:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129733.269353:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fb67800/0x48868a4e439466ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34da82 expref: 41 pid: 3624 timeout: 779 lvb_type: 1 00010000:00010000:0.0:1746129733.269361:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fb67800/0x48868a4e439466ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34da82 expref: 41 pid: 3624 timeout: 779 lvb_type: 1 00010000:00010000:0.0:1746129733.269388:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fb67800/0x48868a4e439466ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34da82 expref: 41 pid: 3624 timeout: 779 lvb_type: 1 00010000:00010000:0.0:1746129733.269399:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129733.269401:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129733.269405:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa7be00/0x48868a4e43946810 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db69 expref: 24 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129733.269412:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa7be00/0x48868a4e43946810 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db69 expref: 24 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129733.269436:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa7be00/0x48868a4e43946810 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db69 expref: 24 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129733.269445:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053118464:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129733.269481:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129733.273140:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.273649:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.273678:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.298091:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.300108:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.302031:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.305505:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.305533:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.305553:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.305576:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.305598:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051731584 00000100:00100000:0.0:1746129733.305603:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051731584 00000100:00100000:0.0:1746129733.305633:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051731712 00000100:00100000:0.0:1746129733.305635:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051731712 00000100:00100000:0.0:1746129733.305647:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9706 00000100:00100000:0.0:1746129733.305652:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+7:1962:x1830949051731584:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129733.305665:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129733.305676:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800949e9c00/0x48868a4e4394684f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34db93 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129733.305710:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053119360:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129733.306045:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129733.306063:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.306096:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00010000:0.0:1746129733.308064:0:8436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime: 1746129732 -> 1746129733 00002000:00010000:0.0:1746129733.308068:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime: 1746129732 -> 1746129733 00002000:00010000:0.0:1746129733.308069:0:8436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime: 1746129732 -> 1746129733 00000100:00100000:0.0:1746129733.308076:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be66a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053119488:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129733.308090:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131496800/0x48868a4e4394685d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db9a expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129733.308097:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131496800/0x48868a4e4394685d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db9a expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129733.308104:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131496800, rc 0) 00000100:00100000:0.0:1746129733.308117:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949051731712:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 2324us (2563us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129733.308129:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9708 00000100:00100000:0.0:1746129733.311358:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.313497:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.316480:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.319125:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.322550:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051733376 00000100:00100000:0.0:1746129733.322554:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051733376 00000100:00100000:0.0:1746129733.322578:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051733632 00000100:00100000:0.0:1746129733.322580:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051733632 00000100:00100000:0.0:1746129733.322590:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051733248 00000100:00100000:0.0:1746129733.322591:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051733248 00000100:00100000:0.0:1746129733.322601:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9713 00000100:00100000:0.0:1746129733.322606:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949051733376:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:0.0:1746129733.322622:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800949e9a00/0x48868a4e439468b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129733.322633:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801348e9e00/0x48868a4e43946802 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db5b expref: 24 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129733.322642:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129733.322644:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129733.322646:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800949e9a00/0x48868a4e439468b1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129733.322660:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801348e9e00/0x48868a4e43946802 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db5b expref: 24 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129733.322668:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801348e9e00/0x48868a4e43946802 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db5b expref: 24 pid: 8435 timeout: 779 lvb_type: 0 00000100:00100000:0.0:1746129733.322677:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053120000:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129733.322699:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129733.322712:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051733504 00000100:00100000:0.0:1746129733.322714:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051733504 00000100:00100000:0.0:1746129733.322726:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051733760 00000100:00100000:0.0:1746129733.322728:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051733760 00000100:00100000:0.0:1746129733.322749:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9714 00000100:00100000:0.0:1746129733.322754:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949051733632:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:0.0:1746129733.322767:0:10930:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800949e8000/0x48868a4e439468b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129733.322776:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fceaa00/0x48868a4e439467a7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db1c expref: 23 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129733.322788:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a139200/0x48868a4e43946872 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dbaf expref: 9 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129733.322794:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a138600/0x48868a4e439467ca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db3f expref: 37 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129733.322800:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bd8b400/0x48868a4e43946714 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dac1 expref: 37 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129733.322807:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec9a800/0x48868a4e43946784 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34daf9 expref: 23 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129733.322812:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746129733.322814:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746129733.322816:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800949e8000/0x48868a4e439468b8 lrc: 8/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129733.322830:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec9a800/0x48868a4e43946784 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34daf9 expref: 23 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129733.322838:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ec9a800/0x48868a4e43946784 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34daf9 expref: 23 pid: 20441 timeout: 779 lvb_type: 0 00000100:00100000:0.0:1746129733.322845:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053120128:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129733.322896:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bd8b400/0x48868a4e43946714 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dac1 expref: 37 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129733.322903:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bd8b400/0x48868a4e43946714 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dac1 expref: 37 pid: 3623 timeout: 779 lvb_type: 0 00000100:00100000:0.0:1746129733.322911:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053120384:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129733.322932:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a138600/0x48868a4e439467ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db3f expref: 37 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129733.322939:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a138600/0x48868a4e439467ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db3f expref: 37 pid: 7976 timeout: 779 lvb_type: 1 00000100:00100000:0.0:1746129733.322946:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053120512:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129733.322965:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a139200/0x48868a4e43946872 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dbaf expref: 9 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129733.322971:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a139200/0x48868a4e43946872 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dbaf expref: 9 pid: 3623 timeout: 779 lvb_type: 1 00000100:00100000:0.0:1746129733.322978:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053120640:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129733.322998:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fceaa00/0x48868a4e439467a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db1c expref: 23 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129733.323004:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fceaa00/0x48868a4e439467a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db1c expref: 23 pid: 3623 timeout: 779 lvb_type: 0 00000100:00100000:0.0:1746129733.323011:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053120768:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129733.323024:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129733.323037:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9717 00000100:00100000:0.0:1746129733.323042:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949051733760:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:0.0:1746129733.323055:0:1140:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d5df000/0x48868a4e439468cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129733.323064:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a139c00/0x48868a4e43946799 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db0e expref: 24 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129733.323070:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a138a00/0x48868a4e4394686b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dbb6 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129733.323076:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ec9a000/0x48868a4e439467d1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db46 expref: 25 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129733.323082:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129733.323083:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129733.323085:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d5df000/0x48868a4e439468cd lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129733.323098:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ec9a000/0x48868a4e439467d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db46 expref: 25 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129733.323105:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ec9a000/0x48868a4e439467d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db46 expref: 25 pid: 1877 timeout: 779 lvb_type: 1 00000100:00100000:0.0:1746129733.323112:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053120896:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129733.323134:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a138a00/0x48868a4e4394686b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dbb6 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129733.323141:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a138a00/0x48868a4e4394686b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dbb6 expref: 9 pid: 8437 timeout: 779 lvb_type: 1 00000100:00100000:0.0:1746129733.323149:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053121024:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129733.323171:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a139c00/0x48868a4e43946799 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db0e expref: 24 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129733.323178:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a139c00/0x48868a4e43946799 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db0e expref: 24 pid: 3623 timeout: 779 lvb_type: 0 00000100:00100000:0.0:1746129733.323185:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053121152:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129733.323196:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129733.330838:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.330900:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.331112:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053120896:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129733.331131:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051733888 00000100:00100000:0.0:1746129733.331135:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051733888 00002000:00100000:0.0:1746129733.331165:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e8:0x0] (794624->1048575) req@ffff880092ad9880 x1830949051733888/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:474/0 lens 488/0 e 0 to 0 dl 1746129744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129733.331173:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad9880 with x1830949051733888 ext(794624->1048575) 00010000:00010000:0.0:1746129733.331179:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801348e8a00/0x48868a4e439467ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 794624->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db23 expref: 38 pid: 3623 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746129733.331189:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801348e8a00/0x48868a4e439467ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 794624->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db23 expref: 38 pid: 3623 timeout: 779 lvb_type: 0 00002000:00010000:0.0:1746129733.331196:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092ad9880 00000100:00100000:0.0:1746129733.331221:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051734016 00000100:00100000:0.0:1746129733.331224:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051734016 00002000:00100000:0.0:1746129733.331234:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1470464->2097151) req@ffff880092ad8000 x1830949051734016/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:474/0 lens 488/0 e 0 to 0 dl 1746129744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129733.331240:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad8000 with x1830949051734016 ext(1470464->2097151) 00010000:00010000:0.0:1746129733.331244:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801348e9e00/0x48868a4e43946802 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db5b expref: 25 pid: 8435 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746129733.331250:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801348e9e00/0x48868a4e43946802 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db5b expref: 25 pid: 8435 timeout: 779 lvb_type: 0 00002000:00010000:0.0:1746129733.331255:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092ad8000 00000100:00100000:0.0:1746129733.331265:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 435 00000100:00100000:0.0:1746129733.331270:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1962:x1830949051733888:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129733.331553:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053121024:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129733.333479:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053121152:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129733.333498:0:1140:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012d5df000/0x48868a4e439468cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129733.334446:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051734144 00000100:00100000:0.0:1746129733.334449:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051734144 00010000:00010000:0.0:1746129733.334465:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec9a800/0x48868a4e43946784 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34daf9 expref: 24 pid: 20441 timeout: 779 lvb_type: 0 00000100:00100000:0.0:1746129733.334495:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4658 00000100:00100000:0.0:1746129733.334500:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1964:x1830949051734144:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129733.334508:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129733.334525:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ec9a800/0x48868a4e43946784 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34daf9 expref: 24 pid: 20441 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746129733.334533:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ec9a800/0x48868a4e43946784 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34daf9 expref: 24 pid: 20441 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746129733.334550:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec9a800/0x48868a4e43946784 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34daf9 expref: 24 pid: 20441 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746129733.334571:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129733.334591:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1964:x1830949051734144:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 90us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129733.334596:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4658 00000100:00100000:0.0:1746129733.339683:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.344103:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.345665:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051734912 00000100:00100000:0.0:1746129733.345668:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051734912 00002000:00100000:0.0:1746129733.345690:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1150975) req@ffff88009be64700 x1830949051734912/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:474/0 lens 488/0 e 0 to 0 dl 1746129744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129733.345698:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be64700 with x1830949051734912 ext(1048576->1150975) 00010000:00010000:0.0:1746129733.345704:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa7be00/0x48868a4e43946810 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db69 expref: 22 pid: 8435 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746129733.345714:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa7be00/0x48868a4e43946810 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db69 expref: 22 pid: 8435 timeout: 779 lvb_type: 0 00002000:00010000:0.0:1746129733.345719:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009be64700 00000100:00100000:0.0:1746129733.345747:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 438 00010000:00010000:0.0:1746129733.347144:0:1140:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012d5df000/0x48868a4e439468cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129733.347152:0:1140:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d5df000/0x48868a4e439468cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129733.347165:0:1140:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d5df000/0x48868a4e439468cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129733.347170:0:1140:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d5df000/0x48868a4e439468cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129733.347175:0:1140:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d5df000/0x48868a4e439468cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129733.347179:0:1140:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d5df000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129733.347182:0:1140:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d5df000/0x48868a4e439468cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129733.347187:0:1140:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d5df000/0x48868a4e439468cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129733.347199:0:1140:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d5df000/0x48868a4e439468cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129733.347204:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d5df000/0x48868a4e439468cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129733.347244:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949051733760:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 24201us (24736us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129733.347250:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9717 00000100:00100000:0.0:1746129733.347266:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949051734912:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:0.0:1746129733.361384:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1961:x1830949051734912:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 15630us (16182us total) trans 17179872869 rc 0/0 00000100:00100000:0.0:1746129733.361391:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 438 00002000:00100000:0.0:1746129733.361397:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1150975) req@ffff88009be64700 x1830949051734912/t17179872869(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:474/0 lens 488/448 e 0 to 0 dl 1746129744 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129733.361405:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be64700 with x1830949051734912 ext(1048576->1150975) 00010000:00010000:0.0:1746129733.361411:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa7be00/0x48868a4e43946810 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db69 expref: 24 pid: 8435 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746129733.361419:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa7be00/0x48868a4e43946810 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34db69 expref: 24 pid: 8435 timeout: 779 lvb_type: 0 00002000:00010000:0.0:1746129733.361424:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009be64700 00000100:00100000:0.0:1746129733.365890:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.369073:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.385648:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.385687:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.385979:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.386001:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.386817:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.390254:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.427699:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053124096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129733.427724:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746129733.428641:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092adb800/2, rc 0, transno 17179872877 00000100:00100000:0.0:1746129733.428645:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053124096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129733.429537:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.434039:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.437181:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.437515:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.437544:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.437819:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.437833:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129733.438313:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.450903:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.456698:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.457048:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.458051:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.468433:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.469098:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.469706:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.469759:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.469789:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051739392 00000100:00100000:0.0:1746129734.469796:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051739392 00000100:00100000:0.0:1746129734.469833:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051739776 00000100:00100000:0.0:1746129734.469835:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051739776 00000100:00100000:0.0:1746129734.469863:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051739904 00000100:00100000:0.0:1746129734.469865:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051739904 00000100:00100000:0.0:1746129734.469876:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051740160 00000100:00100000:0.0:1746129734.469878:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051740160 00000100:00100000:0.0:1746129734.469889:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3474 00000100:00100000:0.0:1746129734.469894:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6141239f-0c60-480d-830c-e22ba61457b0+14:1963:x1830949051739392:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:0.0:1746129734.469920:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4c00/0x48868a4e43946936 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.469930:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129734.469932:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129734.469936:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4c00/0x48868a4e43946936 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.469946:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4c00/0x48868a4e43946936 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129734.471232:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3475 00000100:00100000:0.0:1746129734.471240:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6141239f-0c60-480d-830c-e22ba61457b0+14:1961:x1830949051739776:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:0.0:1746129734.471259:0:21601:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e4394693d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.471267:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129734.471269:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129734.471272:0:21601:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e4394693d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.471285:0:21601:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e4394693d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129734.473196:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3476 00000100:00100000:0.0:1746129734.473205:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949051739904:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:0.0:1746129734.473227:0:8440:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4a00/0x48868a4e43946944 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.473236:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129734.473237:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129734.473240:0:8440:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4a00/0x48868a4e43946944 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.473249:0:8440:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4a00/0x48868a4e43946944 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.526923:0:21601:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e4394693d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.526936:0:21601:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e4394693d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.526943:0:21601:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e4394693d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.526949:0:21601:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b22c5000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129734.526952:0:21601:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e4394693d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.526959:0:21601:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e4394693d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.526974:0:21601:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e4394693d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.526980:0:21601:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e4394693d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129734.527051:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949051739776:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 55807us (57950us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129734.527059:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3475 00000100:00100000:0.0:1746129734.554014:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.560932:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.576164:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.581542:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.581579:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.581604:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.581616:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.581627:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.581649:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.581674:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051741440 00000100:00100000:0.0:1746129734.581679:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051741440 00000100:00100000:0.0:1746129734.581704:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051741952 00000100:00100000:0.0:1746129734.581705:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051741952 00000100:00100000:0.0:1746129734.586141:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.592310:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.606513:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.606551:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.611591:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.611653:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.611679:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.614158:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.614951:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051742848 00000100:00100000:0.0:1746129734.614953:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051742848 00000100:00100000:0.0:1746129734.614985:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051743488 00000100:00100000:0.0:1746129734.614987:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051743488 00000100:00100000:0.0:1746129734.614998:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9748 00000100:00100000:0.0:1746129734.615003:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+6:1962:x1830949051742848:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129734.615015:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129734.615028:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e439469de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34dc5e expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.615045:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129734.615046:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129734.615053:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e439469de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc5e expref: 7 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129734.615064:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e439469de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc5e expref: 7 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129734.615072:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b534c200, rc 0) 00000100:00100000:0.0:1746129734.615100:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1962:x1830949051742848:12345-192.168.204.31@tcp:101:cat.0 Request processed in 97us (3421us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129734.615105:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9748 00000100:00100000:0.0:1746129734.615115:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9749 00000100:00100000:0.0:1746129734.615118:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+6:1962:x1830949051743488:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129734.615123:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129734.615130:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b534d000/0x48868a4e439469e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34dc6c expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.615138:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129734.615139:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129734.615142:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b534d000/0x48868a4e439469e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc6c expref: 7 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129734.615150:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b534d000/0x48868a4e439469e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc6c expref: 7 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129734.615155:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b534d000, rc 0) 00000100:00100000:0.0:1746129734.615164:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1962:x1830949051743488:12345-192.168.204.31@tcp:101:cat.0 Request processed in 45us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129734.615168:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9749 00000100:00100000:0.0:1746129734.615187:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.615197:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051742720 00000100:00100000:0.0:1746129734.615199:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051742720 00000100:00100000:0.0:1746129734.615209:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9750 00000100:00100000:0.0:1746129734.615212:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1962:x1830949051742720:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129734.615216:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129734.615221:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009faeae00/0x48868a4e439469ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34dc57 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.615228:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129734.615230:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129734.615233:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009faeae00/0x48868a4e439469ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc57 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129734.615239:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009faeae00/0x48868a4e439469ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc57 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129734.615244:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faeae00, rc 0) 00000100:00100000:0.0:1746129734.615254:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1962:x1830949051742720:12345-192.168.204.31@tcp:101:cat.0 Request processed in 41us (66us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129734.615258:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9750 00000100:00100000:0.0:1746129734.615287:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.615293:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051742976 00000100:00100000:0.0:1746129734.615294:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051742976 00000100:00100000:0.0:1746129734.615304:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9751 00000100:00100000:0.0:1746129734.615307:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1962:x1830949051742976:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129734.615311:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129734.615317:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f26600/0x48868a4e439469f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34dc65 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.615324:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129734.615325:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129734.615329:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f26600/0x48868a4e439469f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc65 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129734.615337:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094f26600/0x48868a4e439469f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc65 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129734.615346:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f26600, rc 0) 00000100:00100000:0.0:1746129734.615359:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1962:x1830949051742976:12345-192.168.204.31@tcp:101:cat.0 Request processed in 50us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129734.615363:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9751 00000100:00100000:0.0:1746129734.615402:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.615416:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051743616 00000100:00100000:0.0:1746129734.615418:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051743616 00000100:00100000:0.0:1746129734.615440:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9623 00000100:00100000:0.0:1746129734.615445:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28079:x1830949051743616:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129734.615453:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129734.615462:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f26400/0x48868a4e439469fa lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34dc73 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.615500:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094f26400/0x48868a4e439469fa lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc73 expref: 285 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.615508:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f26400/0x48868a4e439469fa lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc73 expref: 285 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.615519:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129734.615522:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129734.615524:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f26400, rc 0) 00000100:00100000:0.0:1746129734.616138:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28079:x1830949051743616:12345-192.168.204.31@tcp:101:cat.0 Request processed in 692us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129734.616143:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9623 00000100:00100000:0.0:1746129734.629515:0:3296:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840054 gen 2 00000004:00080000:0.0:1746129734.629521:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00ea00, transno 21474840021 00000004:00080000:0.0:1746129734.629526:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00d500, transno 21474840022 00000004:00080000:0.0:1746129734.629528:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093288a80, transno 21474840023 00000004:00080000:0.0:1746129734.629530:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00f100, transno 21474840024 00000004:00080000:0.0:1746129734.629532:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00dc00, transno 21474840025 00000004:00080000:0.0:1746129734.629534:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00c000, transno 21474840026 00000004:00080000:0.0:1746129734.629536:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095240380, transno 21474840027 00000004:00080000:0.0:1746129734.629538:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00ed80, transno 21474840028 00000004:00080000:0.0:1746129734.629540:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009be65500, transno 21474840047 00000004:00080000:0.0:1746129734.629542:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c088380, transno 21474840048 00000004:00080000:0.0:1746129734.629544:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009be66a00, transno 21474840049 00000004:00080000:0.0:1746129734.629546:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c08a680, transno 21474840050 00000004:00080000:0.0:1746129734.629547:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009be67100, transno 21474840051 00000004:00080000:0.0:1746129734.629549:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c089880, transno 21474840052 00000004:00080000:0.0:1746129734.629551:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284d500, transno 21474840053 00000004:00080000:0.0:1746129734.629553:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c088000, transno 21474840054 00000100:00100000:0.0:1746129734.629560:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c043b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053124608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746129734.635674:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.635718:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.635752:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.636211:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3479 00000100:00100000:0.0:1746129734.636218:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1961:x1830949051744640:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129734.638188:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.638260:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.638956:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.639426:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051744512 00000100:00100000:0.0:1746129734.639429:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051744512 00002000:00100000:0.0:1746129734.639444:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012c041f80 x1830949051744512/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:475/0 lens 488/0 e 0 to 0 dl 1746129745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129734.639450:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c041f80 with x1830949051744512 ext(1048576->2097151) 00002000:00010000:0.0:1746129734.639453:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c041f80 00000100:00100000:0.0:1746129734.639463:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3481 00000100:00100000:0.0:1746129734.639466:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949051744512:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129734.686581:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949051745408:12345-192.168.204.31@tcp:3:cat.0 Request processed in 26274us (26495us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129734.686592:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3482 00002000:00100000:0.0:1746129734.686602:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800a504f480 x1830949051745408/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:475/0 lens 488/440 e 0 to 0 dl 1746129745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129734.686611:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504f480 with x1830949051745408 ext(1048576->2097151) 00002000:00010000:0.0:1746129734.686616:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504f480 00000100:00100000:0.0:1746129734.687098:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053125376:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129734.691929:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb64800/0x48868a4e439468db lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dbd2 expref: 8 pid: 1851 timeout: 780 lvb_type: 0 00000100:00100000:0.0:1746129734.691958:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053125504:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129734.691974:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b49dc00/0x48868a4e43946a1d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129734.691982:0:15044:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b49dc00/0x48868a4e43946a1d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129734.691986:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b49dc00/0x48868a4e43946a1d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00000040:00080000:0.0:1746129734.692560:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2623, 88 off217656 00000004:00080000:0.0:1746129734.692567:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 680750718493ns, next at 641639930618ns, rc = 0 00000100:00100000:0.0:1746129734.695838:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1961:x1830949051744512:12345-192.168.204.31@tcp:3:cat.0 Request processed in 56365us (56876us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129734.695863:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3481 00002000:00100000:0.0:1746129734.695874:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012c041f80 x1830949051744512/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:475/0 lens 488/440 e 0 to 0 dl 1746129745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129734.695882:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c041f80 with x1830949051744512 ext(1048576->2097151) 00002000:00010000:0.0:1746129734.695888:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c041f80 00000100:00100000:0.0:1746129734.696414:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949051745664:12345-192.168.204.31@tcp:3:cat.0 Request processed in 33006us (33375us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129734.696419:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3484 00002000:00100000:0.0:1746129734.696425:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800a504dc00 x1830949051745664/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:475/0 lens 488/440 e 0 to 0 dl 1746129745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129734.696431:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504dc00 with x1830949051745664 ext(0->1048575) 00002000:00010000:0.0:1746129734.696434:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a504dc00 00000100:00100000:0.0:1746129734.707074:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.707200:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051746688 00000100:00100000:0.0:1746129734.707208:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051746688 00000100:00100000:0.0:1746129734.707245:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9628 00000100:00100000:0.0:1746129734.707252:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28082:x1830949051746688:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129734.707329:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129734.707345:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0fe400/0x48868a4e43946a2b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34dc96 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.707400:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0fe400/0x48868a4e43946a2b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc96 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.707411:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0fe400/0x48868a4e43946a2b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc96 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.707420:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129734.707423:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129734.707426:0:16808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131497a00/0x48868a4e43946a24 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc8f expref: 287 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.707433:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c0fe400, rc 0) 00000100:00100000:0.0:1746129734.707471:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28082:x1830949051746688:12345-192.168.204.31@tcp:101:cat.0 Request processed in 219us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129734.707476:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9628 00000100:00100000:0.0:1746129734.740404:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.740973:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.741041:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.741916:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.753367:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.753410:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.764211:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.764229:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.764251:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129734.767588:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faea200/0x48868a4e43946998 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc18 expref: 21 pid: 3623 timeout: 780 lvb_type: 1 00000100:00100000:0.0:1746129734.767611:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094768000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053128448:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129734.767622:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe29400/0x48868a4e439469d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc49 expref: 7 pid: 20441 timeout: 780 lvb_type: 1 00000100:00100000:0.0:1746129734.767630:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094768700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053128576:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129734.767640:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d5df000/0x48868a4e43946905 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dbe0 expref: 9 pid: 1877 timeout: 780 lvb_type: 1 00000100:00100000:0.0:1746129734.767648:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009476b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053128704:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129734.767669:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4d4f600/0x48868a4e43946a39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 647168->774143) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dca4 expref: 20 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.767678:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4d4f600, rc 0) 00000100:00100000:0.0:1746129734.767706:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:28076:x1830949051747968:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 7432us (7533us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129734.767723:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9771 00000100:00100000:0.0:1746129734.768063:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fdc4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053128960:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129734.768074:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129734.768675:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949051748480:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2906us (4420us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129734.768683:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4684 00000100:00100000:0.0:1746129734.774165:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.774204:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.775885:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.775911:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051749120 00000100:00100000:0.0:1746129734.775914:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051749120 00010000:00010000:0.0:1746129734.775933:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe29a00/0x48868a4e43946a01 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc50 expref: 11 pid: 20441 timeout: 780 lvb_type: 1 00000100:00100000:0.0:1746129734.775952:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4685 00000100:00100000:0.0:1746129734.775957:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1963:x1830949051749120:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129734.775966:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129734.775980:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fe29a00/0x48868a4e43946a01 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc50 expref: 11 pid: 20441 timeout: 780 lvb_type: 1 00010000:00010000:0.0:1746129734.775991:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fe29a00/0x48868a4e43946a01 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc50 expref: 11 pid: 20441 timeout: 780 lvb_type: 1 00010000:00010000:0.0:1746129734.776008:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fe29a00/0x48868a4e43946a01 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc50 expref: 11 pid: 20441 timeout: 780 lvb_type: 1 00010000:00010000:0.0:1746129734.776020:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129734.776021:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129734.776027:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801360b2400/0x48868a4e43946a32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc9d expref: 10 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.776034:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801360b2400/0x48868a4e43946a32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc9d expref: 10 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.776060:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801360b2400/0x48868a4e43946a32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc9d expref: 10 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.776074:0:10980:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801360b2400/0x48868a4e43946a32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc9d expref: 10 pid: 20441 timeout: 780 lvb_type: 0 00000100:00100000:0.0:1746129734.776084:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053129088:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129734.776145:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129734.781944:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053129088:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129734.781960:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129734.782005:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1963:x1830949051749120:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6046us (6121us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129734.782013:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4685 00000100:00100000:0.0:1746129734.789205:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051749888 00000100:00100000:0.0:1746129734.789214:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051749888 00002000:00100000:0.0:1746129734.789249:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e6:0x0] (1769472->2097151) req@ffff880136318700 x1830949051749888/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:475/0 lens 488/0 e 0 to 0 dl 1746129745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129734.789259:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136318700 with x1830949051749888 ext(1769472->2097151) 00010000:00010000:0.0:1746129734.789266:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801360b2400/0x48868a4e43946a32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc9d expref: 8 pid: 20441 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746129734.789279:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801360b2400/0x48868a4e43946a32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc9d expref: 8 pid: 20441 timeout: 780 lvb_type: 0 00002000:00010000:0.0:1746129734.789285:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136318700 00000100:00100000:0.0:1746129734.789313:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 441 00000100:00100000:0.0:1746129734.789320:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1962:x1830949051749888:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:0.0:1746129734.794398:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.808910:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949051749888:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 19581us (19814us total) trans 21474840063 rc 0/0 00000100:00100000:0.0:1746129734.808922:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 441 00002000:00100000:0.0:1746129734.808930:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e6:0x0] (1769472->2097151) req@ffff880136318700 x1830949051749888/t21474840063(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:475/0 lens 488/448 e 0 to 0 dl 1746129745 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129734.808939:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136318700 with x1830949051749888 ext(1769472->2097151) 00010000:00010000:0.0:1746129734.808947:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801360b2400/0x48868a4e43946a32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc9d expref: 10 pid: 20441 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746129734.808959:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801360b2400/0x48868a4e43946a32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc9d expref: 10 pid: 20441 timeout: 780 lvb_type: 0 00002000:00010000:0.0:1746129734.808965:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136318700 00000100:00100000:0.0:1746129734.822085:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.828226:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.838390:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.844615:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.844685:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.866519:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.877695:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.881350:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051752320 00000100:00100000:0.0:1746129734.881358:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051752320 00002000:00100000:0.0:1746129734.881389:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009fdc6300 x1830949051752320/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:475/0 lens 488/0 e 0 to 0 dl 1746129745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129734.881397:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fdc6300 with x1830949051752320 ext(2097152->3145727) 00002000:00010000:0.0:1746129734.881402:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fdc6300 00000100:00100000:0.0:1746129734.881418:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3492 00000100:00100000:0.0:1746129734.881424:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fdc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1961:x1830949051752320:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129734.923097:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.923564:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949051752832:12345-192.168.204.31@tcp:3:cat.0 Request processed in 34096us (35386us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129734.923573:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3494 00002000:00100000:0.0:1746129734.923582:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012c088380 x1830949051752832/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:475/0 lens 488/440 e 0 to 0 dl 1746129745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129734.923591:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c088380 with x1830949051752832 ext(2097152->3145727) 00002000:00010000:0.0:1746129734.923596:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c088380 00000100:00100000:0.0:1746129734.938171:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.945700:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.945749:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129734.948683:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051754240 00000100:00100000:1.0:1746129734.948692:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051754240 00000100:00100000:1.0:1746129734.948731:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051754112 00000100:00100000:1.0:1746129734.948734:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051754112 00000100:00100000:1.0:1746129734.948751:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9777 00000100:00100000:1.0:1746129734.948758:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949051754240:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129734.948771:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129734.948785:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5217800/0x48868a4e43946a86 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34dcdc expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129734.948802:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129734.948804:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129734.948812:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5217800/0x48868a4e43946a86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dcdc expref: 12 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129734.948828:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5217800/0x48868a4e43946a86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dcdc expref: 12 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129734.948837:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5217800, rc 0) 00000100:00100000:1.0:1746129734.949756:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949051754240:12345-192.168.204.31@tcp:101:cat.0 Request processed in 997us (4062us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129734.949761:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9777 00000100:00100000:0.0:1746129734.950730:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129734.950781:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051754368 00000100:00100000:1.0:1746129734.950785:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051754368 00000100:00100000:0.0:1746129734.958458:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129734.963225:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129734.963273:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.963414:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051754752 00000100:00100000:0.0:1746129734.963421:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051754752 00010000:00010000:0.0:1746129734.963450:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe29000/0x48868a4e439468f7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dbf5 expref: 8 pid: 4589 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746129734.963471:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051754880 00000100:00100000:0.0:1746129734.963473:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051754880 00010000:00010000:0.0:1746129734.963481:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e439469de lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc5e expref: 7 pid: 8435 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746129734.963495:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4692 00000100:00100000:0.0:1746129734.963501:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c089880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1963:x1830949051754880:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129734.963508:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129734.963524:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e439469de lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc5e expref: 7 pid: 8435 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746129734.963533:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e439469de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc5e expref: 7 pid: 8435 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746129734.966309:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e439469de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc5e expref: 7 pid: 8435 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746129734.966333:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129734.966374:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c089880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+6:1963:x1830949051754880:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2871us (3099us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129734.966381:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4692 00000100:00100000:1.0:1746129734.966402:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.966415:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051755136 00000100:00100000:0.0:1746129734.966419:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051755136 00002000:00100000:0.0:1746129734.966445:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88012c088000 x1830949051755136/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:475/0 lens 488/0 e 0 to 0 dl 1746129745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129734.966453:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c088000 with x1830949051755136 ext(4194304->4964351) 00002000:00010000:0.0:1746129734.966457:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c088000 00000100:00100000:0.0:1746129734.966469:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3497 00000100:00100000:1.0:1746129734.967293:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+6:1961:x1830949051755136:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129734.975051:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+6:1961:x1830949051755136:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8569us (8642us total) trans 0 rc 770048/770048 00000100:00100000:0.0:1746129734.975060:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3497 00002000:00100000:0.0:1746129734.975068:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88012c088000 x1830949051755136/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:475/0 lens 488/440 e 0 to 0 dl 1746129745 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129734.975076:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c088000 with x1830949051755136 ext(4194304->4964351) 00002000:00010000:0.0:1746129734.975080:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c088000 00000100:00100000:0.0:1746129734.978504:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.978546:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.983507:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.984686:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.984777:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.984816:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.985082:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9784 00000100:00100000:0.0:1746129734.985088:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1963:x1830949051755904:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129734.985094:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129734.985099:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131497e00/0x48868a4e43946ab7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34dd06 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129734.985109:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129734.985113:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131497e00/0x48868a4e43946ab7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd06 expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129734.985120:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131497e00/0x48868a4e43946ab7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd06 expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129734.985130:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131497e00, rc 0) 00000100:00100000:0.0:1746129734.985143:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1963:x1830949051755904:12345-192.168.204.31@tcp:101:cat.0 Request processed in 57us (328us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129734.985148:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9784 00000100:00100000:0.0:1746129734.987049:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129734.987098:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051756160 00000100:00100000:1.0:1746129734.987104:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051756160 00002000:00100000:1.0:1746129734.987130:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1376256->1380351) req@ffff880093289f80 x1830949051756160/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:475/0 lens 488/0 e 0 to 0 dl 1746129745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129734.987138:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289f80 with x1830949051756160 ext(1376256->1380351) 00002000:00010000:1.0:1746129734.987142:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093289f80 00000100:00100000:1.0:1746129734.987153:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3498 00000100:00100000:1.0:1746129734.987159:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1964:x1830949051756160:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129734.987291:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1964:x1830949051756160:12345-192.168.204.31@tcp:3:cat.0 Request processed in 132us (242us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129734.987296:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3498 00002000:00100000:1.0:1746129734.987301:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1376256->1380351) req@ffff880093289f80 x1830949051756160/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:475/0 lens 488/4536 e 0 to 0 dl 1746129745 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129734.987306:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289f80 with x1830949051756160 ext(1376256->1380351) 00002000:00010000:1.0:1746129734.987309:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093289f80 00000100:00100000:0.0:1746129734.991752:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129734.991833:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051756416 00000100:00100000:1.0:1746129734.991840:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051756416 00002000:00100000:1.0:1746129734.991899:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1753088->1757183) req@ffff88009328a680 x1830949051756416/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:475/0 lens 488/0 e 0 to 0 dl 1746129745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129734.991908:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328a680 with x1830949051756416 ext(1753088->1757183) 00002000:00010000:1.0:1746129734.991914:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009328a680 00000100:00100000:1.0:1746129734.991943:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3499 00000100:00100000:1.0:1746129734.991951:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1964:x1830949051756416:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129734.992118:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1964:x1830949051756416:12345-192.168.204.31@tcp:3:cat.0 Request processed in 168us (371us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129734.992127:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3499 00002000:00100000:1.0:1746129734.992131:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1753088->1757183) req@ffff88009328a680 x1830949051756416/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:475/0 lens 488/4536 e 0 to 0 dl 1746129745 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129734.992137:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328a680 with x1830949051756416 ext(1753088->1757183) 00002000:00010000:1.0:1746129734.992140:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009328a680 00000100:00100000:0.0:1746129734.995985:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129734.996387:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129734.996448:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051756928 00000100:00100000:1.0:1746129734.996453:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051756928 00002000:00100000:1.0:1746129734.996468:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880094a4c700 x1830949051756928/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:475/0 lens 488/0 e 0 to 0 dl 1746129745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129734.996474:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4c700 with x1830949051756928 ext(3145728->4194303) 00002000:00010000:1.0:1746129734.996477:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a4c700 00000100:00100000:1.0:1746129734.996502:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3501 00000100:00100000:1.0:1746129734.996508:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949051756928:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129735.002085:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.002124:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.002811:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3503 00000100:00100000:0.0:1746129735.002818:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949051757312:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129735.024221:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1961:x1830949051757312:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21395us (22088us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129735.024230:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3503 00002000:00100000:1.0:1746129735.024239:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880094a4ca80 x1830949051757312/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:476/0 lens 488/440 e 0 to 0 dl 1746129746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129735.024247:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4ca80 with x1830949051757312 ext(3145728->4194303) 00002000:00010000:1.0:1746129735.024252:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a4ca80 00000100:00100000:0.0:1746129735.029499:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.029582:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051757696 00000100:00100000:1.0:1746129735.029590:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051757696 00002000:00100000:1.0:1746129735.029647:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880094a4c380 x1830949051757696/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:476/0 lens 488/0 e 0 to 0 dl 1746129746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129735.029662:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4c380 with x1830949051757696 ext(4194304->4964351) 00002000:00010000:1.0:1746129735.029667:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a4c380 00000100:00100000:1.0:1746129735.029696:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3504 00000100:00100000:1.0:1746129735.029714:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1963:x1830949051757696:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129735.035460:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1963:x1830949051757696:12345-192.168.204.31@tcp:3:cat.0 Request processed in 5749us (5960us total) trans 0 rc 770048/770048 00000100:00100000:1.0:1746129735.035471:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3504 00002000:00100000:1.0:1746129735.035480:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880094a4c380 x1830949051757696/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:476/0 lens 488/440 e 0 to 0 dl 1746129746 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129735.035489:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4c380 with x1830949051757696 ext(4194304->4964351) 00002000:00010000:1.0:1746129735.035494:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a4c380 00000100:00100000:0.0:1746129735.041422:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.059647:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.059673:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051758208 00000100:00100000:0.0:1746129735.059680:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051758208 00000100:00100000:0.0:1746129735.059759:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9630 00000100:00100000:0.0:1746129735.059766:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28091:x1830949051758208:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129735.059785:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129735.059799:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12be00/0x48868a4e43946abe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34dd0d expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129735.059907:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a600/0x48868a4e43946ac5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.059917:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a600/0x48868a4e43946ac5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.059925:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a600/0x48868a4e43946ac5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.059935:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12ac00/0x48868a4e43946acc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.059940:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12ac00/0x48868a4e43946acc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.059944:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12ac00/0x48868a4e43946acc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.060025:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a000/0x48868a4e43946ad3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.060033:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a000/0x48868a4e43946ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.060039:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a000/0x48868a4e43946ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:0.0:1746129735.060046:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129735.060114:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a600/0x48868a4e43946ac5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.060120:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a600/0x48868a4e43946ac5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.060125:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a600/0x48868a4e43946ac5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.060129:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a12a600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129735.060132:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a600/0x48868a4e43946ac5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.060137:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a600/0x48868a4e43946ac5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.060146:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:0.0:1746129735.060149:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129735.060152:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a600/0x48868a4e43946ac5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.060157:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a600/0x48868a4e43946ac5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.060170:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12ac00/0x48868a4e43946acc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.060175:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12ac00/0x48868a4e43946acc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.060179:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12ac00/0x48868a4e43946acc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.060182:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a12ac00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129735.060184:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12ac00/0x48868a4e43946acc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.060189:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12ac00/0x48868a4e43946acc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.060194:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009baa2f00) 00010000:00010000:0.0:1746129735.060196:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129735.060198:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12ac00/0x48868a4e43946acc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.060201:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12ac00/0x48868a4e43946acc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.060229:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12be00/0x48868a4e43946abe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd0d expref: 12 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129735.060244:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a000/0x48868a4e43946ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd0d expref: 11 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129735.060250:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129735.060252:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746129735.060254:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a12a000, rc 0) 00000100:00100000:0.0:1746129735.060292:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28091:x1830949051758208:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 526us (652us total) trans 8589943373 rc 0/0 00000100:00100000:0.0:1746129735.060298:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9630 00000100:00100000:0.0:1746129735.064678:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.068507:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.071790:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.079058:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.079114:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051758848 00000100:00100000:1.0:1746129735.079121:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051758848 00002000:00100000:1.0:1746129735.079153:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (1773568->1777663) req@ffff88012ba3ad80 x1830949051758848/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:476/0 lens 488/0 e 0 to 0 dl 1746129746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129735.079161:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3ad80 with x1830949051758848 ext(1773568->1777663) 00002000:00010000:1.0:1746129735.079165:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba3ad80 00000100:00100000:1.0:1746129735.079190:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3505 00000100:00100000:1.0:1746129735.079196:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949051758848:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129735.079327:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949051758848:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 130us (277us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129735.079332:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3505 00002000:00100000:1.0:1746129735.079337:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (1773568->1777663) req@ffff88012ba3ad80 x1830949051758848/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:476/0 lens 488/4536 e 0 to 0 dl 1746129746 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129735.079343:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3ad80 with x1830949051758848 ext(1773568->1777663) 00002000:00010000:1.0:1746129735.079345:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba3ad80 00000100:00100000:0.0:1746129735.085516:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.092990:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.129647:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.137195:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.139592:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.153567:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.153614:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.153675:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051760640 00000100:00100000:1.0:1746129735.153683:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051760640 00000100:00100000:1.0:1746129735.153744:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 531 00000100:00100000:1.0:1746129735.153751:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949051760640:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129735.153761:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129735.153780:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8c00/0x48868a4e43946b20 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd22 expref: 15 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.153796:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129735.153800:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129735.153832:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949051760640:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 82us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129735.153838:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 531 00000100:00100000:0.0:1746129735.160614:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.160662:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.173503:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.176699:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.184277:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.195390:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.195478:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.195515:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.200917:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949051761792:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129735.213209:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.237417:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.239884:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.243624:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.248643:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.252544:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.255191:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.255438:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051763072 00000100:00100000:1.0:1746129735.255444:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051763072 00002000:00100000:1.0:1746129735.255470:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e6:0x0] (1773568->1916927) req@ffff88012ba1a300 x1830949051763072/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:476/0 lens 488/0 e 0 to 0 dl 1746129746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129735.255478:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba1a300 with x1830949051763072 ext(1773568->1916927) 00010000:00010000:1.0:1746129735.255484:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b8e8800/0x48868a4e43946ae1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd14 expref: 12 pid: 1140 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746129735.255498:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b8e8800/0x48868a4e43946ae1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd14 expref: 12 pid: 1140 timeout: 781 lvb_type: 0 00002000:00010000:1.0:1746129735.255504:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba1a300 00000100:00100000:1.0:1746129735.255653:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 446 00000100:00100000:1.0:1746129735.255660:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1964:x1830949051763072:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129735.272917:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.273356:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.274655:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1964:x1830949051763072:12345-192.168.204.31@tcp:4:cat.0 Request processed in 18994us (19470us total) trans 21474840065 rc 0/0 00000100:00100000:1.0:1746129735.274663:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 446 00002000:00100000:1.0:1746129735.274670:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e6:0x0] (1773568->1916927) req@ffff88012ba1a300 x1830949051763072/t21474840065(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:476/0 lens 488/448 e 0 to 0 dl 1746129746 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129735.274678:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba1a300 with x1830949051763072 ext(1773568->1916927) 00010000:00010000:1.0:1746129735.274684:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b8e8800/0x48868a4e43946ae1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd14 expref: 14 pid: 1140 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746129735.274693:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b8e8800/0x48868a4e43946ae1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd14 expref: 14 pid: 1140 timeout: 781 lvb_type: 0 00002000:00010000:1.0:1746129735.274698:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba1a300 00000100:00100000:0.0:1746129735.281817:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.282252:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.282326:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051763712 00000100:00100000:1.0:1746129735.282333:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051763712 00002000:00100000:1.0:1746129735.282366:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88012ba18000 x1830949051763712/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:476/0 lens 488/0 e 0 to 0 dl 1746129746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129735.282374:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba18000 with x1830949051763712 ext(1048576->2097151) 00002000:00010000:1.0:1746129735.282379:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba18000 00000100:00100000:1.0:1746129735.282406:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3511 00000100:00100000:1.0:1746129735.282412:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1962:x1830949051763712:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129735.292834:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.292899:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.292912:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.292951:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.292963:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051764224 00000100:00100000:1.0:1746129735.292966:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051764352 00000100:00100000:1.0:1746129735.292970:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051764352 00000100:00100000:0.0:1746129735.292970:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051764224 00000100:00080000:1.0:1746129735.292988:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1746129735.292994:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8e8800/0x48868a4e43946ae1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1773568->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd14 expref: 14 pid: 1140 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746129735.293009:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051764096 00000100:00100000:0.0:1746129735.293011:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051764096 00000100:00100000:1.0:1746129735.293013:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9634 00000100:00100000:1.0:1746129735.293018:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+6:28102:x1830949051764352:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:0.0:1746129735.293024:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4699 00000100:00100000:0.0:1746129735.293027:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949051764224:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129735.293033:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129735.293037:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129735.293046:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed200/0x48868a4e43946b82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34dd68 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129735.293051:0:7108:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129733 -> 1746129735 00010000:00010000:0.0:1746129735.293055:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b8e8800/0x48868a4e43946ae1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1773568->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd14 expref: 14 pid: 1140 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746129735.293065:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b8e8800/0x48868a4e43946ae1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1773568->1916927) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd14 expref: 14 pid: 1140 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746129735.293081:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129735.293083:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129735.293086:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec400/0x48868a4e43946b89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.293089:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f87de00/0x48868a4e43946b51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd4c expref: 14 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.293095:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec400/0x48868a4e43946b89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.293095:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f87de00/0x48868a4e43946b51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd4c expref: 14 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.293103:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec400/0x48868a4e43946b89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129735.293112:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43946b90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129735.293116:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43946b90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.293117:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f87de00/0x48868a4e43946b51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd4c expref: 14 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.293124:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43946b90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:0.0:1746129735.293127:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053132800:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129735.293176:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129735.293189:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 532 00000100:00100000:0.0:1746129735.293194:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:1961:x1830949051764096:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129735.293200:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129735.293206:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e43946b97 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.293209:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ce00/0x48868a4e43946b6d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd53 expref: 292 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.293214:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb800/0x48868a4e439469c9 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc42 expref: 292 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.293219:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e43946b97 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.296454:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129735.296466:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e43946b97 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.296475:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e43946b97 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.296483:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e43946b97 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.296488:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129735.296512:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb800/0x48868a4e439469c9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc42 expref: 291 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.296523:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb800/0x48868a4e439469c9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc42 expref: 291 pid: 1851 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746129735.296535:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053132928:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129735.296546:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:1961:x1830949051764096:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3350us (3631us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129735.296552:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 532 00000100:00100000:1.0:1746129735.297092:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801363666c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129735.301965:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053132800:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129735.301982:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129735.302017:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949051764224:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8987us (9117us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129735.302025:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4699 00000100:00100000:0.0:1746129735.302660:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.303971:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1962:x1830949051763712:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21556us (22158us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129735.303977:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3511 00002000:00100000:1.0:1746129735.303983:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88012ba18000 x1830949051763712/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:476/0 lens 488/440 e 0 to 0 dl 1746129746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129735.303990:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba18000 with x1830949051763712 ext(1048576->2097151) 00002000:00010000:1.0:1746129735.303993:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba18000 00000100:00100000:1.0:1746129735.304521:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053132928:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129735.304538:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e43946b97 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:0.0:1746129735.304817:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.304871:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051764736 00000100:00100000:1.0:1746129735.304876:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051764736 00010000:00010000:1.0:1746129735.304893:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb800/0x48868a4e439469c9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc42 expref: 291 pid: 1851 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746129735.304908:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4700 00000100:00100000:1.0:1746129735.304914:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:1962:x1830949051764736:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129735.304922:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129735.304927:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb800/0x48868a4e439469c9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc42 expref: 291 pid: 1851 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746129735.304935:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb800/0x48868a4e439469c9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc42 expref: 291 pid: 1851 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746129735.304951:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb800/0x48868a4e439469c9 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc42 expref: 291 pid: 1851 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746129735.304974:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129735.304978:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e43946b97 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129735.304985:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e43946b97 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129735.304991:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e43946b97 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129735.305004:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129735.305021:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:1962:x1830949051764736:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 107us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129735.305026:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4700 00010000:00010000:1.0:1746129735.305066:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e43946b97 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129735.305071:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e43946b97 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:1.0:1746129735.305103:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:1.0:1746129735.305107:0:16808:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746129735.305117:0:16808:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e43946b97 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129735.305125:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e43946b97 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129735.305132:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec400/0x48868a4e43946b89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129735.305137:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec400/0x48868a4e43946b89 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129735.305141:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec400/0x48868a4e43946b89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129735.305149:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800921ec400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129735.305152:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec400/0x48868a4e43946b89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129735.305157:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec400/0x48868a4e43946b89 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129735.305164:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129735.305166:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129735.305168:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec400/0x48868a4e43946b89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129735.305172:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec400/0x48868a4e43946b89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129735.305180:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43946b90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129735.305184:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43946b90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129735.305188:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43946b90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129735.305191:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800921ed400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129735.305193:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43946b90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129735.305197:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43946b90 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129735.305202:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009b251f00) 00010000:00010000:1.0:1746129735.305204:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129735.305206:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43946b90 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129735.305210:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43946b90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129735.305235:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed200/0x48868a4e43946b82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd68 expref: 8 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.305244:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e43946b97 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd68 expref: 7 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.305249:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129735.305251:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129735.305253:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800921ec800, rc 0) 00000100:00100000:1.0:1746129735.305271:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+7:28102:x1830949051764352:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 12253us (12319us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129735.305276:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9634 00000100:00100000:0.0:1746129735.313345:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.313442:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:1.0:1746129735.313751:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129735.314524:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:1.0:1746129735.316456:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129735.317420:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.317454:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.317485:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.317499:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051765504 00000100:00100000:1.0:1746129735.317503:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051765504 00000100:00100000:1.0:1746129735.317529:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051765760 00000100:00100000:1.0:1746129735.317531:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051765760 00000100:00100000:1.0:1746129735.317555:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9797 00000100:00100000:1.0:1746129735.317561:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+9:1963:x1830949051765504:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129735.317570:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129735.317573:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9799 00000100:00100000:0.0:1746129735.317578:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1963:x1830949051765632:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129735.317580:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800921ed400/0x48868a4e43946bc1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34dd84 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129735.317584:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129735.317589:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b530ae00/0x48868a4e43946bc8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34dd8b expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.317594:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129735.317596:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129735.317601:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800921ed400/0x48868a4e43946bc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd84 expref: 10 pid: 4589 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129735.317606:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053133440:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129735.317611:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800921ed400/0x48868a4e43946bc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd84 expref: 10 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129735.317618:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800921ed400, rc 0) 00000100:00100000:0.0:1746129735.317648:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129735.317908:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+10:1963:x1830949051765504:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 345us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129735.317913:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9797 00000100:00100000:0.0:1746129735.328063:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.328521:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.328547:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051767040 00000100:00100000:1.0:1746129735.328554:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051767040 00000100:00100000:1.0:1746129735.328587:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9635 00000100:00100000:1.0:1746129735.328594:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+7:28102:x1830949051767040:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129735.328610:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129735.328625:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec400/0x48868a4e43946bcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34dda7 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.328708:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed200/0x48868a4e43946bd6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129735.328721:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e43946b97 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd68 expref: 8 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.328730:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed200/0x48868a4e43946bd6 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00000100:00100000:0.0:1746129735.329135:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.329168:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.329183:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129735.330198:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e43946b97 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd68 expref: 8 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.330210:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e43946b97 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd68 expref: 8 pid: 16808 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746129735.330426:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053133824:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129735.330472:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129735.331345:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.331369:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.331398:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051766272 00000100:00100000:0.0:1746129735.331403:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051766272 00002000:00100000:0.0:1746129735.331430:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e8:0x0] (0->634879) req@ffff88009423c700 x1830949051766272/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:476/0 lens 488/0 e 0 to 0 dl 1746129746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129735.331438:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423c700 with x1830949051766272 ext(0->634879) 00002000:00010000:0.0:1746129735.331441:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009423c700 00000100:00100000:1.0:1746129735.331506:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3515 00000100:00100000:1.0:1746129735.331513:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949051766784:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129735.331552:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051767296 00000100:00100000:1.0:1746129735.331555:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051767296 00000100:00100000:1.0:1746129735.331574:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9636 00000100:00100000:1.0:1746129735.331578:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28104:x1830949051767296:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129735.331589:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129735.331599:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba69a00/0x48868a4e43946beb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ddae expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.331681:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68a00/0x48868a4e43946bf2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129735.331692:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68a00/0x48868a4e43946bf2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129735.331712:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68a00/0x48868a4e43946bf2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129735.331724:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68600/0x48868a4e43946bf9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129735.331729:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68600/0x48868a4e43946bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129735.331734:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68600/0x48868a4e43946bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129735.332522:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68800/0x48868a4e43946c00 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129735.332532:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68800/0x48868a4e43946c00 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129735.332538:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68800/0x48868a4e43946c00 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:1.0:1746129735.332546:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129735.332617:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68a00/0x48868a4e43946bf2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129735.332623:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68a00/0x48868a4e43946bf2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129735.332628:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68a00/0x48868a4e43946bf2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129735.332633:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ba68a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129735.332636:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68a00/0x48868a4e43946bf2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129735.332672:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68a00/0x48868a4e43946bf2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129735.332682:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129735.332685:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129735.332688:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68a00/0x48868a4e43946bf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129735.332692:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68a00/0x48868a4e43946bf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129735.332733:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68600/0x48868a4e43946bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129735.332738:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68600/0x48868a4e43946bf9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129735.332743:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68600/0x48868a4e43946bf9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129735.332750:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ba68600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129735.332752:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68600/0x48868a4e43946bf9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129735.332756:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68600/0x48868a4e43946bf9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129735.332762:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009b251b00) 00010000:00010000:1.0:1746129735.332764:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129735.332765:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68600/0x48868a4e43946bf9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129735.332769:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68600/0x48868a4e43946bf9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129735.332803:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba69a00/0x48868a4e43946beb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ddae expref: 17 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.332813:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68800/0x48868a4e43946c00 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ddae expref: 16 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.332819:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129735.332821:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129735.332822:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba68800, rc 0) 00000100:00100000:1.0:1746129735.332842:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28104:x1830949051767296:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1263us (1499us total) trans 8589943381 rc 0/0 00000100:00100000:1.0:1746129735.333195:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9636 00000100:00100000:0.0:1746129735.335203:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fdc7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053133696:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129735.335220:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bd9c800/0x48868a4e43946be4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dda0 expref: 14 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129735.335231:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bd9c800/0x48868a4e43946be4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dda0 expref: 14 pid: 1140 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129735.335295:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129735.335382:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bd9c800, rc 0) 00000100:00100000:0.0:1746129735.335398:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051767424 00000100:00100000:0.0:1746129735.335402:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051767424 00010000:00010000:0.0:1746129735.335424:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e43946b97 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd68 expref: 9 pid: 16808 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746129735.335451:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4701 00000100:00100000:0.0:1746129735.335457:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949051767424:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129735.335467:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129735.335472:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e43946b97 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd68 expref: 9 pid: 16808 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746129735.335487:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e43946b97 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd68 expref: 9 pid: 16808 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746129735.335501:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129735.335505:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed200/0x48868a4e43946bd6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.335513:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed200/0x48868a4e43946bd6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.335518:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed200/0x48868a4e43946bd6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.335531:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129735.335549:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949051767424:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 92us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129735.335553:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4701 00000100:00100000:0.0:1746129735.335574:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1964:x1830949051766144:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6155us (6439us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129735.335579:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9801 00010000:00010000:1.0:1746129735.336277:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e43946b97 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd68 expref: 8 pid: 16808 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746129735.336303:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053133824:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129735.336326:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed200/0x48868a4e43946bd6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129735.336333:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed200/0x48868a4e43946bd6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129735.336338:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed200/0x48868a4e43946bd6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:1.0:1746129735.336357:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129735.336463:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec400/0x48868a4e43946bcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dda7 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.336475:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed200/0x48868a4e43946bd6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dda7 expref: 8 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.336481:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129735.336483:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129735.336485:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800921ed200, rc 0) 00000100:00100000:1.0:1746129735.336502:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:28102:x1830949051767040:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 7908us (7981us total) trans 8589943382 rc 0/0 00000100:00100000:1.0:1746129735.336508:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9635 00000100:00100000:0.0:1746129735.346325:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.346415:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.346459:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051767808 00000100:00100000:0.0:1746129735.346462:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.346466:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051767808 00000100:00100000:1.0:1746129735.346493:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051767680 00000100:00100000:1.0:1746129735.346495:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051767680 00000100:00100000:1.0:1746129735.346514:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9802 00000100:00100000:1.0:1746129735.346520:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1963:x1830949051767808:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129735.346534:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129735.346547:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba68600/0x48868a4e43946c15 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ddbc expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129735.346594:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053133952:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129735.346651:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129735.350926:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051767936 00000100:00100000:1.0:1746129735.350933:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051767936 00000100:00100000:1.0:1746129735.350966:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9637 00000100:00100000:1.0:1746129735.350972:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28102:x1830949051767936:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129735.350988:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129735.351004:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e43946c23 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ddc3 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.351222:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921eda00/0x48868a4e43946c2a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129735.351235:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed200/0x48868a4e43946bd6 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dda7 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.351241:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800921eda00/0x48868a4e43946c2a lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129735.351266:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed200/0x48868a4e43946bd6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dda7 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.351277:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed200/0x48868a4e43946bd6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dda7 expref: 9 pid: 16808 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746129735.351287:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053134208:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129735.351330:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129735.351626:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053133952:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129735.351647:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba68600/0x48868a4e43946c15 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ddbc expref: 14 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129735.351661:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba68600/0x48868a4e43946c15 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ddbc expref: 14 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129735.351681:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba68600, rc 0) 00000100:00100000:0.0:1746129735.351720:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1963:x1830949051767808:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5199us (5304us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129735.351726:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9802 00000100:00100000:1.0:1746129735.362120:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053134208:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129735.362140:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129735.362144:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800921eda00/0x48868a4e43946c2a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129735.362403:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800921eda00/0x48868a4e43946c2a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129735.362409:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800921eda00/0x48868a4e43946c2a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:1.0:1746129735.362444:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:1.0:1746129735.362448:0:14315:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746129735.362460:0:14315:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800921eda00/0x48868a4e43946c2a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129735.362486:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e43946c23 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ddc3 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.362516:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921eda00/0x48868a4e43946c2a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ddc3 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.362522:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129735.362524:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129735.362527:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800921eda00, rc 0) 00000100:00100000:1.0:1746129735.362550:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28102:x1830949051767936:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 11578us (11744us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129735.362556:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9637 00000100:00100000:0.0:1746129735.367089:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.367184:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.367236:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051768192 00000100:00100000:1.0:1746129735.367246:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051768192 00000100:00100000:1.0:1746129735.367283:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9804 00000100:00100000:1.0:1746129735.367289:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+8:1963:x1830949051768192:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129735.367303:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129735.367319:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bd9cc00/0x48868a4e43946c31 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ddca expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129735.367361:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053134464:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129735.367419:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366180 going to sleep for 11 seconds 00002000:00010000:1.0:1746129735.375351:0:1140:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime: 1746129735 -> 1746129736 00000100:00100000:1.0:1746129735.375365:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053134464:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129735.375382:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bd9cc00/0x48868a4e43946c31 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ddca expref: 9 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129735.375392:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bd9cc00/0x48868a4e43946c31 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ddca expref: 9 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129735.375414:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bd9cc00, rc 0) 00000100:00100000:1.0:1746129735.375434:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+8:1963:x1830949051768192:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 8145us (8353us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129735.375439:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9804 00000100:00100000:0.0:1746129735.381658:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.381756:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051768576 00000100:00100000:1.0:1746129735.381763:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051768576 00000100:00100000:1.0:1746129735.381811:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9638 00000100:00100000:1.0:1746129735.381818:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28102:x1830949051768576:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129735.381834:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129735.381876:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ce00/0x48868a4e43946c3f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ddd8 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.381951:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d200/0x48868a4e43946c46 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129735.381964:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d200/0x48868a4e43946c46 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129735.381972:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d200/0x48868a4e43946c46 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129735.381982:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d200/0x48868a4e43946c46 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129735.381987:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d200/0x48868a4e43946c46 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129735.381993:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d200/0x48868a4e43946c46 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129735.381997:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bd9d200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129735.382000:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d200/0x48868a4e43946c46 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129735.382006:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d200/0x48868a4e43946c46 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129735.382014:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129735.382017:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746129735.382020:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d200/0x48868a4e43946c46 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129735.382024:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d200/0x48868a4e43946c46 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129735.382077:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ce00/0x48868a4e43946c3f lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ddd8 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.382083:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ce00/0x48868a4e43946c3f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ddd8 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.382092:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bd9ce00, rc 0) 00000100:00100000:1.0:1746129735.382131:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28102:x1830949051768576:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 314us (481us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129735.382136:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9638 00000100:00100000:0.0:1746129735.387451:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.389604:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.389679:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051769088 00000100:00100000:1.0:1746129735.389684:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051769088 00000100:00100000:1.0:1746129735.389726:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3731 00000100:00100000:1.0:1746129735.389731:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:28101:x1830949051769088:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129735.389904:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:28101:x1830949051769088:12345-192.168.204.31@tcp:35:cat.0 Request processed in 172us (306us total) trans 8589943384 rc 0/0 00000100:00100000:1.0:1746129735.389909:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3731 00000100:00100000:0.0:1746129735.485561:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.494490:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.494562:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051769472 00000100:00100000:1.0:1746129735.494569:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051769472 00000100:00100000:1.0:1746129735.494610:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9806 00000100:00100000:1.0:1746129735.494615:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:28104:x1830949051769472:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129735.494629:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129735.494642:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bd9c400/0x48868a4e43946c70 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34dde6 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.494664:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f77200/0x48868a4e43946913 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dbfc expref: 7 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129735.494671:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f26600/0x48868a4e439469f3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc65 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129735.494677:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009faebe00/0x48868a4e439469a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc34 expref: 23 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129735.494683:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129735.494684:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129735.494687:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bd9c400/0x48868a4e43946c70 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4161536->4194303] (req 4161536->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dde6 expref: 8 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.494719:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009faebe00/0x48868a4e439469a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc34 expref: 23 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129735.494729:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009faebe00/0x48868a4e439469a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc34 expref: 23 pid: 3623 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746129735.494738:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053134592:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129735.494809:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094f26600/0x48868a4e439469f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc65 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129735.494815:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094f26600/0x48868a4e439469f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc65 expref: 8 pid: 8435 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746129735.494822:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053134720:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129735.494838:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f77200/0x48868a4e43946913 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dbfc expref: 7 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129735.494844:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f77200/0x48868a4e43946913 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dbfc expref: 7 pid: 7976 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746129735.494868:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ada680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053134848:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129735.494893:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129735.495922:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.504521:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053134592:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129735.504606:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.504621:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051769856 00000100:00100000:0.0:1746129735.504625:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051769856 00010000:00010000:0.0:1746129735.504644:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009faebe00/0x48868a4e439469a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc34 expref: 24 pid: 3623 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746129735.504662:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4703 00000100:00100000:0.0:1746129735.504667:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949051769856:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129735.504675:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129735.504705:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009faebe00/0x48868a4e439469a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc34 expref: 24 pid: 3623 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746129735.504714:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009faebe00/0x48868a4e439469a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc34 expref: 24 pid: 3623 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746129735.504731:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faebe00/0x48868a4e439469a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc34 expref: 24 pid: 3623 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746129735.504745:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129735.504762:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949051769856:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 94us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129735.504767:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4703 00000100:00100000:1.0:1746129735.504870:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053134720:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129735.504878:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f77200/0x48868a4e43946913 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dbfc expref: 8 pid: 7976 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746129735.504889:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ada680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053134848:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129735.504911:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bd9c400/0x48868a4e43946c70 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [4161536->4194303] (req 4161536->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dde6 expref: 8 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.504919:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bd9c400, rc 0) 00000100:00100000:1.0:1746129735.506145:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28104:x1830949051769472:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 11525us (11657us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129735.506153:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9806 00000100:00100000:0.0:1746129735.515938:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.515977:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.516004:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.516039:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.516061:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051770240 00000100:00100000:0.0:1746129735.516068:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051770240 00000100:00100000:0.0:1746129735.516095:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051770368 00000100:00100000:0.0:1746129735.516097:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051770368 00000100:00100000:0.0:1746129735.516105:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051770496 00000100:00100000:0.0:1746129735.516106:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051770496 00000100:00100000:0.0:1746129735.516117:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9807 00000100:00100000:0.0:1746129735.516122:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949051770240:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129735.516136:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129735.516156:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b530ae00/0x48868a4e43946c77 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34dded expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129735.516268:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053134976:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129735.516330:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129735.516348:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9808 00000100:00100000:0.0:1746129735.516353:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949051770368:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129735.516359:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129735.516368:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba69a00/0x48868a4e43946c7e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ddf4 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129735.516386:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053135104:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129735.516401:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129735.516747:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9809 00000100:00100000:1.0:1746129735.516754:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949051770496:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129735.516761:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129735.516767:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bd9c800/0x48868a4e43946c85 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ddfb expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.516777:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129735.516785:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bd9c800/0x48868a4e43946c85 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ddfb expref: 11 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129735.516793:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bd9c800/0x48868a4e43946c85 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ddfb expref: 11 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129735.516816:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bd9c800, rc 0) 00000100:00100000:1.0:1746129735.516837:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949051770496:12345-192.168.204.31@tcp:101:cat.0 Request processed in 84us (797us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129735.516867:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9809 00000100:00100000:0.0:1746129735.519592:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053134976:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129735.519613:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b530ae00/0x48868a4e43946c77 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dded expref: 9 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129735.519623:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b530ae00/0x48868a4e43946c77 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dded expref: 9 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129735.520871:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b530ae00, rc 0) 00000100:00100000:0.0:1746129735.521399:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1962:x1830949051770240:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5274us (5418us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129735.521406:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9807 00000100:00100000:0.0:1746129735.524197:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051770752 00000100:00100000:0.0:1746129735.524203:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051770752 00002000:00100000:0.0:1746129735.524237:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4161536->4165631) req@ffff88009fdc6a00 x1830949051770752/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:476/0 lens 488/0 e 0 to 0 dl 1746129746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129735.524246:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fdc6a00 with x1830949051770752 ext(4161536->4165631) 00002000:00010000:0.0:1746129735.524251:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fdc6a00 00000100:00100000:0.0:1746129735.524265:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3516 00000100:00100000:0.0:1746129735.524272:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fdc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1961:x1830949051770752:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129735.524434:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fdc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1961:x1830949051770752:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 163us (326us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129735.524440:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3516 00002000:00100000:0.0:1746129735.524445:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4161536->4165631) req@ffff88009fdc6a00 x1830949051770752/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:476/0 lens 488/4536 e 0 to 0 dl 1746129746 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129735.524451:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fdc6a00 with x1830949051770752 ext(4161536->4165631) 00002000:00010000:0.0:1746129735.524454:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fdc6a00 00000100:00100000:0.0:1746129735.526912:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.528784:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051771136 00000100:00100000:0.0:1746129735.528789:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051771136 00000100:00100000:0.0:1746129735.528828:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9640 00000100:00100000:0.0:1746129735.528833:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fdc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:28115:x1830949051771136:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129735.528859:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129735.528871:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68600/0x48868a4e43946c93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34de09 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129735.528950:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68800/0x48868a4e43946c9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.528959:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68800/0x48868a4e43946c9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.528970:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68800/0x48868a4e43946c9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.529029:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba69600/0x48868a4e43946ca1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.529034:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba69600/0x48868a4e43946ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.529040:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba69600/0x48868a4e43946ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.529119:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba69400/0x48868a4e43946ca8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.529127:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba69400/0x48868a4e43946ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.529132:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba69400/0x48868a4e43946ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:0.0:1746129735.529139:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129735.529198:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68800/0x48868a4e43946c9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.529203:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68800/0x48868a4e43946c9a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.529208:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68800/0x48868a4e43946c9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.529213:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ba68800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129735.529216:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68800/0x48868a4e43946c9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.529222:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68800/0x48868a4e43946c9a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.529230:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:0.0:1746129735.529233:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129735.529236:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68800/0x48868a4e43946c9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.529240:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68800/0x48868a4e43946c9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.529249:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba69600/0x48868a4e43946ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.529253:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba69600/0x48868a4e43946ca1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.529258:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba69600/0x48868a4e43946ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.529262:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ba69600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129735.529263:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba69600/0x48868a4e43946ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.529268:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba69600/0x48868a4e43946ca1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.529272:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012bfcaf00) 00010000:00010000:0.0:1746129735.529274:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129735.529276:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba69600/0x48868a4e43946ca1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.529280:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba69600/0x48868a4e43946ca1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129735.529306:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68600/0x48868a4e43946c93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de09 expref: 295 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129735.529314:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba69400/0x48868a4e43946ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de09 expref: 294 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129735.529320:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129735.529321:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129735.529323:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba69400, rc 0) 00000100:00100000:0.0:1746129735.529399:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fdc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:28115:x1830949051771136:12345-192.168.204.31@tcp:101:cat.0 Request processed in 564us (1521us total) trans 8589943387 rc 0/0 00000100:00100000:0.0:1746129735.529405:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9640 00000100:00100000:1.0:1746129735.529799:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051771264 00000100:00100000:1.0:1746129735.529803:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051771264 00000100:00100000:1.0:1746129735.529824:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9811 00000100:00100000:1.0:1746129735.529829:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fdc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28104:x1830949051771264:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129735.529836:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129735.529844:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bd9cc00/0x48868a4e43946cb6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34de10 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.529881:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fe28a00/0x48868a4e439468fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc03 expref: 7 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129735.529888:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b534d000/0x48868a4e439469e5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc6c expref: 14 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129735.529895:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fe28e00/0x48868a4e439469bb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc3b expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129735.529900:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129735.529901:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129735.529903:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bd9cc00/0x48868a4e43946cb6 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->4083711] (req 3145728->4083711) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de10 expref: 14 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.529927:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fe28e00/0x48868a4e439469bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc3b expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129735.529935:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fe28e00/0x48868a4e439469bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc3b expref: 12 pid: 8436 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746129735.529944:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ada680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053135488:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129735.529985:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b534d000/0x48868a4e439469e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc6c expref: 14 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129735.529991:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b534d000/0x48868a4e439469e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc6c expref: 14 pid: 8435 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746129735.529998:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053135616:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129735.530018:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fe28a00/0x48868a4e439468fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc03 expref: 7 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129735.530025:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fe28a00/0x48868a4e439468fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc03 expref: 7 pid: 4589 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746129735.530032:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053135744:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129735.530046:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129735.532875:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.533139:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ada680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053135488:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129735.533151:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053135616:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129735.533158:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053135744:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129735.533183:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bd9cc00/0x48868a4e43946cb6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->4083711] (req 3145728->4083711) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de10 expref: 14 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.533194:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bd9cc00, rc 0) 00000100:00100000:1.0:1746129735.535836:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fdc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28104:x1830949051771264:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5996us (6183us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129735.535856:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9811 00000100:00100000:0.0:1746129735.538045:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.539255:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.551036:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.551061:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051772160 00000100:00100000:0.0:1746129735.551066:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051772160 00010000:00010000:0.0:1746129735.551090:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b534d000/0x48868a4e439469e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc6c expref: 14 pid: 8435 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746129735.551111:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4708 00000100:00100000:0.0:1746129735.551117:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949051772160:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129735.551129:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129735.551146:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b534d000/0x48868a4e439469e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc6c expref: 14 pid: 8435 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746129735.551160:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b534d000/0x48868a4e439469e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc6c expref: 14 pid: 8435 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746129735.551178:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b534d000/0x48868a4e439469e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc6c expref: 14 pid: 8435 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746129735.551199:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129735.551201:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129735.551206:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bd9cc00/0x48868a4e43946cb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4083711) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de10 expref: 13 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129735.551213:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bd9cc00/0x48868a4e43946cb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4083711) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de10 expref: 13 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129735.551240:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bd9cc00/0x48868a4e43946cb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4083711) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de10 expref: 13 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129735.551250:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053136128:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129735.551294:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68300 going to sleep for 11 seconds 00000100:00100000:1.0:1746129735.557642:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.558390:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051772416 00000100:00100000:0.0:1746129735.558395:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051772416 00000100:00100000:0.0:1746129735.558428:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9641 00000100:00100000:0.0:1746129735.558433:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:28117:x1830949051772416:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129735.558445:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129735.558454:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68800/0x48868a4e43946cd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34de2c expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129735.558519:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68a00/0x48868a4e43946ce0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129735.558530:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921eda00/0x48868a4e43946c2a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ddc3 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129735.558536:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e43946c62 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dddf expref: 17 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129735.558541:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba69400/0x48868a4e43946ca8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de09 expref: 295 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129735.558546:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68a00/0x48868a4e43946ce0 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129735.558566:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba69400/0x48868a4e43946ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de09 expref: 295 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129735.558574:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba69400/0x48868a4e43946ca8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de09 expref: 295 pid: 16808 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746129735.558584:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053136256:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129735.558633:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e43946c62 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dddf expref: 17 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129735.558640:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e43946c62 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dddf expref: 17 pid: 16808 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746129735.558651:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053136384:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129735.558672:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800921eda00/0x48868a4e43946c2a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ddc3 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129735.558679:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921eda00/0x48868a4e43946c2a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ddc3 expref: 8 pid: 14315 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746129735.558685:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053136512:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129735.558706:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129735.578345:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.579249:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.579943:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051773312 00000100:00100000:1.0:1746129735.579947:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051773312 00010000:00010000:1.0:1746129735.579963:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800921eda00/0x48868a4e43946c2a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ddc3 expref: 9 pid: 14315 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746129735.579988:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4710 00000100:00100000:1.0:1746129735.579993:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:1963:x1830949051773312:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129735.580001:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129735.580005:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800921eda00/0x48868a4e43946c2a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ddc3 expref: 9 pid: 14315 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746129735.580014:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800921eda00/0x48868a4e43946c2a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ddc3 expref: 9 pid: 14315 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746129735.580031:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921eda00/0x48868a4e43946c2a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ddc3 expref: 9 pid: 14315 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746129735.580058:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129735.580062:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68a00/0x48868a4e43946ce0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129735.580070:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68a00/0x48868a4e43946ce0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129735.580075:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129735.580091:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:1963:x1830949051773312:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 98us (1749us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129735.580097:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4710 00000100:00100000:0.0:1746129735.581204:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.582625:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.583755:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.583768:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051773824 00000100:00100000:0.0:1746129735.583770:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051773824 00002000:00100000:0.0:1746129735.583792:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e8:0x0] (557056->1048575) req@ffff88009468fb80 x1830949051773824/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:476/0 lens 488/0 e 0 to 0 dl 1746129746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129735.583800:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468fb80 with x1830949051773824 ext(557056->1048575) 00002000:00010000:0.0:1746129735.583804:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468fb80 00000100:00100000:0.0:1746129735.583815:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3518 00000100:00100000:0.0:1746129735.583820:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949051773824:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129735.584337:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.584351:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051774080 00000100:00100000:0.0:1746129735.584354:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051774080 00002000:00100000:0.0:1746129735.584366:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009468d880 x1830949051774080/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:476/0 lens 488/0 e 0 to 0 dl 1746129746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129735.584373:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468d880 with x1830949051774080 ext(0->1048575) 00002000:00010000:0.0:1746129735.584376:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468d880 00000100:00100000:0.0:1746129735.584384:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3519 00000100:00100000:0.0:1746129735.584388:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1962:x1830949051774080:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129735.586525:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4711 00000100:00100000:1.0:1746129735.586534:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:1962:x1830949051773056:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129735.586544:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129735.586551:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba69400/0x48868a4e43946ca8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de09 expref: 296 pid: 16808 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746129735.586560:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba69400/0x48868a4e43946ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de09 expref: 296 pid: 16808 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746129735.586577:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba69400/0x48868a4e43946ca8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de09 expref: 296 pid: 16808 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746129735.586588:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129735.586592:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68a00/0x48868a4e43946ce0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129735.586602:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68a00/0x48868a4e43946ce0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129735.586606:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129735.586646:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:1962:x1830949051773056:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 113us (5444us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129735.586651:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4711 00000100:00100000:1.0:1746129735.586667:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4712 00000100:00100000:1.0:1746129735.586671:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949051773184:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129735.586677:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129735.586681:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e43946c62 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dddf expref: 19 pid: 16808 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746129735.586688:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e43946c62 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dddf expref: 19 pid: 16808 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746129735.586706:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e43946c62 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dddf expref: 19 pid: 16808 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746129735.586714:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129735.586717:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68a00/0x48868a4e43946ce0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129735.586722:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68a00/0x48868a4e43946ce0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129735.586728:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68a00/0x48868a4e43946ce0 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129735.586747:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129735.586760:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949051773184:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 89us (4138us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129735.586766:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4712 00010000:00010000:1.0:1746129735.586782:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68a00/0x48868a4e43946ce0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129735.586788:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68a00/0x48868a4e43946ce0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:1.0:1746129735.586800:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129735.586921:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68800/0x48868a4e43946cd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de2c expref: 296 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.586932:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba68a00/0x48868a4e43946ce0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de2c expref: 295 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.586938:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129735.586940:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129735.586942:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba68a00, rc 0) 00000100:00100000:1.0:1746129735.586969:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:28117:x1830949051772416:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 28536us (29328us total) trans 8589943389 rc 0/0 00000100:00100000:1.0:1746129735.586974:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9641 00000100:00100000:1.0:1746129735.594180:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949051773824:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10351us (10417us total) trans 0 rc 491520/491520 00000100:00100000:1.0:1746129735.594189:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3518 00002000:00100000:1.0:1746129735.594198:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e8:0x0] (557056->1048575) req@ffff88009468fb80 x1830949051773824/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:476/0 lens 488/440 e 0 to 0 dl 1746129746 ref 1 fl Complete:/200/0 rc 491520/491520 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129735.594212:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468fb80 with x1830949051773824 ext(557056->1048575) 00002000:00010000:1.0:1746129735.594217:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468fb80 00000100:00100000:0.0:1746129735.602151:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1962:x1830949051774080:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17751us (17803us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129735.602162:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3519 00002000:00100000:0.0:1746129735.602172:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009468d880 x1830949051774080/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:476/0 lens 488/440 e 0 to 0 dl 1746129746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129735.602180:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468d880 with x1830949051774080 ext(0->1048575) 00002000:00010000:0.0:1746129735.602185:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468d880 00000100:00100000:0.0:1746129735.611266:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.615424:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.622408:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00010000:0.0:1746129735.622794:0:7976:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime: 1746129733 -> 1746129736 00002000:00010000:0.0:1746129735.622798:0:7976:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746129733 -> 1746129736 00002000:00010000:0.0:1746129735.622799:0:7976:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime: 1746129733 -> 1746129736 00000100:00100000:0.0:1746129735.622814:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fdc5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053137024:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129735.622835:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f9bda00/0x48868a4e43946cf5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de41 expref: 13 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129735.622866:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bda00/0x48868a4e43946cf5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de41 expref: 13 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129735.623335:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9bda00, rc 0) 00000100:00100000:0.0:1746129735.629182:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.629241:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.629831:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051774720 00000100:00100000:1.0:1746129735.629835:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051774720 00002000:00100000:1.0:1746129735.629873:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1245183) req@ffff88009468ea00 x1830949051774720/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:476/0 lens 488/0 e 0 to 0 dl 1746129746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129735.629881:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468ea00 with x1830949051774720 ext(1048576->1245183) 00010000:00010000:1.0:1746129735.629886:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f87de00/0x48868a4e43946b51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd4c expref: 12 pid: 1140 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746129735.629894:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f87de00/0x48868a4e43946b51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd4c expref: 12 pid: 1140 timeout: 781 lvb_type: 0 00002000:00010000:1.0:1746129735.629899:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009468ea00 00000100:00100000:1.0:1746129735.629921:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 448 00000100:00100000:1.0:1746129735.629926:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+12:1961:x1830949051774720:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129735.634929:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.642111:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949051774720:12345-192.168.204.31@tcp:4:cat.0 Request processed in 12180us (12864us total) trans 21474840066 rc 0/0 00000100:00100000:1.0:1746129735.642121:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 448 00002000:00100000:1.0:1746129735.642128:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1245183) req@ffff88009468ea00 x1830949051774720/t21474840066(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:476/0 lens 488/448 e 0 to 0 dl 1746129746 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129735.642136:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468ea00 with x1830949051774720 ext(1048576->1245183) 00010000:00010000:1.0:1746129735.642144:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f87de00/0x48868a4e43946b51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd4c expref: 14 pid: 1140 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746129735.642153:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f87de00/0x48868a4e43946b51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd4c expref: 14 pid: 1140 timeout: 781 lvb_type: 0 00002000:00010000:1.0:1746129735.642159:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009468ea00 00000100:00100000:0.0:1746129735.654248:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.654293:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.663719:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.668775:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.687120:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.697439:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.718186:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.718244:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.719121:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.719225:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051776384 00000100:00100000:0.0:1746129735.719228:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051776384 00000100:00100000:0.0:1746129735.719249:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9642 00000100:00100000:0.0:1746129735.719253:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28120:x1830949051776384:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129735.719263:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129735.719271:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5ee00/0x48868a4e43946d1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34de6b expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129735.719332:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5fa00/0x48868a4e43946d26 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129735.719341:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5fa00/0x48868a4e43946d26 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129735.719348:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5fa00/0x48868a4e43946d26 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:0.0:1746129735.719356:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129735.719422:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5ee00/0x48868a4e43946d1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de6b expref: 21 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129735.719436:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5fa00/0x48868a4e43946d26 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de6b expref: 20 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129735.719442:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129735.719444:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129735.719447:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be5fa00, rc 0) 00000100:00100000:0.0:1746129735.719463:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:28120:x1830949051776384:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 210us (343us total) trans 8589943390 rc 0/0 00000100:00100000:0.0:1746129735.719468:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9642 00000100:00100000:0.0:1746129735.726273:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.726305:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.726329:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.726353:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.726413:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051776512 00000100:00100000:1.0:1746129735.726420:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051776512 00010000:00010000:1.0:1746129735.726443:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff98400/0x48868a4e43946bb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd7d expref: 7 pid: 20441 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746129735.726460:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051776640 00000100:00100000:1.0:1746129735.726461:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051776640 00010000:00010000:1.0:1746129735.726469:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131849000/0x48868a4e43946a5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dcc7 expref: 15 pid: 3623 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746129735.726480:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051776896 00000100:00100000:1.0:1746129735.726481:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051776896 00010000:00010000:1.0:1746129735.726487:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5217800/0x48868a4e43946a86 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dcdc expref: 16 pid: 3623 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746129735.726499:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4715 00000100:00100000:1.0:1746129735.726504:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+7:1961:x1830949051776512:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129735.726515:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129735.726533:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ff98400/0x48868a4e43946bb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd7d expref: 7 pid: 20441 timeout: 781 lvb_type: 1 00010000:00010000:1.0:1746129735.726542:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ff98400/0x48868a4e43946bb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd7d expref: 7 pid: 20441 timeout: 781 lvb_type: 1 00010000:00010000:1.0:1746129735.726559:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ff98400/0x48868a4e43946bb3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd7d expref: 7 pid: 20441 timeout: 781 lvb_type: 1 00010000:00010000:1.0:1746129735.726576:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129735.726605:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+6:1961:x1830949051776512:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 100us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129735.726610:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4715 00000100:00100000:1.0:1746129735.726634:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4716 00000100:00100000:1.0:1746129735.726638:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949051776640:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129735.726643:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129735.726649:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131849000/0x48868a4e43946a5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dcc7 expref: 15 pid: 3623 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746129735.726656:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131849000/0x48868a4e43946a5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dcc7 expref: 15 pid: 3623 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746129735.726665:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131849000/0x48868a4e43946a5c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dcc7 expref: 15 pid: 3623 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746129735.726672:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129735.726684:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949051776640:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 45us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129735.726689:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4716 00000100:00100000:1.0:1746129735.726711:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4717 00000100:00100000:1.0:1746129735.726716:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1961:x1830949051776896:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129735.726722:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129735.726728:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b5217800/0x48868a4e43946a86 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dcdc expref: 16 pid: 3623 timeout: 781 lvb_type: 1 00010000:00010000:1.0:1746129735.726734:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b5217800/0x48868a4e43946a86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dcdc expref: 16 pid: 3623 timeout: 781 lvb_type: 1 00010000:00010000:1.0:1746129735.726744:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5217800/0x48868a4e43946a86 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dcdc expref: 16 pid: 3623 timeout: 781 lvb_type: 1 00010000:00010000:1.0:1746129735.726751:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129735.726752:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129735.726757:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bd800/0x48868a4e43946d18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de64 expref: 13 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.726764:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9bd800/0x48868a4e43946d18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de64 expref: 13 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.726788:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9bd800/0x48868a4e43946d18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de64 expref: 13 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129735.726798:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053138176:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129735.726841:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129735.734089:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.734289:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053138176:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129735.734306:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129735.734350:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1961:x1830949051776896:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7632us (7995us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129735.734359:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4717 00000100:00100000:1.0:1746129735.734397:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051777152 00000100:00100000:1.0:1746129735.734402:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051777152 00010000:00010000:1.0:1746129735.734420:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bd9cc00/0x48868a4e43946cb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4083711) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de10 expref: 15 pid: 8435 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746129735.734438:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4718 00000100:00100000:1.0:1746129735.734443:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949051777152:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129735.734452:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129735.734469:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bd9cc00/0x48868a4e43946cb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4083711) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de10 expref: 15 pid: 8435 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746129735.734479:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bd9cc00/0x48868a4e43946cb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4083711) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de10 expref: 15 pid: 8435 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746129735.734499:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bd9cc00/0x48868a4e43946cb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4083711) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de10 expref: 15 pid: 8435 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746129735.734515:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129735.734517:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129735.734522:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bd600/0x48868a4e43946d0a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de56 expref: 13 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.734535:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9bd600/0x48868a4e43946d0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de56 expref: 13 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.734558:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9bd600/0x48868a4e43946d0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de56 expref: 13 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129735.734568:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053138304:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129735.734609:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129735.738413:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.759556:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.759578:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.759597:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.759619:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.759637:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051777664 00000100:00100000:0.0:1746129735.759643:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051777664 00002000:00100000:0.0:1746129735.759677:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009adad500 x1830949051777664/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:476/0 lens 488/0 e 0 to 0 dl 1746129746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129735.759686:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adad500 with x1830949051777664 ext(2097152->3145727) 00002000:00010000:0.0:1746129735.759699:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adad500 00000100:00100000:0.0:1746129735.759713:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051778048 00000100:00100000:0.0:1746129735.759715:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051778048 00002000:00100000:0.0:1746129735.759723:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009adad880 x1830949051778048/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:476/0 lens 488/0 e 0 to 0 dl 1746129746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129735.759729:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adad880 with x1830949051778048 ext(3145728->4194303) 00002000:00010000:0.0:1746129735.759731:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adad880 00000100:00100000:0.0:1746129735.759737:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051778304 00000100:00100000:0.0:1746129735.759738:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051778304 00002000:00100000:0.0:1746129735.759747:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009adadc00 x1830949051778304/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:476/0 lens 488/0 e 0 to 0 dl 1746129746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129735.759752:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adadc00 with x1830949051778304 ext(3145728->4194303) 00002000:00010000:0.0:1746129735.759755:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adadc00 00000100:00100000:0.0:1746129735.759763:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3524 00000100:00100000:0.0:1746129735.759768:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1963:x1830949051777664:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129735.760917:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3525 00000100:00100000:0.0:1746129735.760925:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1963:x1830949051778048:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129735.761868:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3526 00000100:00100000:0.0:1746129735.761877:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949051778304:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129735.764373:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053138304:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129735.764389:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129735.764424:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949051777152:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 29981us (30342us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129735.764431:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4718 00000100:00100000:1.0:1746129735.778770:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1963:x1830949051777664:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 18999us (19218us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129735.778778:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3524 00002000:00100000:1.0:1746129735.778785:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009adad500 x1830949051777664/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:476/0 lens 488/440 e 0 to 0 dl 1746129746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129735.778793:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adad500 with x1830949051777664 ext(2097152->3145727) 00002000:00010000:1.0:1746129735.778797:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adad500 00000100:00100000:0.0:1746129735.786470:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.790966:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051778816 00000100:00100000:1.0:1746129735.790973:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051778816 00002000:00100000:1.0:1746129735.791007:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009adac380 x1830949051778816/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:476/0 lens 488/0 e 0 to 0 dl 1746129746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129735.791021:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adac380 with x1830949051778816 ext(2097152->3145727) 00002000:00010000:1.0:1746129735.791025:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adac380 00000100:00100000:1.0:1746129735.791040:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3527 00000100:00100000:1.0:1746129735.791045:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1961:x1830949051778816:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129735.796915:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1963:x1830949051778048:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 35989us (37314us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129735.796923:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3525 00002000:00100000:0.0:1746129735.796932:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009adad880 x1830949051778048/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:476/0 lens 488/440 e 0 to 0 dl 1746129746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129735.796946:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adad880 with x1830949051778048 ext(3145728->4194303) 00002000:00010000:0.0:1746129735.796950:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adad880 00000100:00100000:0.0:1746129735.796962:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051778944 00000100:00100000:0.0:1746129735.796965:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051778944 00002000:00100000:0.0:1746129735.796981:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009a04ed80 x1830949051778944/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:476/0 lens 488/0 e 0 to 0 dl 1746129746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129735.796987:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04ed80 with x1830949051778944 ext(3145728->4194303) 00002000:00010000:0.0:1746129735.796989:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a04ed80 00000100:00100000:0.0:1746129735.796999:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051779200 00000100:00100000:0.0:1746129735.797001:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051779200 00002000:00100000:0.0:1746129735.797010:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009a04c000 x1830949051779200/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:476/0 lens 488/0 e 0 to 0 dl 1746129746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129735.797016:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04c000 with x1830949051779200 ext(3145728->4194303) 00002000:00010000:0.0:1746129735.797018:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04c000 00000100:00100000:0.0:1746129735.797028:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3528 00000100:00100000:0.0:1746129735.797034:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949051778944:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129735.804392:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949051778304:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 42510us (44765us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129735.804402:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3526 00002000:00100000:1.0:1746129735.804411:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009adadc00 x1830949051778304/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:476/0 lens 488/440 e 0 to 0 dl 1746129746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129735.804419:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adadc00 with x1830949051778304 ext(3145728->4194303) 00002000:00010000:1.0:1746129735.804423:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adadc00 00000100:00100000:1.0:1746129735.809766:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949051778816:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18712us (23296us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129735.809776:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3527 00002000:00100000:1.0:1746129735.809787:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009adac380 x1830949051778816/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:476/0 lens 488/440 e 0 to 0 dl 1746129746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129735.809795:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adac380 with x1830949051778816 ext(2097152->3145727) 00002000:00010000:1.0:1746129735.809799:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adac380 00000100:00100000:0.0:1746129735.822635:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.822674:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.827013:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051779840 00000100:00100000:0.0:1746129735.827024:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051779840 00002000:00100000:0.0:1746129735.827059:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1523712->1527807) req@ffff88009adaed80 x1830949051779840/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:476/0 lens 488/0 e 0 to 0 dl 1746129746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129735.827068:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adaed80 with x1830949051779840 ext(1523712->1527807) 00002000:00010000:0.0:1746129735.827074:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adaed80 00000100:00100000:0.0:1746129735.827093:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3530 00000100:00100000:0.0:1746129735.827100:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949051779840:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129735.827211:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949051779840:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 112us (4584us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129735.827216:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3530 00002000:00100000:0.0:1746129735.827221:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1523712->1527807) req@ffff88009adaed80 x1830949051779840/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:476/0 lens 488/4536 e 0 to 0 dl 1746129746 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129735.827227:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adaed80 with x1830949051779840 ext(1523712->1527807) 00002000:00010000:0.0:1746129735.827230:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adaed80 00000100:00100000:1.0:1746129735.828296:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1961:x1830949051778944:12345-192.168.204.31@tcp:3:cat.0 Request processed in 31257us (31753us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129735.828304:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3528 00002000:00100000:1.0:1746129735.828311:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009a04ed80 x1830949051778944/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:476/0 lens 488/440 e 0 to 0 dl 1746129746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129735.828319:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04ed80 with x1830949051778944 ext(3145728->4194303) 00002000:00010000:1.0:1746129735.828323:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a04ed80 00000100:00100000:0.0:1746129735.840124:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.840160:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.840194:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.840224:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051780480 00000100:00100000:0.0:1746129735.840231:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051780480 00002000:00100000:0.0:1746129735.840263:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88012c040700 x1830949051780480/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:476/0 lens 488/0 e 0 to 0 dl 1746129746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129735.840272:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c040700 with x1830949051780480 ext(4194304->4964351) 00002000:00010000:0.0:1746129735.840276:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c040700 00000100:00100000:0.0:1746129735.840303:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3531 00000100:00100000:0.0:1746129735.840308:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949051780480:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129735.841034:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9827 00000100:00100000:0.0:1746129735.841040:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949051780224:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129735.841047:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129735.841058:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bab8800/0x48868a4e43946d49 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34de8e expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129735.841091:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c043100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053138944:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129735.841151:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129735.855047:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949051780480:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14728us (14842us total) trans 0 rc 770048/770048 00000100:00100000:1.0:1746129735.855058:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3531 00002000:00100000:1.0:1746129735.855067:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88012c040700 x1830949051780480/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:476/0 lens 488/440 e 0 to 0 dl 1746129746 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129735.855075:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c040700 with x1830949051780480 ext(4194304->4964351) 00002000:00010000:1.0:1746129735.855080:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c040700 00000100:00100000:0.0:1746129735.855833:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.855899:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051780736 00000100:00100000:1.0:1746129735.855905:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051780736 00002000:00100000:1.0:1746129735.855935:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88012c042a00 x1830949051780736/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:476/0 lens 488/0 e 0 to 0 dl 1746129746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129735.855942:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c042a00 with x1830949051780736 ext(4194304->4964351) 00002000:00010000:1.0:1746129735.855945:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c042a00 00000100:00100000:1.0:1746129735.855970:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3532 00000100:00100000:1.0:1746129735.855976:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1961:x1830949051780736:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129735.862134:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.863035:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1961:x1830949051780736:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7057us (7202us total) trans 0 rc 770048/770048 00000100:00100000:1.0:1746129735.863042:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3532 00002000:00100000:1.0:1746129735.863049:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88012c042a00 x1830949051780736/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:476/0 lens 488/440 e 0 to 0 dl 1746129746 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129735.863057:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c042a00 with x1830949051780736 ext(4194304->4964351) 00002000:00010000:1.0:1746129735.863062:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c042a00 00000100:00100000:0.0:1746129735.876031:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.876081:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.891111:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.892057:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.943284:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.948181:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.949947:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.952002:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.952067:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051782144 00000100:00100000:1.0:1746129735.952072:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051782144 00002000:00100000:1.0:1746129735.952101:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2830336->2834431) req@ffff880131460e00 x1830949051782144/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:476/0 lens 488/0 e 0 to 0 dl 1746129746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129735.952109:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131460e00 with x1830949051782144 ext(2830336->2834431) 00002000:00010000:1.0:1746129735.952113:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131460e00 00000100:00100000:1.0:1746129735.952138:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3533 00000100:00100000:1.0:1746129735.952143:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949051782144:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129735.952279:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949051782144:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 135us (279us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129735.952285:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3533 00002000:00100000:1.0:1746129735.952290:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2830336->2834431) req@ffff880131460e00 x1830949051782144/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:476/0 lens 488/4536 e 0 to 0 dl 1746129746 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129735.952297:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131460e00 with x1830949051782144 ext(2830336->2834431) 00002000:00010000:1.0:1746129735.952299:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131460e00 00000100:00100000:0.0:1746129735.956382:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.964699:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129735.964743:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129735.964874:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051782528 00000100:00100000:1.0:1746129735.964882:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051782528 00010000:00010000:1.0:1746129735.964909:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9bc600/0x48868a4e43946d03 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de4f expref: 26 pid: 7976 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746129735.964994:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051782400 00000100:00100000:1.0:1746129735.964997:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051782400 00010000:00010000:1.0:1746129735.965007:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9bca00/0x48868a4e43946d11 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de5d expref: 10 pid: 4589 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746129735.965026:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4724 00000100:00100000:1.0:1746129735.965032:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949051782528:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129735.965044:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129735.965063:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f9bc600/0x48868a4e43946d03 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de4f expref: 26 pid: 7976 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746129735.965072:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f9bc600/0x48868a4e43946d03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de4f expref: 26 pid: 7976 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746129735.965090:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f9bc600/0x48868a4e43946d03 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de4f expref: 26 pid: 7976 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746129735.965312:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129735.965314:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129735.965320:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800945cfa00/0x48868a4e43946d7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34deb8 expref: 9 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.965326:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800945cfa00/0x48868a4e43946d7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34deb8 expref: 9 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129735.965351:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800945cfa00/0x48868a4e43946d7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34deb8 expref: 9 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129735.965359:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053140352:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129735.966454:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801363660c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129735.969467:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053140352:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129735.969489:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129735.969523:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949051782528:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4490us (4842us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129735.969531:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4724 00000100:00100000:0.0:1746129735.978074:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.009746:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.009805:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051783040 00000100:00100000:1.0:1746129736.009813:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051783040 00000100:00100000:1.0:1746129736.009865:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9643 00000100:00100000:1.0:1746129736.009874:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:28128:x1830949051783040:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129736.009893:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129736.009908:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5200/0x48868a4e43946d81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34debf expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.010007:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4400/0x48868a4e43946d88 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.010017:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4400/0x48868a4e43946d88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.010026:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4400/0x48868a4e43946d88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.010037:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4600/0x48868a4e43946d8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.010043:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4600/0x48868a4e43946d8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.010048:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4600/0x48868a4e43946d8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.010130:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e43946d96 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.010138:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e43946d96 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.010144:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e43946d96 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:1.0:1746129736.010152:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129736.010217:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4400/0x48868a4e43946d88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.010223:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4400/0x48868a4e43946d88 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.010228:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4400/0x48868a4e43946d88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.010233:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b22c4400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129736.010237:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4400/0x48868a4e43946d88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.010242:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4400/0x48868a4e43946d88 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.010252:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129736.010254:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129736.010257:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4400/0x48868a4e43946d88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.010261:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4400/0x48868a4e43946d88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.010283:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4600/0x48868a4e43946d8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.010291:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4600/0x48868a4e43946d8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.010295:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4600/0x48868a4e43946d8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.010299:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b22c4600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129736.010301:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4600/0x48868a4e43946d8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.010305:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4600/0x48868a4e43946d8f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.010310:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009b251f00) 00010000:00010000:1.0:1746129736.010312:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129736.010314:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4600/0x48868a4e43946d8f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.010319:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4600/0x48868a4e43946d8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.010353:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5200/0x48868a4e43946d81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34debf expref: 299 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.010369:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e43946d96 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34debf expref: 298 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.010374:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129736.010376:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129736.010377:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b22c4000, rc 0) 00000100:00100000:1.0:1746129736.010413:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:28128:x1830949051783040:12345-192.168.204.31@tcp:101:cat.0 Request processed in 541us (674us total) trans 8589943392 rc 0/0 00000100:00100000:1.0:1746129736.010419:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9643 00000100:00100000:0.0:1746129736.023204:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.023229:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.023257:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.023303:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051783168 00000100:00100000:0.0:1746129736.023310:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051783168 00000100:00100000:0.0:1746129736.023345:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051783296 00000100:00100000:0.0:1746129736.023347:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051783296 00000100:00100000:0.0:1746129736.023366:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9834 00000100:00100000:0.0:1746129736.023373:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949051783168:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129736.023390:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129736.023404:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135677600/0x48868a4e43946da4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34dec6 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129736.023445:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053140480:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129736.023511:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129736.023525:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9835 00000100:00100000:0.0:1746129736.023530:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949051783296:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129736.023537:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129736.023546:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135676800/0x48868a4e43946dab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34decd expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129736.023569:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053140608:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129736.023589:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129736.023717:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051783424 00000100:00100000:1.0:1746129736.023721:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051783424 00000100:00100000:1.0:1746129736.023747:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 534 00000100:00100000:1.0:1746129736.023752:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:1962:x1830949051783424:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129736.023760:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129736.023776:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e43946d96 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34debf expref: 298 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.023800:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129736.023803:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129736.023826:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:1962:x1830949051783424:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 73us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129736.023832:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 534 00000100:00100000:0.0:1746129736.031899:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053140480:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129736.031933:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135677600/0x48868a4e43946da4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dec6 expref: 26 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129736.031946:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135677600/0x48868a4e43946da4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dec6 expref: 26 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129736.031960:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135677600, rc 0) 00000100:00100000:0.0:1746129736.031993:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949051783168:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8620us (8796us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129736.032001:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9834 00000100:00100000:0.0:1746129736.032088:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053140608:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129736.032102:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135676800/0x48868a4e43946dab lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34decd expref: 15 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129736.032110:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135676800/0x48868a4e43946dab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34decd expref: 15 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129736.032117:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135676800, rc 0) 00000100:00100000:0.0:1746129736.032132:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949051783296:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8601us (8902us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129736.032137:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9835 00000100:00100000:0.0:1746129736.043283:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.043319:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.043344:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.043365:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051784192 00000100:00100000:0.0:1746129736.043372:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051784192 00002000:00100000:0.0:1746129736.043406:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->1851391) req@ffff8800a645d180 x1830949051784192/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:477/0 lens 488/0 e 0 to 0 dl 1746129747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129736.043415:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645d180 with x1830949051784192 ext(1048576->1851391) 00002000:00010000:0.0:1746129736.043419:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645d180 00000100:00100000:0.0:1746129736.043493:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3535 00000100:00100000:0.0:1746129736.043501:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949051784448:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129736.044214:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.044233:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051783936 00000100:00100000:0.0:1746129736.044237:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051783936 00002000:00100000:0.0:1746129736.044251:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800a645f100 x1830949051783936/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:477/0 lens 488/0 e 0 to 0 dl 1746129747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129736.044258:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645f100 with x1830949051783936 ext(1048576->2097151) 00002000:00010000:0.0:1746129736.044261:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645f100 00000100:00100000:0.0:1746129736.044273:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3537 00000100:00100000:0.0:1746129736.044278:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949051783680:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129736.044937:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3538 00000100:00100000:0.0:1746129736.044943:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1962:x1830949051783936:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129736.053366:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.053398:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051784704 00000100:00100000:1.0:1746129736.053404:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051784704 00000100:00100000:1.0:1746129736.053437:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9644 00000100:00100000:1.0:1746129736.053443:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:28130:x1830949051784704:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129736.053463:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129736.053478:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507e600/0x48868a4e43946db2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ded4 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.053564:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e43946db9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129736.053575:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e43946db9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129736.053585:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e43946db9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129736.053595:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e43946dc0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129736.053599:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e43946dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129736.053603:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e43946dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129736.053683:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fc00/0x48868a4e43946dc7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129736.053703:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fc00/0x48868a4e43946dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129736.053708:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fc00/0x48868a4e43946dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:1.0:1746129736.053716:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129736.053781:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e43946db9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129736.053787:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e43946db9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129736.053792:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e43946db9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129736.053797:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a507fe00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129736.053800:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e43946db9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129736.053805:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e43946db9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129736.053813:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129736.053816:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129736.053819:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e43946db9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129736.053823:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e43946db9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129736.053845:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e43946dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129736.053872:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e43946dc0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129736.053876:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e43946dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129736.053880:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a507f200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129736.053882:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e43946dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129736.053886:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e43946dc0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129736.053891:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009b251b00) 00010000:00010000:1.0:1746129736.053892:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129736.053894:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e43946dc0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129736.053898:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e43946dc0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129736.053929:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507e600/0x48868a4e43946db2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ded4 expref: 300 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.053940:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fc00/0x48868a4e43946dc7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ded4 expref: 299 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.053945:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129736.053946:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129736.053948:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a507fc00, rc 0) 00000100:00100000:1.0:1746129736.053982:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:28130:x1830949051784704:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 538us (621us total) trans 8589943393 rc 0/0 00000100:00100000:1.0:1746129736.053988:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9644 00000100:00100000:0.0:1746129736.054455:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949051784448:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10954us (11133us total) trans 0 rc 569344/569344 00000100:00100000:0.0:1746129736.054462:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3535 00002000:00100000:0.0:1746129736.054471:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1527808->2097151) req@ffff8800a645f800 x1830949051784448/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:477/0 lens 488/440 e 0 to 0 dl 1746129747 ref 1 fl Complete:/200/0 rc 569344/569344 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129736.054479:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645f800 with x1830949051784448 ext(1527808->2097151) 00002000:00010000:0.0:1746129736.054483:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a645f800 00000100:00100000:0.0:1746129736.068515:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.068548:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.068954:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051785088 00000100:00100000:1.0:1746129736.068959:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051785088 00000100:00100000:1.0:1746129736.068985:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 535 00000100:00100000:1.0:1746129736.068991:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:1963:x1830949051785088:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129736.068999:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129736.069018:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fc00/0x48868a4e43946dc7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ded4 expref: 300 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.069037:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129736.069041:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129736.069067:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:1963:x1830949051785088:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 76us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129736.069073:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 535 00000100:00100000:0.0:1746129736.080435:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.080570:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.098038:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.104738:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.113760:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.123355:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.123379:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051785856 00000100:00100000:0.0:1746129736.123384:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051785856 00002000:00100000:0.0:1746129736.123409:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1527807) req@ffff88009b00f100 x1830949051785856/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:477/0 lens 488/0 e 0 to 0 dl 1746129747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129736.123416:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00f100 with x1830949051785856 ext(1048576->1527807) 00010000:00010000:0.0:1746129736.123423:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e43946d3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1527807) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de79 expref: 26 pid: 7976 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746129736.123433:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e43946d3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1527807) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de79 expref: 26 pid: 7976 timeout: 782 lvb_type: 0 00002000:00010000:0.0:1746129736.123439:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b00f100 00000100:00100000:0.0:1746129736.123454:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 452 00000100:00100000:0.0:1746129736.123460:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949051785856:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129736.145451:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.145958:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.146390:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.146421:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051786112 00000100:00100000:0.0:1746129736.146429:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051786112 00000100:00100000:0.0:1746129736.146505:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051786240 00000100:00100000:0.0:1746129736.146510:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051786240 00000100:00100000:1.0:1746129736.146608:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051785984 00000100:00100000:1.0:1746129736.146614:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051785984 00010000:00010000:1.0:1746129736.146657:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800945cfa00/0x48868a4e43946d7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34deb8 expref: 13 pid: 3623 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746129736.146696:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4726 00000100:00100000:1.0:1746129736.146705:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949051785984:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129736.146721:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129736.146746:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800945cfa00/0x48868a4e43946d7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34deb8 expref: 13 pid: 3623 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746129736.146758:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800945cfa00/0x48868a4e43946d7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34deb8 expref: 13 pid: 3623 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746129736.146779:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800945cfa00/0x48868a4e43946d7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34deb8 expref: 13 pid: 3623 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746129736.146802:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129736.146804:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129736.146813:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800945cfc00/0x48868a4e43946de3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dee9 expref: 27 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.146821:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800945cfc00/0x48868a4e43946de3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dee9 expref: 27 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.146882:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800945cfc00/0x48868a4e43946de3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dee9 expref: 27 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129736.146896:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053141248:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129736.146986:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129736.147100:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9840 00000100:00100000:0.0:1746129736.147109:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1963:x1830949051786112:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129736.147124:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129736.147137:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb11a00/0x48868a4e43946df1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34def7 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129736.147174:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053141376:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129736.147228:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129736.148035:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.149747:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051786368 00000100:00100000:1.0:1746129736.149756:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051786368 00000100:00100000:1.0:1746129736.149797:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9841 00000100:00100000:1.0:1746129736.149803:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1963:x1830949051786240:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129736.149818:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129736.149832:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a507fa00/0x48868a4e43946df8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34defe expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129736.149888:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ada300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053141504:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129736.150331:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801363660c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129736.153174:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.153460:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051786496 00000100:00100000:1.0:1746129736.153469:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051786496 00010000:00010000:1.0:1746129736.153505:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e43946d3b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1527807) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de79 expref: 28 pid: 7976 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746129736.153538:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4727 00000100:00100000:1.0:1746129736.153547:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1964:x1830949051786496:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129736.153582:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129736.153635:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e43946d3b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1527807) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de79 expref: 28 pid: 7976 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746129736.153648:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e43946d3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1527807) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de79 expref: 28 pid: 7976 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746129736.153672:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129736.153675:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129736.153693:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43946dea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1380352->1589247) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34def0 expref: 14 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.153704:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43946dea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1380352->1589247) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34def0 expref: 14 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.153738:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43946dea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1380352->1589247) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34def0 expref: 14 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129736.153751:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053141632:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129736.153843:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366000 going to sleep for 11 seconds 00010000:00010000:0.0:1746129736.155523:0:3623:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.31@tcp) returned -22 from glimpse AST (req@ffff880092ada300 x1830949053141504) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e43946d3b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1527807) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de79 expref: 28 pid: 7976 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746129736.155548:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e43946d3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1527807) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de79 expref: 28 pid: 7976 timeout: 782 lvb_type: 0 00000100:00100000:0.0:1746129736.155561:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ada300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053141504:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129736.155586:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a507fa00/0x48868a4e43946df8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34defe expref: 14 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129736.155594:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a507fa00/0x48868a4e43946df8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34defe expref: 14 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129736.155601:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a507fa00, rc 0) 00000100:00100000:0.0:1746129736.155631:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1963:x1830949051786240:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5827us (9242us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129736.155638:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9841 00000100:00100000:1.0:1746129736.156152:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053141248:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129736.156163:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129736.156180:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949051785984:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 9477us (10739us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129736.156187:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4726 00000100:00100000:1.0:1746129736.161142:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053141632:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129736.161165:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129736.161966:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949051786496:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8419us (8801us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129736.161976:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4727 00000100:00100000:0.0:1746129736.162518:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.162612:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.177183:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.177261:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.184627:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.185926:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051787520 00000100:00100000:1.0:1746129736.185935:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051787520 00002000:00100000:1.0:1746129736.185972:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1851392->2097151) req@ffff88009fc30700 x1830949051787520/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:477/0 lens 488/0 e 0 to 0 dl 1746129747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129736.185985:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc30700 with x1830949051787520 ext(1851392->2097151) 00010000:00010000:1.0:1746129736.185993:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bd800/0x48868a4e43946d18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de64 expref: 14 pid: 4589 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746129736.186004:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f9bd800/0x48868a4e43946d18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de64 expref: 14 pid: 4589 timeout: 782 lvb_type: 0 00002000:00010000:1.0:1746129736.186010:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fc30700 00000100:00100000:0.0:1746129736.187979:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.188271:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 453 00000100:00100000:1.0:1746129736.188280:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1962:x1830949051787520:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129736.195616:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.198790:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949051787520:12345-192.168.204.31@tcp:4:cat.0 Request processed in 10504us (14162us total) trans 21474840068 rc 0/0 00000100:00100000:1.0:1746129736.198799:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 453 00002000:00100000:1.0:1746129736.198807:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1851392->2097151) req@ffff88009fc30700 x1830949051787520/t21474840068(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:477/0 lens 488/448 e 0 to 0 dl 1746129747 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129736.198815:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc30700 with x1830949051787520 ext(1851392->2097151) 00010000:00010000:1.0:1746129736.198823:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bd800/0x48868a4e43946d18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de64 expref: 17 pid: 4589 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746129736.198834:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f9bd800/0x48868a4e43946d18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de64 expref: 17 pid: 4589 timeout: 782 lvb_type: 0 00002000:00010000:1.0:1746129736.198839:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fc30700 00000100:00100000:1.0:1746129736.209923:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.215024:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4728 00000100:00100000:1.0:1746129736.215036:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1964:x1830949051787904:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129736.215048:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129736.215067:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f9bd800/0x48868a4e43946d18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de64 expref: 17 pid: 4589 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746129736.215078:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f9bd800/0x48868a4e43946d18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de64 expref: 17 pid: 4589 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746129736.215096:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bd800/0x48868a4e43946d18 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de64 expref: 17 pid: 4589 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746129736.216590:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129736.216594:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129736.216602:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130f7ec00/0x48868a4e43946e06 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df0c expref: 17 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.216610:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130f7ec00/0x48868a4e43946e06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df0c expref: 17 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.216641:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130f7ec00/0x48868a4e43946e06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df0c expref: 17 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129736.216651:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053142016:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129736.217301:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129736.219428:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.219503:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.220899:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053142016:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129736.220916:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129736.221387:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1964:x1830949051787904:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6354us (11465us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129736.221395:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4728 00000100:00100000:0.0:1746129736.223007:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.223027:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.223837:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.225753:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 456 00000100:00100000:0.0:1746129736.225761:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949051788800:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129736.235634:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.235667:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.235742:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051789184 00000100:00100000:1.0:1746129736.235749:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051789184 00002000:00100000:1.0:1746129736.235782:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009fc32300 x1830949051789184/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:477/0 lens 488/0 e 0 to 0 dl 1746129747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129736.235790:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc32300 with x1830949051789184 ext(3145728->4194303) 00002000:00010000:1.0:1746129736.235794:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc32300 00000100:00100000:1.0:1746129736.235808:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051789440 00000100:00100000:1.0:1746129736.235810:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051789440 00002000:00100000:1.0:1746129736.235819:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009fc32680 x1830949051789440/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:477/0 lens 488/0 e 0 to 0 dl 1746129747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129736.235825:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc32680 with x1830949051789440 ext(3145728->4194303) 00002000:00010000:1.0:1746129736.235827:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc32680 00000100:00100000:1.0:1746129736.235838:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3543 00000100:00100000:1.0:1746129736.235843:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949051789184:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129736.236324:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1961:x1830949051788800:12345-192.168.204.31@tcp:4:cat.0 Request processed in 10563us (12487us total) trans 17179872894 rc 0/0 00000100:00100000:0.0:1746129736.236330:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 456 00002000:00100000:0.0:1746129736.236336:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3ea:0x0] (1380352->1589247) req@ffff88009fc31f80 x1830949051788800/t17179872894(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:477/0 lens 488/448 e 0 to 0 dl 1746129747 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129736.236341:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc31f80 with x1830949051788800 ext(1380352->1589247) 00010000:00010000:0.0:1746129736.236348:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43946dea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34def0 expref: 16 pid: 7976 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746129736.236359:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43946dea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34def0 expref: 16 pid: 7976 timeout: 782 lvb_type: 0 00002000:00010000:0.0:1746129736.236364:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fc31f80 00000100:00100000:0.0:1746129736.236376:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3544 00000100:00100000:0.0:1746129736.236381:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1961:x1830949051789440:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129736.238343:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.245935:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949051789184:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 10082us (10300us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129736.245946:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3543 00002000:00100000:1.0:1746129736.245955:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009fc32300 x1830949051789184/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:477/0 lens 488/440 e 0 to 0 dl 1746129747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129736.245963:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc32300 with x1830949051789184 ext(3145728->4194303) 00002000:00010000:1.0:1746129736.245969:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc32300 00000100:00100000:0.0:1746129736.251817:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.251890:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.253636:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949051789440:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 17252us (17965us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129736.253644:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3544 00002000:00100000:1.0:1746129736.253651:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009fc32680 x1830949051789440/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:477/0 lens 488/440 e 0 to 0 dl 1746129747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129736.253660:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc32680 with x1830949051789440 ext(3145728->4194303) 00002000:00010000:1.0:1746129736.253663:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc32680 00000100:00100000:0.0:1746129736.257131:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.262936:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.264234:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.264280:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.269653:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.269934:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.270003:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051790976 00000100:00100000:1.0:1746129736.270007:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051790976 00002000:00100000:1.0:1746129736.270032:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88012da48700 x1830949051790976/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:477/0 lens 488/0 e 0 to 0 dl 1746129747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129736.270041:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012da48700 with x1830949051790976 ext(4194304->4964351) 00010000:00010000:1.0:1746129736.270048:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800945cfc00/0x48868a4e43946de3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dee9 expref: 32 pid: 7976 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746129736.270058:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800945cfc00/0x48868a4e43946de3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dee9 expref: 32 pid: 7976 timeout: 782 lvb_type: 0 00002000:00010000:1.0:1746129736.270064:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012da48700 00000100:00100000:1.0:1746129736.270092:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 459 00000100:00100000:1.0:1746129736.270098:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012da48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1963:x1830949051790976:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129736.278588:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012da48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949051790976:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8481us (8646us total) trans 0 rc 770048/770048 00000100:00100000:0.0:1746129736.278598:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 459 00002000:00100000:0.0:1746129736.278609:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88012da48700 x1830949051790976/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:477/0 lens 488/440 e 0 to 0 dl 1746129747 ref 1 fl Complete:H/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129736.278617:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012da48700 with x1830949051790976 ext(4194304->4964351) 00010000:00010000:0.0:1746129736.278626:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800945cfc00/0x48868a4e43946de3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dee9 expref: 31 pid: 7976 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746129736.278636:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800945cfc00/0x48868a4e43946de3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dee9 expref: 31 pid: 7976 timeout: 782 lvb_type: 0 00002000:00010000:0.0:1746129736.278642:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012da48700 00000100:00100000:0.0:1746129736.287176:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.287211:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.287248:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.287268:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051791360 00000100:00100000:0.0:1746129736.287276:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051791360 00010000:00010000:0.0:1746129736.287304:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800945cfc00/0x48868a4e43946de3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dee9 expref: 31 pid: 7976 timeout: 782 lvb_type: 0 00000100:00100000:0.0:1746129736.287339:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4732 00000100:00100000:0.0:1746129736.287346:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1964:x1830949051791360:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129736.287358:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129736.288435:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800945cfc00/0x48868a4e43946de3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dee9 expref: 31 pid: 7976 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746129736.288448:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800945cfc00/0x48868a4e43946de3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dee9 expref: 31 pid: 7976 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746129736.288466:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800945cfc00/0x48868a4e43946de3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dee9 expref: 31 pid: 7976 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746129736.288485:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129736.288486:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129736.288491:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc0bc00/0x48868a4e43946e29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2260991) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df2f expref: 30 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129736.288497:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc0bc00/0x48868a4e43946e29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2260991) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df2f expref: 30 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129736.288523:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc0bc00/0x48868a4e43946e29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2260991) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df2f expref: 30 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129736.288533:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012da49180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053142912:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129736.288609:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129736.288711:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.294472:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.295488:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.300901:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.310592:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.313800:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.313844:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.313983:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9852 00000100:00100000:1.0:1746129736.313992:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012da4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949051792640:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129736.314003:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129736.314012:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801348e9800/0x48868a4e43946e45 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34df44 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129736.314051:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053143296:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129736.314104:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129736.315769:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053143296:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129736.315795:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801348e9800/0x48868a4e43946e45 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df44 expref: 14 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129736.315805:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801348e9800/0x48868a4e43946e45 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df44 expref: 14 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129736.316856:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348e9800, rc 0) 00000100:00100000:1.0:1746129736.316914:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012da4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949051792640:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2921us (3067us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129736.316921:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9852 00000100:00100000:0.0:1746129736.319017:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.319397:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051792896 00000100:00100000:1.0:1746129736.319404:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051792896 00000100:00100000:1.0:1746129736.319441:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9853 00000100:00100000:1.0:1746129736.319447:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012da4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28135:x1830949051792896:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129736.319462:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129736.319474:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801348e8600/0x48868a4e43946e4c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34df52 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.319498:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc0bc00/0x48868a4e43946e29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2260991) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df2f expref: 29 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.319505:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129736.319506:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129736.319509:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801348e8600/0x48868a4e43946e4c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df52 expref: 14 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.319531:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc0bc00/0x48868a4e43946e29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2260991) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df2f expref: 29 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.319540:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dc0bc00/0x48868a4e43946e29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2260991) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df2f expref: 29 pid: 8435 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746129736.319548:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053143424:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129736.320049:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129736.322218:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053143424:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129736.322242:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801348e8600/0x48868a4e43946e4c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df52 expref: 14 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.322255:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348e8600, rc 0) 00000100:00100000:1.0:1746129736.322297:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012da4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28135:x1830949051792896:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2850us (3286us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129736.322304:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9853 00000100:00100000:0.0:1746129736.323722:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051793024 00000100:00100000:0.0:1746129736.323729:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051793024 00002000:00100000:0.0:1746129736.323761:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->2260991) req@ffff88009fdc5180 x1830949051793024/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:477/0 lens 488/0 e 0 to 0 dl 1746129747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129736.323770:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fdc5180 with x1830949051793024 ext(2097152->2260991) 00010000:00010000:0.0:1746129736.323777:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dc0bc00/0x48868a4e43946e29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2260991) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df2f expref: 30 pid: 8435 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746129736.323789:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dc0bc00/0x48868a4e43946e29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2260991) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df2f expref: 30 pid: 8435 timeout: 782 lvb_type: 0 00002000:00010000:0.0:1746129736.323795:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fdc5180 00000100:00100000:0.0:1746129736.323825:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 460 00000100:00100000:0.0:1746129736.323832:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fdc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949051793024:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129736.330568:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.341393:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.341431:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.341459:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.341503:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.341704:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3549 00000100:00100000:1.0:1746129736.341714:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012da4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949051793664:12345-192.168.204.31@tcp:3:cat.0 00002000:00100000:0.0:1746129736.342925:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012da4b480 x1830949051793408/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:477/0 lens 488/0 e 0 to 0 dl 1746129747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129736.342934:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012da4b480 with x1830949051793408 ext(2097152->3145727) 00002000:00010000:0.0:1746129736.342942:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012da4b480 00000100:00100000:0.0:1746129736.342960:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3552 00000100:00100000:0.0:1746129736.342965:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012da4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1961:x1830949051793408:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129736.354113:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012da4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949051793664:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12393us (12673us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129736.354123:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3549 00002000:00100000:1.0:1746129736.354132:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012da4b800 x1830949051793664/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:477/0 lens 488/440 e 0 to 0 dl 1746129747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129736.354142:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012da4b800 with x1830949051793664 ext(3145728->4194303) 00002000:00010000:1.0:1746129736.354146:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012da4b800 00000100:00100000:0.0:1746129736.379432:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.520178:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.520223:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051794560 00000100:00100000:1.0:1746129736.520231:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051794560 00000100:00100000:1.0:1746129736.520277:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9854 00000100:00100000:1.0:1746129736.520284:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28142:x1830949051794560:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129736.520299:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129736.520312:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801348e9400/0x48868a4e43946e53 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34df59 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.520335:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131497800/0x48868a4e43946e0d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df13 expref: 16 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.520342:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc0a000/0x48868a4e43946e3e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df4b expref: 19 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129736.520348:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129736.520350:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129736.520352:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801348e9400/0x48868a4e43946e53 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df59 expref: 19 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.520375:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc0a000/0x48868a4e43946e3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df4b expref: 19 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129736.520389:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dc0a000/0x48868a4e43946e3e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df4b expref: 19 pid: 3624 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746129736.520398:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053143680:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129736.520485:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131497800/0x48868a4e43946e0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df13 expref: 16 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.520492:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131497800/0x48868a4e43946e0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df13 expref: 16 pid: 8435 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746129736.520500:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053143808:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129736.520519:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129736.529402:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.529439:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129736.530385:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc0a000/0x48868a4e43946e3e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df4b expref: 19 pid: 3624 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746129736.530405:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053143680:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129736.530414:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131497800/0x48868a4e43946e0d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df13 expref: 17 pid: 8435 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746129736.530421:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053143808:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129736.530439:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801348e9400/0x48868a4e43946e53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df59 expref: 18 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.530449:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348e9400, rc 0) 00000100:00100000:1.0:1746129736.530476:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28142:x1830949051794560:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 10193us (10306us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129736.530482:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9854 00000100:00100000:0.0:1746129736.532456:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.532712:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051795072 00000100:00100000:1.0:1746129736.532717:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051795072 00000100:00100000:1.0:1746129736.532746:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9645 00000100:00100000:1.0:1746129736.532751:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:28149:x1830949051795072:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129736.532769:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129736.532783:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e9200/0x48868a4e43946e5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34df60 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.532888:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8a00/0x48868a4e43946e61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.532899:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8a00/0x48868a4e43946e61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.532908:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8a00/0x48868a4e43946e61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.532918:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8c00/0x48868a4e43946e68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.532924:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8c00/0x48868a4e43946e68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.532928:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8c00/0x48868a4e43946e68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.535268:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8200/0x48868a4e43946e6f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.535281:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8200/0x48868a4e43946e6f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.535289:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8200/0x48868a4e43946e6f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:1.0:1746129736.535297:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129736.535366:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8a00/0x48868a4e43946e61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.535373:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8a00/0x48868a4e43946e61 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.535378:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8a00/0x48868a4e43946e61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.535383:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801348e8a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129736.535386:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8a00/0x48868a4e43946e61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.535392:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8a00/0x48868a4e43946e61 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.535402:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129736.535404:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129736.535407:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8a00/0x48868a4e43946e61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.535412:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8a00/0x48868a4e43946e61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.535436:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8c00/0x48868a4e43946e68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.535440:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8c00/0x48868a4e43946e68 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.535444:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8c00/0x48868a4e43946e68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.535447:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801348e8c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129736.535449:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8c00/0x48868a4e43946e68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.535452:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8c00/0x48868a4e43946e68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.535458:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009baa2800) 00010000:00010000:1.0:1746129736.535460:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129736.535462:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8c00/0x48868a4e43946e68 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.535466:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8c00/0x48868a4e43946e68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.535503:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e9200/0x48868a4e43946e5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df60 expref: 303 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.535516:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8200/0x48868a4e43946e6f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df60 expref: 302 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.535521:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129736.535524:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129736.535526:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348e8200, rc 0) 00000100:00100000:0.0:1746129736.536698:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.538651:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+302:28149:x1830949051795072:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5893us (6195us total) trans 8589943396 rc 0/0 00000100:00100000:1.0:1746129736.538659:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9645 00000100:00100000:0.0:1746129736.549364:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.549397:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.549416:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.550280:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.550298:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051795840 00000100:00100000:1.0:1746129736.550305:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051795840 00000100:00100000:1.0:1746129736.550354:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9646 00000100:00100000:1.0:1746129736.550361:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+302:28145:x1830949051795840:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129736.550382:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129736.550397:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e9e00/0x48868a4e43946e7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34df75 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.550485:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e9200/0x48868a4e43946e84 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.550495:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e9200/0x48868a4e43946e84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.550503:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e9200/0x48868a4e43946e84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.550513:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8c00/0x48868a4e43946e8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.550518:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8c00/0x48868a4e43946e8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.550523:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8c00/0x48868a4e43946e8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.550611:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8a00/0x48868a4e43946e92 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.550619:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8a00/0x48868a4e43946e92 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.550625:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8a00/0x48868a4e43946e92 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:1.0:1746129736.550631:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129736.550708:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e9200/0x48868a4e43946e84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.550714:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e9200/0x48868a4e43946e84 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.550720:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e9200/0x48868a4e43946e84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.550724:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801348e9200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129736.550727:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e9200/0x48868a4e43946e84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.550732:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e9200/0x48868a4e43946e84 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.550740:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129736.550742:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129736.550745:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e9200/0x48868a4e43946e84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.550749:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e9200/0x48868a4e43946e84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.550770:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8c00/0x48868a4e43946e8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.550778:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8c00/0x48868a4e43946e8b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.550782:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8c00/0x48868a4e43946e8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.550785:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801348e8c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129736.550787:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8c00/0x48868a4e43946e8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.550790:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8c00/0x48868a4e43946e8b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.550795:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009baa2a00) 00010000:00010000:1.0:1746129736.550796:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129736.550798:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8c00/0x48868a4e43946e8b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.550801:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8c00/0x48868a4e43946e8b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129736.550826:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e9e00/0x48868a4e43946e7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df75 expref: 305 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.550835:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e8a00/0x48868a4e43946e92 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df75 expref: 304 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.550839:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129736.550841:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129736.550842:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348e8a00, rc 0) 00000100:00100000:1.0:1746129736.550890:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+304:28145:x1830949051795840:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 530us (1534us total) trans 8589943397 rc 0/0 00000100:00100000:1.0:1746129736.550896:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9646 00000100:00100000:1.0:1746129736.550916:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051795456 00000100:00100000:1.0:1746129736.550919:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051795456 00000100:00100000:0.0:1746129736.552050:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.559232:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053144192:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129736.559249:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb9d200/0x48868a4e43946eae lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->3809279] (req 3145728->3809279) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df7c expref: 15 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129736.559261:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb9d200, rc 0) 00000100:00100000:0.0:1746129736.559278:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28142:x1830949051796096:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5759us (7231us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129736.559284:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9857 00000100:00100000:0.0:1746129736.565063:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.565662:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.566189:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.566263:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051796864 00000100:00100000:1.0:1746129736.566267:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051796864 00000100:00100000:1.0:1746129736.566356:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9858 00000100:00100000:1.0:1746129736.566362:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949051796864:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129736.566375:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129736.566384:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801348e9800/0x48868a4e43946eb5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34df83 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.566397:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129736.566403:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801348e9800/0x48868a4e43946eb5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df83 expref: 16 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129736.566412:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801348e9800/0x48868a4e43946eb5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df83 expref: 16 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129736.566535:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348e9800, rc 0) 00000100:00100000:1.0:1746129736.566627:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949051796864:12345-192.168.204.31@tcp:101:cat.0 Request processed in 264us (437us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129736.566632:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9858 00000100:00100000:0.0:1746129736.576512:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.576643:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051796992 00000100:00100000:1.0:1746129736.576650:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051796992 00000100:00100000:1.0:1746129736.576699:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9859 00000100:00100000:1.0:1746129736.576706:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28151:x1830949051796992:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129736.576722:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129736.576735:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801348e9000/0x48868a4e43946ebc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34df8a expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.576757:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb9d200/0x48868a4e43946eae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3809279) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df7c expref: 16 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.576763:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129736.576764:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129736.576767:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801348e9000/0x48868a4e43946ebc lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df8a expref: 16 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.576790:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb9d200/0x48868a4e43946eae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3809279) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df7c expref: 16 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.576800:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb9d200/0x48868a4e43946eae lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3809279) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df7c expref: 16 pid: 8435 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746129736.576811:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053144576:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129736.576907:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129736.583343:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.583439:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.585433:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.586240:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.586277:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053144576:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129736.586297:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801348e9000/0x48868a4e43946ebc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df8a expref: 15 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129736.586308:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348e9000, rc 0) 00000100:00100000:0.0:1746129736.586330:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28151:x1830949051796992:12345-192.168.204.31@tcp:101:cat.0 Request processed in 9624us (9825us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129736.586336:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9859 00000100:00100000:1.0:1746129736.598120:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.598408:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.598906:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 463 00000100:00100000:1.0:1746129736.598913:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1961:x1830949051798272:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129736.601697:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949051797632:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 14123us (16255us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129736.601710:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3556 00002000:00100000:1.0:1746129736.601718:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009c137480 x1830949051797632/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:477/0 lens 488/440 e 0 to 0 dl 1746129747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129736.601727:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c137480 with x1830949051797632 ext(1048576->2097151) 00002000:00010000:1.0:1746129736.601731:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c137480 00000100:00100000:0.0:1746129736.610410:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.612317:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.612336:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.612348:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051798656 00000100:00100000:0.0:1746129736.612351:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051798656 00000100:00100000:0.0:1746129736.612366:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051798528 00000100:00100000:0.0:1746129736.612367:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051798528 00000100:00100000:0.0:1746129736.612377:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9861 00000100:00100000:0.0:1746129736.612383:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949051798656:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129736.612395:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129736.612405:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a01d3800/0x48868a4e43946eca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34df9f expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129736.612432:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053144960:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129736.614376:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129736.615607:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.619285:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949051798272:12345-192.168.204.31@tcp:4:cat.0 Request processed in 20364us (20868us total) trans 17179872897 rc 0/0 00000100:00100000:1.0:1746129736.619295:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 463 00002000:00100000:1.0:1746129736.619304:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3809279) req@ffff880092adaa00 x1830949051798272/t17179872897(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:477/0 lens 488/448 e 0 to 0 dl 1746129747 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129736.619312:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092adaa00 with x1830949051798272 ext(3145728->3809279) 00010000:00010000:1.0:1746129736.619319:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb9d200/0x48868a4e43946eae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3809279) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df7c expref: 17 pid: 8435 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746129736.619331:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb9d200/0x48868a4e43946eae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3809279) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df7c expref: 17 pid: 8435 timeout: 782 lvb_type: 0 00002000:00010000:1.0:1746129736.619338:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092adaa00 00000100:00100000:0.0:1746129736.624782:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.624839:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051799168 00000100:00100000:1.0:1746129736.624876:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051799168 00002000:00100000:1.0:1746129736.624916:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3088384->3092479) req@ffff88009c134000 x1830949051799168/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:477/0 lens 488/0 e 0 to 0 dl 1746129747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129736.624924:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c134000 with x1830949051799168 ext(3088384->3092479) 00002000:00010000:1.0:1746129736.624928:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c134000 00000100:00100000:1.0:1746129736.624960:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3558 00000100:00100000:1.0:1746129736.624968:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949051799168:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129736.625125:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949051799168:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 158us (350us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129736.625131:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3558 00002000:00100000:1.0:1746129736.625136:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3088384->3092479) req@ffff88009c134000 x1830949051799168/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:477/0 lens 488/4536 e 0 to 0 dl 1746129747 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129736.625142:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c134000 with x1830949051799168 ext(3088384->3092479) 00002000:00010000:1.0:1746129736.625145:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c134000 00000100:00100000:1.0:1746129736.625433:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.626844:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.639633:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.648862:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.648896:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.648925:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.648943:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.648959:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051800064 00000100:00100000:0.0:1746129736.648968:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051800064 00002000:00100000:0.0:1746129736.648999:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009c135f80 x1830949051800064/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:477/0 lens 488/0 e 0 to 0 dl 1746129747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129736.649008:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c135f80 with x1830949051800064 ext(2097152->3145727) 00002000:00010000:0.0:1746129736.649012:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c135f80 00000100:00100000:1.0:1746129736.652749:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3563 00000100:00100000:1.0:1746129736.652758:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949051800832:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129736.667371:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949051800064:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16027us (18524us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129736.667382:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3561 00002000:00100000:0.0:1746129736.667392:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009c135f80 x1830949051800064/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:477/0 lens 488/440 e 0 to 0 dl 1746129747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129736.667401:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c135f80 with x1830949051800064 ext(2097152->3145727) 00002000:00010000:0.0:1746129736.667406:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c135f80 00000100:00100000:0.0:1746129736.680513:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.687706:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.691261:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949051800832:12345-192.168.204.31@tcp:3:cat.0 Request processed in 38496us (42308us total) trans 0 rc 737280/737280 00000100:00100000:1.0:1746129736.694139:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3563 00002000:00100000:1.0:1746129736.694328:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3457024->4194303) req@ffff88009c136d80 x1830949051800832/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:477/0 lens 488/440 e 0 to 0 dl 1746129747 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129736.694336:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c136d80 with x1830949051800832 ext(3457024->4194303) 00010000:00010000:1.0:1746129736.694341:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb9d600/0x48868a4e43946ec3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2781184->3092479) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df91 expref: 19 pid: 3624 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746129736.694350:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb9d600/0x48868a4e43946ec3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2781184->3092479) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df91 expref: 19 pid: 3624 timeout: 782 lvb_type: 0 00002000:00010000:1.0:1746129736.694360:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c136d80 00000100:00100000:0.0:1746129736.699323:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.703566:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.714334:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051801600 00000100:00100000:1.0:1746129736.714342:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051801600 00002000:00100000:1.0:1746129736.714381:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009fdc5c00 x1830949051801600/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:477/0 lens 488/0 e 0 to 0 dl 1746129747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129736.714390:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fdc5c00 with x1830949051801600 ext(3145728->4194303) 00002000:00010000:1.0:1746129736.714394:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fdc5c00 00000100:00100000:1.0:1746129736.714422:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3564 00000100:00100000:1.0:1746129736.714429:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fdc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949051801600:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129736.730467:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.734461:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.734488:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.735860:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fdc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949051801600:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21417us (21584us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129736.735868:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3564 00002000:00100000:1.0:1746129736.735874:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009fdc5c00 x1830949051801600/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:477/0 lens 488/440 e 0 to 0 dl 1746129747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129736.735880:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fdc5c00 with x1830949051801600 ext(3145728->4194303) 00002000:00010000:1.0:1746129736.735889:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fdc5c00 00000100:00100000:0.0:1746129736.753334:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.775686:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.780974:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.788583:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949051802624:12345-192.168.204.31@tcp:3:cat.0 Request processed in 35063us (35259us total) trans 0 rc 770048/770048 00000100:00100000:0.0:1746129736.788590:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3568 00002000:00100000:0.0:1746129736.788596:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff8800a645f480 x1830949051802624/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:477/0 lens 488/440 e 0 to 0 dl 1746129747 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129736.788603:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645f480 with x1830949051802624 ext(4194304->4964351) 00002000:00010000:0.0:1746129736.788606:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a645f480 00000100:00100000:0.0:1746129736.790188:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.798271:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.798695:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.809187:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.809233:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.809315:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051804032 00000100:00100000:1.0:1746129736.809323:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051804032 00010000:00010000:1.0:1746129736.809349:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094051200/0x48868a4e43946edf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dfad expref: 20 pid: 8435 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746129736.809413:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051804160 00000100:00100000:1.0:1746129736.809416:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051804160 00010000:00010000:1.0:1746129736.809425:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094051a00/0x48868a4e43946ee6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dfb4 expref: 20 pid: 8435 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746129736.809484:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4742 00000100:00100000:1.0:1746129736.809491:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949051804032:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129736.809502:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129736.809520:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094051200/0x48868a4e43946edf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dfad expref: 20 pid: 8435 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746129736.809529:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094051200/0x48868a4e43946edf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dfad expref: 20 pid: 8435 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746129736.809546:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094051200/0x48868a4e43946edf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dfad expref: 20 pid: 8435 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746129736.809740:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129736.809742:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129736.809748:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135848200/0x48868a4e43946f10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4034560->4165631) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dfc2 expref: 19 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.809755:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135848200/0x48868a4e43946f10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4034560->4165631) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dfc2 expref: 19 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.809781:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135848200/0x48868a4e43946f10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4034560->4165631) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dfc2 expref: 19 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129736.809791:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053145984:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129736.810087:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129736.812461:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053145984:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129736.812478:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129736.812508:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1961:x1830949051804032:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3018us (3368us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129736.812516:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4742 00000100:00100000:0.0:1746129736.813365:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.826604:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.899258:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.907224:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.914924:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.914996:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.915058:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051805056 00000100:00100000:1.0:1746129736.915061:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051805056 00010000:00010000:1.0:1746129736.915075:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135848200/0x48868a4e43946f10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4034560->4165631) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dfc2 expref: 21 pid: 3624 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746129736.915090:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4744 00000100:00100000:1.0:1746129736.915095:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1964:x1830949051805056:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129736.915101:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129736.915116:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135848200/0x48868a4e43946f10 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4034560->4165631) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dfc2 expref: 21 pid: 3624 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746129736.915124:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135848200/0x48868a4e43946f10 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4034560->4165631) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dfc2 expref: 21 pid: 3624 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746129736.915140:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129736.915141:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129736.915147:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135848000/0x48868a4e43946f17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dfc9 expref: 21 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.915154:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135848000/0x48868a4e43946f17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dfc9 expref: 21 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.915177:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135848000/0x48868a4e43946f17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dfc9 expref: 21 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129736.915185:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053146368:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129736.915209:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129736.917272:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.917291:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053146368:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129736.917305:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129736.917334:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1964:x1830949051805056:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2238us (2336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129736.917343:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4744 00000100:00100000:1.0:1746129736.921029:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.926493:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.926535:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.926567:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051805696 00000100:00100000:0.0:1746129736.926573:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051805696 00010000:00010000:0.0:1746129736.926601:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094051e00/0x48868a4e43946ed8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dfa6 expref: 32 pid: 3624 timeout: 782 lvb_type: 0 00000100:00100000:0.0:1746129736.926639:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4745 00000100:00100000:0.0:1746129736.926646:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949051805696:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129736.926657:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129736.926704:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094051e00/0x48868a4e43946ed8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dfa6 expref: 32 pid: 3624 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746129736.926714:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094051e00/0x48868a4e43946ed8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dfa6 expref: 32 pid: 3624 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746129736.926735:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129736.926766:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949051805696:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 121us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129736.926772:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4745 00000100:00100000:1.0:1746129736.926869:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051805824 00000100:00100000:1.0:1746129736.926873:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051805824 00000100:00100000:1.0:1746129736.926893:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9870 00000100:00100000:1.0:1746129736.926897:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28163:x1830949051805824:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129736.926909:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129736.926924:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a01d2c00/0x48868a4e43946f2c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34dfde expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.926938:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129736.926939:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129736.926945:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01d2c00/0x48868a4e43946f2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dfde expref: 19 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.926956:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a01d2c00/0x48868a4e43946f2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dfde expref: 19 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.926965:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01d2c00, rc 0) 00000100:00100000:1.0:1746129736.926985:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:28163:x1830949051805824:12345-192.168.204.31@tcp:101:cat.0 Request processed in 87us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129736.926990:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9870 00000100:00100000:0.0:1746129736.931784:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.939265:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.940881:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.941460:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.941488:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.941500:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.941523:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.941657:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051806592 00000100:00100000:1.0:1746129736.941662:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051806592 00002000:00100000:1.0:1746129736.941697:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880136318380 x1830949051806592/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:477/0 lens 488/0 e 0 to 0 dl 1746129747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129736.941707:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136318380 with x1830949051806592 ext(2097152->3145727) 00002000:00010000:1.0:1746129736.941711:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136318380 00000100:00100000:1.0:1746129736.941944:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051806848 00000100:00100000:1.0:1746129736.941947:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051806848 00002000:00100000:1.0:1746129736.941960:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4939776->4943871) req@ffff88009fbeea00 x1830949051806848/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:477/0 lens 488/0 e 0 to 0 dl 1746129747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129736.941968:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbeea00 with x1830949051806848 ext(4939776->4943871) 00002000:00010000:1.0:1746129736.941971:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbeea00 00000100:00100000:1.0:1746129736.941979:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051807104 00000100:00100000:1.0:1746129736.941981:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051807104 00002000:00100000:1.0:1746129736.941991:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009fbed500 x1830949051807104/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:477/0 lens 488/0 e 0 to 0 dl 1746129747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129736.941998:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbed500 with x1830949051807104 ext(2097152->3145727) 00002000:00010000:1.0:1746129736.942001:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbed500 00000100:00100000:1.0:1746129736.942010:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3573 00000100:00100000:1.0:1746129736.942015:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949051806592:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129736.942204:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3576 00000100:00100000:0.0:1746129736.942211:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1962:x1830949051807104:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129736.942264:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3577 00000100:00100000:0.0:1746129736.942269:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1962:x1830949051807232:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129736.944680:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1962:x1830949051806848:12345-192.168.204.31@tcp:3:cat.0 Request processed in 2633us (3201us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129736.944691:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3574 00002000:00100000:1.0:1746129736.944698:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4939776->4943871) req@ffff88009fbeea00 x1830949051806848/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:477/0 lens 488/4536 e 0 to 0 dl 1746129747 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129736.944706:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbeea00 with x1830949051806848 ext(4939776->4943871) 00002000:00010000:1.0:1746129736.944711:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbeea00 00000100:00100000:0.0:1746129736.945060:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.945681:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.945962:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.946128:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9872 00000100:00100000:1.0:1746129736.946135:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949051807616:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129736.946143:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129736.946152:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a01d3800/0x48868a4e43946f5d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34dff3 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129736.946177:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053147008:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129736.946216:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129736.950651:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949051807232:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8372us (9117us total) trans 0 rc 974848/974848 00000100:00100000:0.0:1746129736.950661:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3577 00002000:00100000:0.0:1746129736.950678:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4120575) req@ffff88009fbed880 x1830949051807232/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:477/0 lens 488/440 e 0 to 0 dl 1746129747 ref 1 fl Complete:/200/0 rc 974848/974848 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129736.950689:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbed880 with x1830949051807232 ext(3145728->4120575) 00002000:00010000:0.0:1746129736.950694:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbed880 00000100:00100000:0.0:1746129736.950735:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.950971:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053147008:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129736.950995:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a01d3800/0x48868a4e43946f5d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dff3 expref: 21 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129736.951008:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a01d3800/0x48868a4e43946f5d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dff3 expref: 21 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129736.951021:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01d3800, rc 0) 00000100:00100000:1.0:1746129736.951041:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949051807616:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4906us (5373us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129736.951046:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9872 00000100:00100000:1.0:1746129736.961122:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949051806592:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19104us (20240us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129736.961129:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3573 00002000:00100000:1.0:1746129736.961134:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880136318380 x1830949051806592/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:477/0 lens 488/440 e 0 to 0 dl 1746129747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129736.961141:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136318380 with x1830949051806592 ext(2097152->3145727) 00002000:00010000:1.0:1746129736.961144:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136318380 00000100:00100000:0.0:1746129736.965523:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.966517:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.966532:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051808384 00000100:00100000:0.0:1746129736.966535:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051808384 00000100:00100000:0.0:1746129736.966560:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3740 00000100:00100000:0.0:1746129736.966564:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+309:28168:x1830949051808384:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:0.0:1746129736.966762:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+310:28168:x1830949051808384:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 198us (246us total) trans 8589943404 rc 0/0 00000100:00100000:0.0:1746129736.966767:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3740 00000100:00100000:0.0:1746129736.967319:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.967831:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051808640 00000100:00100000:1.0:1746129736.967837:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051808640 00002000:00100000:1.0:1746129736.967892:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4943872->4964351) req@ffff880094d8f480 x1830949051808640/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:477/0 lens 488/0 e 0 to 0 dl 1746129747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129736.967902:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8f480 with x1830949051808640 ext(4943872->4964351) 00002000:00010000:1.0:1746129736.967907:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8f480 00000100:00100000:1.0:1746129736.967929:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3578 00000100:00100000:1.0:1746129736.967935:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949051808640:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129736.971963:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.972074:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.972259:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.972420:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9873 00000100:00100000:1.0:1746129736.972428:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949051808896:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129736.972442:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129736.972454:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d6c4a00/0x48868a4e43946f8e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e008 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129736.972491:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053147264:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129736.972582:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949051808640:12345-192.168.204.31@tcp:3:cat.0 Request processed in 4647us (5264us total) trans 0 rc 20480/20480 00000100:00100000:0.0:1746129736.972590:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3578 00002000:00100000:0.0:1746129736.972597:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4943872->4964351) req@ffff880094d8f480 x1830949051808640/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:477/0 lens 488/440 e 0 to 0 dl 1746129747 ref 1 fl Complete:/200/0 rc 20480/20480 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129736.972606:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8f480 with x1830949051808640 ext(4943872->4964351) 00002000:00010000:0.0:1746129736.972610:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8f480 00000100:00100000:1.0:1746129736.972731:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129736.976139:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053147264:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129736.976156:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d6c4a00/0x48868a4e43946f8e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e008 expref: 21 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129736.976168:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c4a00/0x48868a4e43946f8e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e008 expref: 21 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129736.976209:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c4a00, rc 0) 00000100:00100000:1.0:1746129736.976244:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949051808896:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3817us (4169us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129736.976741:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9873 00000100:00100000:0.0:1746129736.988464:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129736.989315:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129736.989362:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051809152 00000100:00100000:1.0:1746129736.989369:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051809152 00000100:00100000:1.0:1746129736.989412:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9876 00000100:00100000:1.0:1746129736.989418:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:28166:x1830949051809152:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129736.989435:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129736.989450:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d6c5000/0x48868a4e43946f9c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e016 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.989469:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129736.989471:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129736.989478:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6c5000/0x48868a4e43946f9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e016 expref: 32 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.989493:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d6c5000/0x48868a4e43946f9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e016 expref: 32 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129736.989506:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c5000, rc 0) 00000100:00100000:1.0:1746129736.989543:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:28166:x1830949051809152:12345-192.168.204.31@tcp:101:cat.0 Request processed in 125us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129736.989548:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9876 00000100:00100000:0.0:1746129736.999489:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.003234:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:0.0:1746129737.003899:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129737.014781:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.014809:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.014845:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.014901:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:1.0:1746129737.015706:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129737.015741:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4748 00000100:00100000:1.0:1746129737.015746:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1961:x1830949051810176:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129737.015754:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129737.015762:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131497200/0x48868a4e43946e1b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df21 expref: 19 pid: 8435 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.015769:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131497200/0x48868a4e43946e1b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df21 expref: 19 pid: 8435 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.015779:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131497200/0x48868a4e43946e1b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df21 expref: 19 pid: 8435 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.015789:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129737.015791:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129737.015796:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f83a400/0x48868a4e43946faa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e024 expref: 34 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.015802:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f83a400/0x48868a4e43946faa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e024 expref: 34 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.015825:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f83a400/0x48868a4e43946faa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e024 expref: 34 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129737.015832:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c136300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053148032:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129737.015880:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129737.021661:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c136300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053148032:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129737.021687:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129737.021716:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949051810176:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5968us (6813us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129737.021724:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4748 00000100:00100000:0.0:1746129737.023392:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.028251:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:1.0:1746129737.029134:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129737.032052:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:1.0:1746129737.033018:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129737.035185:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.044329:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.044382:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051810944 00000100:00100000:1.0:1746129737.044390:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051810944 00010000:00010000:1.0:1746129737.044419:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135848000/0x48868a4e43946f17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dfc9 expref: 22 pid: 3624 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746129737.044458:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4749 00000100:00100000:1.0:1746129737.044466:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949051810944:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129737.044477:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129737.044497:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135848000/0x48868a4e43946f17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dfc9 expref: 22 pid: 3624 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.044507:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135848000/0x48868a4e43946f17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dfc9 expref: 22 pid: 3624 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.044525:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135848000/0x48868a4e43946f17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dfc9 expref: 22 pid: 3624 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.044541:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129737.044543:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129737.044548:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f83a200/0x48868a4e43946fbf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e039 expref: 20 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.044555:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f83a200/0x48868a4e43946fbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e039 expref: 20 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.044582:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f83a200/0x48868a4e43946fbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e039 expref: 20 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129737.044592:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c136300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053148544:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129737.044662:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129737.048799:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.048841:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.049131:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4751 00000100:00100000:1.0:1746129737.049138:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1964:x1830949051811072:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129737.049144:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129737.049152:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d6c5000/0x48868a4e43946f9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e016 expref: 33 pid: 8435 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.049160:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d6c5000/0x48868a4e43946f9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e016 expref: 33 pid: 8435 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.049173:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d6c5000/0x48868a4e43946f9c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e016 expref: 33 pid: 8435 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.049488:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129737.049491:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129737.049497:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f83ac00/0x48868a4e43946fc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2367487) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e040 expref: 32 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.049505:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f83ac00/0x48868a4e43946fc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2367487) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e040 expref: 32 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.049531:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f83ac00/0x48868a4e43946fc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2367487) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e040 expref: 32 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129737.049541:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c137b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053148672:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129737.049606:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366780 going to sleep for 11 seconds 00000100:00100000:1.0:1746129737.052768:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c136300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053148544:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129737.052787:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129737.052835:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1961:x1830949051810944:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8368us (8512us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129737.052843:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4749 00000100:00100000:0.0:1746129737.056894:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.058962:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.058989:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.059022:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.059657:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3583 00000100:00100000:1.0:1746129737.059665:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949051811968:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129737.079800:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949051811968:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 20128us (20801us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129737.079809:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3583 00002000:00100000:1.0:1746129737.079817:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880136884380 x1830949051811968/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:478/0 lens 488/440 e 0 to 0 dl 1746129748 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129737.079825:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136884380 with x1830949051811968 ext(3145728->4194303) 00002000:00010000:1.0:1746129737.079830:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136884380 00000100:00100000:0.0:1746129737.096658:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.100155:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.102302:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.116815:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949051812608:12345-192.168.204.31@tcp:4:cat.0 Request processed in 14351us (14508us total) trans 17179872898 rc 0/0 00000100:00100000:0.0:1746129737.116830:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 467 00002000:00100000:0.0:1746129737.116840:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4943871) req@ffff880136887100 x1830949051812608/t17179872898(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:478/0 lens 488/448 e 0 to 0 dl 1746129748 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129737.116870:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136887100 with x1830949051812608 ext(4194304->4943871) 00010000:00010000:0.0:1746129737.116878:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f83b600/0x48868a4e43946f25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4943871) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dfd7 expref: 17 pid: 3624 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746129737.116892:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f83b600/0x48868a4e43946f25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4943871) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dfd7 expref: 17 pid: 3624 timeout: 783 lvb_type: 0 00002000:00010000:0.0:1746129737.116899:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136887100 00000100:00100000:0.0:1746129737.128648:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.146461:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.146615:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051812992 00000100:00100000:0.0:1746129737.146624:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051812992 00002000:00100000:0.0:1746129737.146682:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009c136300 x1830949051812992/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:478/0 lens 488/0 e 0 to 0 dl 1746129748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129737.146691:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c136300 with x1830949051812992 ext(4194304->4964351) 00002000:00010000:0.0:1746129737.146697:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c136300 00000100:00100000:0.0:1746129737.146735:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3585 00000100:00100000:0.0:1746129737.146745:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1963:x1830949051812992:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129737.158150:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.162973:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.171208:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:1.0:1746129737.171610:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129737.191374:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.191572:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051813760 00000100:00100000:1.0:1746129737.191579:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051813760 00000100:00100000:1.0:1746129737.191949:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9650 00000100:00100000:1.0:1746129737.191958:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+310:28176:x1830949051813760:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129737.191980:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129737.191994:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4000/0x48868a4e43946fe9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e063 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.192083:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4c00/0x48868a4e43946ff0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.192093:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4c00/0x48868a4e43946ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.192102:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4c00/0x48868a4e43946ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.192113:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4400/0x48868a4e43946ff7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.192118:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4400/0x48868a4e43946ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.192123:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4400/0x48868a4e43946ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.192333:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4600/0x48868a4e43946ffe lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.192345:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4600/0x48868a4e43946ffe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.192351:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4600/0x48868a4e43946ffe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:1.0:1746129737.192358:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129737.192424:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4c00/0x48868a4e43946ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.192430:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4c00/0x48868a4e43946ff0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.192434:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4c00/0x48868a4e43946ff0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.192439:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d6c4c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129737.192442:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4c00/0x48868a4e43946ff0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.192447:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4c00/0x48868a4e43946ff0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.192455:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129737.192458:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129737.192461:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4c00/0x48868a4e43946ff0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.192469:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4c00/0x48868a4e43946ff0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.197342:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4400/0x48868a4e43946ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.197355:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4400/0x48868a4e43946ff7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.197361:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4400/0x48868a4e43946ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.197366:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d6c4400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129737.197369:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4400/0x48868a4e43946ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.197374:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4400/0x48868a4e43946ff7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.197389:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009baa2f00) 00010000:00010000:1.0:1746129737.197391:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129737.197394:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4400/0x48868a4e43946ff7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.197398:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4400/0x48868a4e43946ff7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.197456:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4000/0x48868a4e43946fe9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e063 expref: 313 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.197470:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4600/0x48868a4e43946ffe lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e063 expref: 312 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.197481:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129737.197483:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129737.197485:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c4600, rc 0) 00000100:00100000:1.0:1746129737.198138:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+312:28176:x1830949051813760:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6179us (6768us total) trans 8589943406 rc 0/0 00000100:00100000:1.0:1746129737.198146:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9650 00000100:00100000:0.0:1746129737.200961:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.201715:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.202262:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 541 00000100:00100000:1.0:1746129737.202270:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+314:1964:x1830949051813888:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129737.202279:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129737.202298:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4600/0x48868a4e43946ffe lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e063 expref: 314 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.202322:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129737.202325:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129737.202364:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+313:1964:x1830949051813888:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 91us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129737.202370:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 541 00000100:00100000:0.0:1746129737.216462:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.216504:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.217060:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051814400 00000100:00100000:0.0:1746129737.217064:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051814400 00002000:00100000:0.0:1746129737.217086:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->2367487) req@ffff880135d8fb80 x1830949051814400/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:478/0 lens 488/0 e 0 to 0 dl 1746129748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129737.217094:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8fb80 with x1830949051814400 ext(2097152->2367487) 00010000:00010000:0.0:1746129737.217099:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f83ac00/0x48868a4e43946fc6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2367487) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e040 expref: 34 pid: 1140 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746129737.217109:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f83ac00/0x48868a4e43946fc6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2367487) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e040 expref: 34 pid: 1140 timeout: 783 lvb_type: 0 00002000:00010000:0.0:1746129737.217115:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135d8fb80 00000100:00100000:0.0:1746129737.217138:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 468 00000100:00100000:0.0:1746129737.217143:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949051814400:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129737.224590:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.227874:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.238264:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.246313:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.255886:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.256047:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.256081:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.256157:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9889 00000100:00100000:0.0:1746129737.256164:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949051815552:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129737.256190:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129737.256198:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf46200/0x48868a4e43947021 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e078 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129737.256236:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8791c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053149568:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129737.267128:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.267966:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.269931:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.269956:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.269977:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051816192 00000100:00100000:1.0:1746129737.269982:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051816192 00002000:00100000:1.0:1746129737.270012:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3ea:0x0] (1937408->2097151) req@ffff8800a8792300 x1830949051816192/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:478/0 lens 488/0 e 0 to 0 dl 1746129748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129737.270025:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8792300 with x1830949051816192 ext(1937408->2097151) 00010000:00010000:1.0:1746129737.270033:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f83a400/0x48868a4e43946faa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e024 expref: 35 pid: 1140 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.270043:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f83a400/0x48868a4e43946faa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e024 expref: 35 pid: 1140 timeout: 783 lvb_type: 0 00002000:00010000:1.0:1746129737.270049:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a8792300 00000100:00100000:1.0:1746129737.270059:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051816448 00000100:00100000:1.0:1746129737.270062:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051816448 00002000:00100000:1.0:1746129737.270071:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2519040->2523135) req@ffff8800a8790000 x1830949051816448/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:478/0 lens 488/0 e 0 to 0 dl 1746129748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129737.270077:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8790000 with x1830949051816448 ext(2519040->2523135) 00002000:00010000:1.0:1746129737.270080:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8790000 00000100:00100000:1.0:1746129737.270090:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 472 00000100:00100000:1.0:1746129737.270095:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949051816192:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:0.0:1746129737.273028:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.273096:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051816704 00000100:00100000:1.0:1746129737.273103:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051816704 00002000:00100000:1.0:1746129737.273129:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2818048->2822143) req@ffff8800a8790e00 x1830949051816704/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:478/0 lens 488/0 e 0 to 0 dl 1746129748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129737.273136:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8790e00 with x1830949051816704 ext(2818048->2822143) 00002000:00010000:1.0:1746129737.273141:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8790e00 00000100:00100000:1.0:1746129737.273167:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3587 00000100:00100000:1.0:1746129737.273174:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1961:x1830949051816704:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129737.273269:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1961:x1830949051816704:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 95us (241us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129737.273275:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3587 00002000:00100000:1.0:1746129737.273280:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2818048->2822143) req@ffff8800a8790e00 x1830949051816704/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:478/0 lens 488/4536 e 0 to 0 dl 1746129748 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129737.273286:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8790e00 with x1830949051816704 ext(2818048->2822143) 00002000:00010000:1.0:1746129737.273289:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8790e00 00000100:00100000:0.0:1746129737.273916:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.277990:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.288981:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.291623:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.292011:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.292516:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051817600 00000100:00100000:1.0:1746129737.292519:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051817600 00000100:00100000:1.0:1746129737.292546:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9651 00000100:00100000:1.0:1746129737.292552:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+312:28185:x1830949051817600:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129737.292564:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129737.292577:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5400/0x48868a4e4394703d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e09b expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.292892:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4a00/0x48868a4e43947044 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.292904:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4a00/0x48868a4e43947044 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.292913:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4a00/0x48868a4e43947044 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.292924:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4200/0x48868a4e4394704b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.292930:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4200/0x48868a4e4394704b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.292939:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4200/0x48868a4e4394704b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.293029:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4800/0x48868a4e43947052 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.293037:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4800/0x48868a4e43947052 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.293042:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4800/0x48868a4e43947052 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:1.0:1746129737.293048:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129737.293226:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4a00/0x48868a4e43947044 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.293232:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4a00/0x48868a4e43947044 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.293237:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4a00/0x48868a4e43947044 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.293242:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d6c4a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129737.293245:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4a00/0x48868a4e43947044 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.293250:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4a00/0x48868a4e43947044 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.293258:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129737.293260:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129737.293262:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4a00/0x48868a4e43947044 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.293270:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4a00/0x48868a4e43947044 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.293546:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4200/0x48868a4e4394704b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.293552:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4200/0x48868a4e4394704b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.293556:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4200/0x48868a4e4394704b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.293560:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d6c4200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129737.293572:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4200/0x48868a4e4394704b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.293577:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4200/0x48868a4e4394704b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.293585:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009baa2a00) 00010000:00010000:1.0:1746129737.293590:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129737.293592:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4200/0x48868a4e4394704b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.293596:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4200/0x48868a4e4394704b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.293629:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5400/0x48868a4e4394703d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e09b expref: 315 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.293639:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4800/0x48868a4e43947052 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e09b expref: 314 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.293647:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129737.293649:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129737.293651:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c4800, rc 0) 00000100:00100000:1.0:1746129737.293686:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+314:28185:x1830949051817600:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1134us (1675us total) trans 8589943408 rc 0/0 00000100:00100000:1.0:1746129737.293933:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9651 00000100:00100000:0.0:1746129737.297453:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.298153:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.298174:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.298365:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051817856 00000100:00100000:1.0:1746129737.298369:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051817856 00000100:00100000:1.0:1746129737.298394:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 542 00000100:00100000:1.0:1746129737.298399:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+314:1963:x1830949051817856:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129737.298406:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129737.298423:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4800/0x48868a4e43947052 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e09b expref: 314 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.298438:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129737.298441:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129737.298473:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+313:1963:x1830949051817856:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 73us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129737.298478:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 542 00000100:00100000:0.0:1746129737.299306:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.313572:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.313611:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.313639:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.313655:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.313693:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.315058:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3591 00000100:00100000:0.0:1746129737.315065:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1961:x1830949051819008:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129737.351155:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.364264:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.364303:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.367424:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.367521:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051820288 00000100:00100000:0.0:1746129737.367528:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051820288 00002000:00100000:0.0:1746129737.367560:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88012c089880 x1830949051820288/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:478/0 lens 488/0 e 0 to 0 dl 1746129748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129737.367568:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c089880 with x1830949051820288 ext(4194304->4964351) 00002000:00010000:0.0:1746129737.367573:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c089880 00000100:00100000:0.0:1746129737.367589:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3596 00000100:00100000:0.0:1746129737.367595:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949051820288:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129737.403527:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.403590:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051820544 00000100:00100000:1.0:1746129737.403598:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051820544 00000100:00100000:1.0:1746129737.403642:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9652 00000100:00100000:1.0:1746129737.403650:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+313:28189:x1830949051820544:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129737.403678:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129737.403693:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5c00/0x48868a4e43947075 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e0b7 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.403780:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4800/0x48868a4e4394707c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.403791:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4800/0x48868a4e4394707c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.403799:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4800/0x48868a4e4394707c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.403810:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4200/0x48868a4e43947083 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.403815:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4200/0x48868a4e43947083 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.403819:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4200/0x48868a4e43947083 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.403950:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4a00/0x48868a4e4394708a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.403961:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4a00/0x48868a4e4394708a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.403969:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4a00/0x48868a4e4394708a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:1.0:1746129737.403977:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129737.404062:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4800/0x48868a4e4394707c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.404070:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4800/0x48868a4e4394707c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.404076:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4800/0x48868a4e4394707c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.404081:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d6c4800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129737.404084:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4800/0x48868a4e4394707c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.404090:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4800/0x48868a4e4394707c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.404101:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129737.404104:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129737.404108:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4800/0x48868a4e4394707c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.404112:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4800/0x48868a4e4394707c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.404131:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4200/0x48868a4e43947083 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.404135:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4200/0x48868a4e43947083 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.404140:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4200/0x48868a4e43947083 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.404143:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d6c4200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129737.404145:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4200/0x48868a4e43947083 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.404150:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4200/0x48868a4e43947083 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.404160:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009baa2a00) 00010000:00010000:1.0:1746129737.404162:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129737.404164:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4200/0x48868a4e43947083 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.404169:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4200/0x48868a4e43947083 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.404207:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5c00/0x48868a4e43947075 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e0b7 expref: 316 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.404219:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c4a00/0x48868a4e4394708a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e0b7 expref: 315 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.404225:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129737.404227:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129737.404229:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c4a00, rc 0) 00000100:00100000:1.0:1746129737.404279:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+315:28189:x1830949051820544:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 627us (751us total) trans 8589943409 rc 0/0 00000100:00100000:1.0:1746129737.404286:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9652 00000100:00100000:0.0:1746129737.414396:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.415580:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.415658:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051821056 00000100:00100000:1.0:1746129737.415669:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051821056 00000100:00100000:1.0:1746129737.415693:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3744 00000100:00100000:1.0:1746129737.415699:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+317:28189:x1830949051821056:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129737.416272:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+316:28189:x1830949051821056:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 573us (1883us total) trans 8589943411 rc 0/0 00000100:00100000:1.0:1746129737.416279:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3744 00000100:00100000:0.0:1746129737.426330:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.426366:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.429694:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.478052:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.487598:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.490136:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.493356:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.498721:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.509291:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.509345:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.522067:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.553448:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051823616 00000100:00100000:1.0:1746129737.553459:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051823616 00000100:00100000:0.0:1746129737.559561:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.559579:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.559612:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.559642:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051824000 00000100:00100000:0.0:1746129737.559649:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051824000 00000100:00100000:0.0:1746129737.559697:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 544 00000100:00100000:0.0:1746129737.559703:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+318:1963:x1830949051824000:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129737.559714:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129737.559732:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd9c00/0x48868a4e439470c2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e0d3 expref: 318 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129737.559762:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129737.559766:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129737.559802:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+317:1963:x1830949051824000:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 99us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129737.559807:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 544 00000100:00100000:0.0:1746129737.559832:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9901 00000100:00100000:0.0:1746129737.559836:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1963:x1830949051823872:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129737.559842:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129737.559869:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c131600/0x48868a4e439470d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e0e1 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129737.559902:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5493480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053151488:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129737.565704:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00002000:00010000:1.0:1746129737.566122:0:3624:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime: 1746129737 -> 1746129738 00002000:00010000:1.0:1746129737.566126:0:3624:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746129737 -> 1746129738 00002000:00010000:1.0:1746129737.566128:0:3624:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime: 1746129737 -> 1746129738 00000100:00100000:1.0:1746129737.566148:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5493480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053151488:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129737.566174:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c131600/0x48868a4e439470d7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e0e1 expref: 21 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129737.566186:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c131600/0x48868a4e439470d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e0e1 expref: 21 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129737.566212:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131600, rc 0) 00000100:00100000:1.0:1746129737.566253:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1963:x1830949051823872:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6415us (6671us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129737.566260:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9901 00000100:00100000:0.0:1746129737.575380:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.608908:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.608946:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051824384 00000100:00100000:1.0:1746129737.608955:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051824384 00000100:00100000:1.0:1746129737.609006:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9902 00000100:00100000:1.0:1746129737.609014:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:28197:x1830949051824384:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129737.609032:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129737.609050:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d6c4e00/0x48868a4e439470de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e0e8 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.609078:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130509800/0x48868a4e4394709f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2785280->4194303] (req 2785280->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e0c5 expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.609086:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129737.609088:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129737.609091:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6c4e00/0x48868a4e439470de lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e0e8 expref: 39 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.609118:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130509800/0x48868a4e4394709f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2785280->4194303] (req 2785280->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e0c5 expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.609128:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130509800/0x48868a4e4394709f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2785280->4194303] (req 2785280->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e0c5 expref: 19 pid: 4589 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746129737.609140:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053151616:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129737.609225:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801363660c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129737.620839:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.620844:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053151616:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129737.621376:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d6c4e00/0x48868a4e439470de lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e0e8 expref: 39 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.621388:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c4e00, rc 0) 00000100:00100000:1.0:1746129737.621411:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:28197:x1830949051824384:12345-192.168.204.31@tcp:101:cat.0 Request processed in 12398us (12511us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129737.621418:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9902 00000100:00100000:0.0:1746129737.633702:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.633760:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051824640 00000100:00100000:1.0:1746129737.633769:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051824640 00000100:00100000:1.0:1746129737.633823:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9903 00000100:00100000:1.0:1746129737.633830:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1962:x1830949051824640:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129737.633869:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129737.633884:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d6c4600/0x48868a4e439470e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e0ef expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129737.634056:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.634365:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053151744:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129737.634414:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801363660c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746129737.636242:0:3624:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime: 1746129736 -> 1746129738 00002000:00010000:1.0:1746129737.636248:0:3624:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime: 1746129736 -> 1746129738 00002000:00010000:1.0:1746129737.636250:0:3624:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime: 1746129735 -> 1746129738 00000100:00100000:1.0:1746129737.636267:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053151744:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129737.636288:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d6c4600/0x48868a4e439470e5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e0ef expref: 22 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129737.636299:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c4600/0x48868a4e439470e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e0ef expref: 22 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129737.636311:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c4600, rc 0) 00000100:00100000:1.0:1746129737.636339:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1962:x1830949051824640:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2509us (2643us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129737.636345:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9903 00000100:00100000:0.0:1746129737.649403:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.649465:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051824896 00000100:00100000:1.0:1746129737.649473:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051824896 00000100:00100000:1.0:1746129737.649525:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9905 00000100:00100000:1.0:1746129737.649533:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:28200:x1830949051824896:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129737.649548:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129737.649562:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d6c4c00/0x48868a4e439470f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e0fd expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.649589:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130509e00/0x48868a4e43947098 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->1613823) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e0be expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.649601:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129737.649602:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129737.649605:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6c4c00/0x48868a4e439470f3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e0fd expref: 22 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.649633:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130509e00/0x48868a4e43947098 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->1613823) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e0be expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.649642:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130509e00/0x48868a4e43947098 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->1613823) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e0be expref: 19 pid: 4589 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746129737.649652:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053151872:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129737.649743:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801363660c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129737.650604:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.653250:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.653318:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053151872:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129737.653339:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d6c4c00/0x48868a4e439470f3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e0fd expref: 22 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.653352:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c4c00, rc 0) 00000100:00100000:1.0:1746129737.653378:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:28200:x1830949051824896:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3847us (3984us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129737.653385:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9905 00000100:00100000:0.0:1746129737.663013:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.664574:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.671452:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.675271:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.675292:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051826048 00000100:00100000:1.0:1746129737.675298:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051826048 00000100:00100000:1.0:1746129737.675328:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9654 00000100:00100000:1.0:1746129737.675334:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+317:28204:x1830949051826048:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129737.675352:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129737.675365:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5600/0x48868a4e439470fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e104 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.675441:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5a00/0x48868a4e43947101 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129737.675451:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5a00/0x48868a4e43947101 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129737.675460:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5a00/0x48868a4e43947101 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129737.675470:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5800/0x48868a4e43947108 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129737.675475:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5800/0x48868a4e43947108 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129737.675480:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5800/0x48868a4e43947108 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129737.675563:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5000/0x48868a4e4394710f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129737.675571:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5000/0x48868a4e4394710f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129737.675576:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5000/0x48868a4e4394710f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:1.0:1746129737.675583:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129737.675643:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5a00/0x48868a4e43947101 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129737.675649:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5a00/0x48868a4e43947101 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129737.675679:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5a00/0x48868a4e43947101 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129737.675685:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d6c5a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129737.675688:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5a00/0x48868a4e43947101 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129737.675701:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5a00/0x48868a4e43947101 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129737.675709:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129737.675712:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129737.675715:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5a00/0x48868a4e43947101 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129737.675719:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5a00/0x48868a4e43947101 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129737.675731:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5800/0x48868a4e43947108 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129737.675736:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5800/0x48868a4e43947108 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129737.675740:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5800/0x48868a4e43947108 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129737.675747:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d6c5800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129737.675749:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5800/0x48868a4e43947108 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129737.675753:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5800/0x48868a4e43947108 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129737.675757:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009baa2800) 00010000:00010000:1.0:1746129737.675758:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129737.675760:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5800/0x48868a4e43947108 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129737.675763:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5800/0x48868a4e43947108 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129737.675788:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5600/0x48868a4e439470fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e104 expref: 320 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.675796:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c5000/0x48868a4e4394710f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e104 expref: 319 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.675800:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129737.675802:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129737.675803:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c5000, rc 0) 00000100:00100000:1.0:1746129737.675830:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+319:28204:x1830949051826048:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 497us (567us total) trans 8589943413 rc 0/0 00000100:00100000:1.0:1746129737.675835:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9654 00000100:00100000:0.0:1746129737.685235:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.685271:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.685290:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051826304 00000100:00100000:1.0:1746129737.685297:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051826304 00000100:00100000:0.0:1746129737.685316:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.685329:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3745 00000100:00100000:1.0:1746129737.685335:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+319:28204:x1830949051826304:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129737.685529:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+320:28204:x1830949051826304:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 194us (299us total) trans 8589943414 rc 0/0 00000100:00100000:1.0:1746129737.685535:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3745 00000100:00100000:1.0:1746129737.694932:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.699498:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.700218:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.710630:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.710675:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.710705:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051827072 00000100:00100000:0.0:1746129737.710713:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051827072 00010000:00010000:0.0:1746129737.710739:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6a00/0x48868a4e43946cd2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 557056->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de33 expref: 41 pid: 7976 timeout: 783 lvb_type: 0 00000100:00100000:0.0:1746129737.710765:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4765 00000100:00100000:0.0:1746129737.710772:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1961:x1830949051827072:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129737.710783:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129737.710801:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6a00/0x48868a4e43946cd2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 557056->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de33 expref: 41 pid: 7976 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746129737.710810:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6a00/0x48868a4e43946cd2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 557056->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de33 expref: 41 pid: 7976 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746129737.710831:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129737.710880:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1961:x1830949051827072:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 108us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129737.710886:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4765 00010000:00010000:0.0:1746129737.712103:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6a00/0x48868a4e43946cd2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 557056->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de33 expref: 40 pid: 7976 timeout: 783 lvb_type: 0 00000100:00100000:0.0:1746129737.712129:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053152384:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129737.717153:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1961:x1830949051826688:12345-192.168.204.31@tcp:4:cat.0 Request processed in 22029us (22220us total) trans 21474840075 rc 0/0 00000100:00100000:1.0:1746129737.717164:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 476 00002000:00100000:1.0:1746129737.717173:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->2506751) req@ffff88012ba19f80 x1830949051826688/t21474840075(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:478/0 lens 488/448 e 0 to 0 dl 1746129748 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129737.717182:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba19f80 with x1830949051826688 ext(2097152->2506751) 00010000:00010000:1.0:1746129737.717189:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f83b600/0x48868a4e439470a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e0cc expref: 24 pid: 4589 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.717199:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f83b600/0x48868a4e439470a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e0cc expref: 24 pid: 4589 timeout: 783 lvb_type: 0 00002000:00010000:1.0:1746129737.717205:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba19f80 00000100:00100000:1.0:1746129737.718706:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053152512:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129737.718730:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135849e00/0x48868a4e4394712b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [471040->802815] (req 471040->802815) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e119 expref: 39 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.718749:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135849e00, rc 0) 00000100:00100000:0.0:1746129737.718766:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051827456 00000100:00100000:0.0:1746129737.718771:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051827456 00000100:00100000:1.0:1746129737.718788:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:28204:x1830949051826944:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 17570us (18569us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129737.718794:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9908 00010000:00010000:0.0:1746129737.719099:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091f56000/0x48868a4e43946c8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de02 expref: 24 pid: 3624 timeout: 783 lvb_type: 0 00000100:00100000:0.0:1746129737.719403:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4766 00000100:00100000:0.0:1746129737.719410:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1962:x1830949051827456:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129737.719421:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129737.719438:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091f56000/0x48868a4e43946c8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de02 expref: 24 pid: 3624 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746129737.719447:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091f56000/0x48868a4e43946c8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de02 expref: 24 pid: 3624 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746129737.719863:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091f56000/0x48868a4e43946c8c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34de02 expref: 24 pid: 3624 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746129737.719877:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129737.719878:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129737.719884:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135849e00/0x48868a4e4394712b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 471040->802815) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e119 expref: 38 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129737.719891:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135849e00/0x48868a4e4394712b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 471040->802815) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e119 expref: 38 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.719987:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135849e00/0x48868a4e4394712b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 471040->802815) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e119 expref: 38 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129737.719997:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be66a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053152640:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129737.721391:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129737.724392:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.724465:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.725097:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be66a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053152640:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129737.725110:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129737.725181:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1962:x1830949051827456:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5771us (6451us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129737.725187:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4766 00000100:00100000:0.0:1746129737.731258:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.731318:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051827968 00000100:00100000:1.0:1746129737.731325:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051827968 00000100:00100000:0.0:1746129737.731387:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.731767:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9909 00000100:00100000:1.0:1746129737.731773:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:28200:x1830949051827968:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129737.731782:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129737.731796:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eb7c800/0x48868a4e43947132 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e120 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.731814:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129737.731815:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129737.731822:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb7c800/0x48868a4e43947132 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e120 expref: 24 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.731835:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012eb7c800/0x48868a4e43947132 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e120 expref: 24 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.731842:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb7c800, rc 0) 00000100:00100000:1.0:1746129737.731918:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:28200:x1830949051827968:12345-192.168.204.31@tcp:101:cat.0 Request processed in 145us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129737.731923:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9909 00000100:00100000:0.0:1746129737.732763:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.738259:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.738303:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.745139:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.745180:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.745216:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.745711:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3611 00000100:00100000:0.0:1746129737.745718:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:1964:x1830949051829504:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129737.750003:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1964:x1830949051828480:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 17018us (17234us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129737.750013:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3607 00002000:00100000:0.0:1746129737.750020:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009fd44000 x1830949051828480/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:478/0 lens 488/440 e 0 to 0 dl 1746129748 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129737.750028:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd44000 with x1830949051828480 ext(2097152->3145727) 00002000:00010000:0.0:1746129737.750033:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd44000 00000100:00100000:0.0:1746129737.777447:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.778143:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.778542:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051830016 00000100:00100000:1.0:1746129737.778546:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051830016 00000100:00100000:1.0:1746129737.778579:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9911 00000100:00100000:1.0:1746129737.778584:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949051830016:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129737.778592:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129737.778600:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801300fee00/0x48868a4e43947140 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e12e expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.778612:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129737.778613:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129737.778619:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801300fee00/0x48868a4e43947140 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e12e expref: 23 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129737.778631:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801300fee00/0x48868a4e43947140 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e12e expref: 23 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129737.778638:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801300fee00, rc 0) 00000100:00100000:1.0:1746129737.778676:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949051830016:12345-192.168.204.31@tcp:101:cat.0 Request processed in 92us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129737.778682:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9911 00000100:00100000:0.0:1746129737.784540:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.784575:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.791014:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.791096:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.793966:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051830784 00000100:00100000:1.0:1746129737.793972:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051830784 00000100:00100000:1.0:1746129737.793995:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9913 00000100:00100000:1.0:1746129737.794001:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1963:x1830949051830784:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129737.794013:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129737.794028:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801300ff200/0x48868a4e4394714e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e13c expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129737.794081:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be66a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053153408:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129737.794141:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366480 going to sleep for 11 seconds 00002000:00010000:1.0:1746129737.795951:0:4589:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime: 1746129735 -> 1746129738 00002000:00010000:1.0:1746129737.795956:0:4589:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime: 1746129736 -> 1746129738 00002000:00010000:1.0:1746129737.795957:0:4589:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime: 1746129735 -> 1746129738 00000100:00100000:1.0:1746129737.795969:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be66a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053153408:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129737.795987:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801300ff200/0x48868a4e4394714e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e13c expref: 22 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129737.795996:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801300ff200/0x48868a4e4394714e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e13c expref: 22 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129737.796012:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801300ff200, rc 0) 00000100:00100000:1.0:1746129737.796225:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1963:x1830949051830784:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2221us (2866us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129737.796231:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9913 00000100:00100000:0.0:1746129737.797332:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.797368:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.797421:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051831040 00000100:00100000:1.0:1746129737.797740:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051831040 00000100:00100000:1.0:1746129737.797765:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9915 00000100:00100000:1.0:1746129737.797770:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:28203:x1830949051831040:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129737.797777:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129737.797783:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801300ff400/0x48868a4e4394715c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e14a expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.797796:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d6c4e00/0x48868a4e439470de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e0e8 expref: 39 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.797803:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094fd9c00/0x48868a4e43947124 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e112 expref: 22 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.797809:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129737.797810:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129737.797813:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801300ff400/0x48868a4e4394715c lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->2445311] (req 2097152->2445311) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e14a expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.797828:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094fd9c00/0x48868a4e43947124 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e112 expref: 22 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.797837:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094fd9c00/0x48868a4e43947124 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e112 expref: 22 pid: 3624 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746129737.797845:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be66a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053153664:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129737.797905:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d6c4e00/0x48868a4e439470de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e0e8 expref: 39 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.797912:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d6c4e00/0x48868a4e439470de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e0e8 expref: 39 pid: 3624 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746129737.797919:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be67100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053153792:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129737.797934:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129737.799795:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.800159:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be66a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053153664:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129737.800168:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be67100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053153792:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129737.800182:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801300ff400/0x48868a4e4394715c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->2445311] (req 2097152->2445311) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e14a expref: 23 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.800191:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801300ff400, rc 0) 00000100:00100000:1.0:1746129737.800320:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:28203:x1830949051831040:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2548us (2991us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129737.800327:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9915 00000100:00100000:0.0:1746129737.805384:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.806222:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051831552 00000100:00100000:1.0:1746129737.806230:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051831552 00000100:00100000:1.0:1746129737.806269:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3746 00000100:00100000:1.0:1746129737.806275:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+319:28197:x1830949051831552:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129737.806443:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+320:28197:x1830949051831552:12345-192.168.204.31@tcp:35:cat.0 Request processed in 168us (1071us total) trans 8589943415 rc 0/0 00000100:00100000:1.0:1746129737.806449:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3746 00000100:00100000:0.0:1746129737.808729:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.813067:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.813680:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.813721:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051831936 00000100:00100000:1.0:1746129737.813724:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051831936 00000100:00100000:1.0:1746129737.813753:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9916 00000100:00100000:1.0:1746129737.813760:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1962:x1830949051831808:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129737.813777:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129737.813791:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801300ffe00/0x48868a4e43947163 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e151 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129737.813833:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be67100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053153920:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129737.813917:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801363660c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129737.813991:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.816980:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be67100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053153920:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129737.817003:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801300ffe00/0x48868a4e43947163 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e151 expref: 23 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129737.817014:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801300ffe00/0x48868a4e43947163 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e151 expref: 23 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129737.817022:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801300ffe00, rc 0) 00000100:00100000:1.0:1746129737.817153:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949051831808:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3392us (4091us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129737.817159:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9916 00000100:00100000:1.0:1746129737.819104:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.819480:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051832192 00000100:00100000:0.0:1746129737.819486:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051832192 00000100:00100000:0.0:1746129737.819510:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9918 00000100:00100000:0.0:1746129737.819516:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:28200:x1830949051832192:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129737.819528:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129737.819540:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e0ba400/0x48868a4e43947171 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e15f expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129737.819559:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129737.819560:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129737.819567:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e0ba400/0x48868a4e43947171 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4960256->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e15f expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129737.819578:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e0ba400/0x48868a4e43947171 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4960256->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e15f expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129737.819590:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e0ba400, rc 0) 00000100:00100000:0.0:1746129737.819622:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:28200:x1830949051832192:12345-192.168.204.31@tcp:101:cat.0 Request processed in 106us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129737.819627:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9918 00000100:00100000:0.0:1746129737.820505:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.822060:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.822420:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.822458:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051832576 00000100:00100000:1.0:1746129737.822463:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051832576 00000100:00100000:1.0:1746129737.822492:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051832704 00000100:00100000:1.0:1746129737.822495:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051832704 00000100:00100000:1.0:1746129737.822508:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9919 00000100:00100000:1.0:1746129737.822514:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1961:x1830949051832576:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129737.822525:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129737.822537:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801300ff000/0x48868a4e43947178 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e166 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129737.822575:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be66a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053154176:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129737.822618:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801363660c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129737.824425:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be66a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053154176:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129737.824450:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801300ff000/0x48868a4e43947178 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e166 expref: 23 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129737.824461:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801300ff000/0x48868a4e43947178 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e166 expref: 23 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129737.824470:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801300ff000, rc 0) 00000100:00100000:1.0:1746129737.824513:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949051832576:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1997us (2451us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129737.824518:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9919 00000100:00100000:0.0:1746129737.826176:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.835451:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:1.0:1746129737.837084:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129737.839352:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.839423:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:0.0:1746129737.839756:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129737.841603:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.841681:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.844233:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.844329:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051833984 00000100:00100000:1.0:1746129737.844335:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051833984 00000100:00100000:1.0:1746129737.844376:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9921 00000100:00100000:1.0:1746129737.844382:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+6:1962:x1830949051833984:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129737.844394:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129737.844407:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801300ffe00/0x48868a4e439471a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e17b expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746129737.844434:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129737.844532:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be66a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053154560:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129737.844600:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801363660c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129737.844739:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.844766:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.844793:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.844836:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051834368 00000100:00100000:1.0:1746129737.844839:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051834368 00000100:00100000:1.0:1746129737.844876:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9922 00000100:00100000:1.0:1746129737.844881:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+7:1962:x1830949051834112:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129737.844888:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129737.844897:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801300fec00/0x48868a4e439471a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e182 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.844909:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129737.844911:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129737.844917:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801300fec00/0x48868a4e439471a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e182 expref: 8 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129737.844929:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801300fec00/0x48868a4e439471a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e182 expref: 8 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129737.844937:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801300fec00, rc 0) 00000100:00100000:1.0:1746129737.844955:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949051834112:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 75us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129737.844960:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9922 00000100:00100000:1.0:1746129737.844975:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9924 00000100:00100000:1.0:1746129737.844980:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+7:1962:x1830949051834624:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129737.844985:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129737.844991:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801300fea00/0x48868a4e439471b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e19e expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.845001:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129737.845002:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129737.845006:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801300fea00/0x48868a4e439471b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e19e expref: 8 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129737.845013:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801300fea00/0x48868a4e439471b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e19e expref: 8 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129737.845019:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801300fea00, rc 0) 00000100:00100000:1.0:1746129737.845033:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949051834624:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 53us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129737.845037:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9924 00000100:00080000:0.0:1746129737.845102:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129737.845120:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.845149:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.846519:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be66a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053154560:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129737.846539:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801300ffe00/0x48868a4e439471a2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e17b expref: 9 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129737.846548:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801300ffe00/0x48868a4e439471a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e17b expref: 9 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129737.846569:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801300ffe00, rc 0) 00000100:00100000:1.0:1746129737.846599:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949051833984:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 2217us (2372us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129737.846605:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9921 00000100:00100000:0.0:1746129737.849514:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.852058:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.852245:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051835008 00000100:00100000:1.0:1746129737.852252:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051835008 00010000:00010000:1.0:1746129737.852276:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135849400/0x48868a4e4394719b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e174 expref: 11 pid: 16808 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746129737.852311:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4774 00000100:00100000:1.0:1746129737.852318:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136886300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949051835008:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129737.852329:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129737.852333:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135849400/0x48868a4e4394719b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e174 expref: 11 pid: 16808 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.852341:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135849400/0x48868a4e4394719b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e174 expref: 11 pid: 16808 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.852357:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135849400/0x48868a4e4394719b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e174 expref: 11 pid: 16808 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.852369:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129737.852373:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x48868a4e439471d3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.852380:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x48868a4e439471d3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.852386:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x48868a4e439471d3 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129737.852399:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129737.852430:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136886300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949051835008:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 112us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129737.852435:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4774 00000100:00100000:0.0:1746129737.859321:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.862211:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.864990:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.865022:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.865217:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.865324:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.865349:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.865369:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.865567:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9928 00000100:00100000:1.0:1746129737.865574:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949051835776:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:1.0:1746129737.865593:0:8435:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801300ffa00/0x48868a4e43947204 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.865603:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130f7ec00/0x48868a4e43946e06 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df0c expref: 23 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.865610:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135bc9a00/0x48868a4e439471be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e189 expref: 11 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129737.865616:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131496a00/0x48868a4e43946e22 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df28 expref: 22 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129737.865620:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129737.865621:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129737.865623:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801300ffa00/0x48868a4e43947204 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.865639:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131496a00/0x48868a4e43946e22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df28 expref: 22 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129737.865646:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131496a00/0x48868a4e43946e22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df28 expref: 22 pid: 8435 timeout: 783 lvb_type: 1 00000100:00100000:1.0:1746129737.865665:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be66a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053155072:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129737.865693:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135bc9a00/0x48868a4e439471be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e189 expref: 11 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129737.865700:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135bc9a00/0x48868a4e439471be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e189 expref: 11 pid: 1140 timeout: 783 lvb_type: 1 00000100:00100000:1.0:1746129737.865707:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be66680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053155328:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129737.865730:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130f7ec00/0x48868a4e43946e06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df0c expref: 23 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.865737:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130f7ec00/0x48868a4e43946e06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df0c expref: 23 pid: 8435 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746129737.865744:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be66300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053155584:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129737.865760:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801363660c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129737.865775:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9930 00000100:00100000:1.0:1746129737.865781:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949051836032:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:1.0:1746129737.865796:0:7976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801300ff000/0x48868a4e43947212 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.865805:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801300ff400/0x48868a4e4394715c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2445311) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e14a expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.865811:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f83aa00/0x48868a4e43946fd4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e04e expref: 36 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.865817:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e0ba400/0x48868a4e43947171 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4960256->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e15f expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.865822:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:1.0:1746129737.865823:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:1.0:1746129737.865825:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801300ff000/0x48868a4e43947212 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.865837:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e0ba400/0x48868a4e43947171 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4960256->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e15f expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.865845:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e0ba400/0x48868a4e43947171 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4960256->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e15f expref: 21 pid: 4589 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746129737.865878:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053155968:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129737.865901:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f83aa00/0x48868a4e43946fd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e04e expref: 36 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.865908:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f83aa00/0x48868a4e43946fd4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e04e expref: 36 pid: 1140 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746129737.865915:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be64a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053156096:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129737.865945:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801300ff400/0x48868a4e4394715c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2445311) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e14a expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.865952:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801300ff400/0x48868a4e4394715c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->2445311) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e14a expref: 21 pid: 4589 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746129737.865964:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be64000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053156224:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129737.865977:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129737.871584:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be66a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053155072:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129737.871603:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.872882:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be66680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053155328:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129737.873756:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.873777:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051836416 00000100:00100000:1.0:1746129737.873781:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051836416 00010000:00010000:1.0:1746129737.873799:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801300fee00/0x48868a4e43947140 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e12e expref: 23 pid: 7976 timeout: 783 lvb_type: 1 00000100:00100000:1.0:1746129737.873818:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4776 00000100:00100000:1.0:1746129737.873824:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949051836416:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129737.873833:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129737.873845:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801300fee00/0x48868a4e43947140 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e12e expref: 23 pid: 7976 timeout: 783 lvb_type: 1 00010000:00010000:1.0:1746129737.874368:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801300fee00/0x48868a4e43947140 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e12e expref: 23 pid: 7976 timeout: 783 lvb_type: 1 00010000:00010000:1.0:1746129737.874383:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801300fee00/0x48868a4e43947140 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e12e expref: 23 pid: 7976 timeout: 783 lvb_type: 1 00010000:00010000:1.0:1746129737.874397:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129737.874417:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949051836416:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 593us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129737.874422:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4776 00000100:00100000:0.0:1746129737.874587:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.874599:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051836544 00000100:00100000:1.0:1746129737.874602:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051836544 00010000:00010000:1.0:1746129737.874614:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135bc9a00/0x48868a4e439471be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e189 expref: 12 pid: 1140 timeout: 783 lvb_type: 1 00000100:00100000:1.0:1746129737.874928:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4777 00000100:00100000:1.0:1746129737.874933:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+12:1963:x1830949051836544:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129737.874938:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129737.874941:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129737.874951:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135bc9a00/0x48868a4e439471be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e189 expref: 12 pid: 1140 timeout: 783 lvb_type: 1 00010000:00010000:1.0:1746129737.874959:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135bc9a00/0x48868a4e439471be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e189 expref: 12 pid: 1140 timeout: 783 lvb_type: 1 00010000:00010000:1.0:1746129737.874971:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135bc9a00/0x48868a4e439471be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e189 expref: 12 pid: 1140 timeout: 783 lvb_type: 1 00010000:00010000:1.0:1746129737.874979:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129737.874995:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949051836544:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 62us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129737.874997:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053155840:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129737.875000:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4777 00010000:00010000:0.0:1746129737.875012:0:3623:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135849600/0x48868a4e43947219 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129737.875018:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be66300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053155584:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129737.875031:0:8435:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801300ffa00/0x48868a4e43947204 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129737.876354:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be64a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053156096:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129737.876368:0:7976:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801300ff000/0x48868a4e43947212 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129737.876449:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051836928 00000100:00100000:1.0:1746129737.876454:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051836928 00010000:00010000:1.0:1746129737.876468:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801300fea00/0x48868a4e439471b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e19e expref: 11 pid: 7976 timeout: 783 lvb_type: 1 00000100:00100000:1.0:1746129737.876489:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051837056 00000100:00100000:1.0:1746129737.876491:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051837056 00010000:00010000:1.0:1746129737.876498:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801300fec00/0x48868a4e439471a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e182 expref: 12 pid: 7976 timeout: 783 lvb_type: 1 00000100:00100000:1.0:1746129737.876990:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4778 00000100:00100000:1.0:1746129737.876996:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+12:1964:x1830949051836928:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129737.877005:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129737.877018:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801300fea00/0x48868a4e439471b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e19e expref: 12 pid: 7976 timeout: 783 lvb_type: 1 00010000:00010000:1.0:1746129737.877026:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801300fea00/0x48868a4e439471b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e19e expref: 12 pid: 7976 timeout: 783 lvb_type: 1 00010000:00010000:1.0:1746129737.877039:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801300fea00/0x48868a4e439471b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e19e expref: 12 pid: 7976 timeout: 783 lvb_type: 1 00010000:00010000:1.0:1746129737.877049:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129737.877082:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949051836928:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 86us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129737.877088:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4778 00000100:00100000:0.0:1746129737.877202:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.877234:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051837568 00000100:00100000:1.0:1746129737.877237:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051837568 00010000:00010000:1.0:1746129737.877248:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130f7ec00/0x48868a4e43946e06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df0c expref: 24 pid: 8435 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746129737.877269:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4780 00000100:00100000:1.0:1746129737.877274:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1964:x1830949051837568:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129737.877280:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129737.877288:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130f7ec00/0x48868a4e43946e06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df0c expref: 24 pid: 8435 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.877296:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130f7ec00/0x48868a4e43946e06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df0c expref: 24 pid: 8435 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.877306:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130f7ec00/0x48868a4e43946e06 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34df0c expref: 24 pid: 8435 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.877314:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129737.877315:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129737.877319:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801300ffa00/0x48868a4e43947204 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.877326:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801300ffa00/0x48868a4e43947204 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.877342:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129737.877359:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1964:x1830949051837568:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 85us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129737.877368:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4780 00010000:00010000:0.0:1746129737.877735:0:8435:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801300ffa00/0x48868a4e43947204 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129737.877742:0:8435:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801300ffa00/0x48868a4e43947204 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129737.877761:0:8435:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801300ffa00/0x48868a4e43947204 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129737.877771:0:8435:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801300ffa00/0x48868a4e43947204 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129737.877778:0:8435:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801300ffa00/0x48868a4e43947204 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129737.877783:0:8435:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801300ffa00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129737.877787:0:8435:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801300ffa00/0x48868a4e43947204 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129737.877793:0:8435:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801300ffa00/0x48868a4e43947204 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129737.877802:0:8435:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801300ffa00/0x48868a4e43947204 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129737.877807:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801300ffa00/0x48868a4e43947204 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129737.877907:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949051835776:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 12332us (12882us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129737.877913:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9928 00000100:00100000:1.0:1746129737.880873:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.880934:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.880950:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.880962:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.880974:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.880985:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.880997:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051837696 00000100:00100000:1.0:1746129737.881000:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051837696 00010000:00010000:1.0:1746129737.881015:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f83aa00/0x48868a4e43946fd4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e04e expref: 39 pid: 1140 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746129737.881029:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051837952 00000100:00100000:1.0:1746129737.881030:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051837952 00010000:00010000:1.0:1746129737.881040:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb7c800/0x48868a4e43947132 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e120 expref: 23 pid: 7976 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746129737.881052:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051837184 00000100:00100000:1.0:1746129737.881054:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051837184 00010000:00010000:1.0:1746129737.881061:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6c4c00/0x48868a4e439470f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e0fd expref: 24 pid: 3624 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746129737.881068:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051837440 00000100:00100000:1.0:1746129737.881070:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051837440 00010000:00010000:1.0:1746129737.881076:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e0ba400/0x48868a4e43947171 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4960256->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e15f expref: 24 pid: 4589 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746129737.881084:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4781 00000100:00100000:1.0:1746129737.881089:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1961:x1830949051837696:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129737.881097:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129737.881108:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f83aa00/0x48868a4e43946fd4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e04e expref: 39 pid: 1140 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.881117:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f83aa00/0x48868a4e43946fd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e04e expref: 39 pid: 1140 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.881133:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f83aa00/0x48868a4e43946fd4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e04e expref: 39 pid: 1140 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.881144:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129737.881174:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1961:x1830949051837696:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 84us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129737.881180:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4781 00000100:00100000:1.0:1746129737.881194:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4782 00000100:00100000:1.0:1746129737.881199:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136886300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1961:x1830949051837952:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129737.881205:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129737.881216:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012eb7c800/0x48868a4e43947132 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e120 expref: 24 pid: 7976 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.881224:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012eb7c800/0x48868a4e43947132 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e120 expref: 24 pid: 7976 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.881234:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eb7c800/0x48868a4e43947132 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e120 expref: 24 pid: 7976 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.881246:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129737.881259:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136886300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1961:x1830949051837952:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 61us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129737.881264:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4782 00000100:00100000:1.0:1746129737.881273:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4783 00000100:00100000:1.0:1746129737.881277:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949051837184:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129737.881283:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129737.881291:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d6c4c00/0x48868a4e439470f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e0fd expref: 22 pid: 3624 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.881298:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d6c4c00/0x48868a4e439470f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e0fd expref: 22 pid: 3624 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.881307:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c4c00/0x48868a4e439470f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e0fd expref: 22 pid: 3624 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.881314:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129737.881315:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129737.881319:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c130c00/0x48868a4e4394720b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.881326:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c130c00/0x48868a4e4394720b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.881343:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129737.881356:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1961:x1830949051837184:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 79us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129737.881361:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4783 00000100:00100000:1.0:1746129737.881370:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4784 00000100:00100000:1.0:1746129737.881374:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:1961:x1830949051837440:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129737.881379:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129737.881385:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e0ba400/0x48868a4e43947171 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4960256->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e15f expref: 25 pid: 4589 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.881393:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e0ba400/0x48868a4e43947171 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4960256->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e15f expref: 25 pid: 4589 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.881402:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e0ba400/0x48868a4e43947171 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4960256->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e15f expref: 25 pid: 4589 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.881409:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129737.881421:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1961:x1830949051837440:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 48us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129737.881425:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4784 00000100:00100000:1.0:1746129737.881461:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.881474:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051837824 00000100:00100000:1.0:1746129737.881476:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051837824 00010000:00010000:1.0:1746129737.881485:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf46200/0x48868a4e4394711d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e10b expref: 21 pid: 3624 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746129737.881497:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4785 00000100:00100000:1.0:1746129737.881502:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8e0e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949051837824:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129737.881507:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129737.881513:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bf46200/0x48868a4e4394711d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e10b expref: 21 pid: 3624 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.881520:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bf46200/0x48868a4e4394711d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e10b expref: 21 pid: 3624 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.881528:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf46200/0x48868a4e4394711d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e10b expref: 21 pid: 3624 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746129737.881536:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129737.881537:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129737.881540:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135849800/0x48868a4e43947220 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.881545:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135849800/0x48868a4e43947220 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129737.881557:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129737.881568:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8e0e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949051837824:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 66us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129737.881572:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4785 00000100:00100000:0.0:1746129737.891374:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.901147:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.903983:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129737.904907:0:7976:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801300ff000/0x48868a4e43947212 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129737.904921:0:7976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801300ff000/0x48868a4e43947212 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129737.904934:0:7976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801300ff000/0x48868a4e43947212 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129737.904940:0:7976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801300ff000/0x48868a4e43947212 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129737.904946:0:7976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801300ff000/0x48868a4e43947212 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129737.904954:0:7976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801300ff000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129737.904957:0:7976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801300ff000/0x48868a4e43947212 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129737.904962:0:7976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801300ff000/0x48868a4e43947212 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129737.904972:0:7976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801300ff000/0x48868a4e43947212 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129737.904977:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801300ff000/0x48868a4e43947212 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129737.905024:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+6:1962:x1830949051836032:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 39244us (39699us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129737.905030:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9930 00000100:00100000:0.0:1746129737.913108:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.920051:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.920082:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.920094:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.920107:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051838720 00000100:00100000:1.0:1746129737.920114:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051838720 00010000:00010000:1.0:1746129737.920138:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a000/0x48868a4e43946ad3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dd0d expref: 20 pid: 16808 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746129737.921259:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051838848 00000100:00100000:1.0:1746129737.921263:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051838848 00010000:00010000:1.0:1746129737.921277:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131849600/0x48868a4e43946a78 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dcce expref: 320 pid: 15044 timeout: 783 lvb_type: 0 00000100:00100000:0.0:1746129737.921794:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4790 00000100:00100000:0.0:1746129737.921802:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+320:1964:x1830949051838848:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129737.921809:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129737.921813:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131849600/0x48868a4e43946a78 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dcce expref: 320 pid: 15044 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746129737.921820:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131849600/0x48868a4e43946a78 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dcce expref: 320 pid: 15044 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746129737.921829:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131849600/0x48868a4e43946a78 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dcce expref: 320 pid: 15044 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746129737.921868:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129737.921871:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009adaa600/0x48868a4e43947227 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129737.921877:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129737.921910:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+319:1964:x1830949051838848:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 110us (1827us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129737.921916:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4790 00000100:00100000:0.0:1746129737.921931:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4791 00000100:00100000:0.0:1746129737.921935:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949051838976:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129737.921941:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129737.921945:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0fe400/0x48868a4e43946a2b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc96 expref: 20 pid: 16808 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746129737.921951:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0fe400/0x48868a4e43946a2b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc96 expref: 20 pid: 16808 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746129737.921960:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0fe400/0x48868a4e43946a2b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34dc96 expref: 20 pid: 16808 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746129737.921967:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129737.921969:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009adaa600/0x48868a4e43947227 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129737.921974:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129737.921988:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949051838976:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 53us (1893us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129737.921992:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4791 00000001:00080000:0.0:1746129737.950538:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943404 is committed 00000001:00080000:0.0:1746129737.950546:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943390 is committed 00000001:00080000:0.0:1746129737.950553:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943415 is committed 00000001:00080000:0.0:1746129737.950576:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943382 is committed 00000001:00080000:0.0:1746129737.950582:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943417 is committed 00000001:00080000:0.0:1746129737.950601:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943383 is committed 00000001:00080000:0.0:1746129737.950632:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943420 is committed 00000004:00080000:0.0:1746129737.950635:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1782 committed 00000004:00080000:0.0:1746129737.950810:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1824 committed 00000004:00080000:0.0:1746129737.950817:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1823 committed 00000004:00080000:0.0:1746129737.950818:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1822 committed 00000004:00080000:0.0:1746129737.950820:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1821 committed 00000004:00080000:0.0:1746129737.950822:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1781 committed 00000004:00080000:0.0:1746129737.950824:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1820 committed 00000004:00080000:0.0:1746129737.950825:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1780 committed 00000004:00080000:0.0:1746129737.950828:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1819 committed 00000004:00080000:0.0:1746129737.950829:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1779 committed 00000004:00080000:0.0:1746129737.950830:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1778 committed 00000004:00080000:0.0:1746129737.950832:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1777 committed 00000004:00080000:0.0:1746129737.950833:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1818 committed 00000004:00080000:0.0:1746129737.950835:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1817 committed 00000004:00080000:0.0:1746129737.950836:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1776 committed 00000004:00080000:0.0:1746129737.950838:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1775 committed 00000004:00080000:0.0:1746129737.950839:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1816 committed 00000001:00080000:0.0:1746129737.950862:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943416 is committed 00000100:00080000:0.0:1746129737.952291:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129737.953219:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.956722:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053158400 00000100:00100000:1.0:1746129737.956730:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053158400 00000100:00100000:1.0:1746129737.956777:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053158784 00000100:00100000:1.0:1746129737.956779:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053158784 00000100:00100000:1.0:1746129737.956802:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9941 00000100:00100000:1.0:1746129737.956808:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3296:x1830949053158400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129737.957001:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3296:x1830949053158400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 193us (3605us total) trans 17179872907 rc 0/0 00000100:00100000:1.0:1746129737.957006:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9941 00000100:00100000:1.0:1746129737.957029:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9942 00000100:00100000:1.0:1746129737.957032:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3299:x1830949053158784:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129737.957088:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746129737.957091:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746129737.957092:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746129737.957094:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746129737.957095:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129737.957112:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3299:x1830949053158784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (2566us total) trans 17179872908 rc 0/0 00000100:00100000:1.0:1746129737.957117:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9942 00000100:00100000:1.0:1746129737.957222:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053159296 00000100:00100000:1.0:1746129737.957225:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053159296 00000100:00100000:1.0:1746129737.957243:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9943 00000100:00100000:1.0:1746129737.957246:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3299:x1830949053159296:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129737.957326:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3299:x1830949053159296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (2176us total) trans 17179872909 rc 0/0 00000100:00100000:1.0:1746129737.957331:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9943 00000100:00100000:1.0:1746129737.957340:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053159040 00000100:00100000:1.0:1746129737.957343:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053159040 00000100:00100000:1.0:1746129737.957354:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9945 00000100:00100000:1.0:1746129737.957357:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3297:x1830949053159040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129737.957424:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3297:x1830949053159040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (131us total) trans 17179872911 rc 0/0 00000100:00100000:1.0:1746129737.957429:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9945 00000100:00100000:1.0:1746129737.957447:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053158656 00000100:00100000:1.0:1746129737.957449:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053158656 00000100:00100000:1.0:1746129737.957460:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9946 00000100:00100000:1.0:1746129737.957464:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3298:x1830949053158656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129737.957535:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3298:x1830949053158656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (103us total) trans 17179872912 rc 0/0 00000100:00100000:1.0:1746129737.957540:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9946 00000100:00100000:1.0:1746129737.957588:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746129737.957593:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053159424:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129737.957611:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746129737.958575:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1746129737.959364:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009be66680/2, rc 0, transno 17179872915 00000100:00100000:1.0:1746129737.959370:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053159424:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129737.959384:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009be64a80/2, rc 0, transno 17179872914 00000100:00100000:1.0:1746129737.959387:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053158912:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129737.962134:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129737.962184:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051839488 00000100:00100000:0.0:1746129737.962190:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051839488 00000100:00100000:0.0:1746129737.962978:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9661 00000100:00100000:0.0:1746129737.962986:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:28209:x1830949051839488:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129737.963002:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129737.963017:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f7600/0x48868a4e43947235 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e1c1 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129737.963081:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71e00/0x48868a4e4394723c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129737.963092:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71e00/0x48868a4e4394723c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129737.963101:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71e00/0x48868a4e4394723c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:0.0:1746129737.963122:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:0.0:1746129737.963126:0:16808:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129737.963139:0:16808:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71e00/0x48868a4e4394723c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129737.963160:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f7600/0x48868a4e43947235 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1c1 expref: 10 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129737.963173:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71e00/0x48868a4e4394723c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1c1 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129737.963181:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129737.963183:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129737.963185:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f71e00, rc 0) 00000100:00100000:0.0:1746129737.963232:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+9:28209:x1830949051839488:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 246us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129737.963237:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9661 00000100:00100000:1.0:1746129737.967146:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.967843:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.967889:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.967901:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.967917:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129737.967936:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129738.000480:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129738.358478:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129738.986806:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129738.986833:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129738.986874:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051841152 00000100:00100000:1.0:1746129738.986881:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051841152 00000100:00100000:1.0:1746129738.986918:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051841536 00000100:00100000:1.0:1746129738.986921:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051841536 00000100:00100000:1.0:1746129738.986937:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3618 00000100:00100000:1.0:1746129738.986944:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949051841152:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:1.0:1746129738.986970:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880130542400/0x48868a4e4394727b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129738.986982:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129738.986983:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129738.986987:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130542400/0x48868a4e4394727b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129738.986998:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130542400/0x48868a4e4394727b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129738.989781:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3619 00000100:00100000:0.0:1746129738.989794:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949051841536:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:0.0:1746129738.989829:0:21601:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43947282 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129738.989841:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129738.989842:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129738.989862:0:21601:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43947282 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129738.989878:0:21601:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43947282 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129738.991097:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129738.991623:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051841664 00000100:00100000:0.0:1746129738.991630:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051841664 00000100:00100000:0.0:1746129738.991678:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3620 00000100:00100000:0.0:1746129738.991683:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6141239f-0c60-480d-830c-e22ba61457b0+13:1961:x1830949051841664:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:0.0:1746129738.991705:0:21605:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88013185ce00/0x48868a4e43947289 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129738.991714:0:21605:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129738.991715:0:21605:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129738.991718:0:21605:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013185ce00/0x48868a4e43947289 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129738.991726:0:21605:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013185ce00/0x48868a4e43947289 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129738.995702:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129738.996377:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129738.996400:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129738.996422:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051841792 00000100:00100000:0.0:1746129738.996429:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051841792 00000100:00100000:0.0:1746129738.996466:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051842048 00000100:00100000:0.0:1746129738.996468:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051842048 00000100:00100000:0.0:1746129738.996496:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051842176 00000100:00100000:0.0:1746129738.996499:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051842176 00000100:00100000:0.0:1746129738.996524:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3622 00000100:00100000:0.0:1746129738.996530:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6141239f-0c60-480d-830c-e22ba61457b0+14:1962:x1830949051842048:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:0.0:1746129738.996553:0:21599:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88013185d200/0x48868a4e43947290 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129738.996565:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129738.996566:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129738.996570:0:21599:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013185d200/0x48868a4e43947290 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129738.996580:0:21599:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013185d200/0x48868a4e43947290 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129738.996794:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3623 00000100:00100000:1.0:1746129738.996801:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6141239f-0c60-480d-830c-e22ba61457b0+14:1962:x1830949051842176:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:1.0:1746129738.996816:0:21604:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f9bca00/0x48868a4e4394729e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129738.996822:0:21604:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129738.996823:0:21604:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129738.996826:0:21604:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9bca00/0x48868a4e4394729e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129738.996833:0:21604:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f9bca00/0x48868a4e4394729e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.034779:0:21601:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43947282 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.034795:0:21601:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43947282 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.034802:0:21601:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43947282 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.034809:0:21601:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd85600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129739.034813:0:21601:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43947282 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.034820:0:21601:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43947282 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.034840:0:21601:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43947282 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.034860:0:21601:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43947282 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129739.034920:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949051841536:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 45127us (48083us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129739.034930:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3619 00010000:00010000:1.0:1746129739.069473:0:21604:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f9bca00/0x48868a4e4394729e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129739.069488:0:21604:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9bca00/0x48868a4e4394729e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129739.069496:0:21604:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f9bca00/0x48868a4e4394729e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129739.069501:0:21604:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f9bca00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129739.069505:0:21604:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f9bca00/0x48868a4e4394729e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129739.069512:0:21604:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f9bca00/0x48868a4e4394729e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129739.069527:0:21604:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f9bca00/0x48868a4e4394729e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129739.069536:0:21604:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bca00/0x48868a4e4394729e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129739.069601:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949051842176:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 72796us (73195us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129739.069611:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3623 00000100:00100000:0.0:1746129739.089177:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.089891:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051842432 00000100:00100000:1.0:1746129739.089900:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051842432 00000100:00100000:1.0:1746129739.089963:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 546 00000100:00100000:1.0:1746129739.089971:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+9:28209:x1830949051842432:12345-192.168.204.31@tcp:103:mirror_io.0 00010000:00010000:1.0:1746129739.089983:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129739.090004:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130a00/0x48868a4e439471e8 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1ac expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129739.090022:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129739.090026:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129739.090061:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+8:28209:x1830949051842432:12345-192.168.204.31@tcp:103:mirror_io.0 Request processed in 92us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129739.090066:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 546 00000100:00080000:0.0:1746129739.090147:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129739.096948:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.099188:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051842944 00000100:00100000:0.0:1746129739.099194:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051842944 00000100:00100000:0.0:1746129739.099232:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3750 00000100:00100000:0.0:1746129739.099239:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:28209:x1830949051842944:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:0.0:1746129739.099373:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+10:28209:x1830949051842944:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 134us (237us total) trans 8589943422 rc 0/0 00000100:00100000:0.0:1746129739.099379:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3750 00000100:00100000:0.0:1746129739.119370:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:0.0:1746129739.120264:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129739.137511:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.142365:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051843712 00000100:00100000:1.0:1746129739.142374:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051843712 00000100:00100000:1.0:1746129739.142505:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9663 00000100:00100000:1.0:1746129739.142726:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+281:28223:x1830949051843712:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129739.142744:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129739.142758:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7d800/0x48868a4e439472c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e1f9 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129739.142840:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7da00/0x48868a4e439472cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129739.142868:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7da00/0x48868a4e439472cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129739.142877:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7da00/0x48868a4e439472cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129739.142888:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7dc00/0x48868a4e439472d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129739.142893:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7dc00/0x48868a4e439472d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129739.142898:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7dc00/0x48868a4e439472d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129739.142981:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7c600/0x48868a4e439472dd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129739.142988:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7c600/0x48868a4e439472dd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129739.142993:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7c600/0x48868a4e439472dd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:1.0:1746129739.142999:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129739.143064:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7da00/0x48868a4e439472cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129739.143069:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7da00/0x48868a4e439472cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129739.143077:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7da00/0x48868a4e439472cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129739.143082:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eb7da00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129739.143084:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7da00/0x48868a4e439472cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129739.143089:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7da00/0x48868a4e439472cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129739.143098:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129739.143100:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129739.143103:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7da00/0x48868a4e439472cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129739.143108:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7da00/0x48868a4e439472cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129739.143133:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7dc00/0x48868a4e439472d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129739.143137:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7dc00/0x48868a4e439472d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129739.143141:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7dc00/0x48868a4e439472d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129739.143144:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eb7dc00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129739.143146:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7dc00/0x48868a4e439472d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129739.143150:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7dc00/0x48868a4e439472d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129739.143158:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e8c7300) 00010000:00010000:1.0:1746129739.143159:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129739.143161:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7dc00/0x48868a4e439472d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129739.143164:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7dc00/0x48868a4e439472d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129739.143195:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7d800/0x48868a4e439472c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1f9 expref: 284 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129739.143206:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7c600/0x48868a4e439472dd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1f9 expref: 283 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129739.143211:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129739.143213:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129739.143215:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb7c600, rc 0) 00000100:00100000:1.0:1746129739.143250:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28223:x1830949051843712:12345-192.168.204.31@tcp:101:cat.0 Request processed in 738us (1470us total) trans 8589943425 rc 0/0 00000100:00100000:1.0:1746129739.143255:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9663 00000100:00080000:1.0:1746129739.143333:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129739.153898:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.169996:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051843840 00000100:00100000:1.0:1746129739.170001:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051843840 00000100:00100000:1.0:1746129739.170028:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9959 00000100:00100000:1.0:1746129739.170033:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+6:1963:x1830949051843840:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129739.170041:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129739.170049:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb7d400/0x48868a4e4394730e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e200 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129739.170064:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129739.170065:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129739.170070:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb7d400/0x48868a4e4394730e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e200 expref: 7 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129739.170078:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eb7d400/0x48868a4e4394730e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e200 expref: 7 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129739.170084:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb7d400, rc 0) 00000100:00100000:1.0:1746129739.170102:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1963:x1830949051843840:12345-192.168.204.31@tcp:101:cat.0 Request processed in 69us (27475us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129739.170107:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9959 00000100:00100000:1.0:1746129739.193982:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.194202:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.194220:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051844352 00000100:00100000:0.0:1746129739.194227:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051844352 00000100:00100000:0.0:1746129739.194257:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9960 00000100:00100000:0.0:1746129739.194264:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1963:x1830949051844352:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129739.194280:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129739.194293:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013185de00/0x48868a4e43947315 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e21c expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.194310:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129739.194312:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129739.194319:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013185de00/0x48868a4e43947315 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e21c expref: 8 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129739.194332:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013185de00/0x48868a4e43947315 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e21c expref: 8 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129739.194341:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013185de00, rc 0) 00000100:00100000:0.0:1746129739.194371:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1963:x1830949051844352:12345-192.168.204.31@tcp:101:cat.0 Request processed in 108us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129739.194377:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9960 00000100:00100000:0.0:1746129739.194401:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.194438:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.194450:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.194461:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.194472:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.194483:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.194496:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.194531:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.194543:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.194563:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.194575:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051844480 00000100:00100000:0.0:1746129739.194577:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051844480 00000100:00100000:0.0:1746129739.194590:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051844864 00000100:00100000:0.0:1746129739.194591:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051844864 00000100:00100000:0.0:1746129739.194605:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051844992 00000100:00100000:0.0:1746129739.194606:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051844992 00000100:00100000:0.0:1746129739.194615:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051845120 00000100:00100000:0.0:1746129739.194616:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051845120 00000100:00100000:0.0:1746129739.194623:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051845248 00000100:00100000:0.0:1746129739.194625:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051845248 00000100:00100000:0.0:1746129739.194647:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9961 00000100:00100000:0.0:1746129739.194652:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1963:x1830949051844480:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129739.194658:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129739.194666:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013185c000/0x48868a4e4394731c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e223 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.194676:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129739.194677:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129739.194681:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013185c000/0x48868a4e4394731c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e223 expref: 24 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129739.194690:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013185c000/0x48868a4e4394731c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e223 expref: 24 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129739.194696:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013185c000, rc 0) 00000100:00100000:0.0:1746129739.194712:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1963:x1830949051844480:12345-192.168.204.31@tcp:101:cat.0 Request processed in 60us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129739.194716:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9961 00000100:00100000:0.0:1746129739.194723:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051845376 00000100:00100000:0.0:1746129739.194726:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051845376 00000100:00100000:0.0:1746129739.194732:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051845504 00000100:00100000:0.0:1746129739.194733:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051845504 00000100:00100000:0.0:1746129739.194739:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9962 00000100:00100000:0.0:1746129739.194743:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949051844864:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129739.194748:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129739.194753:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136920800/0x48868a4e43947323 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e231 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.194761:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129739.194762:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129739.194766:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136920800/0x48868a4e43947323 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e231 expref: 20 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129739.194774:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136920800/0x48868a4e43947323 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e231 expref: 20 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129739.194780:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136920800, rc 0) 00000100:00100000:0.0:1746129739.194789:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949051844864:12345-192.168.204.31@tcp:101:cat.0 Request processed in 46us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129739.194793:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9962 00000100:00100000:0.0:1746129739.194800:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9963 00000100:00100000:0.0:1746129739.194804:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949051844992:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129739.194808:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129739.194813:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013185d200/0x48868a4e4394732a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e238 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.194820:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129739.194822:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129739.194826:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013185d200/0x48868a4e4394732a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e238 expref: 23 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129739.194833:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013185d200/0x48868a4e4394732a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e238 expref: 23 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129739.194839:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013185d200, rc 0) 00000100:00100000:0.0:1746129739.194867:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949051844992:12345-192.168.204.31@tcp:101:cat.0 Request processed in 62us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129739.194871:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9963 00000100:00100000:0.0:1746129739.194878:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9964 00000100:00100000:0.0:1746129739.194882:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949051845120:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129739.194887:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129739.194891:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013185cc00/0x48868a4e43947331 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e23f expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.194899:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129739.194900:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129739.194903:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013185cc00/0x48868a4e43947331 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e23f expref: 23 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129739.194911:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013185cc00/0x48868a4e43947331 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e23f expref: 23 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129739.194916:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013185cc00, rc 0) 00000100:00100000:0.0:1746129739.194927:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949051845120:12345-192.168.204.31@tcp:101:cat.0 Request processed in 45us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129739.194935:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9964 00000100:00100000:0.0:1746129739.194941:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9965 00000100:00100000:0.0:1746129739.194945:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949051845248:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129739.194949:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129739.194953:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013185d000/0x48868a4e43947338 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e246 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.194960:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129739.194961:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129739.194964:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013185d000/0x48868a4e43947338 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e246 expref: 20 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129739.194972:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013185d000/0x48868a4e43947338 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e246 expref: 20 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129739.194978:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013185d000, rc 0) 00000100:00100000:0.0:1746129739.194987:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949051845248:12345-192.168.204.31@tcp:101:cat.0 Request processed in 42us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129739.194991:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9965 00000100:00100000:0.0:1746129739.194997:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9966 00000100:00100000:0.0:1746129739.195001:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949051845376:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129739.195005:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129739.195008:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013185ca00/0x48868a4e4394733f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e24d expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.195015:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129739.195017:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129739.195020:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013185ca00/0x48868a4e4394733f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e24d expref: 20 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129739.195027:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013185ca00/0x48868a4e4394733f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e24d expref: 20 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129739.195032:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013185ca00, rc 0) 00000100:00100000:0.0:1746129739.195041:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949051845376:12345-192.168.204.31@tcp:101:cat.0 Request processed in 40us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129739.195045:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9966 00000100:00100000:0.0:1746129739.195051:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9967 00000100:00100000:0.0:1746129739.195054:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949051845504:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129739.195058:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129739.195062:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013185ce00/0x48868a4e43947346 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e254 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.195069:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129739.195070:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129739.195072:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013185ce00/0x48868a4e43947346 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e254 expref: 23 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129739.195080:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013185ce00/0x48868a4e43947346 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e254 expref: 23 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129739.195085:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013185ce00, rc 0) 00000100:00100000:0.0:1746129739.195095:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949051845504:12345-192.168.204.31@tcp:101:cat.0 Request processed in 40us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129739.195102:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9967 00000100:00100000:0.0:1746129739.195118:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051845888 00000100:00100000:0.0:1746129739.195120:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051845888 00010000:00010000:0.0:1746129739.195132:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7c600/0x48868a4e439472dd lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1f9 expref: 283 pid: 16808 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746129739.195144:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051846144 00000100:00100000:0.0:1746129739.195146:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051846144 00010000:00010000:0.0:1746129739.195153:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71e00/0x48868a4e4394723c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1c1 expref: 10 pid: 16808 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746129739.195163:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051846016 00000100:00100000:0.0:1746129739.195164:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051846016 00010000:00010000:0.0:1746129739.195170:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb6c00/0x48868a4e439472ba lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1f2 expref: 12 pid: 14315 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746129739.195180:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4794 00000100:00100000:0.0:1746129739.195184:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:1964:x1830949051845888:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129739.195191:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129739.195195:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7c600/0x48868a4e439472dd lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1f9 expref: 283 pid: 16808 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746129739.195203:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7c600/0x48868a4e439472dd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1f9 expref: 283 pid: 16808 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746129739.195216:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129739.195221:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb7800/0x48868a4e43947300 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129739.195231:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb7800/0x48868a4e43947300 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129739.195235:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129739.195245:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:1964:x1830949051845888:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 61us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129739.195250:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4794 00000100:00100000:0.0:1746129739.195257:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4795 00000100:00100000:0.0:1746129739.195260:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+10:1964:x1830949051846144:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129739.195265:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129739.195268:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71e00/0x48868a4e4394723c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1c1 expref: 10 pid: 16808 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746129739.195275:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71e00/0x48868a4e4394723c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1c1 expref: 10 pid: 16808 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746129739.195282:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129739.195285:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb7800/0x48868a4e43947300 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129739.195289:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb7800/0x48868a4e43947300 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129739.195294:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129739.195300:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+10:1964:x1830949051846144:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 40us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129739.195304:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4795 00000100:00100000:0.0:1746129739.195311:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4796 00000100:00100000:0.0:1746129739.195315:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1964:x1830949051846016:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129739.195320:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129739.195323:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb6c00/0x48868a4e439472ba lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1f2 expref: 12 pid: 14315 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746129739.195330:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb6c00/0x48868a4e439472ba lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1f2 expref: 12 pid: 14315 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746129739.195337:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129739.195339:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb7800/0x48868a4e43947300 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129739.195345:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb7800/0x48868a4e43947300 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129739.195350:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb7800/0x48868a4e43947300 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129739.195360:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129739.195367:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1964:x1830949051846016:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 52us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129739.195371:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4796 00000100:00080000:0.0:1746129739.195400:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746129739.195403:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129739.195517:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051845760 00000100:00100000:0.0:1746129739.195520:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051845760 00000100:00100000:0.0:1746129739.195535:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9665 00000100:00100000:0.0:1746129739.195539:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28220:x1830949051845760:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129739.195549:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129739.195556:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445200/0x48868a4e4394734d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e25b expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.195615:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445400/0x48868a4e43947354 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129739.195622:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445400/0x48868a4e43947354 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x1f/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129739.195642:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445400/0x48868a4e43947354 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x1f/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:0.0:1746129739.195650:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129739.195730:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445200/0x48868a4e4394734d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e25b expref: 286 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.195745:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445400/0x48868a4e43947354 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x1f/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e25b expref: 285 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.195751:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129739.195753:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:0.0:1746129739.195755:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c445400, rc 0) 00000100:00100000:0.0:1746129739.195770:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28220:x1830949051845760:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 231us (1796us total) trans 8589943426 rc 0/0 00000100:00100000:0.0:1746129739.195775:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9665 00010000:00010000:0.0:1746129739.195808:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb7c600/0x48868a4e439472dd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1f9 expref: 284 pid: 16808 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746129739.195816:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c042300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053159552:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129739.195824:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb6c00/0x48868a4e439472ba lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1f2 expref: 11 pid: 14315 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746129739.195831:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c041180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053159680:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129739.195839:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71e00/0x48868a4e4394723c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1c1 expref: 9 pid: 16808 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746129739.195864:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053159808:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129739.195880:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb7800/0x48868a4e43947300 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129739.195887:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb7800/0x48868a4e43947300 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129739.195891:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb7800/0x48868a4e43947300 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:0.0:1746129739.195899:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129739.195941:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb6a00/0x48868a4e439472f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e22a expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.195949:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb7800/0x48868a4e43947300 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e22a expref: 11 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.195955:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129739.195957:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129739.195958:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fb7800, rc 0) 00000100:00100000:0.0:1746129739.195970:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28218:x1830949051844736:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 31904us (51944us total) trans 8589943427 rc 0/0 00000100:00100000:0.0:1746129739.195975:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9664 00000100:00100000:0.0:1746129739.210014:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.210056:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051846272 00000100:00100000:0.0:1746129739.210065:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051846272 00000100:00100000:0.0:1746129739.210114:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9666 00000100:00100000:0.0:1746129739.210124:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28222:x1830949051846272:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129739.210147:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129739.210164:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445800/0x48868a4e43947369 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e262 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.210221:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445800/0x48868a4e43947369 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e262 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.210235:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445800/0x48868a4e43947369 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e262 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.210253:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129739.210256:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129739.210260:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c445800, rc 0) 00000100:00100000:0.0:1746129739.210309:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28222:x1830949051846272:12345-192.168.204.31@tcp:101:cat.0 Request processed in 186us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129739.210316:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9666 00000100:00100000:1.0:1746129739.255600:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.262360:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.262900:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.262922:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.264742:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051846784 00000100:00100000:1.0:1746129739.264752:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051846784 00002000:00100000:1.0:1746129739.264784:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ba87b80 x1830949051846784/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:480/0 lens 488/0 e 0 to 0 dl 1746129750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.264793:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba87b80 with x1830949051846784 ext(1048576->2097151) 00002000:00010000:1.0:1746129739.264798:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba87b80 00000100:00100000:1.0:1746129739.264810:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051847040 00000100:00100000:1.0:1746129739.264812:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051847040 00002000:00100000:1.0:1746129739.264819:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009ba85180 x1830949051847040/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:480/0 lens 488/0 e 0 to 0 dl 1746129750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.264825:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85180 with x1830949051847040 ext(1048576->2097151) 00002000:00010000:1.0:1746129739.264828:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba85180 00000100:00100000:1.0:1746129739.264835:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051847296 00000100:00100000:1.0:1746129739.264837:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051847296 00002000:00100000:1.0:1746129739.264857:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009ba87480 x1830949051847296/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:480/0 lens 488/0 e 0 to 0 dl 1746129750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.264863:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba87480 with x1830949051847296 ext(1048576->2097151) 00002000:00010000:1.0:1746129739.264865:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba87480 00000100:00100000:1.0:1746129739.264875:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3625 00000100:00100000:1.0:1746129739.264881:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:1963:x1830949051846784:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129739.266358:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3626 00000100:00100000:1.0:1746129739.266369:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1963:x1830949051847040:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129739.276405:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.276899:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051847552 00000100:00100000:0.0:1746129739.276906:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051847552 00000100:00100000:0.0:1746129739.276941:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9667 00000100:00100000:0.0:1746129739.276949:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28218:x1830949051847552:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129739.276965:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129739.276968:0:15044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746129739.276988:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445800/0x48868a4e43947369 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e262 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.277004:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129739.277008:0:15044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129739.277017:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445c00/0x48868a4e43947370 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e269 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.277053:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445a00/0x48868a4e43947377 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129739.277062:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x48868a4e4394722e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1ba expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.277068:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445400/0x48868a4e43947354 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e25b expref: 283 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.277072:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445a00/0x48868a4e43947377 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129739.277095:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445400/0x48868a4e43947354 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e25b expref: 283 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.277105:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445400/0x48868a4e43947354 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e25b expref: 283 pid: 16808 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746129739.277116:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba84000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053159936:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129739.277184:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x48868a4e4394722e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1ba expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.277191:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x48868a4e4394722e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1ba expref: 8 pid: 14315 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746129739.277198:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c041180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053160064:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129739.277215:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129739.291641:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.291722:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.291750:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051847680 00000100:00100000:0.0:1746129739.291757:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051847680 00010000:00010000:0.0:1746129739.291787:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445400/0x48868a4e43947354 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e25b expref: 284 pid: 16808 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746129739.291812:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051847808 00000100:00100000:0.0:1746129739.291815:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051847808 00010000:00010000:0.0:1746129739.291825:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x48868a4e4394722e lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1ba expref: 9 pid: 14315 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746129739.291842:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4797 00000100:00100000:0.0:1746129739.291871:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:1962:x1830949051847680:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129739.291883:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129739.291889:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445400/0x48868a4e43947354 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x1f/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e25b expref: 284 pid: 16808 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746129739.291898:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445400/0x48868a4e43947354 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x1f/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e25b expref: 284 pid: 16808 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746129739.291919:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129739.291924:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445a00/0x48868a4e43947377 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129739.291931:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445a00/0x48868a4e43947377 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129739.291935:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129739.291972:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:1962:x1830949051847680:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 123us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129739.291978:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4797 00000100:00100000:0.0:1746129739.291993:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4798 00000100:00100000:0.0:1746129739.291998:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8e0d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949051847808:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129739.292005:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129739.292009:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x48868a4e4394722e lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1ba expref: 9 pid: 14315 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746129739.292016:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x48868a4e4394722e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1ba expref: 9 pid: 14315 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746129739.292026:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129739.292028:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445a00/0x48868a4e43947377 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129739.292034:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445a00/0x48868a4e43947377 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129739.292040:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445a00/0x48868a4e43947377 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129739.292054:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129739.292071:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8e0d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949051847808:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 72us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129739.292076:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4798 00010000:00010000:0.0:1746129739.292141:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445400/0x48868a4e43947354 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e25b expref: 283 pid: 16808 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746129739.292154:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba84000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053159936:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129739.292164:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x48868a4e4394722e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1ba expref: 8 pid: 14315 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746129739.292172:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c041180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053160064:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129739.292188:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445a00/0x48868a4e43947377 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129739.292195:0:15044:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445a00/0x48868a4e43947377 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129739.292199:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445a00/0x48868a4e43947377 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000040:00080000:0.0:1746129739.296716:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2641, 88 off219240 00000004:00080000:0.0:1746129739.296726:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 685354878002ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129739.296767:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2596, 88 off215368 00000004:00080000:0.0:1746129739.296772:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 685354923560ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129739.296784:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2597, 88 off215456 00000004:00080000:0.0:1746129739.296786:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 685354938454ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129739.296794:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2642, 88 off219328 00000004:00080000:0.0:1746129739.296797:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 685354949259ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129739.296804:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2643, 88 off219416 00000004:00080000:0.0:1746129739.296806:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 685354958207ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129739.296813:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2598, 88 off215544 00000004:00080000:0.0:1746129739.296815:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 685354966919ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129739.296821:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2599, 88 off215632 00000004:00080000:0.0:1746129739.296823:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 685354974912ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129739.296829:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2600, 88 off215720 00000004:00080000:0.0:1746129739.296830:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 685354982622ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129739.296837:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2644, 88 off219504 00000004:00080000:0.0:1746129739.296839:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 685354991379ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129739.296862:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2601, 88 off215808 00000004:00080000:0.0:1746129739.296997:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 685355149270ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129739.297010:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2645, 88 off219592 00000004:00080000:0.0:1746129739.297013:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 685355164974ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129739.297023:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2602, 88 off215896 00000004:00080000:0.0:1746129739.297026:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 685355178182ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129739.297033:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2646, 88 off219680 00000004:00080000:0.0:1746129739.297035:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 685355187440ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129739.297042:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2647, 88 off219768 00000004:00080000:0.0:1746129739.297044:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 685355195754ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129739.297050:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2648, 88 off219856 00000004:00080000:0.0:1746129739.297052:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 685355203879ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129739.297058:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2649, 88 off219944 00000004:00080000:0.0:1746129739.297060:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 685355211832ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129739.297066:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2603, 88 off215984 00000004:00080000:0.0:1746129739.297068:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 685355220130ns, next at 641623252291ns, rc = 0 00000100:00100000:0.0:1746129739.307242:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.307268:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.307282:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.307293:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.307307:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.307354:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051848192 00000100:00100000:0.0:1746129739.307361:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051848192 00002000:00100000:0.0:1746129739.307394:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012c041180 x1830949051848192/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/0 e 0 to 0 dl 1746129750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129739.307402:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c041180 with x1830949051848192 ext(0->1048575) 00002000:00010000:0.0:1746129739.307407:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c041180 00000100:00100000:0.0:1746129739.307422:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051848448 00000100:00100000:0.0:1746129739.307424:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051848448 00002000:00100000:0.0:1746129739.307435:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012c042300 x1830949051848448/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/0 e 0 to 0 dl 1746129750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129739.307441:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c042300 with x1830949051848448 ext(1048576->2097151) 00002000:00010000:0.0:1746129739.307444:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c042300 00000100:00100000:0.0:1746129739.307453:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051848576 00000100:00100000:0.0:1746129739.307455:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051848576 00002000:00100000:0.0:1746129739.307462:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012da49500 x1830949051848576/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/0 e 0 to 0 dl 1746129750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129739.307468:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012da49500 with x1830949051848576 ext(1048576->2097151) 00002000:00010000:0.0:1746129739.307470:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012da49500 00000100:00100000:0.0:1746129739.307476:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051848832 00000100:00100000:0.0:1746129739.307478:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051848832 00002000:00100000:0.0:1746129739.307485:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009b00d500 x1830949051848832/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/0 e 0 to 0 dl 1746129750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129739.307494:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00d500 with x1830949051848832 ext(1048576->2097151) 00002000:00010000:0.0:1746129739.307496:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00d500 00000100:00100000:0.0:1746129739.307505:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3628 00000100:00100000:0.0:1746129739.307511:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949051848192:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129739.307875:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3629 00000100:00100000:0.0:1746129739.307881:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949051848448:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129739.308827:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3630 00000100:00100000:0.0:1746129739.308833:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012da49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949051848576:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129739.309800:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051848960 00000100:00100000:0.0:1746129739.309804:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051848960 00000100:00100000:0.0:1746129739.309828:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9668 00000100:00100000:0.0:1746129739.309832:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28220:x1830949051848960:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129739.309844:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129739.309872:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800929d0000/0x48868a4e4394737e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e270 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.309912:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445a00/0x48868a4e43947377 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129739.309919:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800929d0000/0x48868a4e4394737e lrc: 4/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e270 expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.309931:0:14315:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009c445a00/0x48868a4e43947377 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129739.309944:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929d0000/0x48868a4e4394737e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e270 expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.309954:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129739.309957:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129739.309959:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800929d0000/0x48868a4e4394737e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e270 expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.309965:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929d0000, rc 0) 00000100:00100000:0.0:1746129739.309989:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28220:x1830949051848960:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 156us (2681us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129739.309994:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9668 00000100:00100000:0.0:1746129739.310016:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3631 00000100:00100000:0.0:1746129739.310021:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949051848832:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129739.310994:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1963:x1830949051846784:12345-192.168.204.31@tcp:3:cat.0 Request processed in 46111us (48641us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129739.311003:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3625 00002000:00100000:1.0:1746129739.311010:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ba87b80 x1830949051846784/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:480/0 lens 488/440 e 0 to 0 dl 1746129750 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.311019:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba87b80 with x1830949051846784 ext(1048576->2097151) 00002000:00010000:1.0:1746129739.311024:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba87b80 00000100:00100000:0.0:1746129739.321274:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.323216:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1963:x1830949051847296:12345-192.168.204.31@tcp:3:cat.0 Request processed in 52715us (60289us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129739.323227:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3627 00002000:00100000:1.0:1746129739.323237:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009ba87480 x1830949051847296/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:480/0 lens 488/440 e 0 to 0 dl 1746129750 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.323245:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba87480 with x1830949051847296 ext(1048576->2097151) 00002000:00010000:1.0:1746129739.323250:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba87480 00000100:00100000:1.0:1746129739.332043:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1963:x1830949051847040:12345-192.168.204.31@tcp:3:cat.0 Request processed in 65671us (69137us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129739.332053:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3626 00002000:00100000:1.0:1746129739.332063:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009ba85180 x1830949051847040/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:480/0 lens 488/440 e 0 to 0 dl 1746129750 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.332072:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85180 with x1830949051847040 ext(1048576->2097151) 00002000:00010000:1.0:1746129739.332076:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba85180 00000100:00100000:0.0:1746129739.338590:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949051848448:12345-192.168.204.31@tcp:3:cat.0 Request processed in 30701us (31314us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129739.338601:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3629 00002000:00100000:0.0:1746129739.338610:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012c042300 x1830949051848448/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/440 e 0 to 0 dl 1746129750 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129739.338620:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c042300 with x1830949051848448 ext(1048576->2097151) 00002000:00010000:0.0:1746129739.338635:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c042300 00000100:00100000:0.0:1746129739.349044:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012da49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949051848576:12345-192.168.204.31@tcp:3:cat.0 Request processed in 40203us (41753us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129739.349058:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3630 00002000:00100000:0.0:1746129739.349068:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012da49500 x1830949051848576/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/440 e 0 to 0 dl 1746129750 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129739.349077:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012da49500 with x1830949051848576 ext(1048576->2097151) 00002000:00010000:0.0:1746129739.349082:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012da49500 00000100:00100000:1.0:1746129739.359389:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949051848832:12345-192.168.204.31@tcp:3:cat.0 Request processed in 49361us (52087us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129739.359398:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3631 00002000:00100000:1.0:1746129739.359407:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009b00d500 x1830949051848832/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/440 e 0 to 0 dl 1746129750 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.359416:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00d500 with x1830949051848832 ext(1048576->2097151) 00002000:00010000:1.0:1746129739.359421:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00d500 00000100:00100000:1.0:1746129739.364410:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949051848192:12345-192.168.204.31@tcp:3:cat.0 Request processed in 56892us (57169us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129739.364420:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3628 00002000:00100000:1.0:1746129739.364431:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012c041180 x1830949051848192/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/440 e 0 to 0 dl 1746129750 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.364439:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c041180 with x1830949051848192 ext(0->1048575) 00002000:00010000:1.0:1746129739.364443:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c041180 00000001:00080000:1.0:1746129739.381476:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943428 is committed 00000004:00080000:1.0:1746129739.381481:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1790 committed 00000004:00080000:1.0:1746129739.381488:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1833 committed 00000004:00080000:1.0:1746129739.381493:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1832 committed 00000004:00080000:1.0:1746129739.381494:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1831 committed 00000004:00080000:1.0:1746129739.381496:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1830 committed 00000004:00080000:1.0:1746129739.381497:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1789 committed 00000004:00080000:1.0:1746129739.381499:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1829 committed 00000004:00080000:1.0:1746129739.381500:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1788 committed 00000004:00080000:1.0:1746129739.381501:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1828 committed 00000004:00080000:1.0:1746129739.381503:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1787 committed 00000004:00080000:1.0:1746129739.381504:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1786 committed 00000004:00080000:1.0:1746129739.381505:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1785 committed 00000004:00080000:1.0:1746129739.381506:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1827 committed 00000004:00080000:1.0:1746129739.381507:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1826 committed 00000004:00080000:1.0:1746129739.381508:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1784 committed 00000004:00080000:1.0:1746129739.381509:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1783 committed 00000004:00080000:1.0:1746129739.381510:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1825 committed 00000001:00080000:1.0:1746129739.381519:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943426 is committed 00000001:00080000:1.0:1746129739.381522:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943422 is committed 00000100:00100000:1.0:1746129739.381941:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053160448:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129739.381973:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129739.381988:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053160960:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129739.382002:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129739.382016:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746129739.382020:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009476aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053160832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129739.382033:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129739.382043:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053161344:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129739.382055:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129739.382076:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053160448 00000100:00100000:1.0:1746129739.382082:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053160448 00000100:00100000:1.0:1746129739.382111:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053160960 00000100:00100000:1.0:1746129739.382113:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053160960 00000100:00100000:1.0:1746129739.382122:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053160832 00000100:00100000:1.0:1746129739.382124:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053160832 00000100:00100000:1.0:1746129739.382131:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053161344 00000100:00100000:1.0:1746129739.382133:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053161344 00000100:00100000:1.0:1746129739.382144:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9968 00000100:00100000:1.0:1746129739.382150:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3297:x1830949053160448:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129739.382376:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746129739.382379:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129738 -> 1746129738 00002000:00010000:1.0:1746129739.382381:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129736 -> 1746129736 00002000:00010000:1.0:1746129739.382383:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129738 -> 1746129738 00002000:00010000:1.0:1746129739.382384:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 1975 -> 1975 00000100:00100000:1.0:1746129739.382410:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3297:x1830949053160448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 260us (436us total) trans 17179872916 rc 0/0 00000100:00100000:1.0:1746129739.382415:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9968 00000100:00100000:1.0:1746129739.382432:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9969 00000100:00100000:1.0:1746129739.382436:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3297:x1830949053160960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129739.382516:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3297:x1830949053160960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (513us total) trans 17179872917 rc 0/0 00000100:00100000:1.0:1746129739.382521:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9969 00000100:00100000:1.0:1746129739.382533:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9970 00000100:00100000:1.0:1746129739.382537:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3297:x1830949053160832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129739.382599:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746129739.382601:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746129739.382603:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746129739.382604:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746129739.382606:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129739.382621:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3297:x1830949053160832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (588us total) trans 17179872918 rc 0/0 00000100:00100000:1.0:1746129739.382642:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9970 00000100:00100000:1.0:1746129739.382653:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9971 00000100:00100000:1.0:1746129739.382657:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3297:x1830949053161344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129739.382739:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3297:x1830949053161344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (683us total) trans 17179872919 rc 0/0 00000100:00100000:1.0:1746129739.382744:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9971 00000100:00080000:1.0:1746129739.382766:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129739.382794:0:3297:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179872915 gen 2 00000004:00080000:1.0:1746129739.382799:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8fd2a00, transno 17179872879 00000004:00080000:1.0:1746129739.382805:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095241c00, transno 17179872880 00000004:00080000:1.0:1746129739.382806:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8fd0a80, transno 17179872881 00000004:00080000:1.0:1746129739.382808:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095242680, transno 17179872882 00000004:00080000:1.0:1746129739.382811:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8fd1880, transno 17179872883 00000004:00080000:1.0:1746129739.382813:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095242a00, transno 17179872884 00000004:00080000:1.0:1746129739.382815:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fbef480, transno 17179872885 00000004:00080000:1.0:1746129739.382817:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095240380, transno 17179872886 00000004:00080000:1.0:1746129739.382819:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131460380, transno 17179872887 00000004:00080000:1.0:1746129739.382822:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d8d500, transno 17179872907 00000004:00080000:1.0:1746129739.382824:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136886300, transno 17179872908 00000004:00080000:1.0:1746129739.382825:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009be66300, transno 17179872909 00000004:00080000:1.0:1746129739.382827:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d8e300, transno 17179872910 00000004:00080000:1.0:1746129739.382829:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009be64e00, transno 17179872911 00000004:00080000:1.0:1746129739.382830:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba85880, transno 17179872912 00000004:00080000:1.0:1746129739.382832:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009be64000, transno 17179872913 00000004:00080000:1.0:1746129739.382834:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009be64a80, transno 17179872914 00000004:00080000:1.0:1746129739.382836:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009be66680, transno 17179872915 00000100:00100000:1.0:1746129739.382841:0:3297:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009476aa00 x1830949053160832/t17179872918(17179872918) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746129755 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746129739.382869:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009476aa00/2, rc 0, transno 17179872918 00000100:00100000:1.0:1746129739.382873:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009476aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053160832:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129739.382883:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c137b80/2, rc 0, transno 17179872919 00000100:00100000:1.0:1746129739.382886:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053161344:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129739.382891:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094d8df80/2, rc 0, transno 17179872916 00000100:00100000:1.0:1746129739.382894:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053160448:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129739.382899:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094768000/2, rc 0, transno 17179872917 00000100:00100000:1.0:1746129739.382902:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053160960:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129739.383049:0:14359:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 4 in flight, 18 done 00000100:00100000:1.0:1746129739.383072:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746129739.383078:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053161472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129739.383096:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129739.383112:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053161472 00000100:00100000:1.0:1746129739.383115:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053161472 00000100:00100000:1.0:1746129739.383128:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9972 00000100:00100000:1.0:1746129739.383132:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3296:x1830949053161472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129739.383214:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3296:x1830949053161472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (115us total) trans 17179872920 rc 0/0 00000100:00100000:1.0:1746129739.383219:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9972 00000004:00080000:1.0:1746129739.383241:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284df80/2, rc 0, transno 17179872920 00000100:00100000:1.0:1746129739.383245:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053161472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129739.391459:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.391483:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051849216 00000100:00100000:0.0:1746129739.391489:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051849216 00000100:00100000:0.0:1746129739.391520:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3752 00000100:00100000:0.0:1746129739.391526:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28222:x1830949051849216:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:0.0:1746129739.392735:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28222:x1830949051849216:12345-192.168.204.31@tcp:49:cat.0 Request processed in 1203us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129739.392743:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3752 00000100:00100000:1.0:1746129739.398535:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.398558:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.398577:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051849472 00000100:00100000:1.0:1746129739.398583:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051849472 00000100:00100000:1.0:1746129739.398613:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9670 00000100:00100000:1.0:1746129739.398618:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:28223:x1830949051849472:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129739.398643:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129739.398657:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4ca00/0x48868a4e4394738c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e27e expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129739.398702:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4ca00/0x48868a4e4394738c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e27e expref: 283 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129739.398713:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4ca00/0x48868a4e4394738c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e27e expref: 283 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129739.398725:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129739.398728:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129739.398730:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a4ca00, rc 0) 00000100:00100000:1.0:1746129739.398760:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28223:x1830949051849472:12345-192.168.204.31@tcp:101:cat.0 Request processed in 142us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129739.398765:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9670 00000100:00100000:0.0:1746129739.399147:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051849344 00000100:00100000:0.0:1746129739.399151:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051849344 00000100:00100000:0.0:1746129739.399178:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3753 00000100:00100000:0.0:1746129739.399183:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c61c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28220:x1830949051849344:12345-192.168.204.31@tcp:49:multiop.0 00000100:00100000:0.0:1746129739.399230:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c61c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28220:x1830949051849344:12345-192.168.204.31@tcp:49:multiop.0 Request processed in 48us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129739.399236:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3753 00000100:00100000:1.0:1746129739.401677:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.401729:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.403452:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051849728 00000100:00100000:0.0:1746129739.403458:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051849728 00000100:00100000:0.0:1746129739.403498:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 547 00000100:00100000:0.0:1746129739.403505:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:1964:x1830949051849728:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129739.403517:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129739.403536:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4ca00/0x48868a4e4394738c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e27e expref: 283 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.403561:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129739.403565:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129739.403593:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:1964:x1830949051849728:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 88us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129739.403598:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 547 00000100:00100000:0.0:1746129739.412743:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.412896:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051849984 00000100:00100000:1.0:1746129739.412904:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051849984 00002000:00100000:1.0:1746129739.412940:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ba85500 x1830949051849984/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:480/0 lens 488/0 e 0 to 0 dl 1746129750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.412950:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85500 with x1830949051849984 ext(1048576->2097151) 00002000:00010000:1.0:1746129739.412955:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba85500 00000100:00100000:1.0:1746129739.412972:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3632 00000100:00100000:1.0:1746129739.412979:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1962:x1830949051849984:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129739.424932:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1962:x1830949051849984:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11947us (12187us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129739.424941:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3632 00002000:00100000:1.0:1746129739.424951:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ba85500 x1830949051849984/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:480/0 lens 488/440 e 0 to 0 dl 1746129750 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.424960:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85500 with x1830949051849984 ext(1048576->2097151) 00002000:00010000:1.0:1746129739.424966:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba85500 00000100:00100000:0.0:1746129739.432425:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.432513:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051850368 00000100:00100000:1.0:1746129739.432521:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051850368 00002000:00100000:1.0:1746129739.432563:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ba85f80 x1830949051850368/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/0 e 0 to 0 dl 1746129750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.432572:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85f80 with x1830949051850368 ext(1048576->2097151) 00002000:00010000:1.0:1746129739.432576:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba85f80 00000100:00100000:1.0:1746129739.432598:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3633 00000100:00100000:1.0:1746129739.432604:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1963:x1830949051850368:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129739.438043:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.443402:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.443481:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.443531:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051850752 00000100:00100000:1.0:1746129739.443540:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051850752 00002000:00100000:1.0:1746129739.443577:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012c041880 x1830949051850752/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:480/0 lens 488/0 e 0 to 0 dl 1746129750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.443585:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c041880 with x1830949051850752 ext(1048576->2097151) 00002000:00010000:1.0:1746129739.443590:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c041880 00000100:00100000:1.0:1746129739.443607:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3634 00000100:00100000:1.0:1746129739.443613:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1963:x1830949051850752:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129739.454259:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.454389:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.454403:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.454425:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.454474:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051851136 00000100:00100000:1.0:1746129739.454480:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051851136 00010000:00010000:1.0:1746129739.454517:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094fd9c00/0x48868a4e4394724a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1dd expref: 9 pid: 10930 timeout: 785 lvb_type: 1 00000100:00100000:1.0:1746129739.454538:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051851008 00000100:00100000:1.0:1746129739.454540:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051851008 00010000:00010000:1.0:1746129739.454548:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013185d000/0x48868a4e43947338 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e246 expref: 22 pid: 3624 timeout: 785 lvb_type: 1 00000100:00100000:1.0:1746129739.454558:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051851264 00000100:00100000:0.0:1746129739.454686:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.454699:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051850880 00000100:00100000:0.0:1746129739.454703:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051850880 00010000:00010000:0.0:1746129739.454717:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6200/0x48868a4e439472f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e215 expref: 8 pid: 1877 timeout: 785 lvb_type: 1 00000100:00100000:0.0:1746129739.454729:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051851392 00000100:00100000:0.0:1746129739.454731:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051851392 00010000:00010000:0.0:1746129739.454744:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009adaba00/0x48868a4e43947243 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1cf expref: 9 pid: 8437 timeout: 785 lvb_type: 1 00000100:00100000:0.0:1746129739.454760:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4799 00000100:00100000:0.0:1746129739.454767:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949051851136:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129739.454777:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129739.454795:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094fd9c00/0x48868a4e4394724a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1dd expref: 9 pid: 10930 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746129739.454804:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094fd9c00/0x48868a4e4394724a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1dd expref: 9 pid: 10930 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746129739.454824:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129739.454873:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949051851136:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 106us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129739.454879:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4799 00000100:00100000:0.0:1746129739.454905:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4800 00000100:00100000:0.0:1746129739.454910:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949051851008:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129739.454916:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129739.454924:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013185d000/0x48868a4e43947338 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e246 expref: 22 pid: 3624 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746129739.454932:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013185d000/0x48868a4e43947338 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e246 expref: 22 pid: 3624 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746129739.454944:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013185d000/0x48868a4e43947338 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e246 expref: 22 pid: 3624 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746129739.454960:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129739.454976:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949051851008:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 66us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129739.454981:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4800 00000100:00100000:0.0:1746129739.454995:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4801 00000100:00100000:0.0:1746129739.454999:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1963:x1830949051850880:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129739.455004:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129739.455011:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6200/0x48868a4e439472f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e215 expref: 8 pid: 1877 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746129739.455018:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6200/0x48868a4e439472f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e215 expref: 8 pid: 1877 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746129739.455028:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6200/0x48868a4e439472f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e215 expref: 8 pid: 1877 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746129739.455036:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129739.455037:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129739.455042:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e43947393 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2056191) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e285 expref: 19 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.455049:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e43947393 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2056191) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e285 expref: 19 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.455073:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e43947393 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2056191) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e285 expref: 19 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129739.455083:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc30000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053163392:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129739.455118:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129739.455132:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4802 00000100:00100000:0.0:1746129739.455137:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949051851392:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129739.455145:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129739.455146:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051851264 00010000:00010000:0.0:1746129739.455155:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009adaba00/0x48868a4e43947243 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1cf expref: 9 pid: 8437 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746129739.455158:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092840a00/0x48868a4e43947307 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e207 expref: 11 pid: 3624 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746129739.455163:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009adaba00/0x48868a4e43947243 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1cf expref: 9 pid: 8437 timeout: 785 lvb_type: 1 00000100:00100000:1.0:1746129739.455170:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4803 00000100:00100000:1.0:1746129739.455174:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949051851264:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129739.455175:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009adaba00/0x48868a4e43947243 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1cf expref: 9 pid: 8437 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746129739.455180:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129739.455182:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129739.455187:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092840a00/0x48868a4e43947307 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e207 expref: 11 pid: 3624 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746129739.455194:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092840a00/0x48868a4e43947307 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e207 expref: 11 pid: 3624 timeout: 785 lvb_type: 1 00000100:00100000:0.0:1746129739.455197:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949051851392:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 60us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129739.455202:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4802 00010000:00010000:1.0:1746129739.455204:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092840a00/0x48868a4e43947307 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e207 expref: 11 pid: 3624 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746129739.455216:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129739.455235:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949051851264:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 60us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129739.455239:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4803 00000100:00100000:1.0:1746129739.455675:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1963:x1830949051850752:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 12062us (12193us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129739.455682:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3634 00002000:00100000:1.0:1746129739.455689:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012c041880 x1830949051850752/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:480/0 lens 488/440 e 0 to 0 dl 1746129750 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.455697:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c041880 with x1830949051850752 ext(1048576->2097151) 00002000:00010000:1.0:1746129739.455700:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c041880 00000100:00100000:0.0:1746129739.456149:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1963:x1830949051850368:12345-192.168.204.31@tcp:3:cat.0 Request processed in 23543us (23730us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129739.456155:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3633 00002000:00100000:0.0:1746129739.456161:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ba85f80 x1830949051850368/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/440 e 0 to 0 dl 1746129750 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129739.456173:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85f80 with x1830949051850368 ext(1048576->2097151) 00010000:00010000:0.0:1746129739.456179:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013185d200/0x48868a4e4394732a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e238 expref: 13 pid: 3624 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746129739.456189:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013185d200/0x48868a4e4394732a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e238 expref: 13 pid: 3624 timeout: 785 lvb_type: 1 00002000:00010000:0.0:1746129739.456195:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ba85f80 00000100:00100000:0.0:1746129739.458607:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc30000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053163392:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129739.458633:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129739.458680:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1963:x1830949051850880:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3678us (4252us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129739.458688:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4801 00000100:00100000:0.0:1746129739.458948:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.459284:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.465255:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.466254:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.466293:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.466309:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051852288 00000100:00100000:0.0:1746129739.466315:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051852288 00000100:00100000:1.0:1746129739.466374:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051852544 00000100:00100000:1.0:1746129739.466377:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051852544 00002000:00100000:1.0:1746129739.466390:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3ea:0x0] (2052096->2056191) req@ffff88009fc33800 x1830949051852544/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/0 e 0 to 0 dl 1746129750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.466396:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc33800 with x1830949051852544 ext(2052096->2056191) 00010000:00010000:1.0:1746129739.466402:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e43947393 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e285 expref: 21 pid: 1877 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746129739.466411:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e43947393 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e285 expref: 21 pid: 1877 timeout: 785 lvb_type: 0 00002000:00010000:1.0:1746129739.466416:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fc33800 00000100:00100000:1.0:1746129739.466426:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 482 00000100:00100000:1.0:1746129739.466430:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949051852544:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129739.466545:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949051852544:12345-192.168.204.31@tcp:3:cat.0 Request processed in 113us (251us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129739.466551:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 482 00002000:00100000:1.0:1746129739.466555:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3ea:0x0] (2052096->2056191) req@ffff88009fc33800 x1830949051852544/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/4536 e 0 to 0 dl 1746129750 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.466561:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc33800 with x1830949051852544 ext(2052096->2056191) 00010000:00010000:1.0:1746129739.466566:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e43947393 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e285 expref: 21 pid: 1877 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746129739.466572:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e43947393 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e285 expref: 21 pid: 1877 timeout: 785 lvb_type: 0 00002000:00010000:1.0:1746129739.466577:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fc33800 00002000:00100000:0.0:1746129739.466631:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1585151) req@ffff88009fc32d80 x1830949051852288/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/0 e 0 to 0 dl 1746129750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129739.466637:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc32d80 with x1830949051852288 ext(1048576->1585151) 00010000:00010000:0.0:1746129739.466641:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e43947393 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e285 expref: 20 pid: 1877 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746129739.466652:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e43947393 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e285 expref: 20 pid: 1877 timeout: 785 lvb_type: 0 00002000:00010000:0.0:1746129739.466657:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fc32d80 00000100:00100000:0.0:1746129739.466666:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 483 00000100:00100000:0.0:1746129739.466671:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949051852288:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129739.478166:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.479038:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.479064:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051853056 00000100:00100000:0.0:1746129739.479070:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051853056 00000100:00100000:0.0:1746129739.479120:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3755 00000100:00100000:0.0:1746129739.479127:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:28220:x1830949051853056:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:0.0:1746129739.479354:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28220:x1830949051853056:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 226us (316us total) trans 8589943429 rc 0/0 00000100:00100000:0.0:1746129739.479360:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3755 00000100:00100000:1.0:1746129739.480177:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051852800 00000100:00100000:1.0:1746129739.480182:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051852800 00002000:00100000:1.0:1746129739.480205:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1585152->2056191) req@ffff88009fc31500 x1830949051852800/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/0 e 0 to 0 dl 1746129750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.480213:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc31500 with x1830949051852800 ext(1585152->2056191) 00010000:00010000:1.0:1746129739.480221:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e43947393 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e285 expref: 22 pid: 1877 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746129739.480231:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e43947393 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e285 expref: 22 pid: 1877 timeout: 785 lvb_type: 0 00002000:00010000:1.0:1746129739.480237:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fc31500 00000100:00100000:1.0:1746129739.480249:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 484 00000100:00100000:1.0:1746129739.480253:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949051852800:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129739.482881:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051853184 00000100:00100000:0.0:1746129739.482887:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051853184 00010000:00010000:0.0:1746129739.483079:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013185d200/0x48868a4e4394732a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e238 expref: 15 pid: 3624 timeout: 785 lvb_type: 1 00000100:00100000:0.0:1746129739.483107:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4804 00000100:00100000:0.0:1746129739.483114:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8e0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949051853184:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129739.483124:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129739.483142:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013185d200/0x48868a4e4394732a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e238 expref: 15 pid: 3624 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746129739.483152:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013185d200/0x48868a4e4394732a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e238 expref: 15 pid: 3624 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746129739.483169:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013185d200/0x48868a4e4394732a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e238 expref: 15 pid: 3624 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746129739.485529:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129739.485534:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129739.485545:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092841200/0x48868a4e4394739a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->1716223) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e28c expref: 7 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.485556:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092841200/0x48868a4e4394739a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->1716223) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e28c expref: 7 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.485593:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092841200/0x48868a4e4394739a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1298432->1716223) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e28c expref: 7 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129739.485604:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053163648:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129739.491171:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129739.500195:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949051852800:12345-192.168.204.31@tcp:4:cat.0 Request processed in 19933us (22029us total) trans 17179872925 rc 0/0 00000100:00100000:1.0:1746129739.500205:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 484 00002000:00100000:1.0:1746129739.500213:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1585152->2056191) req@ffff88009fc31500 x1830949051852800/t17179872925(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/448 e 0 to 0 dl 1746129750 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.500222:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc31500 with x1830949051852800 ext(1585152->2056191) 00010000:00010000:1.0:1746129739.500230:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e43947393 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e285 expref: 22 pid: 1877 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746129739.500243:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e43947393 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e285 expref: 22 pid: 1877 timeout: 785 lvb_type: 0 00002000:00010000:1.0:1746129739.500250:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fc31500 00000100:00100000:0.0:1746129739.501166:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.501310:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.501361:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051853440 00000100:00100000:1.0:1746129739.501367:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051853440 00002000:00100000:1.0:1746129739.501394:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1298432->1302527) req@ffff8800a504df80 x1830949051853440/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:480/0 lens 488/0 e 0 to 0 dl 1746129750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.501402:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504df80 with x1830949051853440 ext(1298432->1302527) 00002000:00010000:1.0:1746129739.501405:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504df80 00000100:00100000:1.0:1746129739.501492:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3636 00000100:00100000:1.0:1746129739.501498:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1961:x1830949051853440:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129739.501617:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1961:x1830949051853440:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 119us (453us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129739.501633:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3636 00002000:00100000:1.0:1746129739.501638:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1298432->1302527) req@ffff8800a504df80 x1830949051853440/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:480/0 lens 488/4536 e 0 to 0 dl 1746129750 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.501643:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504df80 with x1830949051853440 ext(1298432->1302527) 00002000:00010000:1.0:1746129739.501646:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504df80 00000100:00100000:0.0:1746129739.505612:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051853696 00000100:00100000:0.0:1746129739.505618:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051853696 00010000:00010000:0.0:1746129739.505655:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e43947393 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e285 expref: 23 pid: 1877 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746129739.505694:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4805 00000100:00100000:0.0:1746129739.505701:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949051853696:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129739.505711:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746129739.505726:0:7107:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129738 -> 1746129740 00002000:00010000:0.0:1746129739.505729:0:7107:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129738 -> 1746129740 00010000:00010000:0.0:1746129739.505734:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e43947393 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1585152->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e285 expref: 23 pid: 1877 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746129739.505744:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e43947393 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1585152->2056191) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e285 expref: 23 pid: 1877 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746129739.505826:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e43947393 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1585152->2056191) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e285 expref: 23 pid: 1877 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746129739.505844:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129739.505861:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129739.505867:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a4d600/0x48868a4e439473a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e293 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.505874:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a4d600/0x48868a4e439473a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e293 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.505881:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129739.505882:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129739.505885:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a4c800/0x48868a4e439473a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e29a expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.505895:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a4c800/0x48868a4e439473a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e29a expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.505921:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130a4c800/0x48868a4e439473a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e29a expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129739.505931:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053163776:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129739.506001:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130a4d600/0x48868a4e439473a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e293 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129739.506009:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053163904:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129739.506023:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129739.506087:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.507430:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053163776:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129739.507439:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053163904:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129739.507453:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129739.507486:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949051853696:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1785us (2328us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129739.507492:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4805 00000100:00100000:0.0:1746129739.509639:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.511539:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.534579:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.534829:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.534874:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.535026:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3641 00000100:00100000:1.0:1746129739.535034:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1964:x1830949051855104:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129739.535830:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.535844:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051855360 00000100:00100000:0.0:1746129739.535861:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051855360 00002000:00100000:0.0:1746129739.535879:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800a8791880 x1830949051855360/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:480/0 lens 488/0 e 0 to 0 dl 1746129750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129739.535886:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8791880 with x1830949051855360 ext(2097152->3145727) 00002000:00010000:0.0:1746129739.535889:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8791880 00000100:00100000:0.0:1746129739.535900:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3642 00000100:00100000:0.0:1746129739.535905:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1963:x1830949051855360:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129739.536583:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.536686:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051855616 00000100:00100000:1.0:1746129739.536690:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051855616 00002000:00100000:1.0:1746129739.536706:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8800a8793480 x1830949051855616/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:480/0 lens 488/0 e 0 to 0 dl 1746129750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.536712:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8793480 with x1830949051855616 ext(3145728->4194303) 00002000:00010000:1.0:1746129739.536715:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8793480 00000100:00100000:1.0:1746129739.536728:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3643 00000100:00100000:1.0:1746129739.536733:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1963:x1830949051855616:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129739.550457:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1963:x1830949051855360:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14545us (14622us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129739.550466:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3642 00002000:00100000:0.0:1746129739.550474:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800a8791880 x1830949051855360/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:480/0 lens 488/440 e 0 to 0 dl 1746129750 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129739.550482:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8791880 with x1830949051855360 ext(2097152->3145727) 00002000:00010000:0.0:1746129739.550487:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8791880 00000100:00100000:1.0:1746129739.557946:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1963:x1830949051855616:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21204us (21354us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129739.558433:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3643 00002000:00100000:1.0:1746129739.558444:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8800a8793480 x1830949051855616/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:480/0 lens 488/440 e 0 to 0 dl 1746129750 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.558453:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8793480 with x1830949051855616 ext(3145728->4194303) 00002000:00010000:1.0:1746129739.558458:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8793480 00000100:00100000:0.0:1746129739.572222:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.572492:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.572515:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.572533:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.572548:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051856128 00000100:00100000:0.0:1746129739.572551:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051856128 00002000:00100000:0.0:1746129739.572573:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880094eb5f80 x1830949051856128/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/0 e 0 to 0 dl 1746129750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129739.572586:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb5f80 with x1830949051856128 ext(3145728->4194303) 00002000:00010000:0.0:1746129739.572589:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb5f80 00000100:00100000:0.0:1746129739.572891:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051856384 00000100:00100000:0.0:1746129739.572895:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051856384 00002000:00100000:0.0:1746129739.572908:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880094eb5c00 x1830949051856384/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/0 e 0 to 0 dl 1746129750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129739.572918:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb5c00 with x1830949051856384 ext(2097152->3145727) 00002000:00010000:0.0:1746129739.572921:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eb5c00 00000100:00100000:0.0:1746129739.572954:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3644 00000100:00100000:0.0:1746129739.572961:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949051856000:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129739.583910:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949051856000:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10939us (11681us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129739.583921:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3644 00002000:00100000:1.0:1746129739.583931:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a8792a00 x1830949051856000/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/440 e 0 to 0 dl 1746129750 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.583940:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8792a00 with x1830949051856000 ext(2097152->3145727) 00002000:00010000:1.0:1746129739.583945:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8792a00 00000100:00100000:0.0:1746129739.591775:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.604105:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.621687:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.623770:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9671 00000100:00100000:1.0:1746129739.623782:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28228:x1830949051857280:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129739.623802:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129739.623820:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131848600/0x48868a4e439473bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e2af expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129739.623977:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131849400/0x48868a4e439473c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129739.623988:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131849400/0x48868a4e439473c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129739.623996:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131849400/0x48868a4e439473c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129739.624005:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131849600/0x48868a4e439473cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129739.624009:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131849600/0x48868a4e439473cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129739.624014:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131849600/0x48868a4e439473cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129739.624172:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131849e00/0x48868a4e439473d2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129739.624179:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131849e00/0x48868a4e439473d2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129739.624184:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131849e00/0x48868a4e439473d2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:1.0:1746129739.624190:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129739.624250:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131849400/0x48868a4e439473c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129739.624256:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131849400/0x48868a4e439473c4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129739.624260:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131849400/0x48868a4e439473c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129739.624264:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131849400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129739.624267:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131849400/0x48868a4e439473c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129739.624272:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131849400/0x48868a4e439473c4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129739.624279:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129739.624281:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129739.624284:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131849400/0x48868a4e439473c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129739.624288:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131849400/0x48868a4e439473c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129739.624325:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131849600/0x48868a4e439473cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129739.624329:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131849600/0x48868a4e439473cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129739.624333:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131849600/0x48868a4e439473cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129739.624336:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131849600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129739.624338:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131849600/0x48868a4e439473cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129739.624342:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131849600/0x48868a4e439473cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129739.624346:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e8c7f00) 00010000:00010000:1.0:1746129739.624348:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129739.624349:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131849600/0x48868a4e439473cb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129739.624353:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131849600/0x48868a4e439473cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129739.624378:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131848600/0x48868a4e439473bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e2af expref: 286 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129739.624387:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131849e00/0x48868a4e439473d2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e2af expref: 285 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129739.624392:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129739.624394:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129739.624396:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131849e00, rc 0) 00000100:00100000:1.0:1746129739.624441:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28228:x1830949051857280:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 663us (2763us total) trans 8589943430 rc 0/0 00000100:00100000:1.0:1746129739.624446:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9671 00000100:00100000:0.0:1746129739.628883:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000004:00080000:0.0:1746129739.641236:0:14357:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 9 in progress, 0 in flight, 15 done 00000100:00100000:1.0:1746129739.646115:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.650985:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.651012:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051858048 00000100:00100000:0.0:1746129739.651019:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051858048 00000100:00100000:0.0:1746129739.652977:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746129739.652991:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053164416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746129739.653030:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129739.653356:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053164416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746129739.661745:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.670692:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.671201:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3298:1830949053165312:0@lo:400:kworker.0 00000100:00100000:1.0:1746129739.671229:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129739.671248:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746129739.671252:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3298:1830949053165440:0@lo:400:kworker.0 00000100:00100000:1.0:1746129739.671273:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053165312 00000100:00100000:1.0:1746129739.671276:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053165312 00000100:00100000:1.0:1746129739.671299:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053165184 00000100:00100000:1.0:1746129739.671301:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053165184 00000100:00100000:1.0:1746129739.671315:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1746129739.671320:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1830949053165312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746129739.671347:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1830949053165312:12345-0@lo:400:kworker.0 Request processed in 27us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129739.671352:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1746129739.671371:0:14311:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053165056 00000100:00100000:1.0:1746129739.671373:0:14311:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053165056 00000100:00100000:1.0:1746129739.671389:0:14311:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1746129739.671393:0:14311:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ea7f7eb-2f74-477e-bfed-16dc08365411+18:3297:x1830949053165056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746129739.671418:0:14311:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ea7f7eb-2f74-477e-bfed-16dc08365411+18:3297:x1830949053165056:12345-0@lo:400:kworker.0 Request processed in 24us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129739.671427:0:14311:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1746129739.671444:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129739.671463:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3298:1830949053165312:0@lo:400:kworker.0 00000100:00100000:0.0:1746129739.672003:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.672206:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3298:1830949053165440:0@lo:400:kworker.0 00000100:00100000:1.0:1746129739.672488:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051858432 00000100:00100000:1.0:1746129739.672491:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051858432 00000100:00100000:1.0:1746129739.672537:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9993 00000100:00100000:1.0:1746129739.672542:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+12:1964:x1830949051858432:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129739.672551:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129739.675954:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dae6200/0x48868a4e43947411 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e2cb expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129739.676014:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053165568:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129739.676241:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129739.678954:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.678977:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.679096:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053165568:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129739.679121:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dae6200/0x48868a4e43947411 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e2cb expref: 13 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129739.679134:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dae6200/0x48868a4e43947411 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e2cb expref: 13 pid: 1877 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129739.679145:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051858688 00010000:00010000:0.0:1746129739.679147:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dae6200, rc 0) 00000100:00100000:1.0:1746129739.679151:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051858688 00010000:00010000:1.0:1746129739.679177:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135849a00/0x48868a4e43947266 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1e4 expref: 8 pid: 10930 timeout: 785 lvb_type: 1 00000100:00100000:0.0:1746129739.679190:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+12:1964:x1830949051858432:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6646us (7186us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129739.679196:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9993 00000100:00100000:1.0:1746129739.679198:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051858560 00000100:00100000:1.0:1746129739.679200:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051858560 00010000:00010000:1.0:1746129739.679209:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013185de00/0x48868a4e43947315 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e21c expref: 8 pid: 4589 timeout: 785 lvb_type: 1 00000100:00100000:1.0:1746129739.679225:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4806 00000100:00100000:1.0:1746129739.679232:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949051858688:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129739.679238:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4807 00010000:00010000:1.0:1746129739.679242:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129739.679244:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1962:x1830949051858560:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129739.679251:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129739.679255:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135849a00/0x48868a4e43947266 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1e4 expref: 8 pid: 10930 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746129739.679260:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013185de00/0x48868a4e43947315 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e21c expref: 8 pid: 4589 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746129739.679265:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135849a00/0x48868a4e43947266 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1e4 expref: 8 pid: 10930 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746129739.679441:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013185de00/0x48868a4e43947315 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e21c expref: 8 pid: 4589 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746129739.679457:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013185de00/0x48868a4e43947315 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e21c expref: 8 pid: 4589 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746129739.679471:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129739.679504:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135849a00/0x48868a4e43947266 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1e4 expref: 8 pid: 10930 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746129739.679517:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129739.679804:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+7:1962:x1830949051858688:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 572us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129739.679804:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1962:x1830949051858560:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 559us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129739.679809:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4806 00000100:00100000:0.0:1746129739.679949:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4807 00000100:00100000:0.0:1746129739.689264:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.692046:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.693027:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051858944 00000100:00100000:1.0:1746129739.693032:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051858944 00000100:00100000:1.0:1746129739.693163:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3757 00000100:00100000:1.0:1746129739.693170:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28223:x1830949051858944:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129739.694335:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:28223:x1830949051858944:12345-192.168.204.31@tcp:35:cat.0 Request processed in 1161us (5074us total) trans 8589943433 rc 0/0 00000100:00100000:1.0:1746129739.694342:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3757 00000100:00100000:0.0:1746129739.709717:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.716161:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.716195:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.726770:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.727451:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051859840 00000100:00100000:0.0:1746129739.727459:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051859840 00010000:00010000:0.0:1746129739.727486:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013185ce00/0x48868a4e43947346 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e254 expref: 13 pid: 3624 timeout: 785 lvb_type: 1 00000100:00100000:0.0:1746129739.727516:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4811 00000100:00100000:0.0:1746129739.727522:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8e0d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1961:x1830949051859840:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129739.727532:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129739.727548:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013185ce00/0x48868a4e43947346 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e254 expref: 13 pid: 3624 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746129739.727558:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013185ce00/0x48868a4e43947346 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e254 expref: 13 pid: 3624 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746129739.727575:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013185ce00/0x48868a4e43947346 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e254 expref: 13 pid: 3624 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746129739.727600:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129739.727601:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129739.727606:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acd4e400/0x48868a4e43947418 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3207167) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e2d2 expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.727612:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd4e400/0x48868a4e43947418 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3207167) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e2d2 expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129739.727644:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800acd4e400/0x48868a4e43947418 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3207167) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e2d2 expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129739.727652:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012da4a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053166208:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129739.727705:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129739.735219:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.735563:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051860096 00000100:00100000:1.0:1746129739.735569:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051860096 00002000:00100000:1.0:1746129739.735604:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (3203072->3207167) req@ffff88012da4b100 x1830949051860096/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/0 e 0 to 0 dl 1746129750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.735613:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012da4b100 with x1830949051860096 ext(3203072->3207167) 00002000:00010000:1.0:1746129739.735629:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012da4b100 00000100:00100000:1.0:1746129739.735659:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3651 00000100:00100000:1.0:1746129739.735666:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012da4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1963:x1830949051860096:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129739.736093:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012da4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+12:1963:x1830949051860096:12345-192.168.204.31@tcp:3:cat.0 Request processed in 426us (881us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129739.736098:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3651 00002000:00100000:1.0:1746129739.736104:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (3203072->3207167) req@ffff88012da4b100 x1830949051860096/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/4536 e 0 to 0 dl 1746129750 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.736110:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012da4b100 with x1830949051860096 ext(3203072->3207167) 00002000:00010000:1.0:1746129739.736113:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012da4b100 00000100:00100000:0.0:1746129739.746755:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.747414:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051860352 00000100:00100000:1.0:1746129739.747423:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051860352 00000100:00100000:1.0:1746129739.747472:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3758 00000100:00100000:1.0:1746129739.747480:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012da4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:28228:x1830949051860352:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129739.747685:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012da4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:28228:x1830949051860352:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 205us (936us total) trans 8589943434 rc 0/0 00000100:00100000:1.0:1746129739.747692:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3758 00000100:00100000:0.0:1746129739.819702:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.828662:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.839634:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.842340:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051860992 00000100:00100000:1.0:1746129739.842345:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051860992 00000100:00100000:1.0:1746129739.842377:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 548 00000100:00100000:1.0:1746129739.842383:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:1961:x1830949051860992:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129739.842393:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129739.842407:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04a00/0x48868a4e43947434 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e2d9 expref: 289 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129739.842422:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129739.842426:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129739.842450:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:1961:x1830949051860992:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 67us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129739.842456:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 548 00000100:00100000:0.0:1746129739.870943:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.870989:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.871010:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.871068:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051861760 00000100:00100000:0.0:1746129739.871075:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051861760 00000100:00100000:0.0:1746129739.871108:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9996 00000100:00100000:0.0:1746129739.871115:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+7:1961:x1830949051861760:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129739.871134:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129739.871149:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131848000/0x48868a4e43947465 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e2f5 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129739.871192:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053166592:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129739.871256:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129739.871345:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051861632 00000100:00100000:0.0:1746129739.871348:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051861632 00002000:00100000:0.0:1746129739.871369:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (1167360->1171455) req@ffff880094a4e300 x1830949051861632/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:480/0 lens 488/0 e 0 to 0 dl 1746129750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129739.871378:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4e300 with x1830949051861632 ext(1167360->1171455) 00002000:00010000:0.0:1746129739.871381:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a4e300 00000100:00100000:0.0:1746129739.871394:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3652 00000100:00100000:0.0:1746129739.871399:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1962:x1830949051861632:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129739.871552:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1962:x1830949051861632:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 152us (562us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129739.871558:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3652 00002000:00100000:0.0:1746129739.871563:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (1167360->1171455) req@ffff880094a4e300 x1830949051861632/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:480/0 lens 488/4536 e 0 to 0 dl 1746129750 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129739.871570:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4e300 with x1830949051861632 ext(1167360->1171455) 00002000:00010000:0.0:1746129739.871573:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a4e300 00000100:00100000:0.0:1746129739.873297:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.873638:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.873653:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051862016 00000100:00100000:0.0:1746129739.873657:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051862016 00000100:00100000:0.0:1746129739.873680:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051861888 00000100:00100000:0.0:1746129739.873681:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051861888 00000100:00100000:0.0:1746129739.873694:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9997 00000100:00100000:0.0:1746129739.873699:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949051862016:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129739.873707:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129739.873717:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131848600/0x48868a4e4394748f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e303 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129739.873750:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053166720:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129739.874540:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129739.875208:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.895629:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.899546:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.906746:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.906792:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.927090:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051863552 00000100:00100000:1.0:1746129739.927094:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051863552 00002000:00100000:1.0:1746129739.927117:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009adace00 x1830949051863552/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/0 e 0 to 0 dl 1746129750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.927125:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adace00 with x1830949051863552 ext(0->1048575) 00002000:00010000:1.0:1746129739.927129:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adace00 00000100:00100000:1.0:1746129739.927153:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3654 00000100:00100000:1.0:1746129739.927158:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949051863552:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129739.931762:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.932584:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.932603:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.932711:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053167104:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129739.932737:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131848000/0x48868a4e439474ce lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e326 expref: 8 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129739.932749:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131848000/0x48868a4e439474ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e326 expref: 8 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129739.932760:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131848000, rc 0) 00000100:00100000:0.0:1746129739.932795:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012da4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1964:x1830949051863680:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6434us (6509us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129739.932806:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10001 00000100:00100000:0.0:1746129739.932828:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051863808 00000100:00100000:0.0:1746129739.932832:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051863808 00000100:00100000:0.0:1746129739.932875:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10002 00000100:00100000:0.0:1746129739.932881:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1964:x1830949051863808:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129739.932891:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129739.932901:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f96f600/0x48868a4e439474e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e32d expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129739.932933:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053167616:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129739.935311:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129739.936381:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051864192 00000100:00100000:1.0:1746129739.936386:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051864192 00000100:00100000:1.0:1746129739.936422:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3760 00000100:00100000:1.0:1746129739.936428:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28231:x1830949051864192:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129739.936591:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28231:x1830949051864192:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 162us (3985us total) trans 8589943439 rc 0/0 00000100:00100000:1.0:1746129739.936596:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3760 00000100:00100000:0.0:1746129739.939905:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.944158:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.945594:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053167616:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129739.945623:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f96f600/0x48868a4e439474e3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e32d expref: 10 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129739.945638:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f96f600/0x48868a4e439474e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e32d expref: 10 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129739.945646:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f96f600, rc 0) 00000100:00100000:1.0:1746129739.945667:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1964:x1830949051863808:12345-192.168.204.31@tcp:101:cat.0 Request processed in 12785us (13912us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129739.945672:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10002 00000100:00100000:1.0:1746129739.946478:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949051863552:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19318us (20254us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129739.946486:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3654 00002000:00100000:1.0:1746129739.946493:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009adace00 x1830949051863552/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/440 e 0 to 0 dl 1746129750 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.946501:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adace00 with x1830949051863552 ext(0->1048575) 00002000:00010000:1.0:1746129739.946504:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adace00 00000100:00100000:0.0:1746129739.957176:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.961472:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.962356:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051865088 00000100:00100000:1.0:1746129739.962365:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051865088 00002000:00100000:1.0:1746129739.962400:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009fc33100 x1830949051865088/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:480/0 lens 488/0 e 0 to 0 dl 1746129750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.962409:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc33100 with x1830949051865088 ext(0->1048575) 00002000:00010000:1.0:1746129739.962413:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc33100 00000100:00100000:1.0:1746129739.962446:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3655 00000100:00100000:1.0:1746129739.962453:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1963:x1830949051865088:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129739.967637:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.967677:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.967722:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051865344 00000100:00100000:1.0:1746129739.967730:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051865344 00000100:00100000:1.0:1746129739.967762:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3761 00000100:00100000:1.0:1746129739.967768:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+7:28238:x1830949051865344:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:1.0:1746129739.968111:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+8:28238:x1830949051865344:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 342us (475us total) trans 8589943441 rc 0/0 00000100:00100000:1.0:1746129739.968117:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3761 00000100:00100000:0.0:1746129739.978233:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.979190:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1963:x1830949051865088:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16736us (17722us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129739.979198:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3655 00002000:00100000:1.0:1746129739.979205:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009fc33100 x1830949051865088/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:480/0 lens 488/440 e 0 to 0 dl 1746129750 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.979213:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc33100 with x1830949051865088 ext(0->1048575) 00002000:00010000:1.0:1746129739.979216:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc33100 00000100:00100000:0.0:1746129739.982730:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.982991:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051865856 00000100:00100000:1.0:1746129739.982997:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051865856 00002000:00100000:1.0:1746129739.983030:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (1060864->1064959) req@ffff88012ba38000 x1830949051865856/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/0 e 0 to 0 dl 1746129750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.983038:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba38000 with x1830949051865856 ext(1060864->1064959) 00010000:00010000:1.0:1746129739.983045:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bf05000/0x48868a4e439474c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1224703) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e318 expref: 14 pid: 1877 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746129739.983056:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bf05000/0x48868a4e439474c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1224703) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e318 expref: 14 pid: 1877 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746129739.983061:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba38000 00000100:00100000:1.0:1746129739.983088:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 486 00000100:00100000:1.0:1746129739.983096:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949051865856:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129739.983547:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949051865856:12345-192.168.204.31@tcp:3:cat.0 Request processed in 450us (817us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129739.983553:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 486 00002000:00100000:1.0:1746129739.983558:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (1060864->1064959) req@ffff88012ba38000 x1830949051865856/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/4536 e 0 to 0 dl 1746129750 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.983565:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba38000 with x1830949051865856 ext(1060864->1064959) 00010000:00010000:1.0:1746129739.983570:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bf05000/0x48868a4e439474c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1224703) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e318 expref: 14 pid: 1877 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746129739.983578:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bf05000/0x48868a4e439474c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1224703) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e318 expref: 14 pid: 1877 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746129739.983583:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba38000 00000100:00100000:0.0:1746129739.984892:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129739.986789:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.986832:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051866240 00000100:00100000:1.0:1746129739.986838:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051866240 00002000:00100000:1.0:1746129739.986890:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (1220608->1224703) req@ffff8800a504e680 x1830949051866240/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/0 e 0 to 0 dl 1746129750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.986898:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504e680 with x1830949051866240 ext(1220608->1224703) 00010000:00010000:1.0:1746129739.986905:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bf05000/0x48868a4e439474c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1224703) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e318 expref: 14 pid: 1877 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746129739.986916:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bf05000/0x48868a4e439474c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1224703) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e318 expref: 14 pid: 1877 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746129739.986923:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a504e680 00000100:00100000:1.0:1746129739.986946:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 487 00000100:00100000:1.0:1746129739.986953:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1964:x1830949051866240:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129739.987078:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1964:x1830949051866240:12345-192.168.204.31@tcp:3:cat.0 Request processed in 125us (293us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129739.987085:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 487 00002000:00100000:1.0:1746129739.987089:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (1220608->1224703) req@ffff8800a504e680 x1830949051866240/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/4536 e 0 to 0 dl 1746129750 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.987096:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504e680 with x1830949051866240 ext(1220608->1224703) 00010000:00010000:1.0:1746129739.987100:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bf05000/0x48868a4e439474c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1224703) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e318 expref: 14 pid: 1877 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746129739.987108:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bf05000/0x48868a4e439474c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1224703) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e318 expref: 14 pid: 1877 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746129739.987112:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a504e680 00000100:00100000:0.0:1746129739.988726:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.988875:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051866624 00000100:00100000:1.0:1746129739.988882:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051866624 00000100:00100000:0.0:1746129739.990383:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129739.990419:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051866752 00000100:00100000:1.0:1746129739.990424:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051866752 00002000:00100000:1.0:1746129739.990448:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (1060864->1224703) req@ffff88008fad0e00 x1830949051866752/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/0 e 0 to 0 dl 1746129750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.990457:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad0e00 with x1830949051866752 ext(1060864->1224703) 00010000:00010000:1.0:1746129739.990469:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bf05000/0x48868a4e439474c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1224703) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e318 expref: 14 pid: 1877 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746129739.990480:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bf05000/0x48868a4e439474c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1224703) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e318 expref: 14 pid: 1877 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746129739.990487:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fad0e00 00000100:00100000:1.0:1746129739.990512:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 488 00000100:00100000:1.0:1746129739.990521:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949051866752:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129739.993494:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1961:x1830949051866752:12345-192.168.204.31@tcp:4:cat.0 Request processed in 2969us (3105us total) trans 21474840093 rc 0/0 00000100:00100000:1.0:1746129739.993504:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 488 00002000:00100000:1.0:1746129739.993512:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (1060864->1224703) req@ffff88008fad0e00 x1830949051866752/t21474840093(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:480/0 lens 488/448 e 0 to 0 dl 1746129750 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129739.993521:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad0e00 with x1830949051866752 ext(1060864->1224703) 00010000:00010000:1.0:1746129739.993529:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bf05000/0x48868a4e439474c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1224703) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e318 expref: 16 pid: 1877 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746129739.993543:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bf05000/0x48868a4e439474c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1224703) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e318 expref: 16 pid: 1877 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746129739.993553:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fad0e00 00000100:00100000:0.0:1746129739.995268:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.001576:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051867136 00000100:00100000:1.0:1746129740.001581:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051867136 00002000:00100000:1.0:1746129740.001609:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800934d4700 x1830949051867136/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:481/0 lens 488/0 e 0 to 0 dl 1746129751 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129740.001628:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4700 with x1830949051867136 ext(1048576->2097151) 00002000:00010000:1.0:1746129740.001632:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800934d4700 00000100:00100000:1.0:1746129740.001646:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3656 00000100:00100000:1.0:1746129740.001653:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1961:x1830949051867136:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129740.011027:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1961:x1830949051867136:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9365us (9539us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129740.011039:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3656 00002000:00100000:1.0:1746129740.011050:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800934d4700 x1830949051867136/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:481/0 lens 488/440 e 0 to 0 dl 1746129751 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129740.011060:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4700 with x1830949051867136 ext(1048576->2097151) 00002000:00010000:1.0:1746129740.011065:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800934d4700 00000100:00100000:0.0:1746129740.019484:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.019754:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.026798:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.029027:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.029797:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.029828:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051868160 00000100:00100000:0.0:1746129740.029833:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051868160 00002000:00100000:0.0:1746129740.029881:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3891199) req@ffff8800a0214380 x1830949051868160/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:481/0 lens 488/0 e 0 to 0 dl 1746129751 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129740.029890:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0214380 with x1830949051868160 ext(3145728->3891199) 00002000:00010000:0.0:1746129740.029894:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0214380 00000100:00100000:0.0:1746129740.029907:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051868416 00000100:00100000:0.0:1746129740.029908:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051868416 00002000:00100000:0.0:1746129740.029917:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800a0214700 x1830949051868416/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:481/0 lens 488/0 e 0 to 0 dl 1746129751 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129740.029922:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0214700 with x1830949051868416 ext(2097152->3145727) 00002000:00010000:0.0:1746129740.029925:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0214700 00000100:00100000:0.0:1746129740.029935:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3659 00000100:00100000:0.0:1746129740.029941:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0214380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1964:x1830949051868160:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129740.047087:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0214380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1964:x1830949051868160:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17144us (18069us total) trans 0 rc 745472/745472 00000100:00100000:0.0:1746129740.047094:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3659 00002000:00100000:0.0:1746129740.047100:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3891199) req@ffff8800a0214380 x1830949051868160/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:481/0 lens 488/440 e 0 to 0 dl 1746129751 ref 1 fl Complete:/200/0 rc 745472/745472 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129740.047108:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0214380 with x1830949051868160 ext(3145728->3891199) 00010000:00010000:0.0:1746129740.047114:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bf04e00/0x48868a4e4394740a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3891200->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e2c4 expref: 22 pid: 8437 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746129740.047128:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bf04e00/0x48868a4e4394740a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3891200->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e2c4 expref: 22 pid: 8437 timeout: 786 lvb_type: 0 00002000:00010000:0.0:1746129740.047134:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0214380 00000100:00100000:0.0:1746129740.047720:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.065253:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.071825:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.074519:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.081227:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.081294:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.082170:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3663 00000100:00100000:0.0:1746129740.082181:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0215c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1961:x1830949051869952:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129740.111427:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.111468:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.111510:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.111542:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051870080 00000100:00100000:0.0:1746129740.111550:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051870080 00000100:00100000:0.0:1746129740.111581:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10009 00000100:00100000:0.0:1746129740.111587:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0215f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28248:x1830949051870080:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129740.111603:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129740.111626:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f96e200/0x48868a4e4394753e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e36c expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.111648:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135848000/0x48868a4e43947258 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1c8 expref: 7 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129740.111659:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136920800/0x48868a4e43947323 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e231 expref: 23 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129740.111665:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eb7d400/0x48868a4e4394730e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e200 expref: 9 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129740.111669:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.111670:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.111671:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f96e200/0x48868a4e4394753e lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [585728->962559] (req 585728->962559) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e36c expref: 9 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.111683:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012eb7d400/0x48868a4e4394730e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e200 expref: 9 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129740.111693:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012eb7d400/0x48868a4e4394730e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e200 expref: 9 pid: 10930 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746129740.111702:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0216a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053169024:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129740.112123:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136920800/0x48868a4e43947323 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e231 expref: 23 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.112132:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136920800/0x48868a4e43947323 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e231 expref: 23 pid: 3624 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746129740.112140:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053169152:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129740.112162:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135848000/0x48868a4e43947258 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1c8 expref: 7 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.112169:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135848000/0x48868a4e43947258 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1c8 expref: 7 pid: 10930 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746129740.112176:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053169280:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129740.112193:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129740.123377:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.123402:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051870720 00000100:00100000:0.0:1746129740.123408:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051870720 00000100:00100000:1.0:1746129740.124010:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0216a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053169024:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129740.125444:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053169152:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129740.125453:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135848000/0x48868a4e43947258 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1c8 expref: 7 pid: 10930 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746129740.125464:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053169280:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129740.125481:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f96e200/0x48868a4e4394753e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [585728->962559] (req 585728->962559) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e36c expref: 8 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.125488:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f96e200, rc 0) 00000100:00100000:1.0:1746129740.125502:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0215f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28248:x1830949051870080:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 13916us (14083us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129740.125507:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10009 00000100:00100000:1.0:1746129740.126764:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.126779:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051871232 00000100:00100000:1.0:1746129740.126782:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051871232 00010000:00010000:1.0:1746129740.126795:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136920800/0x48868a4e43947323 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e231 expref: 26 pid: 3624 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746129740.126815:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4821 00000100:00100000:1.0:1746129740.126819:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949051871232:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129740.126827:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129740.126839:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136920800/0x48868a4e43947323 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e231 expref: 26 pid: 3624 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746129740.126860:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136920800/0x48868a4e43947323 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e231 expref: 26 pid: 3624 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746129740.126876:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136920800/0x48868a4e43947323 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e231 expref: 26 pid: 3624 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746129740.126885:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.126886:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.126891:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f96e200/0x48868a4e4394753e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 585728->962559) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e36c expref: 7 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.126897:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f96e200/0x48868a4e4394753e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 585728->962559) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e36c expref: 7 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.126917:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f96e200/0x48868a4e4394753e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 585728->962559) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e36c expref: 7 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129740.126926:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053169408:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129740.126963:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129740.127259:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0216300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1964:x1830949051870336:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14234us (15790us total) trans 0 rc 770048/770048 00000100:00100000:1.0:1746129740.127265:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3664 00002000:00100000:1.0:1746129740.127272:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff8800a0216300 x1830949051870336/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:481/0 lens 488/440 e 0 to 0 dl 1746129751 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129740.127280:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0216300 with x1830949051870336 ext(4194304->4964351) 00002000:00010000:1.0:1746129740.127283:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0216300 00000100:00100000:0.0:1746129740.129716:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.130139:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051871360 00000100:00100000:1.0:1746129740.130148:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051871360 00000100:00100000:1.0:1746129740.130200:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 549 00000100:00100000:1.0:1746129740.130210:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0217100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:1963:x1830949051871360:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129740.130225:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129740.130254:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9da00/0x48868a4e43947561 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e37a expref: 292 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.130271:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129740.130276:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129740.130605:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0217100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:1963:x1830949051871360:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 394us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129740.130630:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 549 00000100:00100000:0.0:1746129740.134474:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.134503:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051871616 00000100:00100000:0.0:1746129740.134509:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051871616 00002000:00100000:0.0:1746129740.134541:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e8:0x0] (585728->589823) req@ffff8800a0217480 x1830949051871616/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:481/0 lens 488/0 e 0 to 0 dl 1746129751 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129740.134551:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0217480 with x1830949051871616 ext(585728->589823) 00002000:00010000:0.0:1746129740.134555:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0217480 00000100:00100000:0.0:1746129740.134572:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3665 00000100:00100000:0.0:1746129740.134578:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1961:x1830949051871616:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129740.134731:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1961:x1830949051871616:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 152us (264us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129740.134737:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3665 00002000:00100000:0.0:1746129740.134742:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e8:0x0] (585728->589823) req@ffff8800a0217480 x1830949051871616/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:481/0 lens 488/4536 e 0 to 0 dl 1746129751 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129740.134749:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0217480 with x1830949051871616 ext(585728->589823) 00002000:00010000:0.0:1746129740.134751:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0217480 00000100:00100000:1.0:1746129740.135105:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053169408:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129740.135123:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129740.136391:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949051871232:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 9565us (9621us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129740.136401:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4821 00000100:00100000:0.0:1746129740.138892:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.138921:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.138972:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051871744 00000100:00100000:1.0:1746129740.138978:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051871744 00000100:00100000:1.0:1746129740.139002:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051871872 00000100:00100000:1.0:1746129740.139004:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051871872 00000100:00100000:1.0:1746129740.139017:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10011 00000100:00100000:1.0:1746129740.139022:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949051871744:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129740.139034:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129740.139047:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013185c600/0x48868a4e4394756f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e381 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129740.139085:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053169536:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129740.139140:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129740.139156:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10012 00000100:00100000:1.0:1746129740.139161:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0217b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1964:x1830949051871872:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129740.139168:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129740.139175:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013185ca00/0x48868a4e43947576 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e388 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129740.139196:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053169664:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129740.139214:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129740.143565:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00010000:1.0:1746129740.144415:0:10930:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime: 1746129738 -> 1746129740 00002000:00010000:1.0:1746129740.144420:0:10930:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime: 1746129736 -> 1746129740 00002000:00010000:1.0:1746129740.144422:0:10930:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime: 1746129738 -> 1746129740 00000100:00100000:1.0:1746129740.144439:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053169536:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129740.144463:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013185c600/0x48868a4e4394756f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e381 expref: 24 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.144475:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013185c600/0x48868a4e4394756f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e381 expref: 24 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.144488:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013185c600, rc 0) 00000100:00100000:1.0:1746129740.144529:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949051871744:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5506us (5637us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129740.144535:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10011 00000100:00100000:0.0:1746129740.144708:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.145263:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051872256 00000100:00100000:0.0:1746129740.145267:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051872256 00010000:00010000:0.0:1746129740.145915:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd4e400/0x48868a4e43947418 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3207167) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e2d2 expref: 19 pid: 1877 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746129740.145938:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4822 00000100:00100000:0.0:1746129740.145944:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1963:x1830949051872256:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129740.145953:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129740.145966:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acd4e400/0x48868a4e43947418 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3207167) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e2d2 expref: 19 pid: 1877 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746129740.145976:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acd4e400/0x48868a4e43947418 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3207167) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e2d2 expref: 19 pid: 1877 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746129740.145995:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.145997:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.146002:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013261ac00/0x48868a4e43947545 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e373 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.146010:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013261ac00/0x48868a4e43947545 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e373 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.146041:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013261ac00/0x48868a4e43947545 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e373 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129740.146053:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130504380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053169792:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129740.147024:0:1877:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.31@tcp) returned -22 from glimpse AST (req@ffff88009c1c5880 x1830949053169664) - normal race ns: filter-lustre-OST0000_UUID lock: ffff8800acd4e400/0x48868a4e43947418 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3207167) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e2d2 expref: 19 pid: 1877 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746129740.147053:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acd4e400/0x48868a4e43947418 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3207167) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e2d2 expref: 19 pid: 1877 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746129740.147066:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053169664:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129740.147089:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013185ca00/0x48868a4e43947576 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e388 expref: 18 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.147099:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013185ca00/0x48868a4e43947576 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e388 expref: 18 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.147106:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013185ca00, rc 0) 00000100:00100000:1.0:1746129740.147140:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0217b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1964:x1830949051871872:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7977us (8217us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129740.147147:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10012 00000100:00100000:0.0:1746129740.147456:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129740.155646:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.155675:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.155693:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051872384 00000100:00100000:1.0:1746129740.155700:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051872384 00000100:00100000:0.0:1746129740.155752:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051872512 00000100:00100000:0.0:1746129740.155755:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051872512 00000100:00100000:0.0:1746129740.156073:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10013 00000100:00100000:0.0:1746129740.156080:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949051872384:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129740.156093:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129740.156106:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f96ea00/0x48868a4e4394757d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e38f expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129740.156145:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130504700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053169920:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129740.156186:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129740.161715:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.161752:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.161777:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.161867:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130504700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053169920:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129740.161892:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f96ea00/0x48868a4e4394757d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e38f expref: 24 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129740.161903:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f96ea00/0x48868a4e4394757d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e38f expref: 24 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129740.161919:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f96ea00, rc 0) 00000100:00100000:0.0:1746129740.161954:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949051872384:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5875us (6315us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129740.161961:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10013 00000100:00100000:1.0:1746129740.162481:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3668 00000100:00100000:1.0:1746129740.162489:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1962:x1830949051873024:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129740.180815:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1962:x1830949051873024:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 18318us (19053us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129740.180828:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3668 00002000:00100000:1.0:1746129740.180840:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880130504e00 x1830949051873024/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:481/0 lens 488/440 e 0 to 0 dl 1746129751 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129740.180881:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130504e00 with x1830949051873024 ext(3145728->4194303) 00002000:00010000:1.0:1746129740.180886:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130504e00 00000100:00100000:0.0:1746129740.184039:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.191405:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.192250:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051873920 00000100:00100000:1.0:1746129740.192257:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051873920 00000100:00100000:1.0:1746129740.192303:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3764 00000100:00100000:1.0:1746129740.192310:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:7659:x1830949051873920:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746129740.193876:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:7659:x1830949051873920:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 1559us (2466us total) trans 8589943446 rc 0/0 00000100:00100000:1.0:1746129740.193884:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3764 00000100:00100000:0.0:1746129740.195397:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949051873152:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 32804us (33613us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129740.195407:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3669 00002000:00100000:0.0:1746129740.195415:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880130505180 x1830949051873152/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:481/0 lens 488/440 e 0 to 0 dl 1746129751 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129740.195424:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130505180 with x1830949051873152 ext(3145728->4194303) 00002000:00010000:0.0:1746129740.195429:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130505180 00000100:00100000:0.0:1746129740.204248:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.207159:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051874304 00000100:00100000:0.0:1746129740.207165:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051874304 00002000:00100000:0.0:1746129740.207192:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009284e300 x1830949051874304/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:481/0 lens 488/0 e 0 to 0 dl 1746129751 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129740.207200:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284e300 with x1830949051874304 ext(4194304->4964351) 00002000:00010000:0.0:1746129740.207204:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284e300 00000100:00100000:1.0:1746129740.207280:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3670 00000100:00100000:1.0:1746129740.207288:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1962:x1830949051874304:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129740.208801:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.208823:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051874432 00000100:00100000:0.0:1746129740.208827:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051874432 00000100:00100000:0.0:1746129740.208880:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10015 00000100:00100000:0.0:1746129740.208887:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+7:1964:x1830949051874432:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129740.208897:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129740.208911:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f96e600/0x48868a4e439475a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e3a4 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129740.208949:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053170176:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129740.209012:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129740.209037:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.209116:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.209143:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.209158:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051874560 00000100:00100000:0.0:1746129740.209161:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051874560 00000100:00100000:0.0:1746129740.209177:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051874688 00000100:00100000:0.0:1746129740.209179:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051874688 00000100:00100000:0.0:1746129740.209189:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051874816 00000100:00100000:0.0:1746129740.209191:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051874816 00000100:00100000:0.0:1746129740.209201:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10016 00000100:00100000:0.0:1746129740.209206:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+8:1964:x1830949051874560:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129740.209214:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129740.209223:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f96ea00/0x48868a4e439475ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e3ab expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.209234:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.209236:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.209243:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f96ea00/0x48868a4e439475ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3ab expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129740.209254:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f96ea00/0x48868a4e439475ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3ab expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129740.209263:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f96ea00, rc 0) 00000100:00100000:0.0:1746129740.209285:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+9:1964:x1830949051874560:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 78us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129740.209290:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10016 00000100:00100000:0.0:1746129740.209302:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10017 00000100:00100000:0.0:1746129740.209307:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+9:1963:x1830949051874688:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129740.209312:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129740.209319:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f96ee00/0x48868a4e439475b5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e3b2 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.209326:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.209328:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.209332:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f96ee00/0x48868a4e439475b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3b2 expref: 10 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129740.209345:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f96ee00/0x48868a4e439475b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3b2 expref: 10 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129740.209351:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f96ee00, rc 0) 00000100:00100000:0.0:1746129740.209364:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+10:1963:x1830949051874688:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 57us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129740.209369:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10017 00000100:00100000:0.0:1746129740.209377:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10018 00000100:00100000:0.0:1746129740.209381:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+8:1963:x1830949051874816:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129740.209386:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129740.209392:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f96ec00/0x48868a4e439475bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e3b9 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.209400:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.209401:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.209405:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f96ec00/0x48868a4e439475bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3b9 expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129740.209413:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f96ec00/0x48868a4e439475bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3b9 expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129740.209419:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f96ec00, rc 0) 00000100:00100000:0.0:1746129740.209432:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+9:1963:x1830949051874816:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 50us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129740.209436:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10018 00000100:00100000:0.0:1746129740.216811:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.216873:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.218212:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1962:x1830949051874304:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10924us (11272us total) trans 0 rc 770048/770048 00000100:00100000:1.0:1746129740.218219:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3670 00002000:00100000:1.0:1746129740.218227:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009284e300 x1830949051874304/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:481/0 lens 488/440 e 0 to 0 dl 1746129751 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129740.218235:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284e300 with x1830949051874304 ext(4194304->4964351) 00010000:00010000:1.0:1746129740.218240:0:21600:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131849200/0x48868a4e4394751b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e357 expref: 8 pid: 10930 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746129740.218248:0:21600:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131849200/0x48868a4e4394751b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e357 expref: 8 pid: 10930 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746129740.218258:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009284e300 00000100:00100000:0.0:1746129740.221703:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.221738:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.225772:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.226031:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.230360:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.231533:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.231626:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.231678:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051876480 00000100:00100000:1.0:1746129740.231682:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051876480 00000100:00100000:1.0:1746129740.231711:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3765 00000100:00100000:1.0:1746129740.231716:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba7c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:28253:x1830949051876480:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:1.0:1746129740.232005:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba7c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+10:28253:x1830949051876480:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 288us (377us total) trans 8589943448 rc 0/0 00000100:00100000:1.0:1746129740.232011:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3765 00000100:00100000:1.0:1746129740.232049:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051876096 00000100:00100000:1.0:1746129740.232052:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051876096 00010000:00010000:1.0:1746129740.232063:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131849200/0x48868a4e4394751b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e357 expref: 9 pid: 10930 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746129740.232088:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4827 00000100:00100000:1.0:1746129740.232093:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1964:x1830949051876096:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129740.232100:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129740.232116:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131849200/0x48868a4e4394751b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e357 expref: 9 pid: 10930 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746129740.232126:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131849200/0x48868a4e4394751b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e357 expref: 9 pid: 10930 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746129740.232137:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131849200/0x48868a4e4394751b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e357 expref: 9 pid: 10930 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746129740.232150:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.232152:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.232156:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d08da00/0x48868a4e439475c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3076096->3145727] (req 3076096->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3c0 expref: 22 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.232162:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d08da00/0x48868a4e439475c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3076096->3145727] (req 3076096->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3c0 expref: 22 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.232184:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d08da00/0x48868a4e439475c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3076096->3145727] (req 3076096->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3c0 expref: 22 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129740.232194:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053170816:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129740.232237:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129740.234030:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.234940:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.234961:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051876864 00000100:00100000:1.0:1746129740.234966:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051876864 00002000:00100000:1.0:1746129740.234997:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3076096->3080191) req@ffff88009c1c4e00 x1830949051876864/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:481/0 lens 488/0 e 0 to 0 dl 1746129751 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129740.235005:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c4e00 with x1830949051876864 ext(3076096->3080191) 00002000:00010000:1.0:1746129740.235009:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1c4e00 00000100:00100000:0.0:1746129740.235243:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053170816:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129740.235256:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129740.235285:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1964:x1830949051876096:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3191us (3751us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129740.235292:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4827 00000100:00100000:1.0:1746129740.235377:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3671 00000100:00100000:1.0:1746129740.235383:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949051876864:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129740.235504:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949051876864:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 121us (566us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129740.235512:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3671 00002000:00100000:1.0:1746129740.235516:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3076096->3080191) req@ffff88009c1c4e00 x1830949051876864/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:481/0 lens 488/4536 e 0 to 0 dl 1746129751 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129740.235523:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c4e00 with x1830949051876864 ext(3076096->3080191) 00002000:00010000:1.0:1746129740.235525:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1c4e00 00000100:00100000:0.0:1746129740.238098:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.238141:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.238179:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051877248 00000100:00100000:1.0:1746129740.238183:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051877248 00000100:00100000:1.0:1746129740.238343:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10023 00000100:00100000:1.0:1746129740.238350:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:28250:x1830949051877248:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129740.238360:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129740.238371:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013185c800/0x48868a4e43947602 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e3ea expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.238391:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013261ac00/0x48868a4e43947545 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e373 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.238399:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f96ec00/0x48868a4e439475bc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3b9 expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.238404:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fb67600/0x48868a4e43947584 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e396 expref: 18 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.238410:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.238412:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.238414:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013185c800/0x48868a4e43947602 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->2625535] (req 2097152->2625535) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3ea expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.238441:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fb67600/0x48868a4e43947584 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e396 expref: 18 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.238450:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fb67600/0x48868a4e43947584 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e396 expref: 18 pid: 4589 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746129740.238460:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053170944:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129740.238527:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f96ec00/0x48868a4e439475bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3b9 expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.238535:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f96ec00/0x48868a4e439475bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3b9 expref: 8 pid: 20441 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746129740.238543:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053171072:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129740.238566:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013261ac00/0x48868a4e43947545 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e373 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.238573:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013261ac00/0x48868a4e43947545 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e373 expref: 9 pid: 8437 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746129740.238791:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053171200:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129740.238812:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129740.246996:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.247018:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051877504 00000100:00100000:0.0:1746129740.247024:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051877504 00010000:00010000:0.0:1746129740.247053:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f96ec00/0x48868a4e439475bc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3b9 expref: 9 pid: 20441 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746129740.247324:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053170944:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129740.247335:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053171072:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129740.247342:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053171200:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129740.247364:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013185c800/0x48868a4e43947602 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->2625535] (req 2097152->2625535) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3ea expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.247377:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013185c800, rc 0) 00000100:00100000:1.0:1746129740.247412:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:28250:x1830949051877248:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 9063us (9270us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129740.247418:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10023 00000100:00100000:1.0:1746129740.247450:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.248570:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.248668:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051877376 00000100:00100000:0.0:1746129740.248673:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051877376 00010000:00010000:0.0:1746129740.248690:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb67600/0x48868a4e43947584 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e396 expref: 18 pid: 4589 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746129740.248712:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4828 00000100:00100000:0.0:1746129740.248718:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:1963:x1830949051877504:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129740.248729:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129740.248745:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f96ec00/0x48868a4e439475bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3b9 expref: 9 pid: 20441 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746129740.248754:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f96ec00/0x48868a4e439475bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3b9 expref: 9 pid: 20441 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746129740.248770:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f96ec00/0x48868a4e439475bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3b9 expref: 9 pid: 20441 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746129740.248788:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129740.248809:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:1963:x1830949051877504:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 91us (1820us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129740.248813:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4828 00000100:00100000:0.0:1746129740.248823:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4829 00000100:00100000:0.0:1746129740.248827:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1963:x1830949051877376:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129740.248833:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129740.248838:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fb67600/0x48868a4e43947584 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e396 expref: 18 pid: 4589 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746129740.248845:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fb67600/0x48868a4e43947584 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e396 expref: 18 pid: 4589 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746129740.248871:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fb67600/0x48868a4e43947584 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e396 expref: 18 pid: 4589 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746129740.248878:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129740.248890:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1963:x1830949051877376:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 63us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129740.248894:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4829 00000100:00100000:0.0:1746129740.262314:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.263266:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051878144 00000100:00100000:1.0:1746129740.263275:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051878144 00000100:00100000:1.0:1746129740.264656:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3766 00000100:00100000:1.0:1746129740.264667:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:28250:x1830949051878144:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129740.266018:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:28250:x1830949051878144:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 1348us (3705us total) trans 8589943449 rc 0/0 00000100:00100000:1.0:1746129740.266027:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3766 00000100:00100000:0.0:1746129740.300944:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.307690:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.307735:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.307768:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051878528 00000100:00100000:1.0:1746129740.307776:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051878528 00000100:00100000:1.0:1746129740.307821:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051878656 00000100:00100000:1.0:1746129740.307823:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051878656 00000100:00100000:1.0:1746129740.307834:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10025 00000100:00100000:1.0:1746129740.307838:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949051878656:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129740.308089:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129740.308100:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f96f000/0x48868a4e43947633 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e3ff expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.308116:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f96f000/0x48868a4e43947633 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3ff expref: 26 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129740.308125:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f96f000/0x48868a4e43947633 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3ff expref: 26 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129740.308142:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f96f000, rc 0) 00000100:00100000:0.0:1746129740.308413:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949051878656:12345-192.168.204.31@tcp:101:cat.0 Request processed in 572us (677us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129740.308419:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10025 00000100:00100000:0.0:1746129740.312538:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.315336:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.324600:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.331900:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.362597:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.375720:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.381026:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.381055:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.381087:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.381139:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051879680 00000100:00100000:1.0:1746129740.381145:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051879680 00000100:00100000:1.0:1746129740.381170:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051879808 00000100:00100000:1.0:1746129740.381171:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051879808 00000100:00100000:1.0:1746129740.381178:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051879936 00000100:00100000:1.0:1746129740.381179:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051879936 00000100:00100000:1.0:1746129740.381191:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10028 00000100:00100000:1.0:1746129740.381196:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1963:x1830949051879680:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129740.381209:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129740.381221:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013185c600/0x48868a4e43947648 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e414 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.381239:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.381240:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.381246:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013185c600/0x48868a4e43947648 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e414 expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.381259:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013185c600/0x48868a4e43947648 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e414 expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.381267:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013185c600, rc 0) 00000100:00100000:1.0:1746129740.381297:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1963:x1830949051879680:12345-192.168.204.31@tcp:101:cat.0 Request processed in 100us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129740.381311:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10028 00000100:00100000:1.0:1746129740.381321:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10029 00000100:00100000:1.0:1746129740.381325:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1963:x1830949051879808:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129740.381330:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129740.381335:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013185d000/0x48868a4e4394764f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e41b expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.381352:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013185d000/0x48868a4e4394764f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e41b expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.381358:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013185d000/0x48868a4e4394764f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e41b expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.381368:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013185d000, rc 0) 00000100:00100000:1.0:1746129740.381379:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1963:x1830949051879808:12345-192.168.204.31@tcp:101:cat.0 Request processed in 53us (323us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129740.381382:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10029 00000100:00100000:1.0:1746129740.381388:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10030 00000100:00100000:1.0:1746129740.381391:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1963:x1830949051879936:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129740.381397:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129740.381404:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013185de00/0x48868a4e43947656 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e422 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129740.381435:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053171968:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129740.381482:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129740.382246:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.388084:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009476a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053172096:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129740.388102:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129740.388427:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1964:x1830949051880064:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5173us (6180us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129740.388436:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4832 00000100:00100000:0.0:1746129740.397386:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.399734:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.402397:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.402839:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051881088 00000100:00100000:1.0:1746129740.402861:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051881088 00002000:00100000:1.0:1746129740.402898:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2625536->3674111) req@ffff88012ba39880 x1830949051881088/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:481/0 lens 488/0 e 0 to 0 dl 1746129751 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129740.402907:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba39880 with x1830949051881088 ext(2625536->3674111) 00002000:00010000:1.0:1746129740.402912:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba39880 00000100:00100000:1.0:1746129740.402952:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3677 00000100:00100000:1.0:1746129740.402959:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949051881088:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129740.406819:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.406907:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.409643:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051880832 00000100:00100000:0.0:1746129740.409649:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051880832 00002000:00100000:0.0:1746129740.409669:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012ba38e00 x1830949051880832/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:481/0 lens 488/0 e 0 to 0 dl 1746129751 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129740.409676:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba38e00 with x1830949051880832 ext(3145728->4194303) 00002000:00010000:0.0:1746129740.409679:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba38e00 00000100:00100000:0.0:1746129740.409691:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3679 00000100:00100000:0.0:1746129740.409695:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949051880832:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129740.421514:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.421537:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051881728 00000100:00100000:0.0:1746129740.421544:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051881728 00010000:00010000:0.0:1746129740.421573:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130efbe00/0x48868a4e4394761e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3f1 expref: 295 pid: 1851 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746129740.421597:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4833 00000100:00100000:0.0:1746129740.421615:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:1962:x1830949051881728:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129740.421626:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129740.421632:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130efbe00/0x48868a4e4394761e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3f1 expref: 295 pid: 1851 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746129740.421642:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130efbe00/0x48868a4e4394761e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3f1 expref: 295 pid: 1851 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746129740.421659:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129740.421663:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08c200/0x48868a4e43947664 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129740.421671:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08c200/0x48868a4e43947664 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129740.421676:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08c200/0x48868a4e43947664 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129740.421689:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129740.421717:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:1962:x1830949051881728:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 114us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129740.421723:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4833 00000100:00100000:1.0:1746129740.431229:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949051881088:12345-192.168.204.31@tcp:3:cat.0 Request processed in 28269us (31499us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129740.431236:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3677 00002000:00100000:1.0:1746129740.431241:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2625536->3674111) req@ffff88012ba39880 x1830949051881088/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:481/0 lens 488/440 e 0 to 0 dl 1746129751 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129740.431247:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba39880 with x1830949051881088 ext(2625536->3674111) 00002000:00010000:1.0:1746129740.431250:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba39880 00000100:00100000:0.0:1746129740.443452:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.445106:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10031 00000100:00100000:1.0:1746129740.445231:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28262:x1830949051881856:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129740.445249:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129740.445266:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9200/0x48868a4e43947672 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e430 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.445287:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.445289:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.445296:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9200/0x48868a4e43947672 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e430 expref: 11 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.445309:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9200/0x48868a4e43947672 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e430 expref: 11 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.445318:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8e9200, rc 0) 00000100:00100000:1.0:1746129740.445767:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28262:x1830949051881856:12345-192.168.204.31@tcp:101:cat.0 Request processed in 650us (2321us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129740.445773:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10031 00000100:00100000:0.0:1746129740.453193:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.453243:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.488638:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.489958:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051882496 00000100:00100000:1.0:1746129740.489966:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051882496 00000100:00100000:1.0:1746129740.490012:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10032 00000100:00100000:1.0:1746129740.490019:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28262:x1830949051882496:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129740.490031:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129740.490045:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b8e8e00/0x48868a4e43947679 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e437 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.490067:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013185c800/0x48868a4e43947602 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2625535) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3ea expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.490074:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129740.490075:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129740.490078:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8e8e00/0x48868a4e43947679 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e437 expref: 10 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.490100:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013185c800/0x48868a4e43947602 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2625535) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3ea expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.490110:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013185c800/0x48868a4e43947602 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2625535) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3ea expref: 16 pid: 8437 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746129740.490120:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053172352:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129740.490182:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129740.502918:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.502996:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.503492:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053172352:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129740.503516:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b8e8e00/0x48868a4e43947679 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e437 expref: 10 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.503531:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8e8e00, rc 0) 00000100:00100000:1.0:1746129740.503565:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28262:x1830949051882496:12345-192.168.204.31@tcp:101:cat.0 Request processed in 13547us (14935us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129740.503573:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10032 00000100:00100000:0.0:1746129740.504386:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.504515:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.504663:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051883264 00000100:00100000:1.0:1746129740.504667:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051883264 00000100:00100000:1.0:1746129740.504698:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10033 00000100:00100000:1.0:1746129740.504703:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28264:x1830949051883264:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129740.504712:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129740.504725:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9800/0x48868a4e43947680 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e445 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.504742:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d08d400/0x48868a4e43947641 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e40d expref: 25 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.504749:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9200/0x48868a4e43947672 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e430 expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.504754:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.504755:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.504758:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9800/0x48868a4e43947680 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2301952->2940927] (req 2301952->2940927) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e445 expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.504780:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9200/0x48868a4e43947672 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e430 expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.504789:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9200/0x48868a4e43947672 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e430 expref: 12 pid: 1877 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746129740.504799:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053172480:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129740.504882:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d08d400/0x48868a4e43947641 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e40d expref: 25 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.504891:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d08d400/0x48868a4e43947641 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e40d expref: 25 pid: 1877 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746129740.504898:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053172608:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129740.504928:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129740.513417:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053172480:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129740.513432:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053172608:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129740.513462:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9800/0x48868a4e43947680 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2301952->2940927] (req 2301952->2940927) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e445 expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.513480:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8e9800, rc 0) 00000100:00100000:1.0:1746129740.514265:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28264:x1830949051883264:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 9556us (9745us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129740.514274:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10033 00000100:00100000:0.0:1746129740.514574:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051883520 00000100:00100000:0.0:1746129740.514580:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051883520 00000100:00100000:0.0:1746129740.514622:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4834 00000100:00100000:0.0:1746129740.514629:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1964:x1830949051883392:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129740.514639:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129740.514655:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9200/0x48868a4e43947672 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e430 expref: 12 pid: 1877 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746129740.514664:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9200/0x48868a4e43947672 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e430 expref: 12 pid: 1877 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746129740.514675:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9200/0x48868a4e43947672 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e430 expref: 12 pid: 1877 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746129740.514685:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129740.514695:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949051883392:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 67us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129740.514700:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4834 00000100:00100000:1.0:1746129740.518510:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.527653:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.527711:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051883904 00000100:00100000:1.0:1746129740.527716:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051883904 00002000:00100000:1.0:1746129740.527742:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (2301952->2306047) req@ffff8800a8fd2a00 x1830949051883904/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:481/0 lens 488/0 e 0 to 0 dl 1746129751 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129740.527748:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd2a00 with x1830949051883904 ext(2301952->2306047) 00002000:00010000:1.0:1746129740.527751:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8fd2a00 00000100:00100000:1.0:1746129740.527765:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3682 00000100:00100000:1.0:1746129740.527771:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1963:x1830949051883904:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129740.527905:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1963:x1830949051883904:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 134us (253us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129740.527911:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3682 00002000:00100000:1.0:1746129740.527916:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (2301952->2306047) req@ffff8800a8fd2a00 x1830949051883904/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:481/0 lens 488/4536 e 0 to 0 dl 1746129751 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129740.527922:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd2a00 with x1830949051883904 ext(2301952->2306047) 00002000:00010000:1.0:1746129740.527924:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8fd2a00 00000100:00100000:0.0:1746129740.540300:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.552531:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.552568:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.552593:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.552641:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.552674:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051884416 00000100:00100000:0.0:1746129740.552680:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051884416 00002000:00100000:0.0:1746129740.552716:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (2936832->2940927) req@ffff88012da4ad80 x1830949051884416/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:481/0 lens 488/0 e 0 to 0 dl 1746129751 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129740.552725:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012da4ad80 with x1830949051884416 ext(2936832->2940927) 00002000:00010000:0.0:1746129740.552730:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012da4ad80 00000100:00100000:0.0:1746129740.552742:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051884928 00000100:00100000:0.0:1746129740.552744:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051884928 00002000:00100000:0.0:1746129740.552754:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012da48e00 x1830949051884928/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:481/0 lens 488/0 e 0 to 0 dl 1746129751 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129740.552759:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012da48e00 with x1830949051884928 ext(3145728->4194303) 00002000:00010000:0.0:1746129740.552762:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012da48e00 00000100:00100000:0.0:1746129740.552767:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051885184 00000100:00100000:0.0:1746129740.552768:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051885184 00002000:00100000:0.0:1746129740.552775:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012da48a80 x1830949051885184/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:481/0 lens 488/0 e 0 to 0 dl 1746129751 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129740.552780:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012da48a80 with x1830949051885184 ext(3145728->4194303) 00002000:00010000:0.0:1746129740.552782:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012da48a80 00000100:00100000:0.0:1746129740.552790:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3683 00000100:00100000:0.0:1746129740.552794:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012da4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1963:x1830949051884416:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129740.552946:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012da4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1963:x1830949051884416:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 151us (377us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129740.552953:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3683 00002000:00100000:0.0:1746129740.552958:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (2936832->2940927) req@ffff88012da4ad80 x1830949051884416/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:481/0 lens 488/4536 e 0 to 0 dl 1746129751 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129740.552964:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012da4ad80 with x1830949051884416 ext(2936832->2940927) 00002000:00010000:0.0:1746129740.552966:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012da4ad80 00000100:00100000:0.0:1746129740.552977:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3684 00000100:00100000:0.0:1746129740.552981:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012da48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949051884928:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129740.553544:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051884160 00000100:00100000:1.0:1746129740.553551:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051884160 00000100:00100000:1.0:1746129740.553570:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10034 00000100:00100000:1.0:1746129740.553574:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:28267:x1830949051884160:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129740.553585:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129740.553598:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ff99a00/0x48868a4e439476aa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e44c expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.553626:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b8e8e00/0x48868a4e43947679 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e437 expref: 10 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.553637:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.553638:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.553642:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff99a00/0x48868a4e439476aa lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2490368->2887679] (req 2490368->2887679) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e44c expref: 19 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.553662:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b8e8e00/0x48868a4e43947679 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e437 expref: 10 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.553671:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b8e8e00/0x48868a4e43947679 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e437 expref: 10 pid: 1877 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746129740.553679:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053172992:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129740.553726:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129740.554498:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.570039:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053172992:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129740.570068:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ff99a00/0x48868a4e439476aa lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2490368->2887679] (req 2490368->2887679) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e44c expref: 19 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.570082:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff99a00, rc 0) 00000100:00100000:1.0:1746129740.570122:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:28267:x1830949051884160:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 16545us (17595us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129740.570130:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10034 00000100:00100000:1.0:1746129740.577520:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012da48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949051884928:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 24531us (24918us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129740.577530:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3684 00002000:00100000:1.0:1746129740.577540:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012da48e00 x1830949051884928/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:481/0 lens 488/440 e 0 to 0 dl 1746129751 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129740.577549:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012da48e00 with x1830949051884928 ext(3145728->4194303) 00010000:00010000:1.0:1746129740.577558:0:21600:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b8e8e00/0x48868a4e43947679 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e437 expref: 12 pid: 1877 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746129740.577570:0:21600:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b8e8e00/0x48868a4e43947679 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e437 expref: 12 pid: 1877 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746129740.577577:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012da48e00 00000100:00100000:1.0:1746129740.596867:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051885312 00000100:00100000:1.0:1746129740.596875:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051885312 00000100:00100000:1.0:1746129740.596916:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10035 00000100:00100000:1.0:1746129740.596924:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28262:x1830949051885312:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129740.596938:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129740.596953:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a507f400/0x48868a4e439476b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e453 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.596971:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.596973:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.596979:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a507f400/0x48868a4e439476b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e453 expref: 11 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.596991:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a507f400/0x48868a4e439476b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e453 expref: 11 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.597001:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a507f400, rc 0) 00000100:00100000:1.0:1746129740.597173:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28262:x1830949051885312:12345-192.168.204.31@tcp:101:cat.0 Request processed in 248us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129740.597179:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10035 00000100:00100000:0.0:1746129740.597307:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.600242:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.608434:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.617164:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.618084:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.618108:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.618230:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051886336 00000100:00100000:1.0:1746129740.618234:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051886336 00000100:00100000:1.0:1746129740.618249:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051886464 00000100:00100000:1.0:1746129740.618251:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051886464 00000100:00100000:1.0:1746129740.618266:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10036 00000100:00100000:1.0:1746129740.618271:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949051886336:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129740.618280:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129740.618293:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a507e600/0x48868a4e439476b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e45a expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.618314:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a507e600/0x48868a4e439476b8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e45a expref: 12 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.618323:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a507e600/0x48868a4e439476b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e45a expref: 12 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.618335:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a507e600, rc 0) 00000100:00100000:1.0:1746129740.618366:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949051886336:12345-192.168.204.31@tcp:101:cat.0 Request processed in 95us (283us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129740.618371:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10036 00000100:00100000:1.0:1746129740.618381:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10037 00000100:00100000:1.0:1746129740.618385:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949051886464:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129740.618390:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129740.618397:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a507e800/0x48868a4e439476bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e461 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.618408:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a507e800/0x48868a4e439476bf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e461 expref: 11 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.619043:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a507e800/0x48868a4e439476bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e461 expref: 11 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.619051:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a507e800, rc 0) 00000100:00100000:1.0:1746129740.619078:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949051886464:12345-192.168.204.31@tcp:101:cat.0 Request processed in 692us (969us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129740.619083:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10037 00000100:00100000:0.0:1746129740.621837:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.626000:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.645818:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.645882:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051887104 00000100:00100000:1.0:1746129740.645890:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051887104 00000100:00100000:1.0:1746129740.645938:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10038 00000100:00100000:1.0:1746129740.645945:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949051887104:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129740.645960:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129740.645975:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a507e800/0x48868a4e439476c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e468 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.645998:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a507e800/0x48868a4e439476c6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e468 expref: 12 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.646007:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a507e800/0x48868a4e439476c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e468 expref: 12 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.646031:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a507e800, rc 0) 00000100:00100000:1.0:1746129740.646066:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949051887104:12345-192.168.204.31@tcp:101:cat.0 Request processed in 122us (256us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129740.646071:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10038 00000100:00100000:0.0:1746129740.647176:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.653816:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.653916:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.654013:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051887360 00000100:00100000:0.0:1746129740.654016:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051887360 00000100:00100000:0.0:1746129740.654177:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10041 00000100:00100000:0.0:1746129740.654184:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949051887360:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129740.654192:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129740.654200:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013185de00/0x48868a4e439476db lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e476 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129740.665515:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.665609:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051887616 00000100:00100000:1.0:1746129740.665619:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051887616 00000100:00100000:1.0:1746129740.665668:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9687 00000100:00100000:1.0:1746129740.665675:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+10:28272:x1830949051887616:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129740.665697:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129740.665717:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fa00/0x48868a4e439476e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e484 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.665770:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fc00/0x48868a4e439476e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129740.665781:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fc00/0x48868a4e439476e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129740.665790:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fc00/0x48868a4e439476e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129740.665800:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e439476f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129740.665805:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e439476f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129740.665809:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e439476f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129740.665927:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e439476f7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129740.665936:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08c200/0x48868a4e43947664 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e429 expref: 18 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.665942:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e439476f7 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129740.665965:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08c200/0x48868a4e43947664 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e429 expref: 18 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.665975:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08c200/0x48868a4e43947664 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e429 expref: 18 pid: 1851 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746129740.665985:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053173248:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129740.666687:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129740.669415:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053173248:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129740.669580:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e439476f7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000100:00100000:1.0:1746129740.672621:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129740.673080:0:15044:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e439476f7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129740.673087:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e439476f7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:0.0:1746129740.673120:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:0.0:1746129740.673124:0:15044:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129740.673136:0:15044:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e439476f7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129740.673144:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e439476f7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129740.673152:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fc00/0x48868a4e439476e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129740.673158:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fc00/0x48868a4e439476e9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129740.673164:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fc00/0x48868a4e439476e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129740.673169:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a507fc00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129740.673172:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fc00/0x48868a4e439476e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129740.673181:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fc00/0x48868a4e439476e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129740.673195:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:0.0:1746129740.673197:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129740.673200:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fc00/0x48868a4e439476e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129740.673204:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fc00/0x48868a4e439476e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129740.673216:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e439476f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129740.673220:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e439476f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129740.673224:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e439476f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129740.673228:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a507fe00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129740.673230:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e439476f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129740.673233:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e439476f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129740.673238:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e8c7500) 00010000:00010000:0.0:1746129740.673240:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129740.673241:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e439476f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129740.673245:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e439476f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129740.673287:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fa00/0x48868a4e439476e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e484 expref: 12 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.673297:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e439476f7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e484 expref: 11 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.673302:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129740.673304:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129740.673306:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a507f200, rc 0) 00000100:00100000:0.0:1746129740.678737:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.678778:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.678821:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.678960:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10042 00000100:00100000:1.0:1746129740.678970:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+8:1964:x1830949051888128:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129740.678993:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129740.679004:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a507f000/0x48868a4e439476fe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e48b expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.679022:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.679023:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.679029:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a507f000/0x48868a4e439476fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e48b expref: 10 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.679042:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a507f000/0x48868a4e439476fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e48b expref: 10 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.679050:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a507f000, rc 0) 00000100:00100000:1.0:1746129740.679085:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+10:1964:x1830949051888128:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 118us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129740.679090:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10042 00000100:00100000:1.0:1746129740.679105:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10044 00000100:00100000:1.0:1746129740.679109:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+8:1964:x1830949051888384:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129740.679116:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129740.679124:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a507e800/0x48868a4e4394770c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e499 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.679138:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a507e800/0x48868a4e4394770c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e499 expref: 9 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.679145:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a507e800/0x48868a4e4394770c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e499 expref: 9 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.679156:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a507e800, rc 0) 00000100:00100000:1.0:1746129740.679169:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+8:1964:x1830949051888384:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 59us (348us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129740.679173:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10044 00000100:00100000:0.0:1746129740.683222:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.687777:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.688085:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051888768 00000100:00100000:0.0:1746129740.688090:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051888768 00010000:00010000:0.0:1746129740.688113:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e439476f7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e484 expref: 13 pid: 15044 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746129740.688139:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4839 00000100:00100000:0.0:1746129740.688145:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949051888768:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129740.688156:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129740.688160:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e439476f7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e484 expref: 13 pid: 15044 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746129740.688169:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e439476f7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e484 expref: 13 pid: 15044 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746129740.688188:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e439476f7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e484 expref: 13 pid: 15044 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746129740.688219:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129740.688223:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e79e00/0x48868a4e4394771a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129740.688230:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e79e00/0x48868a4e4394771a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129740.688235:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e79e00/0x48868a4e4394771a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129740.688248:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129740.688275:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949051888768:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 130us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129740.688280:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4839 00000100:00100000:0.0:1746129740.693789:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.697898:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129740.698441:0:15044:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129e78e00/0x48868a4e4394772f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129740.698448:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e78e00/0x48868a4e4394772f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:0.0:1746129740.698479:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:0.0:1746129740.698483:0:15044:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129740.698495:0:15044:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129e78e00/0x48868a4e4394772f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129740.698518:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e78c00/0x48868a4e43947728 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4a7 expref: 14 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.698544:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e78e00/0x48868a4e4394772f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4a7 expref: 13 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.698550:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129740.698552:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129740.698555:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e78e00, rc 0) 00000100:00100000:0.0:1746129740.699000:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+12:28272:x1830949051888896:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5077us (5218us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129740.699006:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9689 00000100:00100000:0.0:1746129740.702068:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.702203:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.704622:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.708984:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10048 00000100:00100000:1.0:1746129740.708990:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949051889920:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:1.0:1746129740.709008:0:10930:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a507e600/0x48868a4e43947760 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.709017:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135849400/0x48868a4e4394725f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1d6 expref: 8 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.709024:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013185cc00/0x48868a4e43947331 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e23f expref: 18 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.709031:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7600/0x48868a4e439472eb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e20e expref: 9 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.709035:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.709036:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.709038:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a507e600/0x48868a4e43947760 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.709050:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7600/0x48868a4e439472eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e20e expref: 9 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.709057:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7600/0x48868a4e439472eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e20e expref: 9 pid: 1877 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746129740.709065:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053174016:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129740.709087:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013185cc00/0x48868a4e43947331 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e23f expref: 18 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.709097:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013185cc00/0x48868a4e43947331 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e23f expref: 18 pid: 3624 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746129740.709104:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053174144:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129740.709119:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135849400/0x48868a4e4394725f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1d6 expref: 8 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.709126:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135849400/0x48868a4e4394725f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1d6 expref: 8 pid: 10930 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746129740.709132:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053174400:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129740.709141:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129740.709386:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.709417:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051889792 00000100:00100000:1.0:1746129740.709420:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051889792 00000100:00100000:0.0:1746129740.709433:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.709436:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10050 00000100:00100000:1.0:1746129740.709441:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949051889792:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:1.0:1746129740.709455:0:1877:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094c1f800/0x48868a4e4394776e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.709464:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131848600/0x48868a4e439474ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e33b expref: 18 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129740.709467:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129740.709471:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f96ea00/0x48868a4e439475ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3ab expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129740.709480:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051890048 00010000:00010000:1.0:1746129740.709481:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131849400/0x48868a4e43947506 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e342 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129740.709483:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051890048 00010000:00010000:1.0:1746129740.709486:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.709487:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.709489:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c1f800/0x48868a4e4394776e lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129740.709496:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051890304 00000100:00100000:0.0:1746129740.709497:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051890304 00010000:00010000:1.0:1746129740.709502:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131849400/0x48868a4e43947506 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e342 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129740.709507:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10051 00010000:00010000:1.0:1746129740.709509:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131849400/0x48868a4e43947506 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e342 expref: 9 pid: 8437 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746129740.709511:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949051890048:12345-192.168.204.31@tcp:1:lfs.0 00000100:00100000:1.0:1746129740.709516:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012da4a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053174656:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129740.709524:0:3624:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013185d000/0x48868a4e43947775 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.709533:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a4d600/0x48868a4e439473a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e293 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.709538:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f96ea00/0x48868a4e439475ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3ab expref: 10 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129740.709544:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acd4ee00/0x48868a4e43947496 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e2fc expref: 10 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.709545:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f96ea00/0x48868a4e439475ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3ab expref: 10 pid: 20441 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746129740.709550:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a4c800/0x48868a4e439473a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e29a expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129740.709551:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053174784:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129740.709555:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.709556:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.709557:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013185d000/0x48868a4e43947775 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.709567:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131848600/0x48868a4e439474ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e33b expref: 18 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.709568:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a4c800/0x48868a4e439473a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e29a expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.709575:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a4c800/0x48868a4e439473a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e29a expref: 24 pid: 8437 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746129740.709577:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131848600/0x48868a4e439474ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e33b expref: 18 pid: 10930 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746129740.709582:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136887480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053175040:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129740.709583:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130506300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053174912:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129740.709592:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092540 going to sleep for 11 seconds 00010000:00010000:0.0:1746129740.709610:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800acd4ee00/0x48868a4e43947496 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e2fc expref: 10 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129740.709618:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800acd4ee00/0x48868a4e43947496 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e2fc expref: 10 pid: 1877 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746129740.710210:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136885f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053175168:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129740.710236:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a4d600/0x48868a4e439473a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e293 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.710243:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a4d600/0x48868a4e439473a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e293 expref: 10 pid: 8437 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746129740.710250:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053175296:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129740.710261:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129740.710277:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10052 00000100:00100000:0.0:1746129740.710282:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949051890304:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:0.0:1746129740.710299:0:20441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e4394777c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.710309:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ff99a00/0x48868a4e439476aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2490368->3145727] (req 2490368->2887679) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e44c expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.710315:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a507f400/0x48868a4e439476b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e453 expref: 9 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.710321:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746129740.710322:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746129740.710324:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e4394777c lrc: 5/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.710339:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a507f400/0x48868a4e439476b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e453 expref: 9 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.710350:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a507f400/0x48868a4e439476b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e453 expref: 9 pid: 1877 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746129740.710357:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053175424:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129740.710385:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ff99a00/0x48868a4e439476aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2490368->3145727] (req 2490368->2887679) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e44c expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.710393:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ff99a00/0x48868a4e439476aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2490368->3145727] (req 2490368->2887679) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e44c expref: 18 pid: 1877 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746129740.710399:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053175552:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129740.710422:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129740.730093:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.730186:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.730240:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051890560 00000100:00100000:0.0:1746129740.730240:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.730248:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051890560 00000100:00100000:0.0:1746129740.730257:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051890432 00000100:00100000:0.0:1746129740.730260:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051890432 00010000:00010000:1.0:1746129740.730274:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a507f000/0x48868a4e439476fe lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e48b expref: 11 pid: 10930 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746129740.730274:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013185c600/0x48868a4e43947648 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e414 expref: 11 pid: 8437 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746129740.730294:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051890688 00000100:00100000:0.0:1746129740.730296:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051890688 00010000:00010000:0.0:1746129740.730305:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7600/0x48868a4e439472eb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e20e expref: 10 pid: 1877 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746129740.731109:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4841 00000100:00100000:0.0:1746129740.731117:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949051890432:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129740.731128:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129740.731147:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013185c600/0x48868a4e43947648 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e414 expref: 11 pid: 8437 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746129740.731158:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013185c600/0x48868a4e43947648 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e414 expref: 11 pid: 8437 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746129740.731177:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129740.731212:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4842 00000100:00100000:0.0:1746129740.731213:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949051890432:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 97us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129740.731219:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4841 00000100:00100000:1.0:1746129740.731220:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949051890560:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129740.731229:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129740.731232:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4843 00000100:00100000:0.0:1746129740.731236:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1ae9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949051890688:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129740.731239:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a507f000/0x48868a4e439476fe lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e48b expref: 11 pid: 10930 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746129740.731242:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129740.731248:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a507f000/0x48868a4e439476fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e48b expref: 11 pid: 10930 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746129740.731252:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7600/0x48868a4e439472eb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e20e expref: 10 pid: 1877 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746129740.731259:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129740.731260:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7600/0x48868a4e439472eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e20e expref: 10 pid: 1877 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746129740.731271:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129740.731277:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949051890560:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 58us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129740.731282:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4842 00000100:00100000:0.0:1746129740.731286:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1ae9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949051890688:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 49us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129740.731291:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4843 00010000:00010000:1.0:1746129740.731352:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7600/0x48868a4e439472eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e20e expref: 9 pid: 1877 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746129740.731378:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053174016:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129740.731389:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053174144:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129740.731433:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013185c600/0x48868a4e43947648 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e414 expref: 10 pid: 8437 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746129740.731441:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053173632:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129740.731450:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a507f000/0x48868a4e439476fe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e48b expref: 10 pid: 10930 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746129740.734053:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053173760:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129740.734082:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053173888:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129740.734104:0:3623:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e43947759 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129740.734366:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.739563:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136887480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053175040:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129740.739595:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136885f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053175168:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129740.739627:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.739653:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.739665:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.739677:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.739693:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051890816 00000100:00100000:0.0:1746129740.739698:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051890816 00010000:00010000:0.0:1746129740.739725:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013185cc00/0x48868a4e43947331 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e23f expref: 19 pid: 3624 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746129740.739745:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4844 00000100:00100000:0.0:1746129740.739752:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949051890816:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129740.739763:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129740.739782:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013185cc00/0x48868a4e43947331 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e23f expref: 19 pid: 3624 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746129740.739791:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013185cc00/0x48868a4e43947331 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e23f expref: 19 pid: 3624 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746129740.739808:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013185cc00/0x48868a4e43947331 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e23f expref: 19 pid: 3624 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746129740.739875:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051890944 00000100:00100000:1.0:1746129740.739880:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051890944 00010000:00010000:1.0:1746129740.739894:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e439475f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3dc expref: 10 pid: 8437 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746129740.739906:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051891200 00000100:00100000:1.0:1746129740.739907:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051891200 00010000:00010000:1.0:1746129740.739915:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131849400/0x48868a4e43947506 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e342 expref: 9 pid: 8437 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746129740.739927:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051891456 00000100:00100000:1.0:1746129740.739929:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051891456 00010000:00010000:1.0:1746129740.739936:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131848600/0x48868a4e439474ff lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e33b expref: 19 pid: 10930 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746129740.739943:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051891328 00000100:00100000:1.0:1746129740.739944:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051891328 00010000:00010000:1.0:1746129740.739952:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f96ea00/0x48868a4e439475ae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3ab expref: 11 pid: 20441 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746129740.739962:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4845 00000100:00100000:1.0:1746129740.739966:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949051890944:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129740.739973:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129740.739985:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e439475f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3dc expref: 10 pid: 8437 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746129740.739993:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e439475f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3dc expref: 10 pid: 8437 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746129740.740004:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e439475f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3dc expref: 10 pid: 8437 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746129740.740015:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129740.740046:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1964:x1830949051890944:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 79us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129740.740051:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4845 00000100:00100000:1.0:1746129740.740076:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4846 00000100:00100000:1.0:1746129740.740080:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949051891200:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129740.740084:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129740.740092:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131849400/0x48868a4e43947506 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e342 expref: 9 pid: 8437 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746129740.740098:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131849400/0x48868a4e43947506 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e342 expref: 9 pid: 8437 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746129740.740107:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129740.740116:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949051891200:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 36us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129740.740120:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4846 00000100:00100000:1.0:1746129740.740128:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4847 00000100:00100000:1.0:1746129740.740132:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949051891456:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129740.740136:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129740.740141:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131848600/0x48868a4e439474ff lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e33b expref: 19 pid: 10930 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746129740.740148:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131848600/0x48868a4e439474ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e33b expref: 19 pid: 10930 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746129740.740155:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129740.740163:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949051891456:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 32us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129740.740167:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4847 00000100:00100000:1.0:1746129740.740174:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4848 00000100:00100000:1.0:1746129740.740178:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949051891328:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129740.740182:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129740.740185:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f96ea00/0x48868a4e439475ae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3ab expref: 11 pid: 20441 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746129740.740192:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f96ea00/0x48868a4e439475ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3ab expref: 11 pid: 20441 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746129740.740199:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.740201:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.740204:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c1f800/0x48868a4e4394776e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.740211:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c1f800/0x48868a4e4394776e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.740223:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129740.740232:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949051891328:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 54us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129740.740236:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4848 00000100:00100000:1.0:1746129740.740255:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053174400:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129740.740273:0:10930:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a507e600/0x48868a4e43947760 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.740290:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131849400/0x48868a4e43947506 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e342 expref: 8 pid: 8437 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746129740.740302:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012da4a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053174656:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129740.740308:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f96ea00/0x48868a4e439475ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e3ab expref: 10 pid: 20441 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746129740.740314:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053174784:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129740.740320:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131848600/0x48868a4e439474ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e33b expref: 18 pid: 10930 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746129740.740325:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130506300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053174912:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129740.740336:0:1877:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094c1f800/0x48868a4e4394776e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.740342:0:1877:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094c1f800/0x48868a4e4394776e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.740348:0:1877:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c1f800/0x48868a4e4394776e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.740361:0:1877:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094c1f800/0x48868a4e4394776e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.740367:0:1877:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094c1f800/0x48868a4e4394776e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.740377:0:1877:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094c1f800/0x48868a4e4394776e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.740382:0:1877:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c1f800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129740.740384:0:1877:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094c1f800/0x48868a4e4394776e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.740390:0:1877:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094c1f800/0x48868a4e4394776e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.740397:0:1877:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094c1f800/0x48868a4e4394776e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.740402:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c1f800/0x48868a4e4394776e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129740.740432:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949051889792:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 30991us (31047us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129740.740438:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10050 00000100:00100000:1.0:1746129740.740465:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.740518:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.740529:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051891584 00000100:00100000:1.0:1746129740.740532:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051891584 00010000:00010000:1.0:1746129740.740543:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd4ee00/0x48868a4e43947496 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e2fc expref: 10 pid: 1877 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746129740.740558:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4849 00000100:00100000:1.0:1746129740.740562:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949051891584:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129740.740569:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129740.740577:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800acd4ee00/0x48868a4e43947496 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e2fc expref: 10 pid: 1877 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746129740.740584:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800acd4ee00/0x48868a4e43947496 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e2fc expref: 10 pid: 1877 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746129740.740594:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acd4ee00/0x48868a4e43947496 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e2fc expref: 10 pid: 1877 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746129740.740629:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129740.740644:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949051891584:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 82us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129740.740649:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4849 00000100:00100000:1.0:1746129740.740658:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051891072 00000100:00100000:1.0:1746129740.740660:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051891072 00010000:00010000:1.0:1746129740.740667:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135849400/0x48868a4e4394725f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1d6 expref: 9 pid: 10930 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746129740.740676:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4850 00000100:00100000:1.0:1746129740.740680:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1ae9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:1963:x1830949051891072:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129740.740685:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129740.740692:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135849400/0x48868a4e4394725f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1d6 expref: 9 pid: 10930 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746129740.740698:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135849400/0x48868a4e4394725f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1d6 expref: 9 pid: 10930 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746129740.740706:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135849400/0x48868a4e4394725f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e1d6 expref: 9 pid: 10930 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746129740.740713:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.740714:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.740716:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a507e600/0x48868a4e43947760 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.740721:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a507e600/0x48868a4e43947760 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.740732:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129740.740745:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1ae9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:1963:x1830949051891072:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 65us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129740.740750:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4850 00010000:00010000:1.0:1746129740.740763:0:10930:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a507e600/0x48868a4e43947760 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.740769:0:10930:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a507e600/0x48868a4e43947760 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.740779:0:10930:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a507e600/0x48868a4e43947760 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.740785:0:10930:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a507e600/0x48868a4e43947760 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.740791:0:10930:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a507e600/0x48868a4e43947760 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.740795:0:10930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a507e600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129740.740798:0:10930:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a507e600/0x48868a4e43947760 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.740804:0:10930:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a507e600/0x48868a4e43947760 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.740810:0:10930:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a507e600/0x48868a4e43947760 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.740814:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a507e600/0x48868a4e43947760 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129740.740835:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+7:1962:x1830949051889920:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 31845us (32147us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129740.740841:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10048 00010000:00010000:0.0:1746129740.741028:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129740.741046:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949051890816:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1294us (6682us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129740.741051:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4844 00000100:00100000:0.0:1746129740.741091:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053175296:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129740.741106:0:3624:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013185d000/0x48868a4e43947775 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129740.741148:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053175424:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129740.741166:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.741176:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051891712 00000100:00100000:0.0:1746129740.741178:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051891712 00010000:00010000:0.0:1746129740.741190:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a4c800/0x48868a4e439473a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e29a expref: 25 pid: 8437 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746129740.741203:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4851 00000100:00100000:0.0:1746129740.741207:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1963:x1830949051891712:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129740.741212:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129740.741220:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a4c800/0x48868a4e439473a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e29a expref: 25 pid: 8437 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746129740.741227:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a4c800/0x48868a4e439473a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e29a expref: 25 pid: 8437 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746129740.741242:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a4c800/0x48868a4e439473a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e29a expref: 25 pid: 8437 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746129740.741250:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129740.741264:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949051891712:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 57us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129740.741269:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4851 00000100:00100000:0.0:1746129740.741307:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053175552:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129740.741318:0:20441:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e4394777c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129740.741340:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.741349:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051891840 00000100:00100000:0.0:1746129740.741351:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051891840 00010000:00010000:0.0:1746129740.741361:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a4d600/0x48868a4e439473a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e293 expref: 9 pid: 8437 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746129740.741372:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4852 00000100:00100000:0.0:1746129740.741376:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1963:x1830949051891840:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129740.741382:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129740.741388:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a4d600/0x48868a4e439473a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e293 expref: 9 pid: 8437 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746129740.741394:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a4d600/0x48868a4e439473a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e293 expref: 9 pid: 8437 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746129740.741407:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a4d600/0x48868a4e439473a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e293 expref: 9 pid: 8437 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746129740.741415:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.741416:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.741418:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013185d000/0x48868a4e43947775 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.741423:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013185d000/0x48868a4e43947775 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.741434:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129740.741443:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1963:x1830949051891840:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 67us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129740.741448:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4852 00010000:00010000:0.0:1746129740.741459:0:3624:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013185d000/0x48868a4e43947775 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.741465:0:3624:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013185d000/0x48868a4e43947775 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.741476:0:3624:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013185d000/0x48868a4e43947775 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.741482:0:3624:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013185d000/0x48868a4e43947775 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.741492:0:3624:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013185d000/0x48868a4e43947775 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.741497:0:3624:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013185d000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129740.741499:0:3624:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013185d000/0x48868a4e43947775 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.741505:0:3624:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013185d000/0x48868a4e43947775 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.741513:0:3624:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013185d000/0x48868a4e43947775 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.741518:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013185d000/0x48868a4e43947775 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129740.741548:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949051890048:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 32036us (32114us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129740.741553:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10051 00000100:00100000:0.0:1746129740.741580:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.741589:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051892096 00000100:00100000:0.0:1746129740.741592:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051892096 00010000:00010000:0.0:1746129740.741612:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d08cc00/0x48868a4e4394763a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e406 expref: 24 pid: 1877 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746129740.741626:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4853 00000100:00100000:0.0:1746129740.741630:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1964:x1830949051892096:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129740.741636:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129740.741643:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d08cc00/0x48868a4e4394763a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e406 expref: 24 pid: 1877 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746129740.741650:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d08cc00/0x48868a4e4394763a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e406 expref: 24 pid: 1877 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746129740.741658:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d08cc00/0x48868a4e4394763a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e406 expref: 24 pid: 1877 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746129740.741665:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.741666:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.741669:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e43947759 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.741674:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e43947759 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.741693:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129740.741705:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949051892096:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 75us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129740.741710:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4853 00000100:00100000:0.0:1746129740.741735:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.741774:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.741804:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.741814:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051892352 00000100:00100000:0.0:1746129740.741816:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051892352 00010000:00010000:0.0:1746129740.741827:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a507f400/0x48868a4e439476b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e453 expref: 8 pid: 1877 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746129740.741839:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4854 00000100:00100000:0.0:1746129740.741843:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1964:x1830949051892352:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129740.741864:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129740.741874:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a507f400/0x48868a4e439476b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e453 expref: 8 pid: 1877 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746129740.741881:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a507f400/0x48868a4e439476b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e453 expref: 8 pid: 1877 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746129740.741892:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a507f400/0x48868a4e439476b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e453 expref: 8 pid: 1877 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746129740.741900:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129740.741911:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1964:x1830949051892352:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 68us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129740.741916:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4854 00000100:00100000:0.0:1746129740.741942:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 495 00000100:00100000:0.0:1746129740.741947:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1964:x1830949051891968:12345-192.168.204.31@tcp:4:multiop.0 00010000:00010000:0.0:1746129740.742939:0:3623:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e43947759 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.742948:0:3623:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e43947759 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.742967:0:3623:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e43947759 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.742973:0:3623:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e43947759 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.742978:0:3623:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e43947759 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.742982:0:3623:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d08c000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129740.742984:0:3623:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e43947759 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.742990:0:3623:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e43947759 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.742999:0:3623:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e43947759 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.743003:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e43947759 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129740.743032:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+7:1962:x1830949051889664:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 34255us (34370us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129740.743038:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10047 00000100:00100000:0.0:1746129740.759259:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949051892224:12345-192.168.204.31@tcp:4:cat.0 Request processed in 17288us (17475us total) trans 17179872929 rc 0/0 00000100:00100000:0.0:1746129740.759271:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 496 00002000:00100000:0.0:1746129740.759282:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2301952->2940927) req@ffff880099e3e050 x1830949051892224/t17179872929(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:481/0 lens 488/448 e 0 to 0 dl 1746129751 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129740.759290:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e3e050 with x1830949051892224 ext(2301952->2940927) 00010000:00010000:0.0:1746129740.759299:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9800/0x48868a4e43947680 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2301952->3145727] (req 2301952->2940927) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e445 expref: 10 pid: 1877 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746129740.759310:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9800/0x48868a4e43947680 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2301952->3145727] (req 2301952->2940927) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e445 expref: 10 pid: 1877 timeout: 786 lvb_type: 0 00002000:00010000:0.0:1746129740.759317:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099e3e050 00000100:00100000:0.0:1746129740.768567:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.768595:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051892480 00000100:00100000:0.0:1746129740.768611:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051892480 00010000:00010000:0.0:1746129740.768642:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9800/0x48868a4e43947680 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2301952->3145727] (req 2301952->2940927) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e445 expref: 10 pid: 1877 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746129740.768666:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4855 00000100:00100000:0.0:1746129740.768672:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949051892480:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129740.768685:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746129740.768700:0:7107:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129740 -> 1746129741 00010000:00010000:0.0:1746129740.768706:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9800/0x48868a4e43947680 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2301952->3145727] (req 2301952->2940927) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e445 expref: 10 pid: 1877 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746129740.768715:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9800/0x48868a4e43947680 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2301952->3145727] (req 2301952->2940927) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e445 expref: 10 pid: 1877 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746129740.768735:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9800/0x48868a4e43947680 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2301952->3145727] (req 2301952->2940927) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e445 expref: 10 pid: 1877 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746129740.771608:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1964:x1830949051891968:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 29644us (29856us total) trans 21474840096 rc 0/0 00000100:00100000:1.0:1746129740.771618:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 495 00002000:00100000:1.0:1746129740.771627:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (2490368->2887679) req@ffff88012c040000 x1830949051891968/t21474840096(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:481/0 lens 488/448 e 0 to 0 dl 1746129751 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129740.771635:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c040000 with x1830949051891968 ext(2490368->2887679) 00010000:00010000:1.0:1746129740.771644:0:21600:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ff99a00/0x48868a4e439476aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2490368->3145727] (req 2490368->2887679) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e44c expref: 19 pid: 1877 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746129740.771656:0:21600:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ff99a00/0x48868a4e439476aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2490368->3145727] (req 2490368->2887679) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e44c expref: 19 pid: 1877 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746129740.771662:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c040000 00010000:00010000:0.0:1746129740.773325:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.773330:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.773336:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fa5400/0x48868a4e43947767 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.773347:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8fa5400/0x48868a4e43947767 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.773373:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129740.773411:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949051892480:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4735us (4848us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129740.773419:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4855 00000100:00100000:0.0:1746129740.775747:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129740.777410:0:20441:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e4394777c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.777417:0:20441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e4394777c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.777434:0:20441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e4394777c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.777440:0:20441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e4394777c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.777450:0:20441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e4394777c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.777456:0:20441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e78c00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129740.777459:0:20441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e4394777c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.777466:0:20441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e4394777c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.777476:0:20441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e4394777c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.777481:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e4394777c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129740.778018:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+6:1962:x1830949051890304:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 67735us (68549us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129740.778025:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10052 00000100:00100000:0.0:1746129740.780051:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.786934:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.786997:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.790513:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051893120 00000100:00100000:0.0:1746129740.790522:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051893120 00010000:00010000:1.0:1746129740.791188:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131849e00/0x48868a4e439473d2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e2af expref: 297 pid: 15044 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746129740.791325:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4858 00000100:00100000:1.0:1746129740.791331:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:1962:x1830949051893120:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129740.791338:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129740.791342:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131849e00/0x48868a4e439473d2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e2af expref: 297 pid: 15044 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746129740.791350:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131849e00/0x48868a4e439473d2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e2af expref: 297 pid: 15044 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746129740.791361:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131849e00/0x48868a4e439473d2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e2af expref: 297 pid: 15044 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746129740.791390:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129740.791394:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fa5600/0x48868a4e43947783 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129740.791401:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129740.791940:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:1962:x1830949051893120:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 608us (5006us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129740.791946:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4858 00000100:00100000:1.0:1746129740.792427:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.792438:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.792519:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000001:00080000:1.0:1746129740.825933:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943429 is committed 00000001:00080000:1.0:1746129740.825942:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943449 is committed 00000001:00080000:1.0:1746129740.825946:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943448 is committed 00000001:00080000:1.0:1746129740.825949:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943446 is committed 00000001:00080000:1.0:1746129740.825961:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943457 is committed 00000001:00080000:1.0:1746129740.825964:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943454 is committed 00000001:00080000:1.0:1746129740.825974:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943458 is committed 00000004:00080000:1.0:1746129740.825977:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1798 committed 00000004:00080000:1.0:1746129740.825983:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1842 committed 00000004:00080000:1.0:1746129740.825987:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1841 committed 00000004:00080000:1.0:1746129740.825989:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1840 committed 00000004:00080000:1.0:1746129740.825990:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1839 committed 00000004:00080000:1.0:1746129740.825991:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1797 committed 00000004:00080000:1.0:1746129740.825992:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1838 committed 00000004:00080000:1.0:1746129740.825994:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1796 committed 00000004:00080000:1.0:1746129740.825995:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1837 committed 00000004:00080000:1.0:1746129740.825997:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1795 committed 00000004:00080000:1.0:1746129740.825999:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1794 committed 00000004:00080000:1.0:1746129740.826002:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1793 committed 00000004:00080000:1.0:1746129740.826003:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1836 committed 00000004:00080000:1.0:1746129740.826004:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1835 committed 00000004:00080000:1.0:1746129740.826006:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1792 committed 00000004:00080000:1.0:1746129740.826008:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1791 committed 00000004:00080000:1.0:1746129740.826009:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1834 committed 00000001:00080000:1.0:1746129740.826014:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943455 is committed 00000100:00100000:1.0:1746129740.826162:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053176576:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129740.826217:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129740.826254:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053177088:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129740.826270:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129740.826281:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053177600:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129740.826294:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129740.826304:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053178112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129740.826315:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129740.826329:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746129740.826333:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053176704:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129740.826345:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129740.826354:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053177216:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129740.826365:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129740.826373:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053177728:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129740.826385:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129740.826393:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053178240:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129740.826404:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129740.826422:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053176576 00000100:00100000:1.0:1746129740.826428:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053176576 00000100:00100000:1.0:1746129740.826458:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053177088 00000100:00100000:1.0:1746129740.826460:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053177088 00000100:00100000:1.0:1746129740.826469:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053177600 00000100:00100000:1.0:1746129740.826470:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053177600 00000100:00100000:1.0:1746129740.826478:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053178112 00000100:00100000:1.0:1746129740.826480:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053178112 00000100:00100000:1.0:1746129740.826486:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053176704 00000100:00100000:1.0:1746129740.826488:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053176704 00000100:00100000:1.0:1746129740.826492:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053177216 00000100:00100000:1.0:1746129740.826494:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053177216 00000100:00100000:1.0:1746129740.826499:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053177728 00000100:00100000:1.0:1746129740.826501:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053177728 00000100:00100000:1.0:1746129740.826506:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053178240 00000100:00100000:1.0:1746129740.826508:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053178240 00000100:00100000:1.0:1746129740.826516:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10053 00000100:00100000:1.0:1746129740.826522:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3298:x1830949053176576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129740.826713:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3298:x1830949053176576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 189us (495us total) trans 21474840097 rc 0/0 00000100:00100000:1.0:1746129740.826719:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10053 00000100:00100000:1.0:1746129740.826733:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10054 00000100:00100000:1.0:1746129740.826737:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3298:x1830949053177088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129740.826813:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3298:x1830949053177088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (541us total) trans 21474840098 rc 0/0 00000100:00100000:1.0:1746129740.826817:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10054 00000100:00100000:1.0:1746129740.826826:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10055 00000100:00100000:1.0:1746129740.826830:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3298:x1830949053177600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129740.826957:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3298:x1830949053177600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 126us (661us total) trans 17179872930 rc 0/0 00000100:00100000:1.0:1746129740.826964:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10055 00000100:00100000:1.0:1746129740.826974:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10056 00000100:00100000:1.0:1746129740.826978:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3298:x1830949053178112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129740.827047:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3298:x1830949053178112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (730us total) trans 17179872931 rc 0/0 00000100:00100000:1.0:1746129740.827052:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10056 00000100:00100000:1.0:1746129740.827060:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10057 00000100:00100000:1.0:1746129740.827064:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3298:x1830949053176704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129740.827131:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3298:x1830949053176704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (785us total) trans 21474840099 rc 0/0 00000100:00100000:1.0:1746129740.827136:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10057 00000100:00100000:1.0:1746129740.827144:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10058 00000100:00100000:1.0:1746129740.827147:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3298:x1830949053177216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129740.827211:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3298:x1830949053177216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (844us total) trans 21474840100 rc 0/0 00000100:00100000:1.0:1746129740.827215:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10058 00000100:00100000:1.0:1746129740.827238:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10059 00000100:00100000:1.0:1746129740.827242:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3298:x1830949053177728:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129740.827306:0:20441:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746129740.827308:0:20441:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746129740.827310:0:20441:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746129740.827311:0:20441:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746129740.827313:0:20441:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129740.827333:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3298:x1830949053177728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (947us total) trans 17179872932 rc 0/0 00000100:00100000:1.0:1746129740.827339:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10059 00000100:00100000:1.0:1746129740.827351:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10060 00000100:00100000:1.0:1746129740.827355:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3298:x1830949053178240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129740.827436:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8790a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3298:x1830949053178240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (1031us total) trans 17179872933 rc 0/0 00000100:00100000:1.0:1746129740.827441:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10060 00000100:00100000:0.0:1746129740.828679:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053176320 00000100:00100000:0.0:1746129740.828687:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053176320 00000100:00100000:0.0:1746129740.828710:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053176832 00000100:00100000:0.0:1746129740.828711:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053176832 00000100:00100000:0.0:1746129740.828721:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10061 00000100:00100000:0.0:1746129740.828726:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3296:x1830949053176320:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129740.828872:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3296:x1830949053176320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 145us (1414us total) trans 21474840101 rc 0/0 00000100:00100000:0.0:1746129740.828877:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10061 00000100:00100000:0.0:1746129740.828891:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10063 00000100:00100000:0.0:1746129740.828895:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3296:x1830949053177344:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129740.828943:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130506d80/2, rc 0, transno 21474840099 00000100:00100000:0.0:1746129740.828948:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053176704:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129740.828956:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130504000/2, rc 0, transno 21474840100 00000100:00100000:0.0:1746129740.828958:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053177216:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129740.828966:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130506300/2, rc 0, transno 17179872932 00000100:00100000:0.0:1746129740.828973:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053177728:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129740.828980:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba85c00/2, rc 0, transno 17179872933 00000100:00100000:0.0:1746129740.828982:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053178240:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129740.828990:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130505880/2, rc 0, transno 21474840097 00000100:00100000:0.0:1746129740.828992:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053176576:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129740.828998:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130506a00/2, rc 0, transno 21474840098 00000100:00100000:0.0:1746129740.829000:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053177088:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129740.829007:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130505500/2, rc 0, transno 17179872930 00000100:00100000:0.0:1746129740.829010:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053177600:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129740.829015:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba84380/2, rc 0, transno 17179872931 00000100:00100000:0.0:1746129740.829018:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053178112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129740.829119:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3296:x1830949053177344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 224us (390us total) trans 17179872935 rc 0/0 00000100:00100000:0.0:1746129740.829124:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10063 00000100:00100000:1.0:1746129740.836508:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.843205:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.847936:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051894016 00000100:00100000:0.0:1746129740.847943:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051894016 00000100:00100000:0.0:1746129740.847973:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051894272 00000100:00100000:0.0:1746129740.847974:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051894272 00000100:00100000:0.0:1746129740.847984:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051894528 00000100:00100000:0.0:1746129740.847986:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051894528 00000100:00100000:0.0:1746129740.847995:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051893888 00000100:00100000:0.0:1746129740.847996:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051893888 00000100:00100000:0.0:1746129740.848008:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10070 00000100:00100000:0.0:1746129740.848014:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+7:1961:x1830949051894016:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129740.848030:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129740.848047:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb20a00/0x48868a4e4394779f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e4d8 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129740.848067:0:20441:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e6:0x0] initial LVB size: 2097152, mtime: 0x6813d34c, atime: 0x6813d34c, ctime: 0x6813d34c, blocks: 0x821 00010000:00010000:0.0:1746129740.848081:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.848082:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.848089:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb20a00/0x48868a4e4394779f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4d8 expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129740.848103:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb20a00/0x48868a4e4394779f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4d8 expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129740.848111:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb20a00, rc 0) 00000100:00100000:0.0:1746129740.848142:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949051894016:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 128us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129740.848150:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10070 00000100:00100000:0.0:1746129740.848161:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10071 00000100:00100000:0.0:1746129740.848165:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+7:1961:x1830949051894272:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129740.848170:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129740.848178:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb21800/0x48868a4e439477a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e4e6 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129740.848189:0:20441:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3ea:0x0] initial LVB size: 2097152, mtime: 0x6813d34c, atime: 0x6813d349, ctime: 0x6813d34c, blocks: 0x81f 00010000:00010000:0.0:1746129740.848195:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.848196:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.848199:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb21800/0x48868a4e439477a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4e6 expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129740.848208:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb21800/0x48868a4e439477a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4e6 expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129740.848214:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb21800, rc 0) 00000100:00100000:0.0:1746129740.848224:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949051894272:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 59us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129740.848228:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10071 00000100:00100000:0.0:1746129740.848235:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10072 00000100:00100000:0.0:1746129740.848238:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+7:1961:x1830949051894528:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129740.848243:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129740.848249:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb21000/0x48868a4e439477ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e4f4 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129740.848261:0:20441:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e8:0x0] initial LVB size: 4194304, mtime: 0x6813d34d, atime: 0x6813d34d, ctime: 0x6813d34d, blocks: 0x1029 00010000:00010000:0.0:1746129740.848266:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.848267:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.848270:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb21000/0x48868a4e439477ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4f4 expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129740.848278:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb21000/0x48868a4e439477ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4f4 expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129740.848284:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb21000, rc 0) 00000100:00100000:0.0:1746129740.848294:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949051894528:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 55us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129740.848298:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10072 00000100:00100000:0.0:1746129740.848307:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10073 00000100:00100000:0.0:1746129740.848310:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+7:1961:x1830949051893888:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129740.848314:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129740.848319:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb20400/0x48868a4e439477b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e4d1 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129740.848326:0:20441:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e8:0x0] initial LVB size: 1048576, mtime: 0x6813d34c, atime: 0x6813d348, ctime: 0x6813d34c, blocks: 0x7b7 00010000:00010000:0.0:1746129740.848332:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.848333:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.848336:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb20400/0x48868a4e439477b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4d1 expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129740.848343:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb20400/0x48868a4e439477b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4d1 expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129740.848349:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb20400, rc 0) 00000100:00100000:0.0:1746129740.848358:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949051893888:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 48us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129740.848362:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10073 00000100:00100000:1.0:1746129740.850092:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051894144 00000100:00100000:1.0:1746129740.850098:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051894144 00000100:00100000:1.0:1746129740.850117:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051894400 00000100:00100000:1.0:1746129740.850119:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051894400 00000100:00100000:1.0:1746129740.850130:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10074 00000100:00100000:1.0:1746129740.850135:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949051894144:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129740.850145:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129740.850157:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135848a00/0x48868a4e439477bb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e4df expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129740.850171:0:7976:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e7:0x0] initial LVB size: 2097152, mtime: 0x6813d348, atime: 0x6813d348, ctime: 0x6813d348, blocks: 0x821 00010000:00010000:1.0:1746129740.850182:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.850184:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.850190:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135848a00/0x48868a4e439477bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4df expref: 9 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.850200:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135848a00/0x48868a4e439477bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4df expref: 9 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.850213:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135848a00, rc 0) 00000100:00100000:1.0:1746129740.850237:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949051894144:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 102us (2360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129740.850242:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10074 00000100:00100000:1.0:1746129740.850266:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10075 00000100:00100000:1.0:1746129740.850269:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949051894400:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129740.850275:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129740.850282:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135849400/0x48868a4e439477c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e4ed expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129740.850292:0:7976:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3eb:0x0] initial LVB size: 4960928, mtime: 0x6813d34c, atime: 0x6813d34d, ctime: 0x6813d34c, blocks: 0x1627 00010000:00010000:1.0:1746129740.850298:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.850299:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.850302:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135849400/0x48868a4e439477c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4ed expref: 9 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.850310:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135849400/0x48868a4e439477c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4ed expref: 9 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129740.850316:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135849400, rc 0) 00000100:00100000:1.0:1746129740.850326:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949051894400:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 57us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129740.850331:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10075 00000100:00100000:0.0:1746129740.857946:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.858016:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051894784 00000100:00100000:1.0:1746129740.858023:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051894784 00000100:00100000:1.0:1746129740.858067:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3690 00000100:00100000:1.0:1746129740.858073:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6141239f-0c60-480d-830c-e22ba61457b0+9:1964:x1830949051894784:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:1.0:1746129740.858099:0:21600:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135849800/0x48868a4e439477c9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.858111:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.858112:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.858116:0:21600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135849800/0x48868a4e439477c9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.858127:0:21600:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135849800/0x48868a4e439477c9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129740.865290:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.866317:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.876898:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.877731:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.879099:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051895680 00000100:00100000:0.0:1746129740.879108:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051895680 00000100:00100000:0.0:1746129740.879150:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051895552 00000100:00100000:0.0:1746129740.879152:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051895552 00000100:00100000:0.0:1746129740.879165:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3693 00000100:00100000:0.0:1746129740.879171:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6141239f-0c60-480d-830c-e22ba61457b0+12:1964:x1830949051895680:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:0.0:1746129740.879196:0:21601:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012bb20000/0x48868a4e439477de lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.879208:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.879210:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.879214:0:21601:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb20000/0x48868a4e439477de lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.879226:0:21601:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb20000/0x48868a4e439477de lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129740.880246:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3694 00000100:00100000:1.0:1746129740.880253:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6141239f-0c60-480d-830c-e22ba61457b0+13:1964:x1830949051895552:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:1.0:1746129740.880269:0:21604:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f858800/0x48868a4e439477e5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.880276:0:21604:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.880277:0:21604:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129740.880279:0:21604:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f858800/0x48868a4e439477e5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.880287:0:21604:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f858800/0x48868a4e439477e5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129740.882816:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.882834:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.882865:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.882882:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051896192 00000100:00100000:0.0:1746129740.882888:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051896192 00000100:00100000:0.0:1746129740.882919:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051896320 00000100:00100000:0.0:1746129740.882920:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051896320 00000100:00100000:0.0:1746129740.882930:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051896448 00000100:00100000:0.0:1746129740.882931:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051896448 00000100:00100000:0.0:1746129740.882940:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3695 00000100:00100000:0.0:1746129740.882946:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6141239f-0c60-480d-830c-e22ba61457b0+15:1963:x1830949051896192:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:0.0:1746129740.882969:0:8440:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012ffbca00/0x48868a4e439477ec lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.882980:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.882982:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.882986:0:8440:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffbca00/0x48868a4e439477ec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.882996:0:8440:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ffbca00/0x48868a4e439477ec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129740.884021:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3696 00000100:00100000:0.0:1746129740.884026:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6141239f-0c60-480d-830c-e22ba61457b0+14:1963:x1830949051896320:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:0.0:1746129740.884042:0:25617:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012ffbcc00/0x48868a4e439477f3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.884049:0:25617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.884051:0:25617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129740.884063:0:25617:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffbcc00/0x48868a4e439477f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129740.884072:0:25617:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ffbcc00/0x48868a4e439477f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.893411:0:21600:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135849800/0x48868a4e439477c9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.893426:0:21600:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135849800/0x48868a4e439477c9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.893433:0:21600:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135849800/0x48868a4e439477c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.893439:0:21600:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135849800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129740.893442:0:21600:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135849800/0x48868a4e439477c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.893449:0:21600:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135849800/0x48868a4e439477c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.893464:0:21600:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135849800/0x48868a4e439477c9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.893469:0:21600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135849800/0x48868a4e439477c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129740.893547:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6141239f-0c60-480d-830c-e22ba61457b0+15:1964:x1830949051894784:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 35470us (35603us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129740.893556:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3690 00010000:00010000:1.0:1746129740.917293:0:21604:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f858800/0x48868a4e439477e5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.917310:0:21604:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f858800/0x48868a4e439477e5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.917316:0:21604:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f858800/0x48868a4e439477e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.917322:0:21604:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f858800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129740.917325:0:21604:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f858800/0x48868a4e439477e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.917332:0:21604:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f858800/0x48868a4e439477e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.917347:0:21604:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f858800/0x48868a4e439477e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129740.917353:0:21604:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f858800/0x48868a4e439477e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129740.917438:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949051895552:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 37181us (39703us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129740.917447:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3694 00000100:00100000:0.0:1746129740.942966:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.948124:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.948147:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051896960 00000100:00100000:0.0:1746129740.948153:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051896960 00000100:00100000:0.0:1746129740.948181:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10076 00000100:00100000:0.0:1746129740.948187:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949051896960:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129740.948325:0:3623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746129740.948328:0:3623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129740 -> 1746129741 00002000:00010000:0.0:1746129740.948330:0:3623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129736 -> 1746129741 00002000:00010000:0.0:1746129740.948332:0:3623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129740 -> 1746129741 00002000:00010000:0.0:1746129740.948334:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 1975 -> 1975 00000100:00100000:0.0:1746129740.948367:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949051896960:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 180us (249us total) trans 17179872939 rc 0/0 00000100:00100000:0.0:1746129740.948373:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10076 00000100:00100000:0.0:1746129740.949026:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.949435:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.949450:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051897088 00000100:00100000:0.0:1746129740.949453:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051897088 00000100:00100000:0.0:1746129740.950557:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051897344 00000100:00100000:0.0:1746129740.950564:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051897344 00000100:00100000:0.0:1746129740.950612:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10077 00000100:00100000:0.0:1746129740.950619:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949051897088:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129740.950751:0:3623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129740.950754:0:3623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129740 -> 1746129741 00002000:00010000:0.0:1746129740.950756:0:3623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129740 -> 1746129741 00002000:00010000:0.0:1746129740.950758:0:3623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129740 -> 1746129741 00002000:00010000:0.0:1746129740.950760:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129740.950807:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949051897088:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 189us (1781us total) trans 21474840105 rc 0/0 00000100:00100000:0.0:1746129740.950814:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10077 00000100:00100000:0.0:1746129740.950934:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10078 00000100:00100000:0.0:1746129740.950939:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949051897344:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129740.951016:0:3623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129740.951019:0:3623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129740 -> 1746129741 00002000:00010000:0.0:1746129740.951021:0:3623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746129737 -> 1746129741 00002000:00010000:0.0:1746129740.951022:0:3623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129740 -> 1746129741 00002000:00010000:0.0:1746129740.951024:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746129740.951041:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949051897344:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 102us (1606us total) trans 17179872940 rc 0/0 00000100:00100000:0.0:1746129740.951046:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10078 00000100:00100000:0.0:1746129740.951080:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.951094:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051897216 00000100:00100000:0.0:1746129740.951097:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051897216 00000100:00100000:0.0:1746129740.951111:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10079 00000100:00100000:0.0:1746129740.951115:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949051897216:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129740.951179:0:3623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129740.951182:0:3623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129736 -> 1746129741 00002000:00010000:0.0:1746129740.951184:0:3623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129736 -> 1746129741 00002000:00010000:0.0:1746129740.951185:0:3623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129736 -> 1746129741 00002000:00010000:0.0:1746129740.951187:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129740.951204:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949051897216:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 88us (123us total) trans 21474840106 rc 0/0 00000100:00100000:0.0:1746129740.951209:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10079 00000100:00100000:0.0:1746129740.951244:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.951253:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051897600 00000100:00100000:0.0:1746129740.951255:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051897600 00000100:00100000:0.0:1746129740.951269:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10080 00000100:00100000:0.0:1746129740.951273:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949051897600:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129740.951324:0:3623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746129740.951326:0:3623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129741 -> 1746129741 00002000:00010000:0.0:1746129740.951328:0:3623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129741 -> 1746129741 00002000:00010000:0.0:1746129740.951330:0:3623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129741 -> 1746129741 00002000:00010000:0.0:1746129740.951331:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746129740.951346:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949051897600:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 72us (101us total) trans 21474840107 rc 0/0 00000100:00100000:0.0:1746129740.951350:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10080 00000100:00100000:0.0:1746129740.951388:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.951400:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051897472 00000100:00100000:0.0:1746129740.951402:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051897472 00000100:00100000:0.0:1746129740.951416:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10081 00000100:00100000:0.0:1746129740.951420:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949051897472:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129740.951477:0:3623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:0.0:1746129740.951480:0:3623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129740 -> 1746129741 00002000:00010000:0.0:1746129740.951481:0:3623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129741 -> 1746129741 00002000:00010000:0.0:1746129740.951483:0:3623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129740 -> 1746129741 00002000:00010000:0.0:1746129740.951484:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5671 -> 5671 00000100:00100000:0.0:1746129740.951500:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949051897472:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 80us (112us total) trans 17179872941 rc 0/0 00000100:00100000:0.0:1746129740.951505:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10081 00000100:00100000:0.0:1746129740.955247:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129740.957572:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129740.957643:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051897984 00000100:00100000:1.0:1746129740.957648:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051897984 00010000:00010000:1.0:1746129740.957669:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094b2de00/0x48868a4e4394778a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4c3 expref: 10 pid: 1851 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746129740.957702:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4862 00000100:00100000:1.0:1746129740.957707:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949051897984:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129740.957716:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129740.957720:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094b2de00/0x48868a4e4394778a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4c3 expref: 10 pid: 1851 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129740.957728:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094b2de00/0x48868a4e4394778a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4c3 expref: 10 pid: 1851 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129740.957741:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b2de00/0x48868a4e4394778a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4c3 expref: 10 pid: 1851 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129740.957758:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129740.957762:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947808 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 00010000:00010000:1.0:1746129740.957769:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947808 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15740 initiator: MDT0 00010000:00010000:1.0:1746129740.957773:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947808 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15740 initiator: MDT0 00010000:00010000:1.0:1746129740.957788:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129740.957816:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949051897984:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 109us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129740.957821:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4862 00000001:00080000:1.0:1746129740.990007:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943460 is committed 00000004:00080000:1.0:1746129740.990016:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1806 committed 00000004:00080000:1.0:1746129740.990022:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1851 committed 00000004:00080000:1.0:1746129740.990028:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1850 committed 00000004:00080000:1.0:1746129740.990030:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1849 committed 00000004:00080000:1.0:1746129740.990031:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1848 committed 00000004:00080000:1.0:1746129740.990033:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1805 committed 00000004:00080000:1.0:1746129740.990034:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1847 committed 00000004:00080000:1.0:1746129740.990036:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1804 committed 00000004:00080000:1.0:1746129740.990037:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1846 committed 00000004:00080000:1.0:1746129740.990038:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1803 committed 00000004:00080000:1.0:1746129740.990040:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1802 committed 00000004:00080000:1.0:1746129740.990041:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1801 committed 00000004:00080000:1.0:1746129740.990043:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1845 committed 00000004:00080000:1.0:1746129740.990044:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1844 committed 00000004:00080000:1.0:1746129740.990046:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1800 committed 00000004:00080000:1.0:1746129740.990047:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1799 committed 00000004:00080000:1.0:1746129740.990049:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1843 committed 00000100:00100000:1.0:1746129740.990238:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053178752:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129740.990287:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129740.990311:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053179264:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129740.990326:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129740.990340:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053179776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129740.990353:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129740.990362:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053180288:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129740.990372:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129740.990613:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053179264 00000100:00100000:1.0:1746129740.990617:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053179264 00000100:00100000:1.0:1746129740.990633:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053180288 00000100:00100000:1.0:1746129740.990635:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053180288 00000100:00100000:1.0:1746129740.990648:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10083 00000100:00100000:1.0:1746129740.990654:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3299:x1830949053178880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129740.990783:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746129740.990786:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129741 -> 1746129741 00002000:00010000:1.0:1746129740.990788:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129741 -> 1746129741 00002000:00010000:1.0:1746129740.990790:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129741 -> 1746129741 00002000:00010000:1.0:1746129740.990791:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746129740.990813:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3299:x1830949053178880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 159us (505us total) trans 21474840109 rc 0/0 00000100:00100000:1.0:1746129740.990818:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10083 00000100:00100000:1.0:1746129740.990831:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10086 00000100:00100000:1.0:1746129740.990835:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3298:x1830949053180288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129740.990937:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3298:x1830949053180288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (562us total) trans 17179872942 rc 0/0 00000100:00100000:1.0:1746129740.990942:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10086 00000100:00100000:3.0:1746129740.991013:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053180416:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129740.991013:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129740.991016:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129741 -> 1746129741 00002000:00010000:1.0:1746129740.991018:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129741 -> 1746129741 00002000:00010000:1.0:1746129740.991020:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129741 -> 1746129741 00002000:00010000:1.0:1746129740.991022:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746129740.991027:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129740.991041:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3298:x1830949053178752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 398us (754us total) trans 21474840110 rc 0/0 00000100:00100000:1.0:1746129740.991047:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10082 00000004:00080000:3.0:1746129740.991052:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8791880/2, rc 0, transno 21474840109 00000100:00100000:3.0:1746129740.991056:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8791880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053178880:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129740.991056:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053179392 00000100:00100000:1.0:1746129740.991059:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053179392 00000100:00100000:3.0:1746129740.991067:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053179904 00000100:00100000:3.0:1746129740.991069:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053179904 00000100:00100000:1.0:1746129740.991070:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053180416 00000100:00100000:1.0:1746129740.991072:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053180416 00000100:00100000:3.0:1746129740.991081:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10087 00000100:00100000:3.0:1746129740.991085:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3299:x1830949053179392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129740.991085:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10088 00000100:00100000:1.0:1746129740.991089:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3299:x1830949053179904:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129740.991156:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:1.0:1746129740.991159:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129741 -> 1746129741 00000100:00100000:3.0:1746129740.991160:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3299:x1830949053179392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (182us total) trans 21474840111 rc 0/0 00002000:00010000:1.0:1746129740.991161:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129741 -> 1746129741 00002000:00010000:1.0:1746129740.991162:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129741 -> 1746129741 00002000:00010000:1.0:1746129740.991164:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5671 -> 5671 00000100:00100000:3.0:1746129740.991165:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10087 00000100:00100000:3.0:1746129740.991175:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10089 00000100:00100000:3.0:1746129740.991179:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3299:x1830949053180416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129740.991184:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3299:x1830949053179904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (178us total) trans 17179872944 rc 0/0 00000100:00100000:1.0:1746129740.991189:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10088 00000004:00080000:1.0:1746129740.991214:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8791c00/2, rc 0, transno 21474840110 00000100:00100000:1.0:1746129740.991218:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053178752:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129740.991224:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8790380/2, rc 0, transno 21474840108 00000100:00100000:1.0:1746129740.991226:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053179264:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129740.991232:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b00ca80/2, rc 0, transno 17179872943 00000100:00100000:1.0:1746129740.991238:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053179776:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129740.991244:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b00ea00/2, rc 0, transno 17179872942 00000100:00100000:1.0:1746129740.991246:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053180288:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129740.991252:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3299:x1830949053180416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (223us total) trans 17179872945 rc 0/0 00000100:00100000:3.0:1746129740.991256:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10089 00000004:00080000:3.0:1746129740.991281:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8793b80/2, rc 0, transno 21474840111 00000100:00100000:3.0:1746129740.991284:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8793b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053179392:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129740.991290:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b00d880/2, rc 0, transno 17179872944 00000100:00100000:3.0:1746129740.991292:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053179904:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129740.991297:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b00f100/2, rc 0, transno 17179872945 00000100:00100000:3.0:1746129740.991299:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053180416:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129740.991307:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129740.991316:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053179136:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129740.991328:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129740.991335:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053179648:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129740.991345:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129740.991351:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053180160:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129740.991359:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129740.991368:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053180672:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129740.991377:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129740.991388:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053178624 00000100:00100000:3.0:1746129740.991391:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053178624 00000100:00100000:3.0:1746129740.991400:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053179136 00000100:00100000:3.0:1746129740.991401:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053179136 00000100:00100000:3.0:1746129740.991407:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053179648 00000100:00100000:3.0:1746129740.991408:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053179648 00000100:00100000:3.0:1746129740.991415:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053180160 00000100:00100000:3.0:1746129740.991416:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053180160 00000100:00100000:3.0:1746129740.991422:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053180672 00000100:00100000:3.0:1746129740.991423:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053180672 00000100:00100000:3.0:1746129740.991431:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10090 00000100:00100000:3.0:1746129740.991434:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3297:x1830949053178624:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129740.991496:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129740.991498:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129741 -> 1746129741 00002000:00010000:3.0:1746129740.991500:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129741 -> 1746129741 00002000:00010000:3.0:1746129740.991501:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129741 -> 1746129741 00002000:00010000:3.0:1746129740.991503:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746129740.991521:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3297:x1830949053178624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (213us total) trans 21474840112 rc 0/0 00000100:00100000:3.0:1746129740.991525:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10090 00000100:00100000:3.0:1746129740.991534:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10091 00000100:00100000:3.0:1746129740.991537:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3297:x1830949053179136:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129740.991589:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129740.991591:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746129740.991592:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746129740.991605:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746129740.991606:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746129740.991622:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3297:x1830949053179136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (293us total) trans 21474840113 rc 0/0 00000100:00100000:3.0:1746129740.991627:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10091 00000100:00100000:3.0:1746129740.991635:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10092 00000100:00100000:3.0:1746129740.991638:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3297:x1830949053179648:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129740.991691:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746129740.991693:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129741 -> 1746129741 00002000:00010000:3.0:1746129740.991695:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129741 -> 1746129741 00002000:00010000:3.0:1746129740.991696:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129741 -> 1746129741 00002000:00010000:3.0:1746129740.991698:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 1975 -> 1975 00000100:00100000:3.0:1746129740.991712:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3297:x1830949053179648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (366us total) trans 17179872946 rc 0/0 00000100:00100000:3.0:1746129740.991716:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10092 00000100:00100000:3.0:1746129740.991724:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10093 00000100:00100000:3.0:1746129740.991727:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3297:x1830949053180160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129740.992068:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10094 00000100:00100000:1.0:1746129740.992074:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3297:x1830949053180672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129740.994230:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3297:x1830949053180672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2154us (2849us total) trans 17179872948 rc 0/0 00000100:00100000:1.0:1746129740.994238:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10094 00000100:00100000:1.0:1746129740.994255:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053179008 00000100:00100000:1.0:1746129740.994261:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053179008 00000100:00100000:1.0:1746129740.994279:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10095 00000100:00100000:1.0:1746129740.994285:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3296:x1830949053179008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129740.994418:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3296:x1830949053179008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 133us (211us total) trans 21474840114 rc 0/0 00000100:00100000:1.0:1746129740.994423:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10095 00000100:00100000:1.0:1746129740.994444:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10097 00000100:00100000:1.0:1746129740.994448:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3296:x1830949053180032:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129740.994521:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746129740.994523:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746129740.994525:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746129740.994527:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746129740.994528:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129740.994546:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3296:x1830949053180032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (238us total) trans 17179872949 rc 0/0 00000100:00100000:1.0:1746129740.994551:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10097 00000004:00080000:1.0:1746129740.994585:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8793480/2, rc 0, transno 21474840114 00000100:00100000:1.0:1746129740.994590:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053179008:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129740.994610:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8790a80/2, rc 0, transno 21474840115 00000100:00100000:1.0:1746129740.994613:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053179520:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129740.994620:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b00d180/2, rc 0, transno 17179872949 00000100:00100000:1.0:1746129740.994622:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053180032:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129740.994628:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b00fb80/2, rc 0, transno 17179872950 00000100:00100000:1.0:1746129740.994631:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053180544:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129740.995791:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3297:x1830949053180160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4057us (4424us total) trans 17179872947 rc 0/0 00000100:00100000:3.0:1746129740.995799:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10093 00000004:00080000:3.0:1746129740.995863:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b00e680/2, rc 0, transno 17179872948 00000100:00100000:3.0:1746129740.995868:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053180672:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129740.995880:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8792680/2, rc 0, transno 21474840112 00000100:00100000:3.0:1746129740.995883:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053178624:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129740.995891:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8792a00/2, rc 0, transno 21474840113 00000100:00100000:3.0:1746129740.995893:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053179136:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129740.995900:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b00c380/2, rc 0, transno 17179872946 00000100:00100000:3.0:1746129740.995903:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053179648:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129740.995910:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b00ce00/2, rc 0, transno 17179872947 00000100:00100000:3.0:1746129740.995912:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053180160:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746129740.996068:0:3283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947808 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15740 initiator: MDT0 00010000:00010000:3.0:1746129740.996076:0:3283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947808 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15740 initiator: MDT0 00010000:00010000:3.0:1746129740.996082:0:3283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947808 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15740 initiator: MDT0 00010000:00010000:3.0:1746129740.996086:0:3283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ffbd800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129740.996089:0:3283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947808 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15740 initiator: MDT0 00010000:00010000:3.0:1746129740.996094:0:3283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947808 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15740 initiator: MDT0 00010000:00010000:3.0:1746129740.996104:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129740.996106:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129740.996109:0:3283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947808 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15740 initiator: MDT0 00010000:00010000:3.0:1746129740.996113:0:3283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947808 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15740 initiator: MDT0 00000100:00100000:0.0:1746129740.999814:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:0.0:1746129741.005562:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129741.014289:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051898368 00000100:00100000:0.0:1746129741.014302:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051898368 00000100:00100000:0.0:1746129741.014339:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3771 00000100:00100000:0.0:1746129741.014345:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6141239f-0c60-480d-830c-e22ba61457b0+7:28272:x1830949051898368:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:0.0:1746129741.014572:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28272:x1830949051898368:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 226us (763us total) trans 8589943461 rc 0/0 00000100:00100000:0.0:1746129741.014578:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3771 00000100:00100000:0.0:1746129741.058555:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.058614:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.059962:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051898624 00000100:00100000:3.0:1746129741.059975:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051898624 00000100:00100000:3.0:1746129741.060027:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051898880 00000100:00100000:3.0:1746129741.060030:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051898880 00000100:00100000:3.0:1746129741.060048:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9696 00000100:00100000:3.0:1746129741.060055:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+281:28286:x1830949051898624:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129741.060077:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129741.060092:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbce00/0x48868a4e43947816 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e502 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.060293:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbc800/0x48868a4e43947832 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129741.060309:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbc800/0x48868a4e43947832 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129741.060315:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbc800/0x48868a4e43947832 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129741.060321:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbda00/0x48868a4e43947839 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129741.060325:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbda00/0x48868a4e43947839 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129741.060330:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbda00/0x48868a4e43947839 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129741.060367:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947840 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129741.060373:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947840 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129741.060378:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947840 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129741.060385:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000100:00080000:0.0:1746129741.060401:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746129741.060451:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbc800/0x48868a4e43947832 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129741.060457:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbc800/0x48868a4e43947832 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129741.060462:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbc800/0x48868a4e43947832 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129741.060467:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ffbc800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129741.060470:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbc800/0x48868a4e43947832 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129741.060475:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbc800/0x48868a4e43947832 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129741.060484:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129741.060487:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129741.060491:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbc800/0x48868a4e43947832 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129741.060495:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbc800/0x48868a4e43947832 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129741.060518:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbda00/0x48868a4e43947839 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129741.060523:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbda00/0x48868a4e43947839 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129741.060531:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbda00/0x48868a4e43947839 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129741.060534:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ffbda00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129741.060536:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbda00/0x48868a4e43947839 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129741.060540:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbda00/0x48868a4e43947839 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129741.060545:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009cae5400) 00010000:00010000:3.0:1746129741.060547:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129741.060549:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbda00/0x48868a4e43947839 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129741.060553:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbda00/0x48868a4e43947839 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129741.060580:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbce00/0x48868a4e43947816 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e502 expref: 284 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.060588:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947840 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e502 expref: 283 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.060603:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129741.060604:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129741.060607:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffbd800, rc 0) 00000100:00100000:3.0:1746129741.060789:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28286:x1830949051898624:12345-192.168.204.31@tcp:101:cat.0 Request processed in 734us (2240us total) trans 8589943462 rc 0/0 00000100:00100000:3.0:1746129741.060794:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9696 00000100:00100000:1.0:1746129741.068095:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.069240:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051899008 00000100:00100000:3.0:1746129741.069247:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051899008 00000100:00100000:3.0:1746129741.069287:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10099 00000100:00100000:3.0:1746129741.069294:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:28286:x1830949051899008:12345-192.168.204.31@tcp:101:cat.0 00000100:00080000:0.0:1746129741.069396:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129741.071797:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129741.073195:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129741.073209:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ffbc200/0x48868a4e4394786a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e510 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.073225:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129741.073227:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129741.073233:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffbc200/0x48868a4e4394786a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e510 expref: 24 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.073244:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ffbc200/0x48868a4e4394786a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e510 expref: 24 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.073252:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffbc200, rc 0) 00000100:00100000:3.0:1746129741.073284:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:28286:x1830949051899008:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3990us (5196us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129741.073290:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10099 00000100:00080000:0.0:1746129741.074702:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129741.086106:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.087156:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.087227:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.087249:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051899776 00000100:00100000:0.0:1746129741.087253:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051899776 00000100:00100000:1.0:1746129741.087345:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051899520 00000100:00100000:1.0:1746129741.087349:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051899520 00010000:00010000:1.0:1746129741.087367:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43947847 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e509 expref: 9 pid: 15044 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746129741.087383:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051899648 00000100:00100000:1.0:1746129741.087385:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051899648 00010000:00010000:1.0:1746129741.087392:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947840 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e502 expref: 286 pid: 1851 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746129741.087405:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4863 00000100:00100000:1.0:1746129741.087411:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949051899520:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129741.087421:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129741.087426:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43947847 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e509 expref: 9 pid: 15044 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129741.087435:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43947847 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e509 expref: 9 pid: 15044 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129741.087452:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43947847 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e509 expref: 9 pid: 15044 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129741.087482:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129741.087486:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43947863 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.087493:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43947863 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.087501:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129741.087532:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1962:x1830949051899520:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 120us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129741.087537:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4863 00000100:00100000:1.0:1746129741.087566:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4864 00000100:00100000:1.0:1746129741.087571:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1ae8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:1962:x1830949051899648:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129741.087577:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129741.087581:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947840 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e502 expref: 286 pid: 1851 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129741.087589:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947840 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e502 expref: 286 pid: 1851 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129741.087613:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947840 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e502 expref: 286 pid: 1851 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129741.087621:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129741.087624:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43947863 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.087631:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43947863 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.087637:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43947863 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.087650:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129741.087665:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1ae8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:1962:x1830949051899648:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 93us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129741.087670:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4864 00000100:00100000:1.0:1746129741.088947:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9699 00000100:00100000:1.0:1746129741.088956:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28286:x1830949051899776:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129741.088969:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129741.088979:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f5c600/0x48868a4e4394787f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e525 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.089018:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f5c600/0x48868a4e4394787f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e525 expref: 286 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.089027:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f5c600/0x48868a4e4394787f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e525 expref: 286 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.089040:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129741.089042:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129741.089044:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f5c600, rc 0) 00000100:00100000:0.0:1746129741.089508:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.092145:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28286:x1830949051899776:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3183us (4911us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129741.092154:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9699 00000100:00100000:1.0:1746129741.115025:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051900288 00000100:00100000:1.0:1746129741.115033:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051900288 00000100:00100000:1.0:1746129741.115070:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9700 00000100:00100000:1.0:1746129741.115077:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28282:x1830949051900288:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129741.115095:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129741.115110:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28a00/0x48868a4e43947886 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e52c expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.115160:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28a00/0x48868a4e43947886 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e52c expref: 286 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.115170:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28a00/0x48868a4e43947886 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e52c expref: 286 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.115184:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129741.115186:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129741.115189:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe28a00, rc 0) 00000100:00100000:1.0:1746129741.115225:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:28282:x1830949051900288:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 148us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129741.115230:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9700 00000100:00100000:0.0:1746129741.115574:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.115644:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949051900032:12345-192.168.204.31@tcp:3:cat.0 Request processed in 25493us (26135us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129741.115652:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3698 00002000:00100000:1.0:1746129741.115659:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009ba86300 x1830949051900032/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:482/0 lens 488/440 e 0 to 0 dl 1746129752 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129741.115666:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba86300 with x1830949051900032 ext(0->1048575) 00002000:00010000:1.0:1746129741.115669:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba86300 00000100:00100000:1.0:1746129741.115681:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051900416 00000100:00100000:1.0:1746129741.115683:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051900416 00002000:00100000:1.0:1746129741.115699:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009ba87100 x1830949051900416/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/0 e 0 to 0 dl 1746129752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129741.115705:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba87100 with x1830949051900416 ext(0->1048575) 00002000:00010000:1.0:1746129741.115707:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba87100 00000100:00100000:1.0:1746129741.115718:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3699 00000100:00100000:1.0:1746129741.115722:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949051900416:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129741.123409:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.123457:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.123653:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051900544 00000100:00100000:1.0:1746129741.123658:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051900544 00000100:00100000:1.0:1746129741.123684:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 551 00000100:00100000:1.0:1746129741.123689:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:1962:x1830949051900544:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129741.123699:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129741.123710:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28a00/0x48868a4e43947886 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e52c expref: 286 pid: 16808 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129741.128779:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.129165:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949051900416:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 13439us (13589us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129741.129176:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3699 00002000:00100000:3.0:1746129741.129186:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009ba87100 x1830949051900416/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/440 e 0 to 0 dl 1746129752 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.129195:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba87100 with x1830949051900416 ext(0->1048575) 00002000:00010000:3.0:1746129741.129200:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba87100 00000100:00100000:3.0:1746129741.129243:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051900928 00000100:00100000:3.0:1746129741.129249:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051900928 00000100:00100000:3.0:1746129741.129284:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10101 00000100:00100000:3.0:1746129741.129291:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:28285:x1830949051900928:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129741.129302:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129741.129315:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ffbd000/0x48868a4e4394789b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e53a expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.129333:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129741.129335:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129741.129341:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffbd000/0x48868a4e4394789b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e53a expref: 8 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.129354:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ffbd000/0x48868a4e4394789b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e53a expref: 8 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.129362:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffbd000, rc 0) 00000100:00100000:3.0:1746129741.129380:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28285:x1830949051900928:12345-192.168.204.31@tcp:101:cat.0 Request processed in 90us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129741.129385:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10101 00000100:00080000:3.0:1746129741.129409:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1746129741.129468:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129741.129473:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e43947894 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129741.129481:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e43947894 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129741.129485:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129741.129505:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:1962:x1830949051900544:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5816us (6103us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129741.129511:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 551 00000100:00100000:0.0:1746129741.133083:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053181056:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129741.133107:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e43947894 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000100:00100000:0.0:1746129741.135064:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.135169:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051901056 00000100:00100000:1.0:1746129741.135176:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051901056 00010000:00010000:1.0:1746129741.135201:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed200/0x48868a4e4394780f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4fb expref: 8 pid: 15044 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746129741.135231:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4865 00000100:00100000:1.0:1746129741.135238:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949051901056:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129741.135249:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129741.135254:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed200/0x48868a4e4394780f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4fb expref: 8 pid: 15044 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129741.135264:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed200/0x48868a4e4394780f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4fb expref: 8 pid: 15044 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129741.135281:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed200/0x48868a4e4394780f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4fb expref: 8 pid: 15044 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129741.135293:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129741.135297:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e43947894 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129741.135313:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e43947894 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129741.135318:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e43947894 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129741.135343:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129741.135380:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+7:1961:x1830949051901056:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 142us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129741.135386:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4865 00000100:00100000:0.0:1746129741.139672:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.139810:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051901184 00000100:00100000:1.0:1746129741.139817:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051901184 00000100:00100000:1.0:1746129741.139871:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9702 00000100:00100000:1.0:1746129741.139879:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28285:x1830949051901184:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129741.139896:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129741.139910:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28e00/0x48868a4e439478a2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e541 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129741.141434:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129741.141711:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e43947894 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129741.141720:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28e00/0x48868a4e439478a2 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e541 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.141734:0:16808:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e43947894 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129741.141743:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28e00/0x48868a4e439478a2 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e541 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.141753:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129741.141756:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129741.141758:0:16808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28e00/0x48868a4e439478a2 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e541 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.141764:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe28e00, rc 0) 00000100:00100000:1.0:1746129741.141798:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28285:x1830949051901184:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1921us (2131us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129741.141804:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9702 00000100:00100000:0.0:1746129741.145342:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.145727:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051901440 00000100:00100000:1.0:1746129741.145734:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051901440 00000100:00100000:1.0:1746129741.145767:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9703 00000100:00100000:1.0:1746129741.145774:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:28286:x1830949051901440:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129741.145791:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129741.145808:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28a00/0x48868a4e439478b0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e54f expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.146405:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28a00/0x48868a4e439478b0 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e54f expref: 288 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.146417:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28a00/0x48868a4e439478b0 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e54f expref: 288 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.146427:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129741.146430:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129741.146433:0:16808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28e00/0x48868a4e439478a2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e541 expref: 8 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.146439:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe28a00, rc 0) 00000100:00100000:1.0:1746129741.146477:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:28286:x1830949051901440:12345-192.168.204.31@tcp:101:cat.0 Request processed in 704us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129741.146483:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9703 00000100:00100000:0.0:1746129741.152877:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.153560:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051901568 00000100:00100000:1.0:1746129741.153568:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051901568 00000100:00100000:1.0:1746129741.153610:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9704 00000100:00100000:1.0:1746129741.153616:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+7:28287:x1830949051901568:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129741.153633:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129741.153646:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28800/0x48868a4e439478b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e556 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.153688:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29000/0x48868a4e439478be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.153702:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29000/0x48868a4e439478be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.153709:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29000/0x48868a4e439478be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.153718:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29e00/0x48868a4e439478c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.153722:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29e00/0x48868a4e439478c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.153727:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29e00/0x48868a4e439478c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.153788:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439478cc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.153794:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43947863 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e517 expref: 287 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.153800:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439478cc lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x40 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.153821:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43947863 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e517 expref: 287 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.153830:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43947863 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e517 expref: 287 pid: 1851 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746129741.153839:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c042a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053181184:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129741.154963:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129741.158048:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c042a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053181184:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129741.158069:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439478cc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x40 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:1.0:1746129741.160611:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.160636:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051901696 00000100:00100000:1.0:1746129741.160641:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051901696 00010000:00010000:1.0:1746129741.160669:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43947863 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e517 expref: 288 pid: 1851 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746129741.160693:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4866 00000100:00100000:1.0:1746129741.160699:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:1961:x1830949051901696:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129741.160711:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129741.160715:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43947863 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e517 expref: 288 pid: 1851 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129741.160724:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43947863 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e517 expref: 288 pid: 1851 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129741.160740:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43947863 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e517 expref: 288 pid: 1851 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129741.160751:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129741.160755:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439478cc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x40 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.160761:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439478cc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x40 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.160767:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28e00/0x48868a4e439478a2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e541 expref: 8 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.160772:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439478cc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x40 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.160777:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129741.160806:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:1961:x1830949051901696:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 108us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129741.160812:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4866 00000001:00080000:1.0:1746129741.197601:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943461 is committed 00000001:00080000:1.0:1746129741.197623:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943465 is committed 00000004:00080000:1.0:1746129741.197627:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1814 committed 00000004:00080000:1.0:1746129741.197632:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1860 committed 00000004:00080000:1.0:1746129741.197637:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1859 committed 00000004:00080000:1.0:1746129741.197638:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1858 committed 00000004:00080000:1.0:1746129741.197639:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1857 committed 00000004:00080000:1.0:1746129741.197641:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1813 committed 00000004:00080000:1.0:1746129741.197642:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1856 committed 00000004:00080000:1.0:1746129741.197644:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1812 committed 00000004:00080000:1.0:1746129741.197645:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1855 committed 00000004:00080000:1.0:1746129741.197646:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1811 committed 00000004:00080000:1.0:1746129741.197647:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1810 committed 00000004:00080000:1.0:1746129741.197649:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1809 committed 00000004:00080000:1.0:1746129741.197650:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1854 committed 00000004:00080000:1.0:1746129741.197651:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1853 committed 00000004:00080000:1.0:1746129741.197653:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1808 committed 00000004:00080000:1.0:1746129741.197654:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1807 committed 00000004:00080000:1.0:1746129741.197655:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1852 committed 00000001:00080000:1.0:1746129741.197661:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943463 is committed 00000100:00100000:1.0:1746129741.197903:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053181312:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129741.197955:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129741.197993:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053181568:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129741.198009:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129741.198028:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053181312 00000100:00100000:1.0:1746129741.198034:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053181312 00000100:00100000:1.0:1746129741.198067:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053181568 00000100:00100000:1.0:1746129741.198069:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053181568 00000100:00100000:1.0:1746129741.198080:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10103 00000100:00100000:1.0:1746129741.198085:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3298:x1830949053181312:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129741.198225:0:3623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129741.198228:0:3623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129741 -> 1746129741 00002000:00010000:1.0:1746129741.198230:0:3623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129741 -> 1746129741 00002000:00010000:1.0:1746129741.198231:0:3623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129741 -> 1746129741 00002000:00010000:1.0:1746129741.198233:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129741.198256:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3298:x1830949053181312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 171us (300us total) trans 21474840116 rc 0/0 00000100:00100000:1.0:1746129741.198261:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10103 00000100:00100000:1.0:1746129741.198272:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10104 00000100:00100000:1.0:1746129741.198276:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3296:x1830949053181568:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129741.198340:0:3623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746129741.198342:0:3623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129741 -> 1746129741 00002000:00010000:1.0:1746129741.198344:0:3623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129741 -> 1746129741 00002000:00010000:1.0:1746129741.198345:0:3623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129741 -> 1746129741 00002000:00010000:1.0:1746129741.198347:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746129741.198363:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3296:x1830949053181568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (354us total) trans 21474840117 rc 0/0 00000100:00100000:1.0:1746129741.198370:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10104 00000100:00080000:1.0:1746129741.198380:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1746129741.198427:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e43947894 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e533 expref: 284 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.198437:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129741.198439:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746129741.198442:0:15044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439478cc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x40 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.198449:0:15044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439478cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.198454:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439478cc lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.198459:0:15044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28e00/0x48868a4e439478a2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e541 expref: 7 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.198464:0:15044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28e00/0x48868a4e439478a2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e541 expref: 7 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.198469:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28e00/0x48868a4e439478a2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e541 expref: 7 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.198474:0:15044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28a00/0x48868a4e439478b0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e54f expref: 284 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.198479:0:15044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28a00/0x48868a4e439478b0 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e54f expref: 284 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.198487:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28a00/0x48868a4e439478b0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e54f expref: 284 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.198505:0:15044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28a00/0x48868a4e439478b0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e54f expref: 284 pid: 16808 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129741.198513:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053182336:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129741.198726:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053181440:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129741.198748:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129741.198762:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053181696:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129741.198773:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129741.198785:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053181440 00000100:00100000:3.0:1746129741.198788:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053181440 00000100:00100000:3.0:1746129741.198801:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053181696 00000100:00100000:3.0:1746129741.198802:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053181696 00000100:00100000:3.0:1746129741.198811:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10105 00000100:00100000:3.0:1746129741.198815:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3299:x1830949053181440:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129741.198914:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129741.198917:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129741 -> 1746129741 00002000:00010000:3.0:1746129741.198918:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129741 -> 1746129741 00002000:00010000:3.0:1746129741.198920:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129741 -> 1746129741 00002000:00010000:3.0:1746129741.198922:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746129741.198942:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3299:x1830949053181440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 127us (194us total) trans 21474840118 rc 0/0 00000100:00100000:3.0:1746129741.198950:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10105 00000100:00100000:3.0:1746129741.198961:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10106 00000100:00100000:3.0:1746129741.198964:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3297:x1830949053181696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129741.199026:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3297:x1830949053181696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (252us total) trans 21474840119 rc 0/0 00000100:00100000:3.0:1746129741.199030:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10106 00000004:00080000:1.0:1746129741.201751:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009423ed80/2, rc 0, transno 21474840117 00000100:00100000:1.0:1746129741.201761:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053181568:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129741.201770:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053182080:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129741.201809:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129741.201836:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053182720:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129741.201872:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129741.201885:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053183232:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129741.201898:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129741.201909:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746129741.201914:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053182848:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129741.201941:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129741.201952:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053183360:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129741.201965:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129741.201986:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053182080 00000100:00100000:1.0:1746129741.201991:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053182080 00000100:00100000:1.0:1746129741.202014:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053182720 00000100:00100000:1.0:1746129741.202015:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053182720 00000100:00100000:1.0:1746129741.202029:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053183232 00000100:00100000:1.0:1746129741.202031:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053183232 00000100:00100000:1.0:1746129741.202038:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053182848 00000100:00100000:1.0:1746129741.202040:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053182848 00000100:00100000:1.0:1746129741.202046:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053183360 00000100:00100000:1.0:1746129741.202047:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053183360 00000100:00100000:1.0:1746129741.202056:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10107 00000100:00100000:1.0:1746129741.202062:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3296:x1830949053182080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129741.202225:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+34:3296:x1830949053182080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 162us (415us total) trans 21474840120 rc 0/0 00000100:00100000:1.0:1746129741.202230:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10107 00000100:00100000:1.0:1746129741.202243:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10108 00000100:00100000:1.0:1746129741.202247:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3296:x1830949053182720:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129741.202353:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:1.0:1746129741.202356:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129741 -> 1746129741 00002000:00010000:1.0:1746129741.202358:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129741 -> 1746129741 00002000:00010000:1.0:1746129741.202360:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129741 -> 1746129741 00002000:00010000:1.0:1746129741.202362:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5671 -> 5671 00000100:00100000:1.0:1746129741.202382:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3296:x1830949053182720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 135us (510us total) trans 17179872951 rc 0/0 00000100:00100000:1.0:1746129741.202387:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10108 00000100:00100000:1.0:1746129741.202397:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10109 00000100:00100000:1.0:1746129741.202401:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3296:x1830949053183232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129741.202472:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3296:x1830949053183232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (573us total) trans 17179872952 rc 0/0 00000100:00100000:1.0:1746129741.202477:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10109 00000100:00100000:1.0:1746129741.202486:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10110 00000100:00100000:1.0:1746129741.202491:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3296:x1830949053182848:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129741.202552:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746129741.202555:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746129741.202556:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746129741.202558:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746129741.202560:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129741.202577:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3296:x1830949053182848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (635us total) trans 17179872953 rc 0/0 00000100:00100000:1.0:1746129741.202582:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10110 00000100:00100000:1.0:1746129741.202603:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10111 00000100:00100000:1.0:1746129741.202608:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3296:x1830949053183360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129741.202683:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3296:x1830949053183360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (716us total) trans 17179872954 rc 0/0 00000100:00100000:1.0:1746129741.202688:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10111 00000100:00080000:1.0:1746129741.202705:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1746129741.202719:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136886680/2, rc 0, transno 17179872953 00000100:00100000:1.0:1746129741.202727:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053182848:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129741.202735:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136885c00/2, rc 0, transno 17179872954 00000100:00100000:1.0:1746129741.202738:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053183360:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129741.202744:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136886a00/2, rc 0, transno 17179872951 00000100:00100000:1.0:1746129741.202746:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053182720:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129741.202752:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136884000/2, rc 0, transno 17179872952 00000100:00100000:1.0:1746129741.202754:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053183232:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129741.202760:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009423c380/2, rc 0, transno 21474840120 00000100:00100000:1.0:1746129741.202763:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053182080:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129741.203108:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c040000/2, rc 0, transno 21474840116 00000100:00100000:0.0:1746129741.203112:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053181312:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129741.203118:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053181824:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129741.203141:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129741.203158:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053181824 00000100:00100000:0.0:1746129741.203161:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053181824 00000100:00100000:0.0:1746129741.203177:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10112 00000100:00100000:0.0:1746129741.203181:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+34:3298:x1830949053181824:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129741.203260:0:20441:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129741.203262:0:20441:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129741.203264:0:20441:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129741.203265:0:20441:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129741.203267:0:20441:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129741.203289:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:3298:x1830949053181824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (147us total) trans 21474840121 rc 0/0 00000100:00100000:0.0:1746129741.203293:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10112 00010000:00010000:1.0:1746129741.204421:0:15044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28e00/0x48868a4e439478a2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e541 expref: 7 pid: 16808 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129741.204433:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053183616:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129741.205491:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584240 going to sleep for 11 seconds 00010000:00010000:1.0:1746129741.205506:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439478cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.205512:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439478cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:1.0:1746129741.205546:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:1.0:1746129741.205550:0:1851:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746129741.205564:0:1851:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439478cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.205574:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439478cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.205582:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29000/0x48868a4e439478be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.205587:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29000/0x48868a4e439478be lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.205601:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29000/0x48868a4e439478be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.205606:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fe29000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129741.205610:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29000/0x48868a4e439478be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.205615:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29000/0x48868a4e439478be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.205627:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129741.205630:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129741.205634:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29000/0x48868a4e439478be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.205638:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29000/0x48868a4e439478be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.205652:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29e00/0x48868a4e439478c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.205657:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29e00/0x48868a4e439478c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.205661:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29e00/0x48868a4e439478c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.205664:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fe29e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129741.205666:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29e00/0x48868a4e439478c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.205670:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29e00/0x48868a4e439478c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.205675:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009c253d00) 00010000:00010000:1.0:1746129741.205677:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129741.205679:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29e00/0x48868a4e439478c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.205682:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29e00/0x48868a4e439478c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129741.205711:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28800/0x48868a4e439478b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e556 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.205721:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439478cc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e556 expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.205727:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129741.205729:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746129741.205731:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe29600, rc 0) 00000100:00100000:1.0:1746129741.205759:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+7:28287:x1830949051901568:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 52141us (52887us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129741.205765:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9704 00000004:00080000:3.0:1746129741.206739:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009423f480/2, rc 0, transno 21474840119 00000100:00100000:3.0:1746129741.206746:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053181696:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129741.206752:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053182208:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129741.206781:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129741.208297:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.208325:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053182336:192.168.204.31@tcp:105: 00000004:00080000:3.0:1746129741.208631:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009423d880/2, rc 0, transno 21474840123 00000100:00100000:3.0:1746129741.208635:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053182208:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129741.208837:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009423d180/2, rc 0, transno 21474840121 00000100:00100000:0.0:1746129741.208841:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053181824:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129741.212523:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.212711:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051901952 00000100:00100000:0.0:1746129741.213039:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051901952 00000100:00100000:0.0:1746129741.213068:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9705 00000100:00100000:0.0:1746129741.213075:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+7:28287:x1830949051901952:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129741.213085:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129741.213100:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28600/0x48868a4e439478d3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e55d expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129741.213137:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28600/0x48868a4e439478d3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e55d expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129741.213148:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28600/0x48868a4e439478d3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e55d expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129741.213162:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129741.213165:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129741.213167:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe28600, rc 0) 00000100:00100000:0.0:1746129741.213186:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:28287:x1830949051901952:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 113us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129741.213191:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9705 00000100:00100000:1.0:1746129741.213525:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.213564:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.213579:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051902208 00000100:00100000:1.0:1746129741.213582:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051902208 00000100:00100000:1.0:1746129741.213610:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9706 00000100:00100000:1.0:1746129741.213615:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28280:x1830949051902208:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129741.213622:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129741.213630:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136365400/0x48868a4e439478da lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e564 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.213649:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136365400/0x48868a4e439478da lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e564 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.213656:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136365400/0x48868a4e439478da lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e564 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.213665:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129741.213667:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129741.213669:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136365400, rc 0) 00000100:00100000:1.0:1746129741.213689:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28280:x1830949051902208:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 73us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129741.213693:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9706 00000100:00100000:0.0:1746129741.214952:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053183616:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129741.214980:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a540e400/0x48868a4e4394788d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e533 expref: 284 pid: 15044 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746129741.214993:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e43947894 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e533 expref: 283 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129741.215011:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5244600, rc 0) 00000100:00100000:0.0:1746129741.215031:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28282:x1830949051900800:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 91456us (91573us total) trans 8589943465 rc 0/0 00000100:00100000:0.0:1746129741.215036:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9701 00000100:00100000:0.0:1746129741.219730:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.220414:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051902720 00000100:00100000:3.0:1746129741.220423:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051902720 00000100:00100000:3.0:1746129741.220466:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9707 00000100:00100000:3.0:1746129741.220472:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28287:x1830949051902720:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129741.220489:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129741.220502:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009411a000/0x48868a4e439478e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e56b expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.220571:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009411b000/0x48868a4e439478e8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129741.220583:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439478cc lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e556 expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.220599:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009411b000/0x48868a4e439478e8 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129741.220622:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439478cc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e556 expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.220633:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439478cc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e556 expref: 9 pid: 1851 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746129741.220643:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053183744:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129741.221209:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129741.221372:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.221639:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.221840:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051902464 00000100:00100000:1.0:1746129741.221844:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051902464 00000100:00100000:1.0:1746129741.221880:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 552 00000100:00100000:1.0:1746129741.221885:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136887b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949051902464:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129741.221892:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129741.221906:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136365400/0x48868a4e439478da lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e564 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.221919:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129741.221923:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009411b000/0x48868a4e439478e8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.221929:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009411b000/0x48868a4e439478e8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.221933:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129741.221949:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136887b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1962:x1830949051902464:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 65us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129741.221954:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 552 00000100:00100000:0.0:1746129741.224924:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.227532:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.227576:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051902976 00000100:00100000:1.0:1746129741.227583:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051902976 00000100:00100000:1.0:1746129741.227637:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10121 00000100:00100000:1.0:1746129741.227644:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28280:x1830949051902976:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129741.227658:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129741.227671:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a51c5800/0x48868a4e439478f6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e579 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.227692:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb20a00/0x48868a4e4394779f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4d8 expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129741.227699:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e439478a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e548 expref: 18 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.227705:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ffbd000/0x48868a4e4394789b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e53a expref: 9 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.227710:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129741.227711:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129741.227714:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a51c5800/0x48868a4e439478f6 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1847296->2097151] (req 1847296->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e579 expref: 9 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129741.227719:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053183744:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129741.227734:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009411b000/0x48868a4e439478e8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.227734:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ffbd000/0x48868a4e4394789b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e53a expref: 9 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.227743:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ffbd000/0x48868a4e4394789b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e53a expref: 9 pid: 3623 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746129741.227752:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5492a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053184000:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129741.227824:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e439478a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e548 expref: 18 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.227832:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e439478a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e548 expref: 18 pid: 3623 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746129741.227839:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053184128:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129741.227887:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb20a00/0x48868a4e4394779f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4d8 expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129741.227894:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb20a00/0x48868a4e4394779f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4d8 expref: 11 pid: 20441 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746129741.227901:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053184256:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129741.227916:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129741.228252:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.228315:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051903104 00000100:00100000:1.0:1746129741.228319:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051903104 00010000:00010000:1.0:1746129741.228334:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439478cc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e556 expref: 10 pid: 1851 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746129741.228350:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4867 00000100:00100000:1.0:1746129741.228355:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136887480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+10:1963:x1830949051903104:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129741.228362:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129741.228367:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439478cc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e556 expref: 10 pid: 1851 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129741.228378:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439478cc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e556 expref: 10 pid: 1851 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129741.228393:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439478cc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e556 expref: 10 pid: 1851 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129741.228404:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129741.228408:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009411b000/0x48868a4e439478e8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.228415:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009411b000/0x48868a4e439478e8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.228420:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009411b000/0x48868a4e439478e8 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.228443:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129741.228473:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136887480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:1963:x1830949051903104:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 117us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129741.228479:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4867 00010000:00010000:3.0:1746129741.228544:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009411b000/0x48868a4e439478e8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129741.228553:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009411b000/0x48868a4e439478e8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129741.228568:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129741.228739:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009411a000/0x48868a4e439478e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e56b expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.228756:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009411b000/0x48868a4e439478e8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e56b expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.228762:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129741.228764:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746129741.228766:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009411b000, rc 0) 00000100:00100000:3.0:1746129741.228788:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:28287:x1830949051902720:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 8316us (9067us total) trans 8589943466 rc 0/0 00000100:00100000:3.0:1746129741.228793:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9707 00000100:00100000:3.0:1746129741.231969:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051903488 00000100:00100000:3.0:1746129741.231972:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051903488 00002000:00100000:3.0:1746129741.231999:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009468df80 x1830949051903488/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:482/0 lens 488/0 e 0 to 0 dl 1746129752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.232007:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468df80 with x1830949051903488 ext(1048576->2097151) 00010000:00010000:3.0:1746129741.232013:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ffbd000/0x48868a4e4394789b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e53a expref: 10 pid: 3623 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.232022:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ffbd000/0x48868a4e4394789b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e53a expref: 10 pid: 3623 timeout: 787 lvb_type: 0 00002000:00010000:3.0:1746129741.232031:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009468df80 00000100:00100000:3.0:1746129741.232043:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 497 00000100:00100000:3.0:1746129741.232047:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949051903488:12345-192.168.204.31@tcp:3:multiop.0 00000100:00080000:0.0:1746129741.232283:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129741.233236:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5492a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053184000:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129741.233247:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053184128:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129741.233253:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053184256:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129741.233275:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a51c5800/0x48868a4e439478f6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1847296->2097151] (req 1847296->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e579 expref: 10 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.233287:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a51c5800, rc 0) 00000100:00100000:1.0:1746129741.233326:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28280:x1830949051902976:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5681us (5798us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129741.233333:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10121 00010000:00010000:0.0:1746129741.233544:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135849400/0x48868a4e439477c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4ed expref: 12 pid: 7976 timeout: 787 lvb_type: 1 00000100:00100000:0.0:1746129741.233557:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053183872:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129741.233570:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135cab000/0x48868a4e439478ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2293760->2334719) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e572 expref: 25 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129741.233576:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135cab000, rc 0) 00000100:00100000:0.0:1746129741.233601:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:28282:x1830949051902848:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 8227us (8673us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129741.233606:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10120 00000100:00100000:0.0:1746129741.236309:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.236372:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051903616 00000100:00100000:1.0:1746129741.236379:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051903616 00010000:00010000:1.0:1746129741.236414:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb20a00/0x48868a4e4394779f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4d8 expref: 12 pid: 20441 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746129741.236450:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4869 00000100:00100000:1.0:1746129741.236457:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1ae8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949051903616:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129741.236468:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129741.236486:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb20a00/0x48868a4e4394779f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4d8 expref: 12 pid: 20441 timeout: 787 lvb_type: 1 00010000:00010000:1.0:1746129741.236496:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb20a00/0x48868a4e4394779f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4d8 expref: 12 pid: 20441 timeout: 787 lvb_type: 1 00010000:00010000:1.0:1746129741.236515:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb20a00/0x48868a4e4394779f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4d8 expref: 12 pid: 20441 timeout: 787 lvb_type: 1 00010000:00010000:1.0:1746129741.236527:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129741.236572:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1ae8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949051903616:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 116us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129741.236578:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4869 00000100:00080000:0.0:1746129741.238070:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129741.238910:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.238947:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.238959:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051903872 00000100:00100000:3.0:1746129741.238965:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051903872 00000100:00100000:0.0:1746129741.239005:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.239006:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9708 00000100:00100000:3.0:1746129741.239013:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:28287:x1830949051903872:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129741.239036:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129741.239039:0:14315:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746129741.239059:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009411b000/0x48868a4e439478e8 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e56b expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.239075:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129741.239078:0:14315:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129741.239087:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbde00/0x48868a4e43947904 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e580 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.239156:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009411a000/0x48868a4e4394790b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129741.239165:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009411a000/0x48868a4e4394790b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129741.239172:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009411a000/0x48868a4e4394790b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129741.239181:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009411a000/0x48868a4e4394790b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129741.239186:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009411a000/0x48868a4e4394790b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129741.239191:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009411a000/0x48868a4e4394790b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129741.239195:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009411a000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129741.239198:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009411a000/0x48868a4e4394790b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129741.239203:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009411a000/0x48868a4e4394790b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129741.239208:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129741.239210:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129741.239212:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009411a000/0x48868a4e4394790b lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129741.239216:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009411a000/0x48868a4e4394790b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129741.239234:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbde00/0x48868a4e43947904 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e580 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.239239:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbde00/0x48868a4e43947904 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e580 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.239244:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffbde00, rc 0) 00000100:00100000:3.0:1746129741.239274:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28287:x1830949051903872:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 261us (367us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129741.239278:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9708 00000100:00100000:3.0:1746129741.239301:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3700 00000100:00100000:3.0:1746129741.239306:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949051904384:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129741.239400:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949051904384:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 94us (394us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129741.239405:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3700 00002000:00100000:3.0:1746129741.239410:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2293760->2297855) req@ffff880094d8d180 x1830949051904384/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/4536 e 0 to 0 dl 1746129752 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.239416:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8d180 with x1830949051904384 ext(2293760->2297855) 00002000:00010000:3.0:1746129741.239419:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8d180 00000100:00100000:3.0:1746129741.241114:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053184384:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129741.241129:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129741.242599:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949051903360:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 10918us (11058us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129741.242609:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4868 00000100:00100000:3.0:1746129741.242808:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1964:x1830949051903488:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 10760us (11242us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129741.242815:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 497 00002000:00100000:3.0:1746129741.242823:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009468df80 x1830949051903488/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:482/0 lens 488/440 e 0 to 0 dl 1746129752 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.242830:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468df80 with x1830949051903488 ext(1048576->2097151) 00010000:00010000:3.0:1746129741.242838:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ffbd000/0x48868a4e4394789b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e53a expref: 9 pid: 3623 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.242864:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ffbd000/0x48868a4e4394789b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e53a expref: 9 pid: 3623 timeout: 787 lvb_type: 0 00002000:00010000:3.0:1746129741.242871:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009468df80 00000100:00100000:0.0:1746129741.246270:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.246315:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.246395:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051904640 00000100:00100000:3.0:1746129741.246403:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051904640 00000100:00100000:3.0:1746129741.246441:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3775 00000100:00100000:3.0:1746129741.246448:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba7d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+8:28287:x1830949051904640:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:3.0:1746129741.247898:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba7d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:28287:x1830949051904640:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 1446us (1631us total) trans 8589943467 rc 0/0 00000100:00100000:3.0:1746129741.247906:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3775 00000100:00100000:3.0:1746129741.259432:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051905152 00000100:00100000:3.0:1746129741.259441:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051905152 00000100:00100000:0.0:1746129741.259631:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051905280 00000100:00100000:0.0:1746129741.259635:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051905280 00000100:00100000:0.0:1746129741.259665:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10122 00000100:00100000:0.0:1746129741.259678:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28285:x1830949051905280:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129741.259693:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129741.259709:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fe29600/0x48868a4e43947912 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e587 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129741.259730:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129741.259731:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129741.259737:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe29600/0x48868a4e43947912 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e587 expref: 10 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129741.259750:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fe29600/0x48868a4e43947912 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e587 expref: 10 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129741.259757:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe29600, rc 0) 00000100:00100000:0.0:1746129741.259795:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28285:x1830949051905280:12345-192.168.204.31@tcp:101:cat.0 Request processed in 124us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129741.259906:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3776 00000100:00100000:3.0:1746129741.259913:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28282:x1830949051905152:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129741.260054:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28282:x1830949051905152:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 142us (2810us total) trans 8589943468 rc 0/0 00000100:00100000:3.0:1746129741.260060:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3776 00000100:00100000:1.0:1746129741.260392:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.260448:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.260737:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10122 00000100:00100000:3.0:1746129741.260914:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051905536 00000100:00100000:3.0:1746129741.260917:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051905536 00010000:00010000:3.0:1746129741.260932:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffbd000/0x48868a4e4394789b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e53a expref: 10 pid: 3623 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746129741.260958:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4870 00000100:00100000:3.0:1746129741.260963:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949051905536:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129741.260971:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129741.260985:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ffbd000/0x48868a4e4394789b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e53a expref: 10 pid: 3623 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.260993:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ffbd000/0x48868a4e4394789b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e53a expref: 10 pid: 3623 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.261005:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ffbd000/0x48868a4e4394789b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e53a expref: 10 pid: 3623 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.261015:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129741.261045:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949051905536:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 82us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129741.261051:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4870 00000100:00100000:0.0:1746129741.269988:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.270025:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.270060:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051905920 00000100:00100000:3.0:1746129741.270067:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051905920 00000100:00100000:0.0:1746129741.270100:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:3.0:1746129741.270270:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880094d8c700 x1830949051905920/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:482/0 lens 488/0 e 0 to 0 dl 1746129752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.270278:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8c700 with x1830949051905920 ext(1048576->2097151) 00002000:00010000:3.0:1746129741.270282:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d8c700 00000100:00100000:3.0:1746129741.270293:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051906176 00000100:00100000:3.0:1746129741.270295:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051906176 00002000:00100000:3.0:1746129741.270306:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880094d8ca80 x1830949051906176/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/0 e 0 to 0 dl 1746129752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.270311:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8ca80 with x1830949051906176 ext(1048576->2097151) 00002000:00010000:3.0:1746129741.270313:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d8ca80 00000100:00100000:3.0:1746129741.270321:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3702 00000100:00100000:3.0:1746129741.270325:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1964:x1830949051905920:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129741.280652:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.280687:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051906432 00000100:00100000:0.0:1746129741.280695:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051906432 00002000:00100000:0.0:1746129741.280732:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e6:0x0] (1847296->1851391) req@ffff8800a5492a00 x1830949051906432/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:482/0 lens 488/0 e 0 to 0 dl 1746129752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129741.280740:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5492a00 with x1830949051906432 ext(1847296->1851391) 00002000:00010000:0.0:1746129741.280745:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5492a00 00000100:00100000:0.0:1746129741.280762:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3704 00000100:00100000:0.0:1746129741.280769:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949051906432:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129741.281297:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949051906432:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 527us (652us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129741.281303:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3704 00002000:00100000:0.0:1746129741.281308:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e6:0x0] (1847296->1851391) req@ffff8800a5492a00 x1830949051906432/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:482/0 lens 488/4536 e 0 to 0 dl 1746129752 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129741.281315:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5492a00 with x1830949051906432 ext(1847296->1851391) 00002000:00010000:0.0:1746129741.281318:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5492a00 00000100:00100000:3.0:1746129741.294614:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1964:x1830949051905920:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 24276us (24577us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129741.294624:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3702 00002000:00100000:3.0:1746129741.294633:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880094d8c700 x1830949051905920/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:482/0 lens 488/440 e 0 to 0 dl 1746129752 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.294642:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8c700 with x1830949051905920 ext(1048576->2097151) 00002000:00010000:3.0:1746129741.294647:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d8c700 00000100:00100000:0.0:1746129741.294649:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.294671:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051906560 00000100:00100000:0.0:1746129741.294678:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051906560 00000100:00100000:0.0:1746129741.294718:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10124 00000100:00100000:0.0:1746129741.294724:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:28286:x1830949051906560:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129741.294740:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129741.294755:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013261ac00/0x48868a4e43947920 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e595 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129741.294774:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129741.294776:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129741.294782:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013261ac00/0x48868a4e43947920 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e595 expref: 26 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129741.294795:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013261ac00/0x48868a4e43947920 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e595 expref: 26 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129741.294804:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013261ac00, rc 0) 00000100:00100000:0.0:1746129741.294821:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:28286:x1830949051906560:12345-192.168.204.31@tcp:101:cat.0 Request processed in 97us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129741.294826:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10124 00000100:00100000:0.0:1746129741.299082:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.300315:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.303765:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.303806:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051907072 00000100:00100000:3.0:1746129741.303813:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051907072 00002000:00100000:3.0:1746129741.303868:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880094d8ed80 x1830949051907072/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:482/0 lens 488/0 e 0 to 0 dl 1746129752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.303877:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8ed80 with x1830949051907072 ext(1048576->2097151) 00002000:00010000:3.0:1746129741.303881:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8ed80 00000100:00100000:3.0:1746129741.305466:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3705 00000100:00100000:3.0:1746129741.305476:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949051907072:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129741.307927:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.310413:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.310439:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.310463:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.310485:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051907200 00000100:00100000:0.0:1746129741.310489:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051907200 00010000:00010000:0.0:1746129741.310502:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe29600/0x48868a4e43947912 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e587 expref: 10 pid: 3623 timeout: 787 lvb_type: 0 00000100:00100000:0.0:1746129741.310515:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051907456 00000100:00100000:0.0:1746129741.310517:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051907456 00010000:00010000:0.0:1746129741.310525:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135848a00/0x48868a4e439477bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4df expref: 11 pid: 7976 timeout: 787 lvb_type: 1 00000100:00100000:0.0:1746129741.310537:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4873 00000100:00100000:0.0:1746129741.310542:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949051907200:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129741.310549:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129741.310557:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fe29600/0x48868a4e43947912 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e587 expref: 10 pid: 3623 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746129741.310565:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fe29600/0x48868a4e43947912 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e587 expref: 10 pid: 3623 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746129741.310575:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fe29600/0x48868a4e43947912 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e587 expref: 10 pid: 3623 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746129741.310586:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129741.310618:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1961:x1830949051907200:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 75us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129741.310623:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4873 00000100:00100000:0.0:1746129741.310634:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4874 00000100:00100000:0.0:1746129741.310637:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949051907456:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129741.310643:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129741.310649:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135848a00/0x48868a4e439477bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4df expref: 11 pid: 7976 timeout: 787 lvb_type: 1 00010000:00010000:0.0:1746129741.310656:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135848a00/0x48868a4e439477bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4df expref: 11 pid: 7976 timeout: 787 lvb_type: 1 00010000:00010000:0.0:1746129741.310666:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135848a00/0x48868a4e439477bb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4df expref: 11 pid: 7976 timeout: 787 lvb_type: 1 00010000:00010000:0.0:1746129741.310678:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129741.310679:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129741.310684:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801310ecc00/0x48868a4e4394792e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5a3 expref: 8 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129741.310690:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801310ecc00/0x48868a4e4394792e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5a3 expref: 8 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129741.310719:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801310ecc00/0x48868a4e4394792e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5a3 expref: 8 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129741.310729:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053185024:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129741.310777:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135d2c480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129741.326549:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.326577:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051907968 00000100:00100000:0.0:1746129741.326583:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051907968 00002000:00100000:0.0:1746129741.326624:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1327104->1331199) req@ffff88009207ea00 x1830949051907968/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:482/0 lens 488/0 e 0 to 0 dl 1746129752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129741.326632:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207ea00 with x1830949051907968 ext(1327104->1331199) 00002000:00010000:0.0:1746129741.326636:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207ea00 00000100:00100000:0.0:1746129741.326651:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3707 00000100:00100000:0.0:1746129741.326657:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949051907968:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129741.326681:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949051907072:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 21207us (22919us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129741.326688:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3705 00002000:00100000:3.0:1746129741.326692:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880094d8ed80 x1830949051907072/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:482/0 lens 488/440 e 0 to 0 dl 1746129752 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.326697:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8ed80 with x1830949051907072 ext(1048576->2097151) 00002000:00010000:3.0:1746129741.326700:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8ed80 00000100:00100000:1.0:1746129741.326801:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053185024:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129741.326816:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129741.326834:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949051907456:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 16196us (16394us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129741.326840:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4874 00000100:00100000:3.0:1746129741.330306:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949051907968:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 3640us (3755us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129741.330315:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3707 00002000:00100000:3.0:1746129741.330323:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1327104->1331199) req@ffff88009207ea00 x1830949051907968/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:482/0 lens 488/4536 e 0 to 0 dl 1746129752 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.330331:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207ea00 with x1830949051907968 ext(1327104->1331199) 00002000:00010000:3.0:1746129741.330336:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207ea00 00000100:00100000:3.0:1746129741.331657:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949051907712:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 20306us (21188us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129741.331665:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3706 00002000:00100000:3.0:1746129741.331671:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880094d8ea00 x1830949051907712/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/440 e 0 to 0 dl 1746129752 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.331679:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8ea00 with x1830949051907712 ext(1048576->2097151) 00002000:00010000:3.0:1746129741.331683:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8ea00 00000100:00100000:0.0:1746129741.333441:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.333473:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.333640:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051908224 00000100:00100000:1.0:1746129741.333648:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051908224 00000100:00100000:1.0:1746129741.333693:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051908096 00000100:00100000:1.0:1746129741.333696:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051908096 00000100:00100000:1.0:1746129741.333712:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10127 00000100:00100000:1.0:1746129741.333718:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1963:x1830949051908224:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129741.333732:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129741.333746:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd85800/0x48868a4e43947935 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e5b1 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.333762:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129741.333764:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129741.333771:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd85800/0x48868a4e43947935 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5b1 expref: 10 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129741.333784:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd85800/0x48868a4e43947935 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5b1 expref: 10 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129741.333793:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd85800, rc 0) 00000100:00100000:1.0:1746129741.333823:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1963:x1830949051908224:12345-192.168.204.31@tcp:101:cat.0 Request processed in 105us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129741.333827:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10127 00000100:00100000:0.0:1746129741.334082:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.334567:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051908480 00000100:00100000:3.0:1746129741.334571:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051908480 00000100:00100000:3.0:1746129741.334611:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3777 00000100:00100000:3.0:1746129741.334617:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28280:x1830949051908480:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129741.334766:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28280:x1830949051908480:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 148us (684us total) trans 8589943469 rc 0/0 00000100:00100000:3.0:1746129741.334772:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3777 00000100:00100000:0.0:1746129741.339836:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.340089:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051908736 00000100:00100000:3.0:1746129741.340097:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051908736 00002000:00100000:3.0:1746129741.340136:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009207d880 x1830949051908736/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 504/0 e 0 to 0 dl 1746129752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.340150:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207d880 with x1830949051908736 ext(2097152->3145727) 00002000:00010000:3.0:1746129741.340155:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207d880 00000100:00100000:3.0:1746129741.340185:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3708 00000100:00100000:3.0:1746129741.340191:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949051908736:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129741.348350:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.355213:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949051908736:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15012us (15379us total) trans 0 rc 1007616/1007616 00000100:00100000:3.0:1746129741.355225:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3708 00002000:00100000:3.0:1746129741.355235:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009207d880 x1830949051908736/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 504/440 e 0 to 0 dl 1746129752 ref 1 fl Complete:/200/0 rc 1007616/1007616 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.355244:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207d880 with x1830949051908736 ext(2097152->3145727) 00010000:00010000:3.0:1746129741.355254:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135cab000/0x48868a4e439478ef lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2293760->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e572 expref: 26 pid: 3623 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.355268:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135cab000/0x48868a4e439478ef lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2293760->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e572 expref: 26 pid: 3623 timeout: 787 lvb_type: 0 00002000:00010000:3.0:1746129741.355275:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009207d880 00000100:00100000:0.0:1746129741.360306:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.360428:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051908992 00000100:00100000:3.0:1746129741.360436:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051908992 00002000:00100000:3.0:1746129741.360468:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2293760->2334719) req@ffff88009207c700 x1830949051908992/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/0 e 0 to 0 dl 1746129752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.360477:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207c700 with x1830949051908992 ext(2293760->2334719) 00010000:00010000:3.0:1746129741.360484:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135cab000/0x48868a4e439478ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2293760->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e572 expref: 26 pid: 3623 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.360499:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135cab000/0x48868a4e439478ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2293760->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e572 expref: 26 pid: 3623 timeout: 787 lvb_type: 0 00002000:00010000:3.0:1746129741.360505:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009207c700 00000100:00100000:3.0:1746129741.360527:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 499 00000100:00100000:3.0:1746129741.360534:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949051908992:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129741.371073:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949051908992:12345-192.168.204.31@tcp:4:cat.0 Request processed in 10538us (10772us total) trans 17179872960 rc 0/0 00000100:00100000:3.0:1746129741.371081:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 499 00002000:00100000:3.0:1746129741.371089:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2293760->2334719) req@ffff88009207c700 x1830949051908992/t17179872960(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/448 e 0 to 0 dl 1746129752 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.371097:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207c700 with x1830949051908992 ext(2293760->2334719) 00010000:00010000:3.0:1746129741.371105:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135cab000/0x48868a4e439478ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2293760->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e572 expref: 28 pid: 3623 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.371116:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135cab000/0x48868a4e439478ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2293760->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e572 expref: 28 pid: 3623 timeout: 787 lvb_type: 0 00002000:00010000:3.0:1746129741.371123:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009207c700 00000100:00100000:0.0:1746129741.382157:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.382201:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.382254:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051909504 00000100:00100000:1.0:1746129741.382262:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051909504 00010000:00010000:1.0:1746129741.382292:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135cab000/0x48868a4e439478ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2293760->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e572 expref: 28 pid: 3623 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746129741.382324:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4875 00000100:00100000:1.0:1746129741.382331:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949051909504:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129741.382341:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129741.382360:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135cab000/0x48868a4e439478ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2293760->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e572 expref: 28 pid: 3623 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129741.382371:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135cab000/0x48868a4e439478ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2293760->2334719) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e572 expref: 28 pid: 3623 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129741.382388:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135cab000/0x48868a4e439478ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2293760->2334719) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e572 expref: 28 pid: 3623 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129741.382403:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129741.382404:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129741.382410:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801310ec000/0x48868a4e43947943 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5b8 expref: 11 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.382417:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801310ec000/0x48868a4e43947943 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5b8 expref: 11 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.382442:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801310ec000/0x48868a4e43947943 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5b8 expref: 11 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129741.382452:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5493100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053185408:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129741.382465:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051909376 00000100:00100000:3.0:1746129741.382469:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051909376 00002000:00100000:3.0:1746129741.382492:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009207f480 x1830949051909376/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/0 e 0 to 0 dl 1746129752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.382500:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207f480 with x1830949051909376 ext(2097152->3145727) 00002000:00010000:3.0:1746129741.382504:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207f480 00000100:00100000:3.0:1746129741.382517:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3709 00000100:00100000:3.0:1746129741.382522:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949051909376:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129741.382522:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129741.383823:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.384417:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051909632 00000100:00100000:0.0:1746129741.384421:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051909632 00000100:00100000:0.0:1746129741.395186:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5493100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053185408:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129741.395207:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129741.395247:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949051909504:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 12916us (13044us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129741.395258:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4875 00000100:00100000:0.0:1746129741.397294:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.397327:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.397546:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.397675:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.398530:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051910144 00000100:00100000:0.0:1746129741.398533:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051910144 00002000:00100000:0.0:1746129741.398544:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009207f100 x1830949051910144/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:482/0 lens 488/0 e 0 to 0 dl 1746129752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129741.398550:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207f100 with x1830949051910144 ext(3145728->4194303) 00002000:00010000:0.0:1746129741.398552:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207f100 00000100:00100000:0.0:1746129741.398559:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051910656 00000100:00100000:0.0:1746129741.398561:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051910656 00002000:00100000:0.0:1746129741.398570:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009207f800 x1830949051910656/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:482/0 lens 488/0 e 0 to 0 dl 1746129752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129741.398582:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207f800 with x1830949051910656 ext(3145728->4194303) 00002000:00010000:0.0:1746129741.398584:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207f800 00000100:00100000:0.0:1746129741.398603:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3711 00000100:00100000:0.0:1746129741.398607:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949051910144:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129741.412001:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949051909376:12345-192.168.204.31@tcp:3:cat.0 Request processed in 29471us (29843us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129741.412012:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3709 00002000:00100000:3.0:1746129741.412022:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009207f480 x1830949051909376/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/440 e 0 to 0 dl 1746129752 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.412030:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207f480 with x1830949051909376 ext(2097152->3145727) 00002000:00010000:3.0:1746129741.412034:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207f480 00000100:00100000:0.0:1746129741.412983:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.413014:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.413045:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.413116:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051910784 00000100:00100000:3.0:1746129741.413122:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051910784 00000100:00100000:1.0:1746129741.414093:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051910912 00000100:00100000:1.0:1746129741.414097:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051910912 00000100:00100000:3.0:1746129741.414102:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051911040 00000100:00100000:3.0:1746129741.414104:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051911040 00000100:00100000:1.0:1746129741.414126:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10132 00000100:00100000:3.0:1746129741.414129:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10133 00000100:00100000:1.0:1746129741.414131:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949051910912:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:3.0:1746129741.414134:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949051911040:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129741.414138:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129741.414139:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129741.414148:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099ccb200/0x48868a4e4394797b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e5db expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.414148:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135bc9c00/0x48868a4e4394796d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e5d4 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.414163:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129741.414165:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129741.414171:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099ccb200/0x48868a4e4394797b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5db expref: 12 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129741.414183:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099ccb200/0x48868a4e4394797b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5db expref: 12 pid: 1877 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129741.414186:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5493b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053185536:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129741.414191:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ccb200, rc 0) 00000100:00100000:3.0:1746129741.414226:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949051911040:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 91us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129741.414230:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10133 00000100:00100000:1.0:1746129741.414239:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129741.420297:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.420761:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051911168 00000100:00100000:3.0:1746129741.420769:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051911168 00000100:00100000:3.0:1746129741.420803:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10134 00000100:00100000:3.0:1746129741.420810:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:28286:x1830949051911168:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129741.420828:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129741.420842:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099ccb400/0x48868a4e43947982 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e5e2 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.420891:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129741.420893:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129741.420902:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099ccb400/0x48868a4e43947982 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5e2 expref: 28 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.420915:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099ccb400/0x48868a4e43947982 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5e2 expref: 28 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.420925:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ccb400, rc 0) 00000100:00100000:3.0:1746129741.420967:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:28286:x1830949051911168:12345-192.168.204.31@tcp:101:cat.0 Request processed in 157us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129741.420972:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10134 00002000:00010000:3.0:1746129741.421028:0:3623:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime: 1746129741 -> 1746129742 00000100:00100000:3.0:1746129741.421048:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053185664:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129741.421072:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009be5fa00/0x48868a4e43947974 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5cd expref: 13 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129741.421081:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be5fa00/0x48868a4e43947974 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5cd expref: 13 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129741.421095:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be5fa00, rc 0) 00000100:00100000:3.0:1746129741.421112:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949051910784:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 6996us (8131us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129741.421117:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10131 00000100:00100000:3.0:1746129741.421461:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949051910400:12345-192.168.204.31@tcp:3:cat.0 Request processed in 22835us (23915us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129741.421468:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3712 00002000:00100000:3.0:1746129741.421476:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009207df80 x1830949051910400/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:482/0 lens 488/440 e 0 to 0 dl 1746129752 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.421484:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207df80 with x1830949051910400 ext(2097152->3145727) 00002000:00010000:3.0:1746129741.421488:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207df80 00002000:00010000:1.0:1746129741.422119:0:8435:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime: 1746129741 -> 1746129742 00000100:00100000:1.0:1746129741.422132:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5493b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053185536:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129741.422152:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135bc9c00/0x48868a4e4394796d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5d4 expref: 11 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129741.422162:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135bc9c00/0x48868a4e4394796d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5d4 expref: 11 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129741.422174:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bc9c00, rc 0) 00000100:00100000:1.0:1746129741.422197:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949051910912:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 8065us (9181us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129741.422202:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10132 00000100:00100000:1.0:1746129741.424972:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949051910144:12345-192.168.204.31@tcp:3:cat.0 Request processed in 26354us (27634us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129741.424981:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3711 00002000:00100000:1.0:1746129741.424990:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009207f100 x1830949051910144/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:482/0 lens 488/440 e 0 to 0 dl 1746129752 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129741.424999:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207f100 with x1830949051910144 ext(3145728->4194303) 00002000:00010000:1.0:1746129741.425003:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207f100 00000100:00100000:0.0:1746129741.432811:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.432891:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.432938:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051911808 00000100:00100000:1.0:1746129741.432948:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051911808 00002000:00100000:1.0:1746129741.432986:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009206e300 x1830949051911808/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/0 e 0 to 0 dl 1746129752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129741.432996:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206e300 with x1830949051911808 ext(3145728->4194303) 00002000:00010000:1.0:1746129741.433001:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009206e300 00000100:00100000:1.0:1746129741.433020:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3714 00000100:00100000:3.0:1746129741.433021:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051911424 00000100:00100000:3.0:1746129741.433026:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051911424 00000100:00100000:1.0:1746129741.433027:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1963:x1830949051911808:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129741.433053:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9710 00000100:00100000:3.0:1746129741.433058:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+10:28291:x1830949051911424:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129741.433069:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129741.433085:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5fa00/0x48868a4e43947989 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e5e9 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.433162:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43947990 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129741.433174:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e800/0x48868a4e43947966 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5c6 expref: 11 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.433180:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43947990 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129741.433208:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e800/0x48868a4e43947966 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5c6 expref: 11 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.433218:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e800/0x48868a4e43947966 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5c6 expref: 11 pid: 15044 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746129741.433227:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053185792:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129741.433282:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129741.433627:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.445780:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.446207:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051912064 00000100:00100000:1.0:1746129741.446214:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051912064 00010000:00010000:1.0:1746129741.446238:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e800/0x48868a4e43947966 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5c6 expref: 12 pid: 15044 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746129741.446257:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4876 00000100:00100000:1.0:1746129741.446262:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1ae8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949051912064:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129741.446273:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129741.446278:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e800/0x48868a4e43947966 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5c6 expref: 12 pid: 15044 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129741.446287:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e800/0x48868a4e43947966 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5c6 expref: 12 pid: 15044 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129741.446308:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129741.446312:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43947990 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.446319:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43947990 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.446324:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43947990 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.446334:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129741.446349:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1ae8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949051912064:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 87us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129741.446353:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4876 00010000:00010000:3.0:1746129741.446468:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e800/0x48868a4e43947966 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5c6 expref: 11 pid: 15044 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746129741.446493:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053185792:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129741.446506:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43947990 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129741.446513:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43947990 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129741.446517:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43947990 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129741.446534:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129741.447980:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5fa00/0x48868a4e43947989 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5e9 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.448013:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43947990 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5e9 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.448030:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129741.448032:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129741.448034:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be5e200, rc 0) 00000100:00100000:3.0:1746129741.448796:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+11:28291:x1830949051911424:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 15735us (15990us total) trans 8589943470 rc 0/0 00000100:00100000:3.0:1746129741.448815:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9710 00000100:00100000:0.0:1746129741.463307:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1963:x1830949051911808:12345-192.168.204.31@tcp:3:cat.0 Request processed in 30269us (30404us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129741.463964:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3714 00002000:00100000:0.0:1746129741.463976:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009206e300 x1830949051911808/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/440 e 0 to 0 dl 1746129752 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129741.463985:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206e300 with x1830949051911808 ext(3145728->4194303) 00002000:00010000:0.0:1746129741.463990:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009206e300 00000100:00100000:0.0:1746129741.469813:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.470087:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051912192 00000100:00100000:3.0:1746129741.470094:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051912192 00000100:00100000:3.0:1746129741.470254:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9711 00000100:00100000:3.0:1746129741.470262:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+11:28291:x1830949051912192:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129741.470279:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129741.470294:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013185de00/0x48868a4e4394799e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e5f0 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.470362:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a14c00/0x48868a4e439479a5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129741.470374:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43947990 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5e9 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.470380:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a14c00/0x48868a4e439479a5 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129741.470405:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43947990 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5e9 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.470415:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43947990 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5e9 expref: 12 pid: 14315 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746129741.470424:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053185920:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129741.471373:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129741.475986:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.480198:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.480244:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.480275:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051912576 00000100:00100000:0.0:1746129741.480293:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051912576 00000100:00100000:0.0:1746129741.480326:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051912704 00000100:00100000:0.0:1746129741.480328:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051912704 00000100:00100000:0.0:1746129741.480342:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10135 00000100:00100000:0.0:1746129741.480348:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1964:x1830949051912576:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129741.480365:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129741.480378:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd84000/0x48868a4e439479ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e5f7 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129741.480422:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053186048:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129741.480481:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135d2cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129741.480532:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10136 00000100:00100000:0.0:1746129741.480537:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1964:x1830949051912704:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129741.480544:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129741.480551:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd84800/0x48868a4e439479b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e5fe expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129741.480571:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053186176:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129741.480603:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135d2c840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129741.480927:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053185920:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129741.480943:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130a14c00/0x48868a4e439479a5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129741.487305:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.487876:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051912832 00000100:00100000:1.0:1746129741.487886:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051912832 00010000:00010000:1.0:1746129741.487925:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43947990 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5e9 expref: 13 pid: 14315 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746129741.487955:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4877 00000100:00100000:1.0:1746129741.487963:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+13:1961:x1830949051912832:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129741.487978:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129741.487984:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43947990 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5e9 expref: 13 pid: 14315 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129741.487995:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43947990 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5e9 expref: 13 pid: 14315 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129741.488015:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43947990 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5e9 expref: 13 pid: 14315 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129741.488054:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129741.488059:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a14c00/0x48868a4e439479a5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.488067:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a14c00/0x48868a4e439479a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.488073:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a14c00/0x48868a4e439479a5 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.488094:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129741.488137:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949051912832:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 175us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129741.488143:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4877 00010000:00010000:1.0:1746129741.488287:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130a14c00/0x48868a4e439479a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.488293:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a14c00/0x48868a4e439479a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:1.0:1746129741.488326:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:1.0:1746129741.488329:0:14315:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746129741.488340:0:14315:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880130a14c00/0x48868a4e439479a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.488364:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013185de00/0x48868a4e4394799e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5f0 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.488374:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a14c00/0x48868a4e439479a5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5f0 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.488383:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129741.488386:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129741.488387:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a14c00, rc 0) 00000100:00100000:1.0:1746129741.488408:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+11:28291:x1830949051912192:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 18147us (18597us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129741.488413:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9711 00000100:00100000:0.0:1746129741.488459:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.488476:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051913088 00000100:00100000:1.0:1746129741.488479:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051913088 00000100:00100000:1.0:1746129741.488496:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9712 00000100:00100000:0.0:1746129741.488498:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053186176:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129741.488501:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28294:x1830949051913088:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129741.488512:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd84800/0x48868a4e439479b3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5fe expref: 20 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129741.488515:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129741.488522:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd84800/0x48868a4e439479b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5fe expref: 20 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129741.488524:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ecc00/0x48868a4e439479ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e605 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129741.488542:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd84800, rc 0) 00000100:00100000:0.0:1746129741.488559:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1964:x1830949051912704:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8022us (8315us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129741.488564:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10136 00010000:00010000:1.0:1746129741.489222:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ede00/0x48868a4e439479c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.489231:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ede00/0x48868a4e439479c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.489238:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ede00/0x48868a4e439479c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.489248:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed600/0x48868a4e439479c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.489253:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed600/0x48868a4e439479c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.489260:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed600/0x48868a4e439479c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.489337:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e439479cf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.489344:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e439479cf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.489349:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e439479cf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:1.0:1746129741.489355:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129741.489426:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ede00/0x48868a4e439479c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.489432:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ede00/0x48868a4e439479c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.489437:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ede00/0x48868a4e439479c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.489442:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800919ede00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129741.489445:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ede00/0x48868a4e439479c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.489450:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ede00/0x48868a4e439479c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.489456:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129741.489459:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129741.489461:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ede00/0x48868a4e439479c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.489469:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ede00/0x48868a4e439479c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.489476:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed600/0x48868a4e439479c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.489480:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed600/0x48868a4e439479c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.489484:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed600/0x48868a4e439479c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.489488:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800919ed600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129741.489490:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed600/0x48868a4e439479c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.489494:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed600/0x48868a4e439479c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.489499:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009b251f00) 00010000:00010000:1.0:1746129741.489501:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129741.489502:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed600/0x48868a4e439479c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.489506:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed600/0x48868a4e439479c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.489529:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ecc00/0x48868a4e439479ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e605 expref: 287 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.489538:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e439479cf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e605 expref: 286 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.489547:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129741.489549:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129741.489551:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919eda00, rc 0) 00000100:00100000:1.0:1746129741.489594:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:28294:x1830949051913088:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1083us (1128us total) trans 8589943471 rc 0/0 00000100:00100000:1.0:1746129741.489599:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9712 00000100:00100000:0.0:1746129741.491636:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.491680:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.491754:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051913216 00000100:00100000:3.0:1746129741.491760:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051913216 00000100:00100000:3.0:1746129741.491789:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051913344 00000100:00100000:3.0:1746129741.491791:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051913344 00000100:00100000:3.0:1746129741.491814:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10137 00000100:00100000:3.0:1746129741.491821:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949051913216:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129741.491864:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129741.491880:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a14400/0x48868a4e439479dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e60c expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129741.491922:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053186304:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129741.491987:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129741.498491:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.500945:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053186304:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129741.500977:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a14400/0x48868a4e439479dd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e60c expref: 13 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129741.500990:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a14400/0x48868a4e439479dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e60c expref: 13 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129741.501733:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a14400, rc 0) 00000100:00100000:3.0:1746129741.501784:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949051913216:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 9962us (10153us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129741.501792:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10137 00000100:00100000:0.0:1746129741.507135:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.513045:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.513565:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053186560:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129741.513595:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801310ed000/0x48868a4e439479eb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [2076672->2097151] (req 2076672->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e61a expref: 20 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.513607:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310ed000, rc 0) 00000100:00100000:3.0:1746129741.513630:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:28294:x1830949051913728:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5463us (6497us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129741.513636:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10139 00000100:00100000:1.0:1746129741.513750:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051914112 00000100:00100000:1.0:1746129741.513754:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051914112 00000100:00100000:1.0:1746129741.513785:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9713 00000100:00100000:1.0:1746129741.513791:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+11:28291:x1830949051914112:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129741.513801:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129741.513814:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eca00/0x48868a4e439479f2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e621 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.513909:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e439479f9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.513920:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e439479f9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.513929:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e439479f9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.513939:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e439479f9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.513943:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e439479f9 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.513951:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e439479f9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.513955:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800919ec000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129741.513958:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e439479f9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.513963:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e439479f9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.513972:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129741.513974:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746129741.513977:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e439479f9 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.513982:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e439479f9 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.514009:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eca00/0x48868a4e439479f2 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e621 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.514015:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eca00/0x48868a4e439479f2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e621 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.514021:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919eca00, rc 0) 00000100:00100000:1.0:1746129741.514041:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+11:28291:x1830949051914112:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 250us (997us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129741.514046:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9713 00000100:00100000:0.0:1746129741.516691:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.517286:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.517869:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051914368 00000100:00100000:3.0:1746129741.517877:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051914368 00000100:00100000:3.0:1746129741.517919:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10140 00000100:00100000:3.0:1746129741.517926:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949051914368:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129741.517940:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129741.517955:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8f0de00/0x48868a4e43947a00 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e62f expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129741.517994:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053186688:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129741.518053:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129741.518227:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.518251:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051914624 00000100:00100000:0.0:1746129741.518254:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051914624 00000100:00100000:0.0:1746129741.518284:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3778 00000100:00100000:0.0:1746129741.518289:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:28291:x1830949051914624:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:0.0:1746129741.518426:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+12:28291:x1830949051914624:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 136us (199us total) trans 8589943472 rc 0/0 00000100:00100000:0.0:1746129741.518432:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3778 00000100:00100000:3.0:1746129741.519490:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1963:x1830949051913856:12345-192.168.204.31@tcp:4:cat.0 Request processed in 5241us (6315us total) trans 21474840124 rc 0/0 00000100:00100000:3.0:1746129741.519498:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 500 00002000:00100000:3.0:1746129741.519506:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (1847296->2097151) req@ffff88009468dc00 x1830949051913856/t21474840124(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:482/0 lens 488/448 e 0 to 0 dl 1746129752 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.519515:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468dc00 with x1830949051913856 ext(1847296->2097151) 00010000:00010000:3.0:1746129741.519522:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a51c5800/0x48868a4e439478f6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e579 expref: 12 pid: 1877 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.519534:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a51c5800/0x48868a4e439478f6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e579 expref: 12 pid: 1877 timeout: 787 lvb_type: 0 00002000:00010000:3.0:1746129741.519540:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009468dc00 00000100:00100000:3.0:1746129741.522531:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053186688:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129741.522546:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8f0de00/0x48868a4e43947a00 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e62f expref: 21 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129741.522555:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8f0de00/0x48868a4e43947a00 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e62f expref: 21 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129741.522570:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8f0de00, rc 0) 00000100:00100000:3.0:1746129741.522602:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949051914368:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4677us (5916us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129741.522608:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10140 00000100:00100000:0.0:1746129741.522876:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051914752 00000100:00100000:0.0:1746129741.522882:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051914752 00010000:00010000:0.0:1746129741.522903:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a51c5800/0x48868a4e439478f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e579 expref: 12 pid: 1877 timeout: 787 lvb_type: 0 00000100:00100000:0.0:1746129741.522932:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4878 00000100:00100000:0.0:1746129741.522939:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1964:x1830949051914752:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129741.522950:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129741.522959:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a51c5800/0x48868a4e439478f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e579 expref: 12 pid: 1877 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746129741.522967:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a51c5800/0x48868a4e439478f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e579 expref: 12 pid: 1877 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746129741.522981:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a51c5800/0x48868a4e439478f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e579 expref: 12 pid: 1877 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746129741.522992:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129741.522994:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129741.522999:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801310ed000/0x48868a4e439479eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e61a expref: 19 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129741.523007:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801310ed000/0x48868a4e439479eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e61a expref: 19 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129741.523029:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801310ed000/0x48868a4e439479eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e61a expref: 19 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129741.523038:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053186944:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129741.523088:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135d2c840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129741.525414:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053186944:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129741.525568:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051914880 00000100:00100000:3.0:1746129741.525574:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051914880 00010000:00010000:0.0:1746129741.525625:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129741.525628:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10142 00000100:00100000:3.0:1746129741.525635:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949051914880:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129741.525649:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129741.525666:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949051914752:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2727us (2962us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129741.525674:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4878 00010000:00010000:3.0:1746129741.525831:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a14400/0x48868a4e43947a0e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e636 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129741.525894:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053187072:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129741.525995:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129741.526008:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051915136 00000100:00100000:3.0:1746129741.526011:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051915136 00002000:00100000:3.0:1746129741.526204:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (2076672->2080767) req@ffff88009468ca80 x1830949051915136/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/0 e 0 to 0 dl 1746129752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.526212:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468ca80 with x1830949051915136 ext(2076672->2080767) 00002000:00010000:3.0:1746129741.526216:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009468ca80 00000100:00100000:3.0:1746129741.526239:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3718 00000100:00100000:3.0:1746129741.526245:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1964:x1830949051915136:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129741.526489:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1964:x1830949051915136:12345-192.168.204.31@tcp:3:cat.0 Request processed in 240us (1038us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129741.526495:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3718 00002000:00100000:3.0:1746129741.526500:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (2076672->2080767) req@ffff88009468ca80 x1830949051915136/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/4536 e 0 to 0 dl 1746129752 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.526506:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468ca80 with x1830949051915136 ext(2076672->2080767) 00002000:00010000:3.0:1746129741.526509:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009468ca80 00000100:00100000:3.0:1746129741.527317:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053187072:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129741.527336:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a14400/0x48868a4e43947a0e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e636 expref: 21 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129741.527346:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a14400/0x48868a4e43947a0e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e636 expref: 21 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129741.527355:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a14400, rc 0) 00000100:00100000:3.0:1746129741.527390:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949051914880:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1755us (2021us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129741.527395:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10142 00000100:00100000:0.0:1746129741.529681:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.529761:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.529831:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051915264 00000100:00100000:3.0:1746129741.529839:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051915264 00000100:00100000:3.0:1746129741.529888:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10143 00000100:00100000:3.0:1746129741.529895:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:28294:x1830949051915264:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129741.529909:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129741.529922:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136920800/0x48868a4e43947a15 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e63d expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.529940:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801310ecc00/0x48868a4e4394792e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5a3 expref: 10 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.529946:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129741.529948:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129741.529950:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136920800/0x48868a4e43947a15 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->1273855] (req 1048576->1273855) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e63d expref: 21 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.529978:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801310ecc00/0x48868a4e4394792e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5a3 expref: 10 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.529987:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801310ecc00/0x48868a4e4394792e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5a3 expref: 10 pid: 3623 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746129741.529995:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053187200:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129741.530044:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129741.533365:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053187200:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129741.533390:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136920800/0x48868a4e43947a15 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->1273855] (req 1048576->1273855) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e63d expref: 21 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.533405:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136920800, rc 0) 00000100:00100000:3.0:1746129741.533952:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:28294:x1830949051915264:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4055us (4275us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129741.533959:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10143 00000100:00100000:0.0:1746129741.536129:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.536428:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051915648 00000100:00100000:3.0:1746129741.536436:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051915648 00002000:00100000:3.0:1746129741.536471:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->1331199) req@ffff88009fd45880 x1830949051915648/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:482/0 lens 488/0 e 0 to 0 dl 1746129752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.536480:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd45880 with x1830949051915648 ext(1048576->1331199) 00010000:00010000:3.0:1746129741.536487:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801310ecc00/0x48868a4e4394792e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5a3 expref: 11 pid: 3623 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.536504:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801310ecc00/0x48868a4e4394792e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5a3 expref: 11 pid: 3623 timeout: 787 lvb_type: 0 00002000:00010000:3.0:1746129741.536510:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fd45880 00000100:00100000:3.0:1746129741.536535:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 501 00000100:00100000:3.0:1746129741.536542:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949051915648:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129741.541765:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949051915648:12345-192.168.204.31@tcp:4:cat.0 Request processed in 5215us (5635us total) trans 21474840125 rc 0/0 00000100:00100000:3.0:1746129741.541775:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 501 00002000:00100000:3.0:1746129741.541784:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->1331199) req@ffff88009fd45880 x1830949051915648/t21474840125(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:482/0 lens 488/448 e 0 to 0 dl 1746129752 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.541793:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd45880 with x1830949051915648 ext(1048576->1331199) 00010000:00010000:3.0:1746129741.541801:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801310ecc00/0x48868a4e4394792e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5a3 expref: 13 pid: 3623 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.541815:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801310ecc00/0x48868a4e4394792e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5a3 expref: 13 pid: 3623 timeout: 787 lvb_type: 0 00002000:00010000:3.0:1746129741.541821:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fd45880 00000100:00100000:0.0:1746129741.544391:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.549109:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.549305:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051916032 00000100:00100000:3.0:1746129741.549315:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051916032 00002000:00100000:3.0:1746129741.549360:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e7:0x0] (1269760->1273855) req@ffff88009fd46a00 x1830949051916032/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/0 e 0 to 0 dl 1746129752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.549368:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd46a00 with x1830949051916032 ext(1269760->1273855) 00002000:00010000:3.0:1746129741.549373:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd46a00 00000100:00100000:3.0:1746129741.549402:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3719 00000100:00100000:3.0:1746129741.549410:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949051916032:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129741.550073:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949051916032:12345-192.168.204.31@tcp:3:cat.0 Request processed in 663us (967us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129741.550079:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3719 00002000:00100000:3.0:1746129741.550085:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e7:0x0] (1269760->1273855) req@ffff88009fd46a00 x1830949051916032/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/4536 e 0 to 0 dl 1746129752 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.550091:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd46a00 with x1830949051916032 ext(1269760->1273855) 00002000:00010000:3.0:1746129741.550094:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd46a00 00000100:00100000:0.0:1746129741.553079:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.553220:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051916288 00000100:00100000:1.0:1746129741.553228:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051916288 00000100:00100000:1.0:1746129741.553274:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3780 00000100:00100000:1.0:1746129741.553282:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:28294:x1830949051916288:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129741.553468:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:28294:x1830949051916288:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 186us (393us total) trans 8589943474 rc 0/0 00000100:00100000:1.0:1746129741.553474:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3780 00000100:00100000:0.0:1746129741.568383:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.568490:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051916544 00000100:00100000:3.0:1746129741.568498:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051916544 00000100:00100000:3.0:1746129741.568548:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9714 00000100:00100000:3.0:1746129741.568555:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28300:x1830949051916544:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129741.568575:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129741.568618:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e43947a1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e644 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.568703:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28800/0x48868a4e43947a23 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129741.568714:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28800/0x48868a4e43947a23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129741.568723:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28800/0x48868a4e43947a23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129741.568734:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0ca00/0x48868a4e43947a2a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129741.568740:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0ca00/0x48868a4e43947a2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129741.568744:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0ca00/0x48868a4e43947a2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129741.568831:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238000/0x48868a4e43947a31 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129741.568838:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238000/0x48868a4e43947a31 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129741.568843:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238000/0x48868a4e43947a31 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:3.0:1746129741.568881:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129741.568948:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28800/0x48868a4e43947a23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129741.568954:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28800/0x48868a4e43947a23 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129741.568960:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28800/0x48868a4e43947a23 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129741.568965:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fe28800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129741.568968:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28800/0x48868a4e43947a23 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129741.568974:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28800/0x48868a4e43947a23 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129741.568983:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129741.568986:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129741.568989:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28800/0x48868a4e43947a23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129741.568993:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28800/0x48868a4e43947a23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129741.569021:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0ca00/0x48868a4e43947a2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129741.569026:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0ca00/0x48868a4e43947a2a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129741.569030:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0ca00/0x48868a4e43947a2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129741.569034:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8f0ca00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129741.569036:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0ca00/0x48868a4e43947a2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129741.569040:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0ca00/0x48868a4e43947a2a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129741.569045:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880130e02c00) 00010000:00010000:3.0:1746129741.569047:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129741.569049:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0ca00/0x48868a4e43947a2a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129741.569053:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0ca00/0x48868a4e43947a2a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129741.569086:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e43947a1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e644 expref: 12 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.569100:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238000/0x48868a4e43947a31 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e644 expref: 11 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.569105:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129741.569107:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129741.569109:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a238000, rc 0) 00000100:00100000:3.0:1746129741.569147:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28300:x1830949051916544:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 592us (771us total) trans 8589943475 rc 0/0 00000100:00100000:3.0:1746129741.569152:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9714 00000100:00100000:0.0:1746129741.573427:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.573574:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051916672 00000100:00100000:3.0:1746129741.573581:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051916672 00000100:00100000:3.0:1746129741.574562:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10144 00000100:00100000:3.0:1746129741.574572:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28300:x1830949051916672:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129741.574597:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129741.574613:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fe28800/0x48868a4e43947a3f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e64b expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.574641:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb21000/0x48868a4e439477ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4f4 expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129741.574650:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801310eca00/0x48868a4e4394794a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5bf expref: 20 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.574656:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd85800/0x48868a4e43947935 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5b1 expref: 13 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129741.574666:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129741.574667:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129741.574670:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe28800/0x48868a4e43947a3f lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2785280->2904063] (req 2785280->2904063) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e64b expref: 13 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.574697:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd85800/0x48868a4e43947935 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5b1 expref: 13 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129741.574707:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd85800/0x48868a4e43947935 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5b1 expref: 13 pid: 8435 timeout: 787 lvb_type: 1 00000100:00100000:3.0:1746129741.574718:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053187456:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129741.575186:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801310eca00/0x48868a4e4394794a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5bf expref: 20 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.575194:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801310eca00/0x48868a4e4394794a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5bf expref: 20 pid: 20441 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746129741.575202:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053187584:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129741.575226:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb21000/0x48868a4e439477ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4f4 expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129741.575233:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb21000/0x48868a4e439477ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4f4 expref: 9 pid: 20441 timeout: 787 lvb_type: 1 00000100:00100000:3.0:1746129741.575243:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053187712:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129741.575256:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129741.578056:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053187456:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129741.578068:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053187584:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129741.578827:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053187712:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129741.579257:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fe28800/0x48868a4e43947a3f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2785280->2904063] (req 2785280->2904063) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e64b expref: 13 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.579272:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe28800, rc 0) 00000100:00100000:3.0:1746129741.579326:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28300:x1830949051916672:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4756us (5905us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129741.579333:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10144 00000100:00100000:0.0:1746129741.581542:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.581582:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.582136:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.582151:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051916928 00000100:00100000:0.0:1746129741.582154:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051916928 00010000:00010000:0.0:1746129741.582167:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd85800/0x48868a4e43947935 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5b1 expref: 13 pid: 8435 timeout: 787 lvb_type: 1 00000100:00100000:0.0:1746129741.582182:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4881 00000100:00100000:0.0:1746129741.582187:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949051917056:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129741.582192:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129741.582200:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801310eca00/0x48868a4e4394794a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5bf expref: 21 pid: 20441 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746129741.582207:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801310eca00/0x48868a4e4394794a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5bf expref: 21 pid: 20441 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746129741.582221:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801310eca00/0x48868a4e4394794a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5bf expref: 21 pid: 20441 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746129741.582321:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4882 00000100:00100000:3.0:1746129741.582328:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949051916928:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129741.582334:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129741.582343:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd85800/0x48868a4e43947935 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5b1 expref: 13 pid: 8435 timeout: 787 lvb_type: 1 00010000:00010000:3.0:1746129741.582350:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd85800/0x48868a4e43947935 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5b1 expref: 13 pid: 8435 timeout: 787 lvb_type: 1 00010000:00010000:3.0:1746129741.582360:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd85800/0x48868a4e43947935 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5b1 expref: 13 pid: 8435 timeout: 787 lvb_type: 1 00010000:00010000:3.0:1746129741.582372:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129741.582374:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129741.582379:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fe28800/0x48868a4e43947a3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2785280->2904063) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e64b expref: 12 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.582385:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe28800/0x48868a4e43947a3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2785280->2904063) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e64b expref: 12 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.582410:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fe28800/0x48868a4e43947a3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2785280->2904063) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e64b expref: 12 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129741.582419:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053187840:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129741.582474:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6fb40 going to sleep for 11 seconds 00010000:00010000:0.0:1746129741.583230:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129741.583247:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1963:x1830949051917056:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1060us (1664us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129741.583252:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4881 00000100:00100000:0.0:1746129741.585737:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.586429:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053187840:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129741.586442:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129741.586462:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949051916928:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4136us (4327us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129741.586468:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4882 00000100:00100000:0.0:1746129741.589940:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.590321:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051917568 00000100:00100000:1.0:1746129741.590329:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051917568 00002000:00100000:1.0:1746129741.590360:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2899968->2904063) req@ffff88009fd47480 x1830949051917568/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:482/0 lens 488/0 e 0 to 0 dl 1746129752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129741.590369:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd47480 with x1830949051917568 ext(2899968->2904063) 00002000:00010000:1.0:1746129741.590373:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd47480 00000100:00100000:1.0:1746129741.590396:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3721 00000100:00100000:1.0:1746129741.590402:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949051917568:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129741.590552:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949051917568:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 149us (620us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129741.590558:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3721 00002000:00100000:1.0:1746129741.590567:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2899968->2904063) req@ffff88009fd47480 x1830949051917568/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:482/0 lens 488/4536 e 0 to 0 dl 1746129752 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129741.590574:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd47480 with x1830949051917568 ext(2899968->2904063) 00002000:00010000:1.0:1746129741.590576:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd47480 00000100:00100000:0.0:1746129741.594267:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.635643:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.635693:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.636046:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051917952 00000100:00100000:1.0:1746129741.636054:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051917952 00000100:00100000:1.0:1746129741.636823:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051918080 00000100:00100000:1.0:1746129741.636827:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051918080 00000100:00100000:1.0:1746129741.636881:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10145 00000100:00100000:1.0:1746129741.636888:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949051917952:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129741.636904:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129741.636919:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800919ec600/0x48868a4e43947a46 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e652 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129741.636967:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5493b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053187968:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129741.637069:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10146 00000100:00100000:0.0:1746129741.637077:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949051918080:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129741.637083:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129741.637090:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be5ee00/0x48868a4e43947a4d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e659 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129741.637111:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd46300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053188096:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129741.637176:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129741.637219:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135d2c840 going to sleep for 11 seconds 00002000:00010000:1.0:1746129741.639491:0:8435:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime: 1746129741 -> 1746129742 00002000:00010000:1.0:1746129741.639494:0:8435:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime: 1746129741 -> 1746129742 00000100:00100000:1.0:1746129741.639504:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5493b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053187968:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129741.639518:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800919ec600/0x48868a4e43947a46 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e652 expref: 13 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129741.639527:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800919ec600/0x48868a4e43947a46 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e652 expref: 13 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129741.639549:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919ec600, rc 0) 00000100:00100000:1.0:1746129741.639809:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949051917952:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2920us (4171us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129741.639815:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10145 00000100:00100000:0.0:1746129741.645150:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.664043:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.664246:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051918592 00000100:00100000:1.0:1746129741.664255:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051918592 00000100:00100000:1.0:1746129741.664762:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9715 00000100:00100000:1.0:1746129741.664769:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:28307:x1830949051918592:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129741.664788:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129741.664804:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eca00/0x48868a4e43947a54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e660 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.665251:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e43947a5b lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.665265:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e43947a5b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.665273:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e43947a5b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:1.0:1746129741.665281:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129741.665363:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eca00/0x48868a4e43947a54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e660 expref: 291 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.665771:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e43947a5b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e660 expref: 290 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.665779:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129741.665781:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746129741.665783:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919ec000, rc 0) 00000100:00100000:1.0:1746129741.666412:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:28307:x1830949051918592:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1642us (2375us total) trans 8589943477 rc 0/0 00000100:00100000:1.0:1746129741.666418:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9715 00000100:00100000:0.0:1746129741.666983:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.667043:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051918720 00000100:00100000:1.0:1746129741.667048:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051918720 00000100:00100000:1.0:1746129741.667080:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10147 00000100:00100000:1.0:1746129741.667086:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28304:x1830949051918720:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129741.667096:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129741.667106:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800919ed600/0x48868a4e43947a69 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e667 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.667128:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801310ed000/0x48868a4e439479eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e61a expref: 19 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.667135:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129741.667136:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129741.667139:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800919ed600/0x48868a4e43947a69 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e667 expref: 13 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.667160:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801310ed000/0x48868a4e439479eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e61a expref: 19 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.667170:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801310ed000/0x48868a4e439479eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e61a expref: 19 pid: 7975 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746129741.667179:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5493b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053188224:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129741.667229:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129741.672328:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5493b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053188224:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129741.672356:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800919ed600/0x48868a4e43947a69 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e667 expref: 13 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.672371:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919ed600, rc 0) 00000100:00100000:1.0:1746129741.672688:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28304:x1830949051918720:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5599us (5703us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129741.672697:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10147 00000100:00100000:1.0:1746129741.673421:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051918848 00000100:00100000:1.0:1746129741.673427:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051918848 00000100:00100000:1.0:1746129741.673452:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10148 00000100:00100000:1.0:1746129741.673458:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949051918848:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129741.673471:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129741.673483:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800919ede00/0x48868a4e43947a70 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e66e expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129741.673518:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5493b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053188352:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129741.673576:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129741.673632:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051918976 00000100:00100000:3.0:1746129741.673636:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051918976 00002000:00100000:3.0:1746129741.673659:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (2076672->2097151) req@ffff88009468ea00 x1830949051918976/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/0 e 0 to 0 dl 1746129752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.673667:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468ea00 with x1830949051918976 ext(2076672->2097151) 00010000:00010000:3.0:1746129741.673673:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801310ed000/0x48868a4e439479eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e61a expref: 22 pid: 7975 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.673689:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801310ed000/0x48868a4e439479eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e61a expref: 22 pid: 7975 timeout: 787 lvb_type: 0 00002000:00010000:3.0:1746129741.673695:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009468ea00 00000100:00100000:3.0:1746129741.673707:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 502 00000100:00100000:3.0:1746129741.673713:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949051918976:12345-192.168.204.31@tcp:4:cat.0 00002000:00010000:1.0:1746129741.677132:0:8435:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime: 1746129741 -> 1746129742 00002000:00010000:1.0:1746129741.677139:0:8435:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746129741 -> 1746129742 00002000:00010000:1.0:1746129741.677141:0:8435:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime: 1746129741 -> 1746129742 00000100:00100000:1.0:1746129741.677162:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5493b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053188352:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129741.677190:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800919ede00/0x48868a4e43947a70 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e66e expref: 23 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129741.677203:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800919ede00/0x48868a4e43947a70 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e66e expref: 23 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129741.677217:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919ede00, rc 0) 00000100:00100000:1.0:1746129741.677252:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949051918848:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3792us (3996us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129741.677259:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10148 00000100:00100000:3.0:1746129741.677826:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949051918976:12345-192.168.204.31@tcp:4:cat.0 Request processed in 4112us (4462us total) trans 21474840126 rc 0/0 00000100:00100000:3.0:1746129741.677833:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 502 00002000:00100000:3.0:1746129741.677840:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (2076672->2097151) req@ffff88009468ea00 x1830949051918976/t21474840126(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/448 e 0 to 0 dl 1746129752 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.677872:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468ea00 with x1830949051918976 ext(2076672->2097151) 00010000:00010000:3.0:1746129741.677880:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801310ed000/0x48868a4e439479eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e61a expref: 22 pid: 7975 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.677891:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801310ed000/0x48868a4e439479eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e61a expref: 22 pid: 7975 timeout: 787 lvb_type: 0 00002000:00010000:3.0:1746129741.677897:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009468ea00 00000100:00100000:0.0:1746129741.680042:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.681401:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051919104 00000100:00100000:3.0:1746129741.681411:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051919104 00010000:00010000:3.0:1746129741.681445:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801310ed000/0x48868a4e439479eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e61a expref: 22 pid: 7975 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746129741.681488:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4883 00000100:00100000:3.0:1746129741.681495:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1ae8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949051919104:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129741.681507:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129741.681525:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801310ed000/0x48868a4e439479eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e61a expref: 22 pid: 7975 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.681535:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801310ed000/0x48868a4e439479eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e61a expref: 22 pid: 7975 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.681553:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801310ed000/0x48868a4e439479eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e61a expref: 22 pid: 7975 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.681593:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129741.681596:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129741.681603:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800919ed600/0x48868a4e43947a69 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e667 expref: 12 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.681610:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800919ed600/0x48868a4e43947a69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e667 expref: 12 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.681638:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800919ed600/0x48868a4e43947a69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e667 expref: 12 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129741.681650:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053188480:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129741.681732:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129741.684418:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.684836:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053188480:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129741.684873:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129741.685044:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1ae8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949051919104:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3548us (5007us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129741.685054:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4883 00000100:00100000:0.0:1746129741.685559:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.685667:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051919616 00000100:00100000:3.0:1746129741.685673:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051919616 00002000:00100000:3.0:1746129741.685703:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800a645e300 x1830949051919616/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/0 e 0 to 0 dl 1746129752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.685712:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645e300 with x1830949051919616 ext(0->1048575) 00002000:00010000:3.0:1746129741.685716:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a645e300 00000100:00100000:3.0:1746129741.685731:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3723 00000100:00100000:3.0:1746129741.685737:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949051919616:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129741.686867:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051919360 00000100:00100000:1.0:1746129741.686873:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051919360 00000100:00100000:1.0:1746129741.686914:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9716 00000100:00100000:1.0:1746129741.686920:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:28309:x1830949051919360:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129741.686933:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129741.686948:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec800/0x48868a4e43947a77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e675 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.687013:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e43947a7e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.687026:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a14c00/0x48868a4e439479a5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5f0 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.687033:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e439479cf lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e605 expref: 291 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.687039:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238000/0x48868a4e43947a31 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e644 expref: 11 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.687045:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e43947a7e lrc: 6/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.687069:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238000/0x48868a4e43947a31 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e644 expref: 11 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.687079:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238000/0x48868a4e43947a31 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e644 expref: 11 pid: 15044 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746129741.687089:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5493b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053188608:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129741.687144:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e439479cf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e605 expref: 291 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.687152:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e439479cf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e605 expref: 291 pid: 14315 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746129741.687158:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5490e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053188736:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129741.687178:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130a14c00/0x48868a4e439479a5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5f0 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.687184:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a14c00/0x48868a4e439479a5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5f0 expref: 11 pid: 14315 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746129741.687189:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5493480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053188864:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129741.687201:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129741.689193:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.689209:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051919872 00000100:00100000:0.0:1746129741.689214:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051919872 00002000:00100000:0.0:1746129741.689240:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800a645fb80 x1830949051919872/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:482/0 lens 488/0 e 0 to 0 dl 1746129752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129741.689248:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645fb80 with x1830949051919872 ext(1048576->2097151) 00002000:00010000:0.0:1746129741.689252:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645fb80 00000100:00100000:0.0:1746129741.690369:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3724 00000100:00100000:0.0:1746129741.690380:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949051919872:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129741.701468:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.701497:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.701521:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051920128 00000100:00100000:0.0:1746129741.701528:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051920128 00010000:00010000:0.0:1746129741.701557:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e439479cf lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e605 expref: 292 pid: 14315 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746129741.701675:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5493b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053188608:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129741.701685:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5490e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053188736:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129741.703322:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949051919616:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17580us (17759us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129741.703331:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3723 00002000:00100000:1.0:1746129741.703338:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800a645e300 x1830949051919616/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/440 e 0 to 0 dl 1746129752 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129741.703346:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645e300 with x1830949051919616 ext(0->1048575) 00002000:00010000:1.0:1746129741.703351:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a645e300 00000100:00100000:0.0:1746129741.703483:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051920000 00000100:00100000:0.0:1746129741.703489:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051920000 00010000:00010000:0.0:1746129741.703506:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238000/0x48868a4e43947a31 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e644 expref: 12 pid: 15044 timeout: 787 lvb_type: 0 00000100:00100000:0.0:1746129741.703523:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4884 00000100:00100000:0.0:1746129741.703529:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:1961:x1830949051920128:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129741.703539:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129741.703544:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e439479cf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e605 expref: 292 pid: 14315 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746129741.703557:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e439479cf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e605 expref: 292 pid: 14315 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746129741.703573:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e439479cf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e605 expref: 292 pid: 14315 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746129741.703596:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129741.703600:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e43947a7e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.703606:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e43947a7e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.703611:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129741.703626:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:1961:x1830949051920128:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 98us (2166us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129741.703630:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4884 00000100:00100000:0.0:1746129741.703640:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4885 00000100:00100000:0.0:1746129741.703645:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949051920000:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129741.703650:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129741.703653:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238000/0x48868a4e43947a31 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e644 expref: 12 pid: 15044 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746129741.703660:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238000/0x48868a4e43947a31 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e644 expref: 12 pid: 15044 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746129741.703670:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238000/0x48868a4e43947a31 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e644 expref: 12 pid: 15044 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746129741.703678:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129741.703680:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e43947a7e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.703684:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e43947a7e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.703688:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129741.703701:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949051920000:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 56us (2204us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129741.703706:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4885 00000100:00100000:0.0:1746129741.704956:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129741.705571:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a14c00/0x48868a4e439479a5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5f0 expref: 12 pid: 14315 timeout: 787 lvb_type: 0 00000100:00100000:0.0:1746129741.705668:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949051919872:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15290us (16479us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129741.705677:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3724 00002000:00100000:0.0:1746129741.705684:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800a645fb80 x1830949051919872/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:482/0 lens 488/440 e 0 to 0 dl 1746129752 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129741.705692:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645fb80 with x1830949051919872 ext(1048576->2097151) 00002000:00010000:0.0:1746129741.705696:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645fb80 00000100:00100000:1.0:1746129741.705897:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5493480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053188864:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129741.705918:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e43947a7e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.705926:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e43947a7e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129741.705931:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e43947a7e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:1.0:1746129741.705947:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129741.706051:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec800/0x48868a4e43947a77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e675 expref: 292 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.706063:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e43947a7e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e675 expref: 291 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.706069:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129741.706071:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129741.706073:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919ece00, rc 0) 00000100:00100000:1.0:1746129741.706095:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:28309:x1830949051919360:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 19175us (21684us total) trans 8589943478 rc 0/0 00000100:00100000:1.0:1746129741.706101:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9716 00000100:00100000:0.0:1746129741.718831:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.718902:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051920384 00000100:00100000:1.0:1746129741.718910:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051920384 00000100:00100000:1.0:1746129741.718962:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10149 00000100:00100000:1.0:1746129741.718969:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28304:x1830949051920384:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129741.718986:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129741.719001:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135bc9000/0x48868a4e43947a8c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e67c expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129741.719003:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129741.719024:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136920800/0x48868a4e43947a15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e63d expref: 20 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.719037:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129741.719038:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129741.719041:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135bc9000/0x48868a4e43947a8c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e67c expref: 14 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129741.719060:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129741.719066:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136920800/0x48868a4e43947a15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e63d expref: 20 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.719076:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136920800/0x48868a4e43947a15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e63d expref: 20 pid: 7975 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746129741.719086:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5493480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053188992:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129741.719103:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051920640 00000100:00100000:0.0:1746129741.719108:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051920640 00000100:00100000:0.0:1746129741.719141:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9717 00000100:00100000:0.0:1746129741.719148:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28311:x1830949051920640:12345-192.168.204.31@tcp:101:multiop.0 00000100:00100000:1.0:1746129741.719150:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584f00 going to sleep for 11 seconds 00010000:00010000:0.0:1746129741.719164:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129741.719178:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd84400/0x48868a4e43947a93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e683 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129741.719406:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051920768 00000100:00100000:3.0:1746129741.719410:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051920768 00000100:00100000:3.0:1746129741.719434:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10150 00000100:00100000:3.0:1746129741.719439:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:28307:x1830949051920768:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129741.719446:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129741.719453:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa5a00/0x48868a4e43947a9a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e68a expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.719464:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129741.719465:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129741.719471:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa5a00/0x48868a4e43947a9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e68a expref: 22 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.719482:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa5a00/0x48868a4e43947a9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e68a expref: 22 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.719491:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fa5a00, rc 0) 00010000:00010000:0.0:1746129741.721282:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85a00/0x48868a4e43947aa1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.721300:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85a00/0x48868a4e43947aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.721310:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85a00/0x48868a4e43947aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.721323:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85c00/0x48868a4e43947aa8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.721329:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85c00/0x48868a4e43947aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.721334:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85c00/0x48868a4e43947aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.721445:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85000/0x48868a4e43947aaf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.721454:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85000/0x48868a4e43947aaf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.721460:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85000/0x48868a4e43947aaf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:0.0:1746129741.721470:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129741.721557:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85a00/0x48868a4e43947aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.721569:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85a00/0x48868a4e43947aa1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.721575:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85a00/0x48868a4e43947aa1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.721590:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd85a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129741.721596:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85a00/0x48868a4e43947aa1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.721602:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85a00/0x48868a4e43947aa1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.721613:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:0.0:1746129741.721616:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129741.721619:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85a00/0x48868a4e43947aa1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.721624:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85a00/0x48868a4e43947aa1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.721644:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85c00/0x48868a4e43947aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.721649:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85c00/0x48868a4e43947aa8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.721653:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85c00/0x48868a4e43947aa8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.721657:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd85c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129741.721659:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85c00/0x48868a4e43947aa8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.721666:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85c00/0x48868a4e43947aa8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.721672:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f99bf00) 00010000:00010000:0.0:1746129741.721674:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129741.721676:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85c00/0x48868a4e43947aa8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.721681:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85c00/0x48868a4e43947aa8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.721757:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd84400/0x48868a4e43947a93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e683 expref: 14 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129741.721771:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85000/0x48868a4e43947aaf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e683 expref: 13 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129741.721777:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129741.721779:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746129741.721781:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd85000, rc 0) 00000100:00100000:3.0:1746129741.722012:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:28307:x1830949051920768:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2569us (2950us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129741.722019:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10150 00000100:00100000:0.0:1746129741.722700:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28311:x1830949051920640:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3549us (3695us total) trans 8589943479 rc 0/0 00000100:00100000:0.0:1746129741.722707:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9717 00000100:00100000:1.0:1746129741.724696:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5493480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053188992:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129741.724721:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135bc9000/0x48868a4e43947a8c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e67c expref: 14 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.724735:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bc9000, rc 0) 00000100:00100000:1.0:1746129741.724778:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28304:x1830949051920384:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5808us (5956us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129741.724785:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10149 00000100:00100000:1.0:1746129741.729937:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.730138:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.730356:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3725 00000100:00100000:0.0:1746129741.730364:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949051921024:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129741.737904:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.751895:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.751912:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051921536 00000100:00100000:0.0:1746129741.751918:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051921536 00000100:00100000:0.0:1746129741.751942:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9718 00000100:00100000:3.0:1746129741.752938:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949051921280:12345-192.168.204.31@tcp:3:cat.0 Request processed in 22553us (22796us total) trans 0 rc 823296/823296 00000100:00100000:3.0:1746129741.752945:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 503 00002000:00100000:3.0:1746129741.752951:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1273856->2097151) req@ffff8800a5490e00 x1830949051921280/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/440 e 0 to 0 dl 1746129752 ref 1 fl Complete:H/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.752959:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5490e00 with x1830949051921280 ext(1273856->2097151) 00010000:00010000:3.0:1746129741.752966:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136920800/0x48868a4e43947a15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e63d expref: 26 pid: 7975 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.752976:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136920800/0x48868a4e43947a15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e63d expref: 26 pid: 7975 timeout: 787 lvb_type: 0 00002000:00010000:3.0:1746129741.752982:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5490e00 00000100:00100000:0.0:1746129741.753032:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+11:28312:x1830949051921536:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129741.753050:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129741.753062:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bc8400/0x48868a4e43947abd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e691 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129741.753105:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bc9200/0x48868a4e43947ac4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.753115:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bc9200/0x48868a4e43947ac4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.753123:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bc9200/0x48868a4e43947ac4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.753132:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bc9400/0x48868a4e43947acb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.753136:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bc9400/0x48868a4e43947acb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.753141:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bc9400/0x48868a4e43947acb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.753210:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bc8800/0x48868a4e43947ad2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.753217:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e43947a7e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e675 expref: 290 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129741.753222:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bc8800/0x48868a4e43947ad2 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129741.753248:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e43947a7e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e675 expref: 290 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129741.753256:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e43947a7e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e675 expref: 290 pid: 14315 timeout: 787 lvb_type: 0 00000100:00100000:0.0:1746129741.753265:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053189120:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129741.753308:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135d2c840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129741.757113:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.759078:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051921664 00000100:00100000:1.0:1746129741.759087:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051921664 00000100:00100000:1.0:1746129741.759136:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10151 00000100:00100000:1.0:1746129741.759143:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28311:x1830949051921664:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129741.759346:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129741.759362:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef400/0x48868a4e43947ad9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e698 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.759388:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb20400/0x48868a4e439477b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4d1 expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129741.759396:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800919edc00/0x48868a4e43947871 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e51e expref: 13 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.759403:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ffbc200/0x48868a4e4394786a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e510 expref: 27 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.759409:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129741.759411:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129741.759414:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef400/0x48868a4e43947ad9 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [798720->1048575] (req 798720->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e698 expref: 13 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.759890:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ffbc200/0x48868a4e4394786a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e510 expref: 27 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.759904:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ffbc200/0x48868a4e4394786a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e510 expref: 27 pid: 1877 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746129741.759915:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5493b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053189248:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129741.759990:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800919edc00/0x48868a4e43947871 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e51e expref: 13 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.759998:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800919edc00/0x48868a4e43947871 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e51e expref: 13 pid: 3623 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746129741.760005:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053189376:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129741.760026:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb20400/0x48868a4e439477b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4d1 expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129741.760033:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bb20400/0x48868a4e439477b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4d1 expref: 11 pid: 20441 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746129741.760040:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5490000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053189504:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129741.760056:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129741.760253:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053189120:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129741.760274:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135bc8800/0x48868a4e43947ad2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:3.0:1746129741.763230:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949051921024:12345-192.168.204.31@tcp:3:cat.0 Request processed in 32851us (33367us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129741.763245:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3725 00002000:00100000:3.0:1746129741.763261:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800a5493480 x1830949051921024/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/440 e 0 to 0 dl 1746129752 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.763270:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5493480 with x1830949051921024 ext(1048576->2097151) 00002000:00010000:3.0:1746129741.763275:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5493480 00000100:00100000:0.0:1746129741.772733:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.774648:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.775178:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4888 00000100:00100000:3.0:1746129741.775187:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949051921792:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129741.775197:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129741.775217:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136920800/0x48868a4e43947a15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e63d expref: 24 pid: 7975 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.775226:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136920800/0x48868a4e43947a15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e63d expref: 24 pid: 7975 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.775240:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136920800/0x48868a4e43947a15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e63d expref: 24 pid: 7975 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.775259:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129741.775261:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129741.775269:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135bc9000/0x48868a4e43947a8c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e67c expref: 13 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.775277:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135bc9000/0x48868a4e43947a8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e67c expref: 13 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.775310:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135bc9000/0x48868a4e43947a8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e67c expref: 13 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129741.775326:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053189632:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129741.775395:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f480 going to sleep for 11 seconds 00000100:00100000:3.0:1746129741.777473:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.777572:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5493b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053189248:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129741.777598:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053189376:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129741.785400:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.786256:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5490000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053189504:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129741.786283:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef400/0x48868a4e43947ad9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [798720->1048575] (req 798720->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e698 expref: 13 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.786292:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4cef400, rc 0) 00000100:00100000:1.0:1746129741.788303:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.788331:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.788377:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.788549:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28311:x1830949051921664:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 29404us (31443us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129741.788558:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10151 00000100:00100000:3.0:1746129741.788590:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051922432 00000100:00100000:3.0:1746129741.788595:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051922432 00000100:00100000:3.0:1746129741.790081:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051922560 00000100:00100000:3.0:1746129741.790089:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051922560 00000100:00100000:3.0:1746129741.790122:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10152 00000100:00100000:3.0:1746129741.790131:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:28307:x1830949051922432:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129741.790148:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129741.790165:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa5600/0x48868a4e43947ae0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e69f expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.790189:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129741.790192:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129741.790200:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa5600/0x48868a4e43947ae0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e69f expref: 25 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.790214:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa5600/0x48868a4e43947ae0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e69f expref: 25 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.790225:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fa5600, rc 0) 00000100:00100000:3.0:1746129741.790270:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:28307:x1830949051922432:12345-192.168.204.31@tcp:101:cat.0 Request processed in 139us (1935us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129741.790275:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10152 00000100:00100000:3.0:1746129741.790294:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10153 00000100:00100000:3.0:1746129741.790301:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949051922560:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129741.790310:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129741.790321:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8fa5800/0x48868a4e43947ae7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e6a6 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.790333:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129741.790343:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8fa5800/0x48868a4e43947ae7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6a6 expref: 13 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129741.790352:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fa5800/0x48868a4e43947ae7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6a6 expref: 13 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129741.793560:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fa5800, rc 0) 00000100:00100000:3.0:1746129741.794004:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949051922560:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3699us (5621us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129741.794014:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10153 00000100:00100000:3.0:1746129741.794055:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053189632:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129741.794066:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129741.794082:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949051921792:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 18898us (19442us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129741.794087:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4888 00000100:00100000:0.0:1746129741.812954:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.814660:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053189760:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129741.814679:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129741.814724:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949051922304:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 24173us (26424us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129741.814737:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4891 00000100:00100000:0.0:1746129741.820169:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.820273:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051923712 00000100:00100000:3.0:1746129741.820281:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051923712 00002000:00100000:3.0:1746129741.820312:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (798720->802815) req@ffff8800a645ea00 x1830949051923712/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:482/0 lens 488/0 e 0 to 0 dl 1746129752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.820321:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645ea00 with x1830949051923712 ext(798720->802815) 00002000:00010000:3.0:1746129741.820326:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a645ea00 00000100:00100000:3.0:1746129741.820344:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3728 00000100:00100000:3.0:1746129741.820349:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949051923712:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129741.820472:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949051923712:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 122us (311us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129741.820478:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3728 00002000:00100000:3.0:1746129741.820482:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (798720->802815) req@ffff8800a645ea00 x1830949051923712/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:482/0 lens 488/4536 e 0 to 0 dl 1746129752 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.820493:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645ea00 with x1830949051923712 ext(798720->802815) 00002000:00010000:3.0:1746129741.820496:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a645ea00 00000100:00100000:0.0:1746129741.828252:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.828291:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.828539:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051924096 00000100:00100000:3.0:1746129741.828543:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051924096 00000100:00100000:3.0:1746129741.828563:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10157 00000100:00100000:3.0:1746129741.828567:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28311:x1830949051924096:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129741.828575:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129741.828593:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013186ea00/0x48868a4e43947b11 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e6c9 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.828608:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800919ed600/0x48868a4e43947a69 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e667 expref: 15 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.828615:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095328200/0x48868a4e43947af5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6ad expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129741.828620:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa5a00/0x48868a4e43947a9a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e68a expref: 23 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.828625:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129741.828626:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129741.828629:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013186ea00/0x48868a4e43947b11 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->1155071] (req 1048576->1155071) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6c9 expref: 15 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.828641:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa5a00/0x48868a4e43947a9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e68a expref: 23 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.828652:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa5a00/0x48868a4e43947a9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e68a expref: 23 pid: 3623 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746129741.828660:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053190144:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129741.829067:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095328200/0x48868a4e43947af5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6ad expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129741.829075:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095328200/0x48868a4e43947af5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6ad expref: 10 pid: 3624 timeout: 787 lvb_type: 1 00000100:00100000:3.0:1746129741.829082:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053190272:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129741.829395:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800919ed600/0x48868a4e43947a69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e667 expref: 15 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129741.829402:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800919ed600/0x48868a4e43947a69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e667 expref: 15 pid: 8435 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746129741.829409:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053190400:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129741.829423:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129741.833677:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.833757:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.836530:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3730 00000100:00100000:3.0:1746129741.836539:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949051924608:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129741.836843:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053190144:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129741.837272:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053190272:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129741.837280:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053190400:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129741.837296:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013186ea00/0x48868a4e43947b11 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->1155071] (req 1048576->1155071) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6c9 expref: 18 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129741.837309:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013186ea00, rc 0) 00000100:00100000:0.0:1746129741.837340:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28311:x1830949051924096:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 8773us (9096us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129741.837346:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10157 00000100:00100000:0.0:1746129741.837415:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.837457:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.843068:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.843109:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.843262:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051925120 00000100:00100000:3.0:1746129741.843267:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051925120 00010000:00010000:3.0:1746129741.843286:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa5a00/0x48868a4e43947a9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e68a expref: 24 pid: 3623 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746129741.843308:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4895 00000100:00100000:3.0:1746129741.843315:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1964:x1830949051925120:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129741.843323:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129741.843343:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa5a00/0x48868a4e43947a9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e68a expref: 24 pid: 3623 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.843353:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa5a00/0x48868a4e43947a9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e68a expref: 24 pid: 3623 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.843371:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa5a00/0x48868a4e43947a9a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e68a expref: 24 pid: 3623 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.843388:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129741.843440:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949051925120:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 125us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129741.843445:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4895 00000100:00100000:0.0:1746129741.853186:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.853270:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.853302:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.853329:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051925504 00000100:00100000:1.0:1746129741.853337:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051925504 00000100:00100000:1.0:1746129741.853375:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10158 00000100:00100000:1.0:1746129741.853382:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:28309:x1830949051925504:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129741.853396:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129741.853416:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800919eca00/0x48868a4e43947b1f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e6d0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.853438:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fe28800/0x48868a4e43947a3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2785280->2904063) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e64b expref: 15 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.853444:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129741.853445:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129741.853448:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800919eca00/0x48868a4e43947b1f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3342336->4128767] (req 3342336->4128767) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6d0 expref: 24 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.853472:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fe28800/0x48868a4e43947a3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2785280->2904063) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e64b expref: 15 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.853483:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fe28800/0x48868a4e43947a3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2785280->2904063) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e64b expref: 15 pid: 7975 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746129741.853493:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5490000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053190656:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129741.853553:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129741.854052:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949051924608:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17514us (20293us total) trans 0 rc 929792/929792 00000100:00100000:3.0:1746129741.854059:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3730 00002000:00100000:3.0:1746129741.854065:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (3264512->4194303) req@ffff8800a645c000 x1830949051924608/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:482/0 lens 488/440 e 0 to 0 dl 1746129752 ref 1 fl Complete:/200/0 rc 929792/929792 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.855285:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645c000 with x1830949051924608 ext(3264512->4194303) 00010000:00010000:3.0:1746129741.855296:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fe28800/0x48868a4e43947a3f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2785280->2904063) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e64b expref: 14 pid: 7975 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.855307:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fe28800/0x48868a4e43947a3f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2785280->2904063) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e64b expref: 14 pid: 7975 timeout: 787 lvb_type: 0 00002000:00010000:3.0:1746129741.855312:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a645c000 00000100:00100000:1.0:1746129741.856358:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5490000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053190656:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129741.856380:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800919eca00/0x48868a4e43947b1f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3342336->4128767] (req 3342336->4128767) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6d0 expref: 24 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129741.856393:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919eca00, rc 0) 00000100:00100000:1.0:1746129741.856423:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:28309:x1830949051925504:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3041us (3152us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129741.856430:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10158 00000100:00100000:0.0:1746129741.858135:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.858196:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.858353:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051925888 00000100:00100000:3.0:1746129741.858359:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051925888 00010000:00010000:3.0:1746129741.858382:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093beec00/0x48868a4e43947b0a lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6c2 expref: 15 pid: 14315 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746129741.858401:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4896 00000100:00100000:3.0:1746129741.858407:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+15:1963:x1830949051925888:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129741.858417:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129741.858422:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093beec00/0x48868a4e43947b0a lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6c2 expref: 15 pid: 14315 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.858430:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093beec00/0x48868a4e43947b0a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6c2 expref: 15 pid: 14315 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.858447:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129741.858450:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef600/0x48868a4e43947b2d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129741.858457:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef600/0x48868a4e43947b2d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129741.858462:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef600/0x48868a4e43947b2d lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129741.858477:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129741.858513:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+15:1963:x1830949051925888:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 105us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129741.858518:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4896 00000100:00100000:3.0:1746129741.858541:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051926144 00000100:00100000:3.0:1746129741.858543:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051926144 00002000:00100000:3.0:1746129741.858565:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a55a5c00 x1830949051926144/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/0 e 0 to 0 dl 1746129752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.858572:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a5c00 with x1830949051926144 ext(2097152->3145727) 00002000:00010000:3.0:1746129741.858576:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a55a5c00 00000100:00100000:3.0:1746129741.858595:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3732 00000100:00100000:3.0:1746129741.858599:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949051926144:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129741.859591:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.860100:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.860976:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051925760 00000100:00100000:3.0:1746129741.860983:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051925760 00002000:00100000:3.0:1746129741.861007:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2785280->2904063) req@ffff8800a55a7100 x1830949051925760/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:482/0 lens 488/0 e 0 to 0 dl 1746129752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.861015:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a7100 with x1830949051925760 ext(2785280->2904063) 00010000:00010000:3.0:1746129741.861022:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fe28800/0x48868a4e43947a3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2785280->2904063) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e64b expref: 14 pid: 7975 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.861034:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fe28800/0x48868a4e43947a3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2785280->2904063) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e64b expref: 14 pid: 7975 timeout: 787 lvb_type: 0 00002000:00010000:3.0:1746129741.861039:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a55a7100 00000100:00100000:3.0:1746129741.861052:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 505 00000100:00100000:3.0:1746129741.861060:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949051925760:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129741.863725:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.863946:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.863974:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.864002:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.864018:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051926528 00000100:00100000:0.0:1746129741.864023:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051926528 00000100:00100000:0.0:1746129741.864049:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051926656 00000100:00100000:0.0:1746129741.864051:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051926656 00000100:00100000:0.0:1746129741.864061:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051926912 00000100:00100000:0.0:1746129741.864062:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051926912 00000100:00100000:0.0:1746129741.864070:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051926784 00000100:00100000:0.0:1746129741.864072:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051926784 00000100:00100000:0.0:1746129741.864082:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10159 00000100:00100000:0.0:1746129741.864087:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1963:x1830949051926528:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129741.864100:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129741.864113:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135bc8c00/0x48868a4e43947b34 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e6de expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129741.864151:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053190912:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129741.864202:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135d2c480 going to sleep for 11 seconds 00000100:00100000:3.0:1746129741.869553:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949051925760:12345-192.168.204.31@tcp:4:cat.0 Request processed in 8487us (9447us total) trans 21474840128 rc 0/0 00000100:00100000:3.0:1746129741.869563:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 505 00002000:00100000:3.0:1746129741.869571:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2785280->2904063) req@ffff8800a55a7100 x1830949051925760/t21474840128(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:482/0 lens 488/448 e 0 to 0 dl 1746129752 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.869589:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a7100 with x1830949051925760 ext(2785280->2904063) 00010000:00010000:3.0:1746129741.869598:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fe28800/0x48868a4e43947a3f lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2785280->2904063) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e64b expref: 18 pid: 7975 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746129741.869610:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fe28800/0x48868a4e43947a3f lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2785280->2904063) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e64b expref: 18 pid: 7975 timeout: 787 lvb_type: 0 00002000:00010000:3.0:1746129741.869617:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a55a7100 00002000:00010000:3.0:1746129741.873604:0:1877:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime: 1746129741 -> 1746129742 00002000:00010000:3.0:1746129741.873610:0:1877:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime: 1746129741 -> 1746129742 00002000:00010000:3.0:1746129741.873612:0:1877:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime: 1746129741 -> 1746129742 00000100:00100000:3.0:1746129741.873632:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c041f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053191040:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129741.873659:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8fa5a00/0x48868a4e43947b3b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6e5 expref: 12 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129741.873672:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fa5a00/0x48868a4e43947b3b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6e5 expref: 12 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129741.873687:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fa5a00, rc 0) 00000100:00100000:3.0:1746129741.873744:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949051926656:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 9452us (9796us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129741.873750:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10160 00000100:00100000:0.0:1746129741.876629:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.881461:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.881488:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.881502:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.881546:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.888439:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c041c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053191680:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129741.888462:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a12be00/0x48868a4e43947b57 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e708 expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129741.888474:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a12be00/0x48868a4e43947b57 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e708 expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129741.888498:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a12be00, rc 0) 00000100:00100000:3.0:1746129741.888534:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1964:x1830949051927552:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5820us (7031us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129741.888540:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10164 00000100:00100000:0.0:1746129741.888731:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c040700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053191552:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129741.888745:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5244200/0x48868a4e43947b50 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e701 expref: 25 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129741.888756:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5244200, rc 0) 00000100:00100000:0.0:1746129741.888777:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:28307:x1830949051927424:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6261us (7289us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129741.888782:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10163 00000100:00100000:0.0:1746129741.892062:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.898986:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129741.899259:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c040700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053191808:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129741.899286:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094fd9200/0x48868a4e43947b6c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e70f expref: 16 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129741.899299:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094fd9200/0x48868a4e43947b6c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e70f expref: 16 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129741.899311:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fd9200, rc 0) 00000100:00100000:3.0:1746129741.899350:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1963:x1830949051928192:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6455us (7294us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129741.899358:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10165 00000100:00100000:0.0:1746129741.908066:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.908110:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.908188:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051928960 00000100:00100000:1.0:1746129741.908195:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051928960 00002000:00100000:1.0:1746129741.908233:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (3342336->4128767) req@ffff8800a55a7b80 x1830949051928960/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/0 e 0 to 0 dl 1746129752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129741.908242:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a7b80 with x1830949051928960 ext(3342336->4128767) 00010000:00010000:1.0:1746129741.908249:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800919eca00/0x48868a4e43947b1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6d0 expref: 25 pid: 7975 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129741.908261:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800919eca00/0x48868a4e43947b1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6d0 expref: 25 pid: 7975 timeout: 787 lvb_type: 0 00002000:00010000:1.0:1746129741.908268:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a55a7b80 00000100:00100000:1.0:1746129741.908300:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 508 00000100:00100000:1.0:1746129741.908307:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949051928960:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:1.0:1746129741.940781:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949051928960:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 32466us (32661us total) trans 21474840129 rc 0/0 00000100:00100000:1.0:1746129741.940793:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 508 00002000:00100000:1.0:1746129741.940803:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (3342336->4128767) req@ffff8800a55a7b80 x1830949051928960/t21474840129(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/448 e 0 to 0 dl 1746129752 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129741.940811:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a7b80 with x1830949051928960 ext(3342336->4128767) 00010000:00010000:1.0:1746129741.940820:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800919eca00/0x48868a4e43947b1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6d0 expref: 27 pid: 7975 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746129741.940832:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800919eca00/0x48868a4e43947b1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6d0 expref: 27 pid: 7975 timeout: 787 lvb_type: 0 00002000:00010000:1.0:1746129741.940839:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a55a7b80 00000100:00100000:0.0:1746129741.945987:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.965037:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129741.965085:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.965143:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051929344 00000100:00100000:1.0:1746129741.965151:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051929344 00000100:00100000:3.0:1746129741.965159:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051929600 00000100:00100000:3.0:1746129741.965162:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051929600 00002000:00100000:3.0:1746129741.965184:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880136318e00 x1830949051929600/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/0 e 0 to 0 dl 1746129752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129741.965184:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88013631a680 x1830949051929344/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/0 e 0 to 0 dl 1746129752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.965192:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136318e00 with x1830949051929600 ext(3145728->4194303) 00002000:00100000:1.0:1746129741.965192:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631a680 with x1830949051929344 ext(2097152->3145727) 00002000:00010000:3.0:1746129741.965197:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136318e00 00002000:00010000:1.0:1746129741.965197:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013631a680 00000100:00100000:3.0:1746129741.965246:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3733 00000100:00100000:3.0:1746129741.965253:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949051929600:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129741.965812:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3734 00000100:00100000:1.0:1746129741.965819:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949051929344:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129741.982523:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949051929344:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 16695us (17483us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129741.982535:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3734 00002000:00100000:1.0:1746129741.982546:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88013631a680 x1830949051929344/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/440 e 0 to 0 dl 1746129752 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129741.982555:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631a680 with x1830949051929344 ext(2097152->3145727) 00002000:00010000:1.0:1746129741.982560:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013631a680 00000100:00100000:3.0:1746129741.983803:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949051929600:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 18546us (18713us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129741.983810:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3733 00002000:00100000:3.0:1746129741.983816:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880136318e00 x1830949051929600/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:482/0 lens 488/440 e 0 to 0 dl 1746129752 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129741.983824:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136318e00 with x1830949051929600 ext(3145728->4194303) 00002000:00010000:3.0:1746129741.983827:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136318e00 00000100:00100000:3.0:1746129741.990466:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051929856 00000100:00100000:3.0:1746129741.990474:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051929856 00000100:00100000:3.0:1746129741.990515:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051929728 00000100:00100000:3.0:1746129741.990518:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051929728 00000100:00100000:3.0:1746129741.990541:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10166 00000100:00100000:3.0:1746129741.990548:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949051929856:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129741.990563:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129741.990585:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013186fe00/0x48868a4e43947b73 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e71d expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129741.990592:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10167 00000100:00100000:1.0:1746129741.990598:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949051929728:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129741.990605:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129741.990614:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4a7e600/0x48868a4e43947b7a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e716 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129741.990626:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053192064:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129741.990633:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053192192:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129741.990690:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129741.990750:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129741.994179:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053192192:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129741.994208:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a7e600/0x48868a4e43947b7a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e716 expref: 28 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129741.994219:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a7e600/0x48868a4e43947b7a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e716 expref: 28 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129741.994245:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a7e600, rc 0) 00000100:00100000:1.0:1746129741.994289:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949051929728:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3690us (3912us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129741.994297:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10167 00000100:00100000:1.0:1746129741.994362:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053192064:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129741.994377:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013186fe00/0x48868a4e43947b73 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e71d expref: 27 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129741.994386:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013186fe00/0x48868a4e43947b73 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e71d expref: 27 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129741.994394:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013186fe00, rc 0) 00000100:00100000:1.0:1746129741.994411:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949051929856:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3863us (4090us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129741.994420:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10166 00000100:00100000:0.0:1746129741.997940:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129741.998083:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051929984 00000100:00100000:1.0:1746129741.998090:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051929984 00000100:00100000:1.0:1746129741.998135:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10168 00000100:00100000:1.0:1746129741.998142:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949051929984:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129741.998155:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129741.998168:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4a7ec00/0x48868a4e43947b81 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e724 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129741.998207:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053192320:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129741.998276:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129742.000591:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053192320:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129742.000607:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a7ec00/0x48868a4e43947b81 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e724 expref: 28 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.000708:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a7ec00/0x48868a4e43947b81 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e724 expref: 28 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.000717:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a7ec00, rc 0) 00000100:00100000:1.0:1746129742.000733:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949051929984:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2592us (2801us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129742.000737:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10168 00000100:00100000:0.0:1746129742.003306:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.003351:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.003608:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051930240 00000100:00100000:1.0:1746129742.003614:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051930240 00000100:00100000:1.0:1746129742.003678:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10170 00000100:00100000:1.0:1746129742.003685:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949051930240:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129742.003699:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129742.003711:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4a7ee00/0x48868a4e43947b8f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e732 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129742.003749:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053192704:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129742.003996:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129742.007768:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053192704:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129742.007796:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a7ee00/0x48868a4e43947b8f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e732 expref: 28 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.007808:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a7ee00/0x48868a4e43947b8f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e732 expref: 28 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.007819:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a7ee00, rc 0) 00000100:00100000:1.0:1746129742.007883:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949051930240:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4197us (4530us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129742.007894:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10170 00010000:00010000:1.0:1746129742.009119:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129742.040001:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.078486:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.086544:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.091237:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.092940:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051931136 00000100:00100000:3.0:1746129742.092975:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051931136 00002000:00100000:3.0:1746129742.093010:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2744320->2748415) req@ffff88013631b800 x1830949051931136/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.093019:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631b800 with x1830949051931136 ext(2744320->2748415) 00002000:00010000:3.0:1746129742.093024:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013631b800 00000100:00100000:3.0:1746129742.093053:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3735 00000100:00100000:3.0:1746129742.093089:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949051931136:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129742.093391:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949051931136:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 331us (2157us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129742.093397:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3735 00002000:00100000:3.0:1746129742.093403:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2744320->2748415) req@ffff88013631b800 x1830949051931136/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/4536 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.093410:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631b800 with x1830949051931136 ext(2744320->2748415) 00002000:00010000:3.0:1746129742.093413:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013631b800 00000100:00100000:0.0:1746129742.100955:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.101533:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.101556:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051931520 00000100:00100000:0.0:1746129742.101559:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051931520 00000100:00100000:0.0:1746129742.101594:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10173 00000100:00100000:0.0:1746129742.101599:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:28319:x1830949051931520:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129742.101607:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129742.101617:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135bc8c00/0x48868a4e43947bdc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e755 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.101634:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801310ec000/0x48868a4e43947943 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5b8 expref: 11 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.101641:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099ccb400/0x48868a4e43947982 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5e2 expref: 28 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.101648:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099ccb200/0x48868a4e4394797b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5db expref: 10 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129742.101653:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.101661:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.101664:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bc8c00/0x48868a4e43947bdc lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->3227647] (req 3145728->3227647) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e755 expref: 28 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.101732:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099ccb200/0x48868a4e4394797b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5db expref: 10 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129742.101746:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099ccb200/0x48868a4e4394797b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5db expref: 10 pid: 1877 timeout: 788 lvb_type: 1 00000100:00100000:3.0:1746129742.101757:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053193088:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129742.101838:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099ccb400/0x48868a4e43947982 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5e2 expref: 28 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.101864:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099ccb400/0x48868a4e43947982 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5e2 expref: 28 pid: 7975 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.101872:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053193216:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129742.101906:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801310ec000/0x48868a4e43947943 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5b8 expref: 11 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.101913:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801310ec000/0x48868a4e43947943 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5b8 expref: 11 pid: 20441 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.101920:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053193344:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129742.101942:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129742.107621:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.107791:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053193088:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129742.107801:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053193216:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129742.107808:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053193344:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129742.107830:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135bc8c00/0x48868a4e43947bdc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->3227647] (req 3145728->3227647) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e755 expref: 28 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.107844:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bc8c00, rc 0) 00000100:00100000:0.0:1746129742.108043:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051931648 00000100:00100000:0.0:1746129742.108049:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051931648 00010000:00010000:0.0:1746129742.108072:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099ccb200/0x48868a4e4394797b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5db expref: 11 pid: 1877 timeout: 788 lvb_type: 1 00000100:00100000:0.0:1746129742.108100:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4900 00000100:00100000:0.0:1746129742.108107:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949051931648:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129742.108117:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129742.108135:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099ccb200/0x48868a4e4394797b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5db expref: 11 pid: 1877 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746129742.108145:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099ccb200/0x48868a4e4394797b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5db expref: 11 pid: 1877 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746129742.108162:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099ccb200/0x48868a4e4394797b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5db expref: 11 pid: 1877 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746129742.108175:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129742.109402:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:28319:x1830949051931520:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 7795us (7861us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.109410:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10173 00000100:00100000:0.0:1746129742.109480:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+10:1964:x1830949051931648:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1370us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.109487:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4900 00000100:00100000:0.0:1746129742.110428:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.110471:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051931904 00000100:00100000:3.0:1746129742.110477:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051931904 00010000:00010000:3.0:1746129742.110498:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099ccb400/0x48868a4e43947982 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5e2 expref: 28 pid: 7975 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.110531:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4901 00000100:00100000:3.0:1746129742.110536:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1964:x1830949051931904:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129742.110546:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129742.110562:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099ccb400/0x48868a4e43947982 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5e2 expref: 28 pid: 7975 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.110583:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099ccb400/0x48868a4e43947982 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5e2 expref: 28 pid: 7975 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.110599:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099ccb400/0x48868a4e43947982 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5e2 expref: 28 pid: 7975 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.111235:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129742.111312:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949051931904:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 774us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.111318:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4901 00000100:00100000:0.0:1746129742.114422:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.114762:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051931776 00000100:00100000:3.0:1746129742.114770:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051931776 00010000:00010000:3.0:1746129742.114796:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801310ec000/0x48868a4e43947943 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5b8 expref: 12 pid: 20441 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.114832:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4902 00000100:00100000:3.0:1746129742.114839:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949051931776:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129742.114873:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129742.114892:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801310ec000/0x48868a4e43947943 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5b8 expref: 12 pid: 20441 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.114903:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801310ec000/0x48868a4e43947943 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5b8 expref: 12 pid: 20441 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.114922:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801310ec000/0x48868a4e43947943 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e5b8 expref: 12 pid: 20441 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.114936:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129742.114938:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129742.114944:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bc8c00/0x48868a4e43947bdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e755 expref: 26 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.114951:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bc8c00/0x48868a4e43947bdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e755 expref: 26 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.114979:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135bc8c00/0x48868a4e43947bdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e755 expref: 26 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129742.114989:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053193472:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129742.115071:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f180 going to sleep for 11 seconds 00000100:00100000:3.0:1746129742.116565:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053193472:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129742.116589:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129742.117283:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949051931776:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2441us (2866us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.117296:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4902 00000100:00100000:0.0:1746129742.120492:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.120550:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051932160 00000100:00100000:3.0:1746129742.120558:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051932160 00002000:00100000:3.0:1746129742.120606:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3223552->3227647) req@ffff88013631aa00 x1830949051932160/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.120615:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631aa00 with x1830949051932160 ext(3223552->3227647) 00002000:00010000:3.0:1746129742.120620:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013631aa00 00000100:00100000:3.0:1746129742.120647:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3736 00000100:00100000:3.0:1746129742.120655:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949051932160:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129742.120880:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949051932160:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 225us (394us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129742.120885:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3736 00002000:00100000:3.0:1746129742.120891:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3223552->3227647) req@ffff88013631aa00 x1830949051932160/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/4536 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.120896:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631aa00 with x1830949051932160 ext(3223552->3227647) 00002000:00010000:3.0:1746129742.120899:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013631aa00 00000100:00100000:0.0:1746129742.130137:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.130495:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051932416 00000100:00100000:3.0:1746129742.130503:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051932416 00000100:00100000:3.0:1746129742.130555:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3785 00000100:00100000:3.0:1746129742.130563:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:28319:x1830949051932416:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129742.130757:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:28319:x1830949051932416:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 194us (627us total) trans 8589943486 rc 0/0 00000100:00100000:3.0:1746129742.130764:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3785 00000100:00100000:0.0:1746129742.131278:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.132091:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051932544 00000100:00100000:3.0:1746129742.132097:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051932544 00000100:00100000:3.0:1746129742.132122:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10174 00000100:00100000:3.0:1746129742.132128:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949051932544:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129742.132138:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129742.132151:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013186f800/0x48868a4e43947bf1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e75c expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129742.132160:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.132191:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053193600:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129742.132243:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129742.132316:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051932672 00000100:00100000:0.0:1746129742.132319:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051932672 00000100:00100000:0.0:1746129742.132348:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10175 00000100:00100000:0.0:1746129742.132353:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1964:x1830949051932672:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129742.132360:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129742.132368:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135bc8200/0x48868a4e43947bf8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e763 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129742.132414:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053193728:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129742.132436:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135d2c240 going to sleep for 11 seconds 00002000:00010000:3.0:1746129742.133055:0:20441:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime: 1746129741 -> 1746129742 00002000:00010000:3.0:1746129742.133058:0:20441:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime: 1746129741 -> 1746129742 00002000:00010000:3.0:1746129742.133060:0:20441:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime: 1746129741 -> 1746129742 00000100:00100000:3.0:1746129742.133074:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053193600:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129742.133089:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013186f800/0x48868a4e43947bf1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e75c expref: 12 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129742.133099:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013186f800/0x48868a4e43947bf1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e75c expref: 12 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129742.133106:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013186f800, rc 0) 00000100:00100000:3.0:1746129742.133139:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949051932544:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1010us (1862us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129742.133145:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10174 00000100:00100000:1.0:1746129742.135786:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053193728:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129742.135813:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135bc8200/0x48868a4e43947bf8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e763 expref: 16 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.135825:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135bc8200/0x48868a4e43947bf8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e763 expref: 16 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.135870:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bc8200, rc 0) 00000100:00100000:1.0:1746129742.135924:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1964:x1830949051932672:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3569us (3762us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129742.135931:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10175 00000100:00100000:0.0:1746129742.137910:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.137952:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.138693:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051932800 00000100:00100000:1.0:1746129742.138702:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051932800 00000100:00100000:3.0:1746129742.138758:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051932928 00000100:00100000:3.0:1746129742.138763:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051932928 00000100:00100000:3.0:1746129742.138799:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10176 00000100:00100000:3.0:1746129742.138808:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949051932800:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129742.138825:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129742.138842:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013186fa00/0x48868a4e43947bff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e76a expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129742.138921:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053193856:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129742.138993:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129742.139055:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10177 00000100:00100000:0.0:1746129742.139063:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949051932928:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129742.139070:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129742.139079:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135bc9800/0x48868a4e43947c06 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e771 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129742.139101:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053193984:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129742.139121:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135d2c900 going to sleep for 11 seconds 00000100:00100000:3.0:1746129742.140987:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053193856:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129742.141001:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013186fa00/0x48868a4e43947bff lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e76a expref: 28 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129742.141010:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013186fa00/0x48868a4e43947bff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e76a expref: 28 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129742.141080:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013186fa00, rc 0) 00000100:00100000:3.0:1746129742.141102:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949051932800:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2296us (3198us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129742.141108:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10176 00000100:00100000:0.0:1746129742.142967:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.143325:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051933184 00000100:00100000:3.0:1746129742.143333:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051933184 00002000:00100000:3.0:1746129742.143373:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e8:0x0] (0->798719) req@ffff8800a504d500 x1830949051933184/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.143382:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504d500 with x1830949051933184 ext(0->798719) 00002000:00010000:3.0:1746129742.143387:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a504d500 00000100:00100000:3.0:1746129742.143417:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3737 00000100:00100000:3.0:1746129742.143424:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1963:x1830949051933184:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129742.148014:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.148052:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.148089:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051933440 00000100:00100000:0.0:1746129742.148097:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051933440 00002000:00100000:0.0:1746129742.148133:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e6:0x0] (1155072->2097151) req@ffff8800a504d180 x1830949051933440/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129742.148143:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504d180 with x1830949051933440 ext(1155072->2097151) 00002000:00010000:0.0:1746129742.148147:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504d180 00000100:00100000:0.0:1746129742.148171:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3738 00000100:00100000:0.0:1746129742.148178:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949051933440:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129742.148532:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051933568 00000100:00100000:3.0:1746129742.148537:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051933568 00000100:00100000:3.0:1746129742.148582:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10178 00000100:00100000:3.0:1746129742.148590:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:28328:x1830949051933568:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129742.148599:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129742.148614:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013186ec00/0x48868a4e43947c0d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e778 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.148634:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef400/0x48868a4e43947ad9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e698 expref: 12 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.148642:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129742.148643:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129742.148646:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013186ec00/0x48868a4e43947c0d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e778 expref: 28 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.148670:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef400/0x48868a4e43947ad9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e698 expref: 12 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.148681:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef400/0x48868a4e43947ad9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e698 expref: 12 pid: 8435 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.148691:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053194112:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129742.148759:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129742.151689:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1963:x1830949051933184:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8258us (8720us total) trans 0 rc 798720/798720 00000100:00100000:3.0:1746129742.151701:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3737 00002000:00100000:3.0:1746129742.151710:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e8:0x0] (0->798719) req@ffff8800a504d500 x1830949051933184/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/440 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 798720/798720 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.151719:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504d500 with x1830949051933184 ext(0->798719) 00010000:00010000:3.0:1746129742.151727:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef400/0x48868a4e43947ad9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e698 expref: 11 pid: 8435 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.151739:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef400/0x48868a4e43947ad9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e698 expref: 11 pid: 8435 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746129742.151745:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a504d500 00000100:00100000:3.0:1746129742.154934:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053194112:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129742.154957:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013186ec00/0x48868a4e43947c0d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e778 expref: 28 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.154972:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013186ec00, rc 0) 00000100:00100000:3.0:1746129742.155023:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:28328:x1830949051933568:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6433us (6970us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.155031:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10178 00000100:00100000:0.0:1746129742.155476:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.155548:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051933696 00000100:00100000:3.0:1746129742.155553:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051933696 00002000:00100000:3.0:1746129742.155590:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e8:0x0] (798720->1048575) req@ffff8800a504df80 x1830949051933696/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.155599:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504df80 with x1830949051933696 ext(798720->1048575) 00010000:00010000:3.0:1746129742.155606:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef400/0x48868a4e43947ad9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e698 expref: 11 pid: 8435 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.155617:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef400/0x48868a4e43947ad9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e698 expref: 11 pid: 8435 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746129742.155623:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a504df80 00000100:00100000:3.0:1746129742.155647:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 509 00000100:00100000:3.0:1746129742.155654:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949051933696:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129742.159598:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1964:x1830949051933696:12345-192.168.204.31@tcp:4:cat.0 Request processed in 3939us (4117us total) trans 17179872961 rc 0/0 00000100:00100000:3.0:1746129742.159606:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 509 00002000:00100000:3.0:1746129742.159613:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e8:0x0] (798720->1048575) req@ffff8800a504df80 x1830949051933696/t17179872961(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/448 e 0 to 0 dl 1746129753 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.159619:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504df80 with x1830949051933696 ext(798720->1048575) 00010000:00010000:3.0:1746129742.159626:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef400/0x48868a4e43947ad9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e698 expref: 13 pid: 8435 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.159636:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef400/0x48868a4e43947ad9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e698 expref: 13 pid: 8435 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746129742.159640:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a504df80 00000100:00100000:1.0:1746129742.159797:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949051933440:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11621us (11792us total) trans 0 rc 942080/942080 00000100:00100000:1.0:1746129742.159802:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3738 00002000:00100000:1.0:1746129742.159805:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1155072->2097151) req@ffff8800a504d180 x1830949051933440/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/440 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 942080/942080 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129742.159810:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504d180 with x1830949051933440 ext(1155072->2097151) 00002000:00010000:1.0:1746129742.159812:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504d180 00000100:00100000:0.0:1746129742.162473:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.162557:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.162650:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051933824 00000100:00100000:3.0:1746129742.162657:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051933824 00010000:00010000:3.0:1746129742.162685:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef400/0x48868a4e43947ad9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e698 expref: 14 pid: 8435 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.164622:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4903 00000100:00100000:3.0:1746129742.164632:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949051933824:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129742.164645:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129742.164664:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef400/0x48868a4e43947ad9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e698 expref: 14 pid: 8435 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.164675:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef400/0x48868a4e43947ad9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e698 expref: 14 pid: 8435 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.164693:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef400/0x48868a4e43947ad9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e698 expref: 14 pid: 8435 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.164710:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129742.164712:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129742.164717:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013186ec00/0x48868a4e43947c0d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e778 expref: 27 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.164723:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013186ec00/0x48868a4e43947c0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e778 expref: 27 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.164745:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013186ec00/0x48868a4e43947c0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e778 expref: 27 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.164754:0:7107:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013186ec00/0x48868a4e43947c0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e778 expref: 27 pid: 20441 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.164769:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053194368:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129742.164837:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129742.166109:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053194368:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129742.166121:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129742.166245:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949051933824:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1614us (3778us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.166253:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4903 00000100:00100000:0.0:1746129742.169025:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.170758:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.170999:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.171595:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.171703:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051934464 00000100:00100000:3.0:1746129742.171707:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051934464 00000100:00100000:3.0:1746129742.171732:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051934592 00000100:00100000:3.0:1746129742.171735:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051934592 00000100:00100000:3.0:1746129742.171755:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10181 00000100:00100000:3.0:1746129742.171760:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1963:x1830949051934464:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129742.171766:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129742.171776:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b1bc7200/0x48868a4e43947c22 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e78d expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129742.171807:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053194496:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129742.171879:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129742.171896:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10182 00000100:00100000:3.0:1746129742.171901:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1963:x1830949051934592:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129742.171908:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129742.171916:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1bc6c00/0x48868a4e43947c29 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e794 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129742.171940:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053194624:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129742.171963:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129742.176069:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053194624:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129742.176098:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1bc6c00/0x48868a4e43947c29 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e794 expref: 16 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129742.176111:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1bc6c00/0x48868a4e43947c29 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e794 expref: 16 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129742.176129:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1bc6c00, rc 0) 00000100:00100000:3.0:1746129742.176167:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1963:x1830949051934592:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4264us (4570us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129742.176173:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10182 00000100:00100000:0.0:1746129742.181948:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.182084:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051934720 00000100:00100000:3.0:1746129742.182092:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051934720 00000100:00100000:3.0:1746129742.182127:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10183 00000100:00100000:3.0:1746129742.182134:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28326:x1830949051934720:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129742.182146:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129742.182160:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b1bc6a00/0x48868a4e43947c30 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e79b expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.182182:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bc8c00/0x48868a4e43947bdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e755 expref: 29 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.182193:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129742.182194:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129742.182197:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1bc6a00/0x48868a4e43947c30 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e79b expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.182220:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135bc8c00/0x48868a4e43947bdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e755 expref: 29 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.182230:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135bc8c00/0x48868a4e43947bdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e755 expref: 29 pid: 20441 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.182239:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053194752:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129742.182830:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129742.184812:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053194752:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129742.184831:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b1bc6a00/0x48868a4e43947c30 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e79b expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.184844:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1bc6a00, rc 0) 00000100:00100000:3.0:1746129742.184887:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28326:x1830949051934720:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2753us (2945us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.184893:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10183 00000100:00100000:0.0:1746129742.185220:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.189955:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949051934848:12345-192.168.204.31@tcp:4:cat.0 Request processed in 4526us (4728us total) trans 17179872962 rc 0/0 00000100:00100000:0.0:1746129742.189965:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 511 00002000:00100000:0.0:1746129742.190066:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3227647) req@ffff8800a504ea00 x1830949051934848/t17179872962(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/448 e 0 to 0 dl 1746129753 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129742.190075:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504ea00 with x1830949051934848 ext(3145728->3227647) 00010000:00010000:0.0:1746129742.190085:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135bc8c00/0x48868a4e43947bdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e755 expref: 30 pid: 20441 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746129742.190095:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135bc8c00/0x48868a4e43947bdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e755 expref: 30 pid: 20441 timeout: 788 lvb_type: 0 00002000:00010000:0.0:1746129742.190101:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a504ea00 00000100:00100000:0.0:1746129742.191939:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.192498:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.192798:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051934976 00000100:00100000:3.0:1746129742.192806:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051934976 00000100:00100000:3.0:1746129742.192875:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10184 00000100:00100000:3.0:1746129742.192883:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:28328:x1830949051934976:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129742.192898:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129742.192912:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1bc6800/0x48868a4e43947c37 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e7a2 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.192941:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013186ea00/0x48868a4e43947b11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6c9 expref: 14 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.192947:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129742.192949:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129742.192952:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1bc6800/0x48868a4e43947c37 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7a2 expref: 27 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.192975:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013186ea00/0x48868a4e43947b11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6c9 expref: 14 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.192984:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013186ea00/0x48868a4e43947b11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6c9 expref: 14 pid: 7975 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.192995:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053194880:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129742.193961:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129742.194197:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.195389:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4904 00000100:00100000:1.0:1746129742.195396:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130565450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949051935104:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129742.195406:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129742.195424:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135bc8c00/0x48868a4e43947bdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e755 expref: 31 pid: 20441 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746129742.195432:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135bc8c00/0x48868a4e43947bdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e755 expref: 31 pid: 20441 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746129742.195454:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135bc8c00/0x48868a4e43947bdc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e755 expref: 31 pid: 20441 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746129742.195468:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.195469:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.195475:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b1bc6a00/0x48868a4e43947c30 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e79b expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.195481:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1bc6a00/0x48868a4e43947c30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e79b expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.195501:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b1bc6a00/0x48868a4e43947c30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e79b expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129742.195509:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053195008:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129742.195550:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129742.196425:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.196439:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051935360 00000100:00100000:0.0:1746129742.196443:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051935360 00002000:00100000:0.0:1746129742.196465:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1155071) req@ffff8800a504f480 x1830949051935360/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129742.196473:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504f480 with x1830949051935360 ext(1048576->1155071) 00010000:00010000:0.0:1746129742.196479:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013186ea00/0x48868a4e43947b11 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6c9 expref: 15 pid: 7975 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746129742.196489:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013186ea00/0x48868a4e43947b11 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6c9 expref: 15 pid: 7975 timeout: 788 lvb_type: 0 00002000:00010000:0.0:1746129742.196495:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a504f480 00000100:00100000:0.0:1746129742.196505:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 512 00000100:00100000:0.0:1746129742.196509:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1961:x1830949051935360:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129742.198428:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.198459:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051935616 00000100:00100000:3.0:1746129742.198463:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051935616 00002000:00100000:3.0:1746129742.198483:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e8:0x0] (12288->16383) req@ffff88009c134e00 x1830949051935616/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.198491:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c134e00 with x1830949051935616 ext(12288->16383) 00002000:00010000:3.0:1746129742.198494:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c134e00 00000100:00100000:3.0:1746129742.198514:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3739 00000100:00100000:3.0:1746129742.198521:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949051935616:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129742.198666:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949051935616:12345-192.168.204.31@tcp:3:cat.0 Request processed in 145us (238us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129742.198671:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3739 00002000:00100000:3.0:1746129742.198675:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e8:0x0] (12288->16383) req@ffff88009c134e00 x1830949051935616/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/4536 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.198681:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c134e00 with x1830949051935616 ext(12288->16383) 00002000:00010000:3.0:1746129742.198683:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c134e00 00000100:00100000:1.0:1746129742.202541:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949051935360:12345-192.168.204.31@tcp:4:cat.0 Request processed in 6023us (6110us total) trans 21474840130 rc 0/0 00000100:00100000:1.0:1746129742.202551:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 512 00002000:00100000:1.0:1746129742.202561:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1155071) req@ffff8800a504f480 x1830949051935360/t21474840130(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/448 e 0 to 0 dl 1746129753 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129742.202569:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504f480 with x1830949051935360 ext(1048576->1155071) 00010000:00010000:1.0:1746129742.202587:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013186ea00/0x48868a4e43947b11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6c9 expref: 17 pid: 7975 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746129742.202604:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013186ea00/0x48868a4e43947b11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6c9 expref: 17 pid: 7975 timeout: 788 lvb_type: 0 00002000:00010000:1.0:1746129742.202613:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a504f480 00000100:00100000:0.0:1746129742.205245:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.205344:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051935872 00000100:00100000:1.0:1746129742.205352:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051935872 00002000:00100000:1.0:1746129742.205383:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009c137800 x1830949051935872/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129742.205392:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c137800 with x1830949051935872 ext(2097152->3145727) 00002000:00010000:1.0:1746129742.205397:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c137800 00000100:00100000:1.0:1746129742.206400:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3740 00000100:00100000:1.0:1746129742.206409:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949051935872:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129742.211264:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.211546:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.211718:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051936256 00000100:00100000:3.0:1746129742.211722:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051936256 00002000:00100000:3.0:1746129742.211747:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e8:0x0] (516096->520191) req@ffff88009c137480 x1830949051936256/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.211755:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c137480 with x1830949051936256 ext(516096->520191) 00002000:00010000:3.0:1746129742.211759:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c137480 00000100:00100000:3.0:1746129742.211781:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3741 00000100:00100000:3.0:1746129742.211787:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949051936256:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129742.211920:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949051936256:12345-192.168.204.31@tcp:3:cat.0 Request processed in 132us (372us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129742.211925:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3741 00002000:00100000:3.0:1746129742.211929:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e8:0x0] (516096->520191) req@ffff88009c137480 x1830949051936256/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/4536 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.211935:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c137480 with x1830949051936256 ext(516096->520191) 00002000:00010000:3.0:1746129742.211938:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c137480 00000100:00100000:0.0:1746129742.216411:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.216665:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051936512 00000100:00100000:3.0:1746129742.216674:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051936512 00000100:00100000:3.0:1746129742.217058:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3786 00000100:00100000:3.0:1746129742.217066:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28321:x1830949051936512:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129742.217261:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949051935872:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10853us (12021us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129742.217269:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3740 00002000:00100000:1.0:1746129742.217277:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009c137800 x1830949051935872/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/440 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129742.217284:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c137800 with x1830949051935872 ext(2097152->3145727) 00002000:00010000:1.0:1746129742.217288:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c137800 00000100:00100000:1.0:1746129742.218040:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.218089:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28321:x1830949051936512:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 1023us (1684us total) trans 8589943487 rc 0/0 00000100:00100000:3.0:1746129742.218095:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3786 00000100:00100000:1.0:1746129742.218127:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051936768 00000100:00100000:1.0:1746129742.218131:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051936768 00002000:00100000:1.0:1746129742.218152:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800a5493b80 x1830949051936768/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129742.218164:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5493b80 with x1830949051936768 ext(1048576->2097151) 00002000:00010000:1.0:1746129742.218168:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5493b80 00000100:00100000:1.0:1746129742.218192:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3742 00000100:00100000:1.0:1746129742.218198:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949051936768:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129742.225007:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.228346:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949051936768:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10141us (10299us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129742.228356:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3742 00002000:00100000:1.0:1746129742.228364:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800a5493b80 x1830949051936768/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/440 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129742.228372:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5493b80 with x1830949051936768 ext(1048576->2097151) 00002000:00010000:1.0:1746129742.228377:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5493b80 00000100:00100000:0.0:1746129742.229506:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.229609:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051937024 00000100:00100000:1.0:1746129742.229614:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051937024 00002000:00100000:1.0:1746129742.229639:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2744320->3145727) req@ffff88009c135880 x1830949051937024/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129742.229647:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c135880 with x1830949051937024 ext(2744320->3145727) 00010000:00010000:1.0:1746129742.229652:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094fd8e00/0x48868a4e43947bc0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e747 expref: 27 pid: 20441 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746129742.229662:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094fd8e00/0x48868a4e43947bc0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e747 expref: 27 pid: 20441 timeout: 788 lvb_type: 0 00002000:00010000:1.0:1746129742.229668:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c135880 00000100:00100000:1.0:1746129742.229844:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 513 00000100:00100000:1.0:1746129742.229869:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949051937024:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129742.239119:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1964:x1830949051937024:12345-192.168.204.31@tcp:4:cat.0 Request processed in 9238us (9602us total) trans 21474840131 rc 0/0 00000100:00100000:1.0:1746129742.239130:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 513 00002000:00100000:1.0:1746129742.239140:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2744320->3145727) req@ffff88009c135880 x1830949051937024/t21474840131(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/448 e 0 to 0 dl 1746129753 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129742.239149:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c135880 with x1830949051937024 ext(2744320->3145727) 00010000:00010000:1.0:1746129742.239158:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094fd8e00/0x48868a4e43947bc0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e747 expref: 29 pid: 20441 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746129742.239171:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094fd8e00/0x48868a4e43947bc0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e747 expref: 29 pid: 20441 timeout: 788 lvb_type: 0 00002000:00010000:1.0:1746129742.239178:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c135880 00000100:00100000:0.0:1746129742.240200:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.245246:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.253433:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051937536 00000100:00100000:1.0:1746129742.253439:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051937536 00002000:00100000:1.0:1746129742.253468:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009b00dc00 x1830949051937536/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129742.253477:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00dc00 with x1830949051937536 ext(2097152->3145727) 00002000:00010000:1.0:1746129742.253480:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00dc00 00000100:00100000:1.0:1746129742.253536:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3743 00000100:00100000:1.0:1746129742.253543:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949051937536:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129742.258743:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.262029:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3745 00000100:00100000:0.0:1746129742.262038:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949051938048:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129742.263775:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3746 00000100:00100000:1.0:1746129742.263786:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1964:x1830949051938176:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129742.266254:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051938560 00000100:00100000:3.0:1746129742.266267:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051938560 00000100:00100000:3.0:1746129742.266326:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9724 00000100:00100000:3.0:1746129742.266334:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:28332:x1830949051938560:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129742.266352:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129742.266369:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bc7400/0x48868a4e43947c4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e7b7 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.266449:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bc6600/0x48868a4e43947c53 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.266461:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef600/0x48868a4e43947b2d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6d7 expref: 13 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.266468:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd8a00/0x48868a4e43947bb2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e740 expref: 295 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.266474:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd9400/0x48868a4e43947be3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e74e expref: 16 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.266479:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bc6600/0x48868a4e43947c53 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.266508:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd9400/0x48868a4e43947be3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e74e expref: 16 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.266518:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd9400/0x48868a4e43947be3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e74e expref: 16 pid: 15044 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.266528:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053195648:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129742.266601:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd8a00/0x48868a4e43947bb2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e740 expref: 295 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.266608:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd8a00/0x48868a4e43947bb2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e740 expref: 295 pid: 15044 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.266614:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053195776:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129742.266635:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef600/0x48868a4e43947b2d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6d7 expref: 13 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.266641:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef600/0x48868a4e43947b2d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6d7 expref: 13 pid: 14315 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.266647:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053195904:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129742.266658:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f900 going to sleep for 11 seconds 00000100:00100000:3.0:1746129742.275458:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053195648:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129742.278408:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.278485:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.278509:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.278583:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051938688 00000100:00100000:3.0:1746129742.278589:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051938688 00010000:00010000:3.0:1746129742.278620:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd9400/0x48868a4e43947be3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e74e expref: 17 pid: 15044 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.278642:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051938816 00000100:00100000:3.0:1746129742.278644:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051938816 00010000:00010000:3.0:1746129742.278652:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd8a00/0x48868a4e43947bb2 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e740 expref: 296 pid: 15044 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.278663:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051938944 00000100:00100000:3.0:1746129742.278664:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051938944 00010000:00010000:3.0:1746129742.278671:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef600/0x48868a4e43947b2d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6d7 expref: 14 pid: 14315 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.278682:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4908 00000100:00100000:3.0:1746129742.278689:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949051938688:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129742.278699:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129742.278704:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd9400/0x48868a4e43947be3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e74e expref: 17 pid: 15044 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.278713:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd9400/0x48868a4e43947be3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e74e expref: 17 pid: 15044 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.278731:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd9400/0x48868a4e43947be3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e74e expref: 17 pid: 15044 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.278747:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129742.278751:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bc6600/0x48868a4e43947c53 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.278759:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bc6600/0x48868a4e43947c53 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.278764:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129742.278796:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949051938688:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 108us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.278802:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4908 00000100:00100000:3.0:1746129742.278818:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4909 00000100:00100000:3.0:1746129742.278822:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:1963:x1830949051938816:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129742.278828:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129742.278832:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd8a00/0x48868a4e43947bb2 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e740 expref: 296 pid: 15044 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.278838:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd8a00/0x48868a4e43947bb2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e740 expref: 296 pid: 15044 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.278864:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129742.278867:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bc6600/0x48868a4e43947c53 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.278871:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bc6600/0x48868a4e43947c53 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.278875:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129742.278889:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:1963:x1830949051938816:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 66us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.278894:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4909 00000100:00100000:3.0:1746129742.278903:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4910 00000100:00100000:3.0:1746129742.278907:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+14:1963:x1830949051938944:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129742.278915:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129742.278918:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef600/0x48868a4e43947b2d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6d7 expref: 14 pid: 14315 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.278925:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef600/0x48868a4e43947b2d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6d7 expref: 14 pid: 14315 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.278934:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129742.278936:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bc6600/0x48868a4e43947c53 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.278941:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bc6600/0x48868a4e43947c53 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.278947:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bc6600/0x48868a4e43947c53 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.278958:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129742.278971:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+14:1963:x1830949051938944:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 63us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.278976:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4910 00010000:00010000:3.0:1746129742.279014:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd8a00/0x48868a4e43947bb2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e740 expref: 295 pid: 15044 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.279023:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053195776:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129742.279031:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef600/0x48868a4e43947b2d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6d7 expref: 13 pid: 14315 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.279038:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053195904:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129742.279054:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bc6600/0x48868a4e43947c53 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.279060:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bc6600/0x48868a4e43947c53 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.279065:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bc6600/0x48868a4e43947c53 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129742.279079:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129742.279186:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bc7400/0x48868a4e43947c4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7b7 expref: 296 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.279196:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bc6600/0x48868a4e43947c53 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7b7 expref: 295 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.279202:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129742.279204:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129742.279206:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1bc6600, rc 0) 00000100:00100000:3.0:1746129742.279228:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:28332:x1830949051938560:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 12895us (20492us total) trans 8589943488 rc 0/0 00000100:00100000:3.0:1746129742.279234:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9724 00000100:00100000:0.0:1746129742.279567:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949051937536:12345-192.168.204.31@tcp:3:cat.0 Request processed in 26023us (26375us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129742.279609:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3743 00002000:00100000:0.0:1746129742.279616:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009b00dc00 x1830949051937536/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/440 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129742.279624:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00dc00 with x1830949051937536 ext(2097152->3145727) 00002000:00010000:0.0:1746129742.279627:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00dc00 00000100:00100000:1.0:1746129742.290345:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949051938176:12345-192.168.204.31@tcp:3:cat.0 Request processed in 26554us (29603us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129742.290354:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3746 00002000:00100000:1.0:1746129742.290362:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009b00df80 x1830949051938176/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/440 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129742.290369:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00df80 with x1830949051938176 ext(3145728->4194303) 00002000:00010000:1.0:1746129742.290374:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00df80 00000100:00100000:3.0:1746129742.290480:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.290625:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051939072 00000100:00100000:1.0:1746129742.290631:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051939072 00000100:00100000:1.0:1746129742.290658:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10187 00000100:00100000:1.0:1746129742.290664:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:28328:x1830949051939072:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129742.290676:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129742.290690:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fc95400/0x48868a4e43947c61 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e7be expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.290711:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.290712:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.290720:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc95400/0x48868a4e43947c61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7be expref: 29 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.290733:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fc95400/0x48868a4e43947c61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7be expref: 29 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.290746:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc95400, rc 0) 00000100:00100000:1.0:1746129742.290765:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:28328:x1830949051939072:12345-192.168.204.31@tcp:101:cat.0 Request processed in 101us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129742.290770:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10187 00000100:00100000:0.0:1746129742.300929:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.301023:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051939200 00000100:00100000:3.0:1746129742.301030:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051939200 00000100:00100000:3.0:1746129742.301069:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10188 00000100:00100000:3.0:1746129742.301076:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949051939200:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129742.301090:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129742.301104:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013186fc00/0x48868a4e43947c68 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e7c5 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.301127:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129742.301129:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129742.301136:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013186fc00/0x48868a4e43947c68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7c5 expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129742.301150:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013186fc00/0x48868a4e43947c68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7c5 expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129742.301160:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013186fc00, rc 0) 00000100:00100000:3.0:1746129742.301196:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949051939200:12345-192.168.204.31@tcp:101:cat.0 Request processed in 121us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.301201:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10188 00000100:00100000:0.0:1746129742.308926:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.308960:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.308977:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.309010:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.309036:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051939584 00000100:00100000:0.0:1746129742.309044:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051939584 00002000:00100000:0.0:1746129742.309080:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009c136d80 x1830949051939584/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129742.309088:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c136d80 with x1830949051939584 ext(4194304->4964351) 00002000:00010000:0.0:1746129742.309093:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c136d80 00000100:00100000:0.0:1746129742.309106:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051939712 00000100:00100000:0.0:1746129742.309108:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051939712 00002000:00100000:0.0:1746129742.309119:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009c136300 x1830949051939712/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129742.309131:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c136300 with x1830949051939712 ext(2097152->3145727) 00002000:00010000:0.0:1746129742.309134:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c136300 00000100:00100000:0.0:1746129742.309141:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051940096 00000100:00100000:0.0:1746129742.309142:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051940096 00002000:00100000:0.0:1746129742.309150:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009c134a80 x1830949051940096/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129742.309156:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c134a80 with x1830949051940096 ext(3145728->4194303) 00002000:00010000:0.0:1746129742.309158:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c134a80 00000100:00100000:0.0:1746129742.309163:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051940224 00000100:00100000:0.0:1746129742.309165:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051940224 00002000:00100000:0.0:1746129742.309171:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009c135180 x1830949051940224/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129742.309177:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c135180 with x1830949051940224 ext(3145728->4194303) 00002000:00010000:0.0:1746129742.309179:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c135180 00000100:00100000:0.0:1746129742.309187:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3747 00000100:00100000:0.0:1746129742.309192:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1963:x1830949051939584:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129742.310532:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3748 00000100:00100000:0.0:1746129742.310539:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949051939712:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129742.311499:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3749 00000100:00100000:0.0:1746129742.311506:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949051940096:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129742.312300:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3750 00000100:00100000:1.0:1746129742.312309:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949051940224:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129742.321274:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.323537:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051940352 00000100:00100000:1.0:1746129742.323544:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051940352 00000100:00100000:1.0:1746129742.323587:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10189 00000100:00100000:1.0:1746129742.323593:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:28332:x1830949051940352:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129742.323604:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129742.323618:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fc95600/0x48868a4e43947c6f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e7cc expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.323641:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b1bc6a00/0x48868a4e43947c30 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e79b expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.323648:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094fd9000/0x48868a4e43947c45 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7b0 expref: 32 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.323654:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.323655:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.323658:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc95600/0x48868a4e43947c6f lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2285568->2629631] (req 2285568->2629631) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7cc expref: 32 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.323688:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094fd9000/0x48868a4e43947c45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7b0 expref: 32 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.323698:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094fd9000/0x48868a4e43947c45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7b0 expref: 32 pid: 8437 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746129742.323707:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053196032:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129742.323938:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b1bc6a00/0x48868a4e43947c30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e79b expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.323946:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b1bc6a00/0x48868a4e43947c30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e79b expref: 13 pid: 8437 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746129742.323954:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053196160:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129742.324060:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129742.333324:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053196032:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129742.333334:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053196160:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129742.333356:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fc95600/0x48868a4e43947c6f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2285568->2629631] (req 2285568->2629631) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7cc expref: 32 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.333370:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc95600, rc 0) 00000100:00100000:1.0:1746129742.333391:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:28332:x1830949051940352:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 9798us (12125us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129742.333400:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10189 00000100:00100000:0.0:1746129742.339441:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.339840:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949051940224:12345-192.168.204.31@tcp:3:cat.0 Request processed in 27531us (30826us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129742.339872:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3750 00002000:00100000:1.0:1746129742.339882:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009c135180 x1830949051940224/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/440 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129742.339892:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c135180 with x1830949051940224 ext(3145728->4194303) 00002000:00010000:1.0:1746129742.339896:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c135180 00000100:00100000:0.0:1746129742.342161:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.342216:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051940608 00000100:00100000:1.0:1746129742.342222:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051940608 00000100:00100000:1.0:1746129742.342267:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10190 00000100:00100000:1.0:1746129742.342274:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:28328:x1830949051940608:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129742.342288:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129742.342302:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fc95c00/0x48868a4e43947c76 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e7d3 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.342325:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.342327:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.342334:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc95c00/0x48868a4e43947c76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7d3 expref: 33 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.342346:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fc95c00/0x48868a4e43947c76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7d3 expref: 33 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.342355:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc95c00, rc 0) 00000100:00100000:1.0:1746129742.342400:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:28328:x1830949051940608:12345-192.168.204.31@tcp:101:cat.0 Request processed in 125us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129742.342405:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10190 00000100:00100000:0.0:1746129742.343691:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949051940096:12345-192.168.204.31@tcp:3:cat.0 Request processed in 32182us (34709us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129742.343699:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3749 00002000:00100000:0.0:1746129742.343705:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009c134a80 x1830949051940096/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/440 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129742.343713:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c134a80 with x1830949051940096 ext(3145728->4194303) 00010000:00010000:0.0:1746129742.343720:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094fd9000/0x48868a4e43947c45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7b0 expref: 31 pid: 8437 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746129742.343732:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094fd9000/0x48868a4e43947c45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7b0 expref: 31 pid: 8437 timeout: 788 lvb_type: 0 00002000:00010000:0.0:1746129742.343737:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c134a80 00000100:00100000:0.0:1746129742.348069:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.348113:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.348132:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051940736 00000100:00100000:1.0:1746129742.348141:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051940736 00010000:00010000:1.0:1746129742.348173:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094fd9000/0x48868a4e43947c45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7b0 expref: 31 pid: 8437 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746129742.348211:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4912 00000100:00100000:1.0:1746129742.348218:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949051940736:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129742.348231:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129742.348250:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094fd9000/0x48868a4e43947c45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7b0 expref: 31 pid: 8437 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746129742.348260:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094fd9000/0x48868a4e43947c45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7b0 expref: 31 pid: 8437 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746129742.348278:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094fd9000/0x48868a4e43947c45 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7b0 expref: 32 pid: 8437 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746129742.348294:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.348295:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.348301:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fc95600/0x48868a4e43947c6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2285568->3145727] (req 2285568->2629631) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7cc expref: 31 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.348308:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc95600/0x48868a4e43947c6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2285568->3145727] (req 2285568->2629631) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7cc expref: 31 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.348338:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fc95600/0x48868a4e43947c6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2285568->3145727] (req 2285568->2629631) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7cc expref: 31 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129742.348347:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053196288:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129742.348402:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129742.350493:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053196288:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129742.350510:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129742.350548:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949051940736:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2329us (2484us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129742.350557:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4912 00000100:00100000:0.0:1746129742.350954:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.357887:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.362463:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.362733:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.363296:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10191 00000100:00100000:1.0:1746129742.363304:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949051941632:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129742.363327:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129742.363342:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fc95e00/0x48868a4e43947c84 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e7da expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129742.363381:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053196416:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129742.363449:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129742.367274:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053196416:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129742.367302:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fc95e00/0x48868a4e43947c84 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7da expref: 31 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.367314:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fc95e00/0x48868a4e43947c84 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7da expref: 31 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.367333:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc95e00, rc 0) 00000100:00100000:1.0:1746129742.367383:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1963:x1830949051941632:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4079us (4926us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129742.367390:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10191 00000100:00100000:0.0:1746129742.371414:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.389310:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.389446:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.389828:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10193 00000100:00100000:1.0:1746129742.389836:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1964:x1830949051942272:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129742.390305:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129742.390315:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fc95e00/0x48868a4e43947c92 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e7ef expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.390335:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fc95e00/0x48868a4e43947c92 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7ef expref: 33 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.390343:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fc95e00/0x48868a4e43947c92 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7ef expref: 33 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.390354:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc95e00, rc 0) 00000100:00100000:1.0:1746129742.390378:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949051942272:12345-192.168.204.31@tcp:101:cat.0 Request processed in 544us (1077us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129742.390384:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10193 00000100:00100000:0.0:1746129742.396346:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051942400 00000100:00100000:0.0:1746129742.396353:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051942400 00000100:00100000:0.0:1746129742.396395:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10195 00000100:00100000:0.0:1746129742.396402:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1963:x1830949051942400:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129742.396419:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129742.396433:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094fd8800/0x48868a4e43947c99 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e7f6 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129742.396463:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051942528 00000100:00100000:3.0:1746129742.396467:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051942528 00000100:00100000:3.0:1746129742.396496:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10196 00000100:00100000:3.0:1746129742.396502:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949051942528:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129742.396509:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129742.396514:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093367400/0x48868a4e43947ca0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e7fd expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.396535:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093367400/0x48868a4e43947ca0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7fd expref: 33 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129742.396541:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093367400/0x48868a4e43947ca0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7fd expref: 33 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129742.396553:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093367400, rc 0) 00000100:00100000:0.0:1746129742.396565:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c088380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053196672:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129742.396599:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1963:x1830949051942528:12345-192.168.204.31@tcp:101:cat.0 Request processed in 96us (196us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129742.396604:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10196 00000100:00100000:0.0:1746129742.396632:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135d2c900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129742.404627:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.404760:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051942656 00000100:00100000:3.0:1746129742.404768:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051942656 00000100:00100000:3.0:1746129742.404804:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9725 00000100:00100000:3.0:1746129742.404811:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+13:28335:x1830949051942656:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129742.404831:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129742.404844:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093367800/0x48868a4e43947ca7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e804 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.404918:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093367a00/0x48868a4e43947cae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.404928:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093367a00/0x48868a4e43947cae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.404937:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093367a00/0x48868a4e43947cae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.404948:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093367c00/0x48868a4e43947cb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.404953:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093367c00/0x48868a4e43947cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.404957:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093367c00/0x48868a4e43947cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.405046:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093367e00/0x48868a4e43947cbc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.405055:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bc6600/0x48868a4e43947c53 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7b7 expref: 294 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.405061:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093367e00/0x48868a4e43947cbc lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.405084:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bc6600/0x48868a4e43947c53 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7b7 expref: 294 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.405094:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bc6600/0x48868a4e43947c53 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7b7 expref: 294 pid: 14315 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.405104:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053196800:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129742.406352:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f900 going to sleep for 11 seconds 00000100:00100000:3.0:1746129742.408089:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053196800:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129742.408106:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093367e00/0x48868a4e43947cbc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:1.0:1746129742.408255:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.408359:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051942912 00000100:00100000:3.0:1746129742.408364:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051942912 00000100:00100000:3.0:1746129742.408400:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3787 00000100:00100000:3.0:1746129742.408406:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba7e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:27195:x1830949051942912:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746129742.408787:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba7e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:27195:x1830949051942912:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 380us (532us total) trans 8589943489 rc 0/0 00000100:00100000:3.0:1746129742.408796:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3787 00000100:00100000:0.0:1746129742.411786:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.411839:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051943040 00000100:00100000:1.0:1746129742.411882:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051943040 00010000:00010000:1.0:1746129742.411907:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bc6600/0x48868a4e43947c53 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7b7 expref: 296 pid: 14315 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746129742.411937:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4913 00000100:00100000:1.0:1746129742.411944:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c089880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:1962:x1830949051943040:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129742.411954:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129742.411958:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bc6600/0x48868a4e43947c53 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7b7 expref: 296 pid: 14315 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746129742.411967:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bc6600/0x48868a4e43947c53 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7b7 expref: 296 pid: 14315 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746129742.411983:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1bc6600/0x48868a4e43947c53 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7b7 expref: 296 pid: 14315 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746129742.412002:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129742.412005:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093367e00/0x48868a4e43947cbc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129742.412013:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093367e00/0x48868a4e43947cbc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129742.412019:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093367e00/0x48868a4e43947cbc lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129742.412036:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129742.412067:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c089880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:1962:x1830949051943040:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 123us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129742.412072:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4913 00000100:00100000:0.0:1746129742.417688:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.417721:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.417740:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.418040:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.418629:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10200 00000100:00100000:3.0:1746129742.418637:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949051943552:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129742.418645:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129742.418653:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093367400/0x48868a4e43947cd8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e820 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.418662:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129742.418663:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129742.418667:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093367400/0x48868a4e43947cd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e820 expref: 12 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129742.418677:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093367400/0x48868a4e43947cd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e820 expref: 12 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129742.418683:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093367400, rc 0) 00000100:00100000:3.0:1746129742.418702:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949051943552:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 66us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.418706:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10200 00000100:00100000:0.0:1746129742.422835:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.425224:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.425282:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051943936 00000100:00100000:3.0:1746129742.425286:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051943936 00010000:00010000:3.0:1746129742.425310:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093367e00/0x48868a4e43947cbc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e804 expref: 16 pid: 14315 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.425341:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4914 00000100:00100000:3.0:1746129742.425347:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+16:1961:x1830949051943936:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129742.425360:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129742.425365:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093367e00/0x48868a4e43947cbc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e804 expref: 16 pid: 14315 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.425374:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093367e00/0x48868a4e43947cbc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e804 expref: 16 pid: 14315 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.425391:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093367e00/0x48868a4e43947cbc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e804 expref: 16 pid: 14315 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.425405:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129742.425409:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50e5000/0x48868a4e43947ce6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.425417:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50e5000/0x48868a4e43947ce6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.425423:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50e5000/0x48868a4e43947ce6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.425448:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129742.426249:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949051943936:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 744us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.426256:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4914 00000100:00100000:0.0:1746129742.431112:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.434151:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.435563:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.435591:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.435608:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.435622:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051944448 00000100:00100000:1.0:1746129742.435626:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051944448 00000100:00100000:1.0:1746129742.435657:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051944704 00000100:00100000:1.0:1746129742.435660:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051944704 00000100:00100000:1.0:1746129742.435670:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051944960 00000100:00100000:1.0:1746129742.435671:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051944960 00000100:00100000:3.0:1746129742.435682:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10202 00000100:00100000:3.0:1746129742.435690:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949051944448:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:3.0:1746129742.435715:0:1877:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093366c00/0x48868a4e43947d10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.435731:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1bc6800/0x48868a4e43947c37 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7a2 expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.435738:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a50e4a00/0x48868a4e43947cca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e812 expref: 13 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129742.435744:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013186fc00/0x48868a4e43947c68 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7c5 expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129742.435749:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129742.435751:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129742.435753:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093366c00/0x48868a4e43947d10 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.435771:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013186fc00/0x48868a4e43947c68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7c5 expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129742.435779:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013186fc00/0x48868a4e43947c68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7c5 expref: 17 pid: 8437 timeout: 788 lvb_type: 1 00000100:00100000:3.0:1746129742.435788:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053197312:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129742.435819:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a50e4a00/0x48868a4e43947cca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e812 expref: 13 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129742.435826:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a50e4a00/0x48868a4e43947cca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e812 expref: 13 pid: 8435 timeout: 788 lvb_type: 1 00000100:00100000:3.0:1746129742.435838:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053197440:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129742.435888:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1bc6800/0x48868a4e43947c37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7a2 expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.435896:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b1bc6800/0x48868a4e43947c37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7a2 expref: 28 pid: 8437 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.435902:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053197568:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129742.435919:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129742.436333:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10203 00000100:00100000:1.0:1746129742.436342:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949051944704:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:1.0:1746129742.436361:0:20441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008fc95a00/0x48868a4e43947d17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.436372:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb21800/0x48868a4e439477a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4e6 expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.436380:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801310ede00/0x48868a4e43947927 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e59c expref: 12 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.436387:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013261ac00/0x48868a4e43947920 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e595 expref: 29 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.436392:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.436393:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.436395:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc95a00/0x48868a4e43947d17 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.436411:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013261ac00/0x48868a4e43947920 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e595 expref: 29 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.436424:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013261ac00/0x48868a4e43947920 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e595 expref: 29 pid: 3623 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746129742.436433:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5492680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053197696:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129742.436463:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801310ede00/0x48868a4e43947927 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e59c expref: 12 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.436470:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801310ede00/0x48868a4e43947927 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e59c expref: 12 pid: 8435 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746129742.436478:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5493100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053197824:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129742.436501:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb21800/0x48868a4e439477a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4e6 expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.436508:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bb21800/0x48868a4e439477a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4e6 expref: 11 pid: 20441 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746129742.436515:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5492d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053197952:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129742.436531:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129742.436555:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.436613:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.436628:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051944576 00000100:00100000:1.0:1746129742.436632:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051944576 00000100:00100000:1.0:1746129742.436647:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051944832 00000100:00100000:1.0:1746129742.436649:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051944832 00000100:00100000:1.0:1746129742.436661:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10205 00000100:00100000:1.0:1746129742.436667:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+14:1962:x1830949051944576:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:1.0:1746129742.436692:0:1140:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a510c000/0x48868a4e43947d25 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.436701:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135bc9000/0x48868a4e43947a8c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e67c expref: 17 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.436707:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fe29600/0x48868a4e43947aee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6b4 expref: 14 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.436713:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa5600/0x48868a4e43947ae0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e69f expref: 28 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.436717:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.436718:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.436720:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a510c000/0x48868a4e43947d25 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.436734:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa5600/0x48868a4e43947ae0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e69f expref: 28 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.436742:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa5600/0x48868a4e43947ae0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e69f expref: 28 pid: 7975 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746129742.436749:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053198464:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129742.436773:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fe29600/0x48868a4e43947aee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6b4 expref: 14 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.436780:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fe29600/0x48868a4e43947aee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6b4 expref: 14 pid: 1877 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746129742.436787:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053198592:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129742.436805:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135bc9000/0x48868a4e43947a8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e67c expref: 17 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.436812:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135bc9000/0x48868a4e43947a8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e67c expref: 17 pid: 8435 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746129742.436819:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053198848:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129742.436830:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129742.438745:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.438793:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051945088 00000100:00100000:3.0:1746129742.438798:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051945088 00000100:00100000:3.0:1746129742.438823:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053197312:192.168.204.31@tcp:104: 00002000:00100000:3.0:1746129742.438866:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (12288->520191) req@ffff88008fad0000 x1830949051945088/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.438873:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad0000 with x1830949051945088 ext(12288->520191) 00010000:00010000:3.0:1746129742.438879:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094fd8600/0x48868a4e43947c14 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->520191) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e77f expref: 13 pid: 20441 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.438888:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094fd8600/0x48868a4e43947c14 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->520191) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e77f expref: 13 pid: 20441 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746129742.438893:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fad0000 00000100:00100000:3.0:1746129742.438907:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 514 00000100:00100000:3.0:1746129742.438914:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1963:x1830949051945088:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129742.440128:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5493100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053197824:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129742.447047:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.447121:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.447133:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.447147:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.447165:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051945216 00000100:00100000:0.0:1746129742.447172:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051945216 00010000:00010000:0.0:1746129742.447199:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013186fc00/0x48868a4e43947c68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7c5 expref: 18 pid: 8437 timeout: 788 lvb_type: 1 00000100:00100000:0.0:1746129742.447218:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051946112 00000100:00100000:0.0:1746129742.447221:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051946112 00010000:00010000:0.0:1746129742.447229:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801310ede00/0x48868a4e43947927 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e59c expref: 15 pid: 8435 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746129742.447239:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051946496 00000100:00100000:0.0:1746129742.447240:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051946496 00010000:00010000:0.0:1746129742.447247:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa5600/0x48868a4e43947ae0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e69f expref: 29 pid: 7975 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746129742.447254:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051945344 00000100:00100000:0.0:1746129742.447255:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051945344 00010000:00010000:0.0:1746129742.447261:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50e4a00/0x48868a4e43947cca lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e812 expref: 15 pid: 8435 timeout: 788 lvb_type: 1 00000100:00100000:0.0:1746129742.447270:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4915 00000100:00100000:0.0:1746129742.447275:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949051945216:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129742.447284:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129742.447301:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013186fc00/0x48868a4e43947c68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7c5 expref: 18 pid: 8437 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746129742.447310:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013186fc00/0x48868a4e43947c68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7c5 expref: 18 pid: 8437 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746129742.447330:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013186fc00/0x48868a4e43947c68 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7c5 expref: 18 pid: 8437 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746129742.447347:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129742.447367:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4916 00000100:00100000:3.0:1746129742.447375:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949051946112:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129742.447379:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949051945216:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 103us (338us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129742.447383:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129742.447384:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4915 00010000:00010000:3.0:1746129742.447398:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801310ede00/0x48868a4e43947927 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e59c expref: 15 pid: 8435 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746129742.447398:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4917 00000100:00100000:0.0:1746129742.447401:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949051946496:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129742.447407:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801310ede00/0x48868a4e43947927 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e59c expref: 15 pid: 8435 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746129742.447408:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129742.447415:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa5600/0x48868a4e43947ae0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e69f expref: 29 pid: 7975 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.447419:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801310ede00/0x48868a4e43947927 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e59c expref: 15 pid: 8435 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746129742.447421:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa5600/0x48868a4e43947ae0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e69f expref: 29 pid: 7975 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746129742.447431:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129742.447433:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129742.447444:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949051946496:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 42us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.447447:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4917 00000100:00100000:3.0:1746129742.447452:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949051946112:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 79us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.447455:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4918 00000100:00100000:3.0:1746129742.447458:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4916 00000100:00100000:0.0:1746129742.447459:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130564c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+15:1964:x1830949051945344:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129742.447464:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129742.447469:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a50e4a00/0x48868a4e43947cca lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e812 expref: 15 pid: 8435 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746129742.447476:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a50e4a00/0x48868a4e43947cca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e812 expref: 15 pid: 8435 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746129742.447483:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129742.447494:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130564c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+15:1964:x1830949051945344:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 35us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.447500:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4918 00010000:00010000:3.0:1746129742.447504:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50e4a00/0x48868a4e43947cca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e812 expref: 15 pid: 8435 timeout: 788 lvb_type: 1 00000100:00100000:3.0:1746129742.447512:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053197440:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129742.447522:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053197568:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129742.447540:0:1877:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880093366c00/0x48868a4e43947d10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129742.447543:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.447557:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051945600 00000100:00100000:3.0:1746129742.447560:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051945600 00010000:00010000:3.0:1746129742.447585:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013261ac00/0x48868a4e43947920 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e595 expref: 30 pid: 3623 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746129742.447596:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.447606:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051945856 00000100:00100000:3.0:1746129742.447608:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051945856 00000100:00100000:0.0:1746129742.447611:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4919 00000100:00100000:0.0:1746129742.447616:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1964:x1830949051945600:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129742.447617:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc95c00/0x48868a4e43947c76 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7d3 expref: 31 pid: 20441 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746129742.447622:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129742.447630:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4920 00010000:00010000:0.0:1746129742.447631:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013261ac00/0x48868a4e43947920 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e595 expref: 31 pid: 3623 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.447634:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1964:x1830949051945856:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129742.447639:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013261ac00/0x48868a4e43947920 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e595 expref: 31 pid: 3623 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.447640:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129742.447648:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fc95c00/0x48868a4e43947c76 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7d3 expref: 31 pid: 20441 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746129742.447649:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129742.447656:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fc95c00/0x48868a4e43947c76 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7d3 expref: 31 pid: 20441 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746129742.447660:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1964:x1830949051945600:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 45us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.447665:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4919 00010000:00010000:3.0:1746129742.447666:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129742.447682:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1964:x1830949051945856:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 48us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.447687:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4920 00000100:00100000:0.0:1746129742.447697:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.447738:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051946240 00000100:00100000:3.0:1746129742.447741:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051946240 00010000:00010000:3.0:1746129742.447751:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094fd8c00/0x48868a4e43947c3e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7a9 expref: 17 pid: 8437 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.447771:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4921 00000100:00100000:3.0:1746129742.447776:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949051946240:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129742.447782:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129742.447790:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094fd8c00/0x48868a4e43947c3e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7a9 expref: 17 pid: 8437 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.447796:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094fd8c00/0x48868a4e43947c3e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7a9 expref: 17 pid: 8437 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.447806:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129742.447808:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.447817:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051946624 00000100:00100000:0.0:1746129742.447820:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051946624 00000100:00100000:3.0:1746129742.447821:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949051946240:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 46us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.447826:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4921 00010000:00010000:0.0:1746129742.447829:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135bc9000/0x48868a4e43947a8c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e67c expref: 18 pid: 8435 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746129742.447841:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4922 00000100:00100000:0.0:1746129742.447868:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949051946624:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129742.447875:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129742.447882:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135bc9000/0x48868a4e43947a8c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e67c expref: 17 pid: 8435 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746129742.447889:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135bc9000/0x48868a4e43947a8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e67c expref: 17 pid: 8435 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746129742.447897:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129742.447900:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.447909:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949051946624:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 41us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.447911:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051945472 00000100:00100000:0.0:1746129742.447913:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4922 00000100:00100000:3.0:1746129742.447914:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051945472 00010000:00010000:3.0:1746129742.447923:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1bc6800/0x48868a4e43947c37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7a2 expref: 29 pid: 8437 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.447943:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4923 00010000:00010000:1.0:1746129742.447979:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fa5600/0x48868a4e43947ae0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e69f expref: 29 pid: 7975 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.448099:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1964:x1830949051945472:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129742.448106:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129742.448113:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b1bc6800/0x48868a4e43947c37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7a2 expref: 28 pid: 8437 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.448120:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b1bc6800/0x48868a4e43947c37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7a2 expref: 28 pid: 8437 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.448133:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1bc6800/0x48868a4e43947c37 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7a2 expref: 28 pid: 8437 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.448141:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129742.448143:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129742.448146:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093366c00/0x48868a4e43947d10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.448153:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093366c00/0x48868a4e43947d10 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129742.448160:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.448170:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051945728 00000100:00100000:0.0:1746129742.448172:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051945728 00010000:00010000:3.0:1746129742.448180:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129742.448180:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb21800/0x48868a4e439477a6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4e6 expref: 13 pid: 20441 timeout: 788 lvb_type: 1 00000100:00100000:0.0:1746129742.448193:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4924 00000100:00100000:0.0:1746129742.448196:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+13:1964:x1830949051945728:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129742.448199:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949051945472:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 250us (298us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129742.448201:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129742.448203:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4923 00010000:00010000:0.0:1746129742.448207:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bb21800/0x48868a4e439477a6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4e6 expref: 13 pid: 20441 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746129742.448214:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bb21800/0x48868a4e439477a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4e6 expref: 13 pid: 20441 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746129742.448222:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.448224:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.448227:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fc95a00/0x48868a4e43947d17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.448232:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc95a00/0x48868a4e43947d17 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129742.448233:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129742.448240:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129742.448242:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051945984 00000100:00100000:3.0:1746129742.448245:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051945984 00000100:00100000:0.0:1746129742.448251:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+13:1964:x1830949051945728:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 54us (91us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129742.448253:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093367400/0x48868a4e43947cd8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e820 expref: 14 pid: 1877 timeout: 788 lvb_type: 1 00000100:00100000:0.0:1746129742.448256:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4924 00000100:00100000:0.0:1746129742.448264:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4925 00000100:00100000:0.0:1746129742.448268:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130564850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+14:1964:x1830949051945984:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129742.448273:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129742.448279:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093367400/0x48868a4e43947cd8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e820 expref: 14 pid: 1877 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746129742.448285:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093367400/0x48868a4e43947cd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e820 expref: 14 pid: 1877 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746129742.448293:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093367400/0x48868a4e43947cd8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e820 expref: 14 pid: 1877 timeout: 788 lvb_type: 1 00000100:00100000:3.0:1746129742.448295:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129742.448300:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129742.448305:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051946368 00000100:00100000:3.0:1746129742.448307:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051946368 00000100:00100000:0.0:1746129742.448310:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130564850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+14:1964:x1830949051945984:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 42us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.448315:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4925 00010000:00010000:3.0:1746129742.448316:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe29600/0x48868a4e43947aee lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6b4 expref: 14 pid: 1877 timeout: 788 lvb_type: 1 00000100:00100000:0.0:1746129742.448330:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4926 00000100:00100000:0.0:1746129742.448334:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+13:1964:x1830949051946368:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129742.448338:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129742.448343:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fe29600/0x48868a4e43947aee lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6b4 expref: 13 pid: 1877 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746129742.448350:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fe29600/0x48868a4e43947aee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6b4 expref: 13 pid: 1877 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746129742.448357:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.449345:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.449352:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a510c000/0x48868a4e43947d25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.449358:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a510c000/0x48868a4e43947d25 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.449372:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129742.449397:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+13:1964:x1830949051946368:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1060us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.449403:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4926 00000100:00100000:3.0:1746129742.449721:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.450596:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053198464:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129742.450623:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fe29600/0x48868a4e43947aee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e6b4 expref: 12 pid: 1877 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746129742.450634:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053198592:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129742.450647:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135bc9000/0x48868a4e43947a8c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e67c expref: 15 pid: 8435 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746129742.450654:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053198848:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129742.450672:0:1140:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a510c000/0x48868a4e43947d25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.450681:0:1140:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a510c000/0x48868a4e43947d25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.450686:0:1140:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a510c000/0x48868a4e43947d25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.450714:0:1140:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a510c000/0x48868a4e43947d25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.450720:0:1140:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a510c000/0x48868a4e43947d25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.450727:0:1140:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a510c000/0x48868a4e43947d25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.450732:0:1140:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a510c000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129742.450735:0:1140:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a510c000/0x48868a4e43947d25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.450741:0:1140:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a510c000/0x48868a4e43947d25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.450754:0:1140:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a510c000/0x48868a4e43947d25 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.450759:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a510c000/0x48868a4e43947d25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129742.450794:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949051944576:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 14127us (14238us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129742.450800:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10205 00000100:00100000:1.0:1746129742.450823:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051946752 00000100:00100000:1.0:1746129742.450827:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051946752 00010000:00010000:1.0:1746129742.450842:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fc95400/0x48868a4e43947c61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7be expref: 27 pid: 20441 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746129742.450875:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4927 00000100:00100000:1.0:1746129742.450880:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949051946752:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129742.450888:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129742.450898:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fc95400/0x48868a4e43947c61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7be expref: 27 pid: 20441 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746129742.450905:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fc95400/0x48868a4e43947c61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7be expref: 27 pid: 20441 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746129742.450917:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fc95400/0x48868a4e43947c61 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7be expref: 27 pid: 20441 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746129742.451450:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.451468:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051946880 00000100:00100000:0.0:1746129742.451471:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051946880 00002000:00100000:0.0:1746129742.451492:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (2285568->2629631) req@ffff88008fad3800 x1830949051946880/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129742.451500:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad3800 with x1830949051946880 ext(2285568->2629631) 00010000:00010000:0.0:1746129742.451505:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fc95600/0x48868a4e43947c6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2285568->3145727] (req 2285568->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7cc expref: 29 pid: 20441 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746129742.451513:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fc95600/0x48868a4e43947c6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2285568->3145727] (req 2285568->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7cc expref: 29 pid: 20441 timeout: 788 lvb_type: 0 00002000:00010000:0.0:1746129742.451519:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fad3800 00000100:00100000:0.0:1746129742.451531:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 515 00000100:00100000:0.0:1746129742.451536:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949051946880:12345-192.168.204.31@tcp:4:cat.0 00010000:00010000:0.0:1746129742.452014:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013261ac00/0x48868a4e43947920 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e595 expref: 30 pid: 3623 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746129742.452024:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5492680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053197696:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129742.452033:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb21800/0x48868a4e439477a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e4e6 expref: 12 pid: 20441 timeout: 788 lvb_type: 1 00000100:00100000:0.0:1746129742.452040:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5492d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053197952:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129742.452054:0:20441:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008fc95a00/0x48868a4e43947d17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.452060:0:20441:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008fc95a00/0x48868a4e43947d17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.452065:0:20441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fc95a00/0x48868a4e43947d17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.452083:0:20441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008fc95a00/0x48868a4e43947d17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.452089:0:20441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc95a00/0x48868a4e43947d17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.452094:0:20441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008fc95a00/0x48868a4e43947d17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.452099:0:20441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fc95a00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129742.452101:0:20441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fc95a00/0x48868a4e43947d17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.452106:0:20441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fc95a00/0x48868a4e43947d17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.452114:0:20441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008fc95a00/0x48868a4e43947d17 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.452118:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fc95a00/0x48868a4e43947d17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.452305:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.452307:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.452310:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a50e4600/0x48868a4e43947d1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.452317:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50e4600/0x48868a4e43947d1e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.452333:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129742.454439:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949051944704:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 18090us (18838us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.454448:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10203 00000100:00100000:1.0:1746129742.454516:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949051946752:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3635us (4795us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129742.454524:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4927 00000100:00100000:3.0:1746129742.465757:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1963:x1830949051945088:12345-192.168.204.31@tcp:4:cat.0 Request processed in 26835us (27004us total) trans 17179872963 rc 0/0 00000100:00100000:3.0:1746129742.465769:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 514 00002000:00100000:3.0:1746129742.465779:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (12288->520191) req@ffff88008fad0000 x1830949051945088/t17179872963(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/448 e 0 to 0 dl 1746129753 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.465788:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad0000 with x1830949051945088 ext(12288->520191) 00010000:00010000:3.0:1746129742.465796:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094fd8600/0x48868a4e43947c14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->520191) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e77f expref: 14 pid: 20441 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.465807:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094fd8600/0x48868a4e43947c14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->520191) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e77f expref: 14 pid: 20441 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746129742.465813:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fad0000 00000100:00100000:1.0:1746129742.466027:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.466954:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949051946880:12345-192.168.204.31@tcp:4:cat.0 Request processed in 15416us (15502us total) trans 17179872964 rc 0/0 00000100:00100000:0.0:1746129742.466962:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 515 00002000:00100000:0.0:1746129742.466968:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (2285568->2629631) req@ffff88008fad3800 x1830949051946880/t17179872964(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/448 e 0 to 0 dl 1746129753 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129742.466976:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad3800 with x1830949051946880 ext(2285568->2629631) 00010000:00010000:0.0:1746129742.466981:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fc95600/0x48868a4e43947c6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2285568->3145727] (req 2285568->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7cc expref: 30 pid: 20441 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746129742.466990:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fc95600/0x48868a4e43947c6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2285568->3145727] (req 2285568->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7cc expref: 30 pid: 20441 timeout: 788 lvb_type: 0 00002000:00010000:0.0:1746129742.466995:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fad3800 00000100:00100000:0.0:1746129742.470536:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.470562:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.470590:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051947264 00000100:00100000:0.0:1746129742.470599:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051947264 00010000:00010000:0.0:1746129742.470626:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094fd8600/0x48868a4e43947c14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->520191) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e77f expref: 14 pid: 20441 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746129742.470646:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051947520 00000100:00100000:0.0:1746129742.470648:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051947520 00010000:00010000:0.0:1746129742.470657:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50e5200/0x48868a4e43947cfb lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e82e expref: 16 pid: 14315 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.470825:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4928 00000100:00100000:3.0:1746129742.470835:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1964:x1830949051947264:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129742.470864:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129742.470884:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094fd8600/0x48868a4e43947c14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->520191) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e77f expref: 14 pid: 20441 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.470894:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094fd8600/0x48868a4e43947c14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->520191) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e77f expref: 14 pid: 20441 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.470911:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094fd8600/0x48868a4e43947c14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->520191) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e77f expref: 14 pid: 20441 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.470937:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129742.470939:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129742.470943:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a50e4c00/0x48868a4e43947d09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.470950:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50e4c00/0x48868a4e43947d09 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.470966:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129742.470999:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1964:x1830949051947264:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 166us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.471097:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4929 00000100:00100000:0.0:1746129742.471103:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+16:1963:x1830949051947520:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129742.471110:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129742.471116:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50e5200/0x48868a4e43947cfb lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e82e expref: 16 pid: 14315 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746129742.471124:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50e5200/0x48868a4e43947cfb lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e82e expref: 16 pid: 14315 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746129742.471136:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50e5200/0x48868a4e43947cfb lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e82e expref: 16 pid: 14315 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746129742.471147:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129742.471152:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e8000/0x48868a4e43947d3a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129742.471159:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e8000/0x48868a4e43947d3a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129742.471164:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e8000/0x48868a4e43947d3a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129742.471175:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129742.471190:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+15:1963:x1830949051947520:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 88us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.471196:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4929 00000100:00100000:0.0:1746129742.471651:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.471665:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051947392 00000100:00100000:0.0:1746129742.471669:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051947392 00010000:00010000:0.0:1746129742.471680:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc95600/0x48868a4e43947c6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2285568->3145727] (req 2285568->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7cc expref: 30 pid: 20441 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746129742.471694:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4930 00000100:00100000:0.0:1746129742.471699:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949051947392:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129742.471705:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746129742.471713:0:10980:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129742 -> 1746129743 00010000:00010000:0.0:1746129742.471718:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fc95600/0x48868a4e43947c6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2285568->3145727] (req 2285568->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7cc expref: 30 pid: 20441 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746129742.471726:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fc95600/0x48868a4e43947c6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2285568->3145727] (req 2285568->2629631) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7cc expref: 30 pid: 20441 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746129742.471737:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fc95600/0x48868a4e43947c6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2285568->3145727] (req 2285568->2629631) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e7cc expref: 30 pid: 20441 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746129742.471745:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.471746:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.471748:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a50e5800/0x48868a4e43947d2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.471754:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50e5800/0x48868a4e43947d2c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.471765:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129742.471779:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949051947392:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 80us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.471783:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4930 00000100:00100000:3.0:1746129742.472271:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4928 00000100:00100000:0.0:1746129742.476666:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.488023:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.488180:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051948032 00000100:00100000:3.0:1746129742.488188:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051948032 00000100:00100000:3.0:1746129742.488236:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3788 00000100:00100000:3.0:1746129742.488244:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+14:28335:x1830949051948032:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:3.0:1746129742.488437:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+15:28335:x1830949051948032:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 193us (421us total) trans 8589943493 rc 0/0 00000100:00100000:3.0:1746129742.488443:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3788 00000100:00100000:0.0:1746129742.498161:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.500111:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.505212:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.512413:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.512837:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051948928 00000100:00100000:3.0:1746129742.512875:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051948928 00002000:00100000:3.0:1746129742.512916:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (2584576->2588671) req@ffff88008fad1f80 x1830949051948928/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.512925:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad1f80 with x1830949051948928 ext(2584576->2588671) 00002000:00010000:3.0:1746129742.512930:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fad1f80 00000100:00100000:3.0:1746129742.514505:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3756 00000100:00100000:3.0:1746129742.514516:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1963:x1830949051948928:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129742.514682:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1963:x1830949051948928:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 168us (2276us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129742.514688:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3756 00002000:00100000:3.0:1746129742.514696:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (2584576->2588671) req@ffff88008fad1f80 x1830949051948928/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/4536 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.514704:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad1f80 with x1830949051948928 ext(2584576->2588671) 00002000:00010000:3.0:1746129742.514708:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fad1f80 00000100:00100000:0.0:1746129742.520358:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129742.521391:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e8e00/0x48868a4e43947d4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e843 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.521484:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9000/0x48868a4e43947d56 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.521495:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9000/0x48868a4e43947d56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.521504:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9000/0x48868a4e43947d56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.521512:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9200/0x48868a4e43947d5d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.521518:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9200/0x48868a4e43947d5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.521523:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9200/0x48868a4e43947d5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.521616:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9400/0x48868a4e43947d64 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.521624:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9400/0x48868a4e43947d64 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.521630:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9400/0x48868a4e43947d64 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:2.0:1746129742.521637:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129742.521697:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9000/0x48868a4e43947d56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.521703:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9000/0x48868a4e43947d56 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.521712:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9000/0x48868a4e43947d56 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.521716:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b52e9000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129742.521719:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9000/0x48868a4e43947d56 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.521724:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9000/0x48868a4e43947d56 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.521732:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129742.521735:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129742.521738:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9000/0x48868a4e43947d56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.521742:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9000/0x48868a4e43947d56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.521755:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9200/0x48868a4e43947d5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.521759:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9200/0x48868a4e43947d5d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.521763:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9200/0x48868a4e43947d5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.521767:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b52e9200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129742.521769:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9200/0x48868a4e43947d5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.521773:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9200/0x48868a4e43947d5d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.521781:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012bfca000) 00010000:00010000:2.0:1746129742.521783:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129742.521785:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9200/0x48868a4e43947d5d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.521789:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9200/0x48868a4e43947d5d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.521817:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e8e00/0x48868a4e43947d4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e843 expref: 298 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.521828:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9400/0x48868a4e43947d64 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e843 expref: 297 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.521833:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129742.521835:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129742.521837:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b52e9400, rc 0) 00000100:00100000:2.0:1746129742.521895:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:28343:x1830949051949184:12345-192.168.204.31@tcp:101:cat.0 Request processed in 536us (1544us total) trans 8589943495 rc 0/0 00000100:00100000:2.0:1746129742.521901:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9730 00000100:00100000:0.0:1746129742.523446:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.523590:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051949440 00000100:00100000:3.0:1746129742.523596:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051949440 00000100:00100000:3.0:1746129742.523639:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3790 00000100:00100000:3.0:1746129742.523646:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:28343:x1830949051949440:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:3.0:1746129742.523828:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:28343:x1830949051949440:12345-192.168.204.31@tcp:35:cat.0 Request processed in 182us (385us total) trans 8589943496 rc 0/0 00000100:00100000:3.0:1746129742.523834:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3790 00000100:00100000:1.0:1746129742.526806:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.526868:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051949568 00000100:00100000:0.0:1746129742.526874:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051949568 00000100:00100000:0.0:1746129742.526914:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10208 00000100:00100000:0.0:1746129742.526921:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949051949568:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129742.526935:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129742.526950:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094fd8800/0x48868a4e43947d72 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e84a expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129742.526970:0:4589:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e8:0x0] initial LVB size: 1048576, mtime: 0x6813d34e, atime: 0x6813d34e, ctime: 0x6813d34e, blocks: 0x7b7 00010000:00010000:0.0:1746129742.526985:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.526987:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.526995:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094fd8800/0x48868a4e43947d72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e84a expref: 30 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129742.527008:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094fd8800/0x48868a4e43947d72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e84a expref: 30 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129742.527018:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fd8800, rc 0) 00000100:00100000:0.0:1746129742.527064:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949051949568:12345-192.168.204.31@tcp:101:cat.0 Request processed in 143us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.527069:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10208 00000100:00100000:0.0:1746129742.529823:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.529891:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.529912:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.529935:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.529952:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051949824 00000100:00100000:0.0:1746129742.529959:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051949824 00000100:00100000:0.0:1746129742.529987:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051950080 00000100:00100000:0.0:1746129742.529989:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051950080 00000100:00100000:0.0:1746129742.529999:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051949696 00000100:00100000:0.0:1746129742.530001:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051949696 00000100:00100000:0.0:1746129742.530008:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051949952 00000100:00100000:0.0:1746129742.530010:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051949952 00000100:00100000:0.0:1746129742.530021:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10209 00000100:00100000:0.0:1746129742.530028:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949051949824:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129742.530042:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129742.530056:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094fd8a00/0x48868a4e43947d79 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e858 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129742.530068:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10210 00002000:00010000:0.0:1746129742.530075:0:20441:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e7:0x0] initial LVB size: 2097152, mtime: 0x6813d34e, atime: 0x6813d34e, ctime: 0x6813d34e, blocks: 0x821 00000100:00100000:1.0:1746129742.530076:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949051950080:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129742.530084:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129742.530090:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.530092:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.530093:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a510c800/0x48868a4e43947d80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e866 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.530099:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fd8a00/0x48868a4e43947d79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e858 expref: 28 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129742.530112:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094fd8a00/0x48868a4e43947d79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e858 expref: 28 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129742.530120:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fd8a00, rc 0) 00000100:00100000:1.0:1746129742.530128:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053199232:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129742.530155:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949051949824:12345-192.168.204.31@tcp:101:cat.0 Request processed in 127us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.530160:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10209 00000100:00100000:0.0:1746129742.530172:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10211 00000100:00100000:0.0:1746129742.530176:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949051949696:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129742.530182:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129742.530183:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584300 going to sleep for 11 seconds 00010000:00010000:0.0:1746129742.530189:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094fd9200/0x48868a4e43947d87 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e851 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129742.530198:0:20441:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e6:0x0] initial LVB size: 2097152, mtime: 0x6813d34e, atime: 0x6813d34e, ctime: 0x6813d34e, blocks: 0x821 00000100:00100000:1.0:1746129742.530200:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10212 00000100:00100000:1.0:1746129742.530205:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949051949952:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129742.530206:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.530207:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.530210:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129742.530211:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fd9200/0x48868a4e43947d87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e851 expref: 28 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.530216:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a510d000/0x48868a4e43947d8e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e85f expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.530219:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094fd9200/0x48868a4e43947d87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e851 expref: 28 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129742.530225:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fd9200, rc 0) 00002000:00010000:1.0:1746129742.530229:0:7976:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3ea:0x0] initial LVB size: 2097152, mtime: 0x6813d34d, atime: 0x6813d34d, ctime: 0x6813d34d, blocks: 0x81f 00010000:00010000:1.0:1746129742.530236:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.530238:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746129742.530239:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949051949696:12345-192.168.204.31@tcp:101:cat.0 Request processed in 63us (326us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129742.530243:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a510d000/0x48868a4e43947d8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e85f expref: 33 pid: 7976 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129742.530244:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10211 00010000:00010000:1.0:1746129742.530252:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a510d000/0x48868a4e43947d8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e85f expref: 33 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.530258:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a510d000, rc 0) 00000100:00100000:1.0:1746129742.530274:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949051949952:12345-192.168.204.31@tcp:101:cat.0 Request processed in 69us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129742.530279:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10212 00000100:00100000:0.0:1746129742.530280:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.530289:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051950208 00000100:00100000:1.0:1746129742.530291:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051950208 00000100:00100000:1.0:1746129742.530313:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10213 00000100:00100000:1.0:1746129742.530318:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949051950208:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129742.530323:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129742.530330:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a510d400/0x48868a4e43947d95 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e86d expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129742.530340:0:7976:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e8:0x0] initial LVB size: 4194304, mtime: 0x6813d34e, atime: 0x6813d34e, ctime: 0x6813d34e, blocks: 0x1029 00010000:00010000:1.0:1746129742.530347:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.530348:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.530352:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a510d400/0x48868a4e43947d95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e86d expref: 29 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.530361:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a510d400/0x48868a4e43947d95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e86d expref: 29 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.531049:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a510d400, rc 0) 00000100:00100000:1.0:1746129742.531068:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949051950208:12345-192.168.204.31@tcp:101:cat.0 Request processed in 749us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129742.531072:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10213 00002000:00010000:1.0:1746129742.532870:0:1140:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime: 1746129742 -> 1746129743 00002000:00010000:1.0:1746129742.532876:0:1140:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime: 1746129742 -> 1746129743 00000100:00100000:1.0:1746129742.532893:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053199232:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129742.532916:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a510c800/0x48868a4e43947d80 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e866 expref: 32 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.532926:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a510c800/0x48868a4e43947d80 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e866 expref: 32 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.532950:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a510c800, rc 0) 00000100:00100000:1.0:1746129742.532984:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949051950080:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2909us (3093us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129742.532990:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10210 00000100:00100000:0.0:1746129742.540758:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.541021:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051950464 00000100:00100000:3.0:1746129742.541030:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051950464 00002000:00100000:3.0:1746129742.541068:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800a5492d80 x1830949051950464/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.541076:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5492d80 with x1830949051950464 ext(0->1048575) 00002000:00010000:3.0:1746129742.541080:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5492d80 00000100:00100000:1.0:1746129742.541087:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.541127:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051950848 00000100:00100000:3.0:1746129742.541130:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051950848 00000100:00100000:1.0:1746129742.541137:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:3.0:1746129742.541142:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800a645c380 x1830949051950848/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.541150:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645c380 with x1830949051950848 ext(1048576->2097151) 00002000:00010000:3.0:1746129742.541152:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645c380 00000100:00100000:3.0:1746129742.541166:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051950976 00000100:00100000:3.0:1746129742.541169:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051950976 00002000:00100000:3.0:1746129742.541178:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800a645f480 x1830949051950976/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746129742.541179:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:3.0:1746129742.541185:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645f480 with x1830949051950976 ext(1048576->2097151) 00002000:00010000:3.0:1746129742.541187:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645f480 00000100:00100000:3.0:1746129742.541194:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051951232 00000100:00100000:3.0:1746129742.541196:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051951232 00002000:00100000:3.0:1746129742.541203:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff8800a645e680 x1830949051951232/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.541209:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645e680 with x1830949051951232 ext(1048576->2097151) 00002000:00010000:3.0:1746129742.541212:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a645e680 00000100:00100000:3.0:1746129742.541222:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3757 00000100:00100000:3.0:1746129742.541228:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949051950464:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129742.541231:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3758 00000100:00100000:0.0:1746129742.541236:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949051950848:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129742.542246:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3759 00000100:00100000:2.0:1746129742.542254:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949051950976:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129742.542944:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3760 00000100:00100000:0.0:1746129742.542952:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949051951232:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129742.560294:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949051950848:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19049us (19198us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129742.560305:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3758 00002000:00100000:2.0:1746129742.560315:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800a645c380 x1830949051950848/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/440 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129742.560329:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645c380 with x1830949051950848 ext(1048576->2097151) 00002000:00010000:2.0:1746129742.560334:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645c380 00000100:00100000:3.0:1746129742.568970:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949051950464:12345-192.168.204.31@tcp:3:cat.0 Request processed in 27730us (28208us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129742.568981:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3757 00002000:00100000:3.0:1746129742.568992:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800a5492d80 x1830949051950464/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/440 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.569000:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5492d80 with x1830949051950464 ext(0->1048575) 00002000:00010000:3.0:1746129742.569006:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5492d80 00000100:00100000:0.0:1746129742.572287:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949051951232:12345-192.168.204.31@tcp:3:cat.0 Request processed in 29327us (31098us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129742.572301:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3760 00002000:00100000:0.0:1746129742.572311:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff8800a645e680 x1830949051951232/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/440 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129742.572319:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645e680 with x1830949051951232 ext(1048576->2097151) 00002000:00010000:0.0:1746129742.572324:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a645e680 00000100:00100000:0.0:1746129742.579511:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.579576:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051951360 00000100:00100000:1.0:1746129742.579584:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051951360 00000100:00100000:0.0:1746129742.579584:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.579599:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051951488 00000100:00100000:0.0:1746129742.579601:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051951488 00000100:00100000:1.0:1746129742.579617:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10214 00000100:00100000:1.0:1746129742.579628:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1963:x1830949051951360:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129742.579643:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129742.579657:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092af6600/0x48868a4e43947d9c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e874 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.579675:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.579677:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.579685:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092af6600/0x48868a4e43947d9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e874 expref: 15 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.579699:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092af6600/0x48868a4e43947d9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e874 expref: 15 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.579709:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092af6600, rc 0) 00000100:00100000:1.0:1746129742.579744:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1963:x1830949051951360:12345-192.168.204.31@tcp:101:cat.0 Request processed in 120us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129742.580168:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949051950976:12345-192.168.204.31@tcp:3:cat.0 Request processed in 37914us (39028us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129742.580175:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3759 00002000:00100000:2.0:1746129742.580182:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800a645f480 x1830949051950976/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/440 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129742.580191:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645f480 with x1830949051950976 ext(1048576->2097151) 00002000:00010000:2.0:1746129742.580195:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645f480 00000100:00100000:0.0:1746129742.580604:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10215 00000100:00100000:0.0:1746129742.580612:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1964:x1830949051951488:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129742.580620:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129742.580630:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094fd9000/0x48868a4e43947da3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e87b expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.580641:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.580643:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.580648:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fd9000/0x48868a4e43947da3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e87b expref: 16 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129742.580657:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094fd9000/0x48868a4e43947da3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e87b expref: 16 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129742.580664:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fd9000, rc 0) 00000100:00100000:0.0:1746129742.580680:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949051951488:12345-192.168.204.31@tcp:101:cat.0 Request processed in 71us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.580688:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10215 00000100:00100000:0.0:1746129742.580721:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.580735:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051951616 00000100:00100000:0.0:1746129742.580738:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051951616 00000100:00100000:0.0:1746129742.580754:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10216 00000100:00100000:0.0:1746129742.580759:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949051951616:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129742.580764:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129742.580770:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094fd8600/0x48868a4e43947daa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e882 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.580779:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.580780:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.580784:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fd8600/0x48868a4e43947daa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e882 expref: 17 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129742.580792:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094fd8600/0x48868a4e43947daa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e882 expref: 17 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129742.580797:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fd8600, rc 0) 00000100:00100000:0.0:1746129742.580811:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949051951616:12345-192.168.204.31@tcp:101:cat.0 Request processed in 53us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.580816:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10216 00000100:00100000:0.0:1746129742.580867:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.580878:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051951744 00000100:00100000:0.0:1746129742.580881:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051951744 00000100:00100000:0.0:1746129742.580895:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10217 00000100:00100000:0.0:1746129742.580900:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949051951744:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129742.580906:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129742.580914:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00afc00/0x48868a4e43947db1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e889 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.580924:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.580925:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.580929:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00afc00/0x48868a4e43947db1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e889 expref: 17 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129742.580937:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00afc00/0x48868a4e43947db1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e889 expref: 17 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129742.580943:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00afc00, rc 0) 00000100:00100000:0.0:1746129742.580958:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949051951744:12345-192.168.204.31@tcp:101:cat.0 Request processed in 58us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.580962:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10217 00000100:00100000:0.0:1746129742.581008:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.581020:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051951872 00000100:00100000:0.0:1746129742.581022:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051951872 00000100:00100000:0.0:1746129742.581037:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10218 00000100:00100000:0.0:1746129742.581041:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1963:x1830949051951872:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129742.581047:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129742.581053:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a00afa00/0x48868a4e43947db8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e890 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.581061:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.581062:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.581066:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00afa00/0x48868a4e43947db8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e890 expref: 18 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129742.581074:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a00afa00/0x48868a4e43947db8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e890 expref: 18 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129742.581079:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00afa00, rc 0) 00000100:00100000:0.0:1746129742.581093:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1963:x1830949051951872:12345-192.168.204.31@tcp:101:cat.0 Request processed in 51us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.581097:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10218 00000100:00100000:1.0:1746129742.582239:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10214 00000100:00100000:0.0:1746129742.589620:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129742.589956:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051952128 00000100:00100000:2.0:1746129742.589964:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051952128 00002000:00100000:2.0:1746129742.589999:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012c08b800 x1830949051952128/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129742.590009:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c08b800 with x1830949051952128 ext(0->1048575) 00002000:00010000:2.0:1746129742.590013:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c08b800 00000100:00100000:2.0:1746129742.590376:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3761 00000100:00100000:2.0:1746129742.590384:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949051952128:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129742.591804:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.593019:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.593057:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.593083:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051952384 00000100:00100000:0.0:1746129742.593083:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.593093:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051952384 00000100:00100000:0.0:1746129742.593109:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051952640 00000100:00100000:0.0:1746129742.593112:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051952640 00002000:00100000:3.0:1746129742.593127:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff880094d8e680 x1830949051952384/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129742.593127:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012c08b480 x1830949051952640/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129742.593135:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c08b480 with x1830949051952640 ext(1048576->2097151) 00002000:00100000:3.0:1746129742.593139:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8e680 with x1830949051952384 ext(1048576->2097151) 00002000:00010000:0.0:1746129742.593139:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c08b480 00002000:00010000:3.0:1746129742.593142:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d8e680 00000100:00100000:3.0:1746129742.593482:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051953024 00000100:00100000:3.0:1746129742.593488:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051953024 00000100:00100000:0.0:1746129742.593488:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3762 00000100:00100000:0.0:1746129742.593495:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1964:x1830949051952640:12345-192.168.204.31@tcp:3:cat.0 00002000:00100000:3.0:1746129742.593501:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88012c089180 x1830949051953024/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.593511:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c089180 with x1830949051953024 ext(1048576->2097151) 00002000:00010000:3.0:1746129742.593513:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c089180 00000100:00100000:3.0:1746129742.593525:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3763 00000100:00100000:3.0:1746129742.593533:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1964:x1830949051952384:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129742.594597:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3764 00000100:00100000:1.0:1746129742.594605:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c089180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949051953024:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129742.595238:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051952896 00000100:00100000:0.0:1746129742.595244:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051952896 00000100:00100000:0.0:1746129742.595268:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10219 00000100:00100000:0.0:1746129742.595273:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c089500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:28343:x1830949051952896:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129742.595282:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129742.595296:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f71600/0x48868a4e43947dbf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e897 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.595316:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b52e8200/0x48868a4e43947d48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2154496->2588671) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e83c expref: 19 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.595322:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129742.595324:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129742.595327:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f71600/0x48868a4e43947dbf lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e897 expref: 32 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.595352:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b52e8200/0x48868a4e43947d48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2154496->2588671) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e83c expref: 19 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.595363:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b52e8200/0x48868a4e43947d48 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2154496->2588671) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e83c expref: 19 pid: 8435 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746129742.595372:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c08a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053199360:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129742.595438:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135d2c840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129742.598194:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.598284:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051953280 00000100:00100000:3.0:1746129742.598292:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051953280 00000100:00100000:3.0:1746129742.598975:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9731 00000100:00100000:3.0:1746129742.598984:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:28349:x1830949051953280:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129742.599005:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129742.599021:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d000/0x48868a4e43947dc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e89e expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.599115:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d200/0x48868a4e43947dcd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.599126:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d200/0x48868a4e43947dcd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.599139:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d200/0x48868a4e43947dcd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.599151:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d400/0x48868a4e43947dd4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.599156:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d400/0x48868a4e43947dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.599161:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d400/0x48868a4e43947dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.599248:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d600/0x48868a4e43947ddb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.599257:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d600/0x48868a4e43947ddb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.599264:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d600/0x48868a4e43947ddb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129742.599272:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129742.599342:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d200/0x48868a4e43947dcd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.599348:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d200/0x48868a4e43947dcd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.599353:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d200/0x48868a4e43947dcd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.599357:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c65d200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129742.599360:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d200/0x48868a4e43947dcd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.599365:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d200/0x48868a4e43947dcd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.599373:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129742.599375:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129742.599379:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d200/0x48868a4e43947dcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.599383:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d200/0x48868a4e43947dcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.599399:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d400/0x48868a4e43947dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.599403:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d400/0x48868a4e43947dd4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.599408:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d400/0x48868a4e43947dd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.599411:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c65d400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129742.599413:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d400/0x48868a4e43947dd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.599417:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d400/0x48868a4e43947dd4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.599423:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008fe79c00) 00010000:00010000:3.0:1746129742.599425:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129742.599427:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d400/0x48868a4e43947dd4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.599431:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d400/0x48868a4e43947dd4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.599463:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d000/0x48868a4e43947dc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e89e expref: 301 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.599473:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d600/0x48868a4e43947ddb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e89e expref: 300 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.599479:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129742.599481:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129742.599483:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c65d600, rc 0) 00000100:00100000:3.0:1746129742.601067:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:28349:x1830949051953280:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2079us (2876us total) trans 8589943497 rc 0/0 00000100:00100000:3.0:1746129742.601075:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9731 00000100:00100000:2.0:1746129742.601964:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c08a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053199360:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129742.601988:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f71600/0x48868a4e43947dbf lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e897 expref: 32 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.602005:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f71600, rc 0) 00000100:00100000:2.0:1746129742.602055:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c089500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:28343:x1830949051952896:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6780us (8996us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129742.602063:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10219 00000100:00100000:0.0:1746129742.602585:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129742.602706:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051953408 00000100:00100000:2.0:1746129742.602712:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051953408 00002000:00100000:2.0:1746129742.602739:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (2154496->2588671) req@ffff88012c089f80 x1830949051953408/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129742.602748:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c089f80 with x1830949051953408 ext(2154496->2588671) 00010000:00010000:2.0:1746129742.602754:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b52e8200/0x48868a4e43947d48 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2154496->2588671) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e83c expref: 20 pid: 8435 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746129742.602766:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b52e8200/0x48868a4e43947d48 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2154496->2588671) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e83c expref: 20 pid: 8435 timeout: 788 lvb_type: 0 00002000:00010000:2.0:1746129742.602771:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c089f80 00000100:00100000:2.0:1746129742.602786:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 516 00000100:00100000:2.0:1746129742.602792:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c089f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949051953408:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129742.604205:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949051952128:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13816us (14586us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129742.604214:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3761 00002000:00100000:3.0:1746129742.604223:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012c08b800 x1830949051952128/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/440 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.604231:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c08b800 with x1830949051952128 ext(0->1048575) 00002000:00010000:3.0:1746129742.604235:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c08b800 00000100:00100000:2.0:1746129742.610790:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949051952640:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17287us (17766us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129742.610801:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3762 00002000:00100000:2.0:1746129742.610811:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012c08b480 x1830949051952640/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/440 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129742.610819:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c08b480 with x1830949051952640 ext(1048576->2097151) 00002000:00010000:2.0:1746129742.610825:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c08b480 00000100:00100000:1.0:1746129742.614268:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c089180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949051953024:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19511us (21031us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129742.614280:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3764 00002000:00100000:1.0:1746129742.614291:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88012c089180 x1830949051953024/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/440 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129742.614307:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c089180 with x1830949051953024 ext(1048576->2097151) 00002000:00010000:1.0:1746129742.614312:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c089180 00000100:00100000:3.0:1746129742.617584:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949051952384:12345-192.168.204.31@tcp:3:cat.0 Request processed in 24034us (25764us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129742.617595:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3763 00002000:00100000:3.0:1746129742.617604:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff880094d8e680 x1830949051952384/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/440 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.617618:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8e680 with x1830949051952384 ext(1048576->2097151) 00002000:00010000:3.0:1746129742.617622:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d8e680 00000100:00100000:2.0:1746129742.619056:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c089f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949051953408:12345-192.168.204.31@tcp:4:cat.0 Request processed in 16260us (16469us total) trans 17179872965 rc 0/0 00000100:00100000:2.0:1746129742.619067:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 516 00002000:00100000:2.0:1746129742.619073:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (2154496->2588671) req@ffff88012c089f80 x1830949051953408/t17179872965(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/448 e 0 to 0 dl 1746129753 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129742.619081:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c089f80 with x1830949051953408 ext(2154496->2588671) 00010000:00010000:2.0:1746129742.619089:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b52e8200/0x48868a4e43947d48 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2154496->2588671) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e83c expref: 18 pid: 8435 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746129742.619101:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b52e8200/0x48868a4e43947d48 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2154496->2588671) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e83c expref: 18 pid: 8435 timeout: 788 lvb_type: 0 00002000:00010000:2.0:1746129742.619106:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c089f80 00000100:00100000:2.0:1746129742.619769:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.619870:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051953536 00000100:00100000:3.0:1746129742.619877:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051953536 00000100:00100000:0.0:1746129742.619987:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 553 00000100:00100000:0.0:1746129742.619995:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:1961:x1830949051953536:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129742.620006:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129742.620023:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d600/0x48868a4e43947ddb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e89e expref: 300 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.620053:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129742.620057:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129742.620088:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:1961:x1830949051953536:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 94us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.620093:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 553 00000100:00100000:0.0:1746129742.622031:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.629617:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051953664 00000100:00100000:3.0:1746129742.629629:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051953664 00010000:00010000:3.0:1746129742.629664:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b52e8200/0x48868a4e43947d48 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2154496->2588671) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e83c expref: 18 pid: 8435 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.629697:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4931 00000100:00100000:3.0:1746129742.629706:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130564450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949051953664:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129742.629720:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129742.629743:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b52e8200/0x48868a4e43947d48 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2154496->2588671) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e83c expref: 18 pid: 8435 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.629756:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b52e8200/0x48868a4e43947d48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2154496->2588671) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e83c expref: 18 pid: 8435 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.629777:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b52e8200/0x48868a4e43947d48 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2154496->2588671) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e83c expref: 18 pid: 8435 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.629814:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129742.629816:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129742.629822:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f71600/0x48868a4e43947dbf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e897 expref: 31 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.629834:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f71600/0x48868a4e43947dbf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e897 expref: 31 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.629894:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f71600/0x48868a4e43947dbf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e897 expref: 31 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129742.629905:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053199488:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129742.629977:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f900 going to sleep for 11 seconds 00000100:00100000:1.0:1746129742.631104:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129742.631160:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051953792 00000100:00100000:2.0:1746129742.631165:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051953792 00000100:00100000:2.0:1746129742.631196:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10220 00000100:00100000:2.0:1746129742.631201:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28348:x1830949051953792:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129742.631215:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129742.631225:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363cec00/0x48868a4e43947de9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e8a5 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.631240:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129742.631242:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129742.631246:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363cec00/0x48868a4e43947de9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8a5 expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.631256:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801363cec00/0x48868a4e43947de9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8a5 expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.631265:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801363cec00, rc 0) 00000100:00100000:2.0:1746129742.631302:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:28348:x1830949051953792:12345-192.168.204.31@tcp:101:cat.0 Request processed in 100us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129742.631307:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10220 00000100:00100000:3.0:1746129742.638589:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053199488:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129742.638606:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129742.638692:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130564450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949051953664:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8987us (16665us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.638713:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4931 00000100:00100000:0.0:1746129742.642175:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129742.642246:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051954048 00000100:00100000:2.0:1746129742.642253:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051954048 00002000:00100000:2.0:1746129742.642289:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012c08bb80 x1830949051954048/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129742.642298:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c08bb80 with x1830949051954048 ext(2097152->3145727) 00002000:00010000:2.0:1746129742.642302:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c08bb80 00000100:00100000:2.0:1746129742.642332:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3765 00000100:00100000:2.0:1746129742.642338:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1963:x1830949051954048:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129742.643661:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.645586:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051954304 00000100:00100000:3.0:1746129742.645596:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051954304 00002000:00100000:3.0:1746129742.645631:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012c089880 x1830949051954304/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.645642:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c089880 with x1830949051954304 ext(3145728->4194303) 00002000:00010000:3.0:1746129742.645646:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c089880 00000100:00100000:3.0:1746129742.645677:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3766 00000100:00100000:3.0:1746129742.645685:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1963:x1830949051954304:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129742.646463:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.646493:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.646513:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.646525:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.646538:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051954688 00000100:00100000:0.0:1746129742.646541:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051954688 00002000:00100000:0.0:1746129742.646559:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012c08a680 x1830949051954688/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129742.646579:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c08a680 with x1830949051954688 ext(3145728->4194303) 00002000:00010000:0.0:1746129742.646582:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c08a680 00000100:00100000:0.0:1746129742.646592:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051954560 00000100:00100000:0.0:1746129742.646594:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051954560 00002000:00100000:0.0:1746129742.646603:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880094eb4380 x1830949051954560/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129742.646608:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb4380 with x1830949051954560 ext(2097152->3145727) 00002000:00010000:0.0:1746129742.646610:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eb4380 00000100:00100000:0.0:1746129742.646617:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051955072 00000100:00100000:0.0:1746129742.646620:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051955072 00002000:00100000:0.0:1746129742.646629:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880094eb4a80 x1830949051955072/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129742.646634:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb4a80 with x1830949051955072 ext(2097152->3145727) 00002000:00010000:0.0:1746129742.646637:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb4a80 00000100:00100000:0.0:1746129742.646642:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051955328 00000100:00100000:0.0:1746129742.646644:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051955328 00002000:00100000:0.0:1746129742.646650:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880094eb6300 x1830949051955328/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129742.646655:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb6300 with x1830949051955328 ext(3145728->4194303) 00002000:00010000:0.0:1746129742.646657:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb6300 00000100:00100000:0.0:1746129742.646665:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3767 00000100:00100000:0.0:1746129742.646670:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1963:x1830949051954688:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129742.646776:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3768 00000100:00100000:3.0:1746129742.646782:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1963:x1830949051954560:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129742.647650:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3769 00000100:00100000:0.0:1746129742.647656:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949051955072:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129742.647682:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3770 00000100:00100000:3.0:1746129742.647686:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949051955328:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129742.648600:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.648638:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.648651:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051955584 00000100:00100000:1.0:1746129742.648654:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051955840 00000100:00100000:0.0:1746129742.648655:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051955584 00000100:00100000:1.0:1746129742.648657:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051955840 00002000:00100000:1.0:1746129742.648675:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880094eb7800 x1830949051955840/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129742.648675:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880094eb7b80 x1830949051955584/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129742.648682:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb7800 with x1830949051955840 ext(3145728->4194303) 00002000:00100000:0.0:1746129742.648682:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb7b80 with x1830949051955584 ext(2097152->3145727) 00002000:00010000:0.0:1746129742.648685:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eb7b80 00002000:00010000:1.0:1746129742.648686:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eb7800 00000100:00100000:2.0:1746129742.651974:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3771 00000100:00100000:2.0:1746129742.651990:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949051955584:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129742.652372:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3772 00000100:00100000:3.0:1746129742.652380:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949051955840:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129742.654073:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1963:x1830949051954048:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11729us (11901us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129742.654081:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3765 00002000:00100000:3.0:1746129742.654089:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012c08bb80 x1830949051954048/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/440 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.654097:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c08bb80 with x1830949051954048 ext(2097152->3145727) 00002000:00010000:3.0:1746129742.654103:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c08bb80 00000100:00100000:2.0:1746129742.662309:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1963:x1830949051954688:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15626us (15834us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129742.662321:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3767 00002000:00100000:2.0:1746129742.662333:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012c08a680 x1830949051954688/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/440 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129742.662342:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c08a680 with x1830949051954688 ext(3145728->4194303) 00002000:00010000:2.0:1746129742.662348:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c08a680 00000100:00100000:3.0:1746129742.668054:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1963:x1830949051954560:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21257us (21545us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129742.668065:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3768 00002000:00100000:3.0:1746129742.668074:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880094eb4380 x1830949051954560/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/440 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.668082:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb4380 with x1830949051954560 ext(2097152->3145727) 00002000:00010000:3.0:1746129742.668087:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eb4380 00000100:00100000:3.0:1746129742.675036:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949051955328:12345-192.168.204.31@tcp:3:cat.0 Request processed in 27338us (28498us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129742.675046:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3770 00002000:00100000:3.0:1746129742.675056:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880094eb6300 x1830949051955328/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/440 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.675065:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb6300 with x1830949051955328 ext(3145728->4194303) 00002000:00010000:3.0:1746129742.675071:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb6300 00000100:00100000:1.0:1746129742.680760:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949051955072:12345-192.168.204.31@tcp:3:cat.0 Request processed in 33096us (34238us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129742.680769:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3769 00002000:00100000:1.0:1746129742.680779:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880094eb4a80 x1830949051955072/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/440 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129742.680787:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb4a80 with x1830949051955072 ext(2097152->3145727) 00002000:00010000:1.0:1746129742.680792:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb4a80 00000100:00100000:3.0:1746129742.693786:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1963:x1830949051954304:12345-192.168.204.31@tcp:3:cat.0 Request processed in 48092us (50118us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129742.693796:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3766 00002000:00100000:3.0:1746129742.693806:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012c089880 x1830949051954304/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/440 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.693814:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c089880 with x1830949051954304 ext(3145728->4194303) 00002000:00010000:3.0:1746129742.693818:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c089880 00000100:00100000:2.0:1746129742.695490:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949051955584:12345-192.168.204.31@tcp:3:cat.0 Request processed in 43501us (46885us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129742.695503:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3771 00002000:00100000:2.0:1746129742.695511:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880094eb7b80 x1830949051955584/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/440 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129742.695519:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb7b80 with x1830949051955584 ext(2097152->3145727) 00002000:00010000:2.0:1746129742.695523:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eb7b80 00000100:00100000:3.0:1746129742.701761:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949051955840:12345-192.168.204.31@tcp:3:cat.0 Request processed in 49371us (53111us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129742.701773:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3772 00002000:00100000:3.0:1746129742.701785:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880094eb7800 x1830949051955840/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/440 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.701792:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb7800 with x1830949051955840 ext(3145728->4194303) 00002000:00010000:3.0:1746129742.701797:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eb7800 00000100:00100000:0.0:1746129742.704917:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.704996:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051956096 00000100:00100000:3.0:1746129742.705004:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051956096 00002000:00100000:3.0:1746129742.705039:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880094eb5880 x1830949051956096/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.705048:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb5880 with x1830949051956096 ext(4194304->4964351) 00002000:00010000:3.0:1746129742.705053:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb5880 00000100:00100000:3.0:1746129742.705083:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3773 00000100:00100000:3.0:1746129742.705091:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1963:x1830949051956096:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129742.717136:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129742.717377:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051956352 00000100:00100000:2.0:1746129742.717385:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051956352 00002000:00100000:2.0:1746129742.717420:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880094eb6680 x1830949051956352/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129742.717428:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb6680 with x1830949051956352 ext(4194304->4964351) 00002000:00010000:2.0:1746129742.717433:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb6680 00000100:00100000:2.0:1746129742.717465:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3774 00000100:00100000:2.0:1746129742.717472:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1963:x1830949051956352:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129742.717658:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1963:x1830949051956096:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12566us (12747us total) trans 0 rc 770048/770048 00000100:00100000:3.0:1746129742.717665:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3773 00002000:00100000:3.0:1746129742.717671:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880094eb5880 x1830949051956096/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/440 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.717679:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb5880 with x1830949051956096 ext(4194304->4964351) 00002000:00010000:3.0:1746129742.717682:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb5880 00000100:00100000:2.0:1746129742.733484:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1963:x1830949051956352:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16004us (16347us total) trans 0 rc 770048/770048 00000100:00100000:2.0:1746129742.733494:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3774 00002000:00100000:2.0:1746129742.733504:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880094eb6680 x1830949051956352/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/440 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129742.733512:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb6680 with x1830949051956352 ext(4194304->4964351) 00002000:00010000:2.0:1746129742.733518:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb6680 00000100:00100000:0.0:1746129742.752261:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129742.752346:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051956480 00000100:00100000:2.0:1746129742.752353:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051956480 00000100:00100000:2.0:1746129742.752395:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10221 00000100:00100000:2.0:1746129742.752402:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28352:x1830949051956480:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129742.752419:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129742.752432:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093eefc00/0x48868a4e43947df0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e8ac expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.752455:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a510d000/0x48868a4e43947d8e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e85f expref: 31 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129742.752463:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00afc00/0x48868a4e43947db1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e889 expref: 19 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129742.752469:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129742.752470:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129742.752474:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093eefc00/0x48868a4e43947df0 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1114112->1196031] (req 1114112->1196031) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ac expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.752496:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00afc00/0x48868a4e43947db1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e889 expref: 19 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129742.752506:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a00afc00/0x48868a4e43947db1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e889 expref: 19 pid: 3624 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746129742.752516:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053199616:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129742.752610:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a510d000/0x48868a4e43947d8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e85f expref: 31 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129742.752617:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a510d000/0x48868a4e43947d8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e85f expref: 31 pid: 7976 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746129742.752628:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053199744:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129742.752643:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129742.757633:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129742.758269:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053199616:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129742.758281:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053199744:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129742.758304:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093eefc00/0x48868a4e43947df0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1114112->1196031] (req 1114112->1196031) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ac expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.758318:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093eefc00, rc 0) 00000100:00100000:2.0:1746129742.758355:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:28352:x1830949051956480:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5953us (6101us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129742.758362:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10221 00000100:00100000:2.0:1746129742.758420:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.758608:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051956608 00000100:00100000:0.0:1746129742.758613:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051956608 00010000:00010000:0.0:1746129742.758635:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00afc00/0x48868a4e43947db1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e889 expref: 19 pid: 3624 timeout: 788 lvb_type: 1 00000100:00100000:3.0:1746129742.759092:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051956736 00000100:00100000:3.0:1746129742.759096:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051956736 00010000:00010000:3.0:1746129742.759111:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a510d000/0x48868a4e43947d8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e85f expref: 32 pid: 7976 timeout: 788 lvb_type: 1 00000100:00100000:3.0:1746129742.759127:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4932 00000100:00100000:3.0:1746129742.759131:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1961:x1830949051956608:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129742.759140:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129742.759158:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a00afc00/0x48868a4e43947db1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e889 expref: 19 pid: 3624 timeout: 788 lvb_type: 1 00010000:00010000:3.0:1746129742.759167:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a00afc00/0x48868a4e43947db1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e889 expref: 19 pid: 3624 timeout: 788 lvb_type: 1 00010000:00010000:3.0:1746129742.759183:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00afc00/0x48868a4e43947db1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e889 expref: 19 pid: 3624 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746129742.759224:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4933 00000100:00100000:1.0:1746129742.759230:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949051956736:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129742.759236:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129742.759244:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a510d000/0x48868a4e43947d8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e85f expref: 32 pid: 7976 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746129742.759251:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a510d000/0x48868a4e43947d8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e85f expref: 32 pid: 7976 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746129742.759261:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a510d000/0x48868a4e43947d8e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e85f expref: 32 pid: 7976 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746129742.759277:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.759279:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.759283:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093eefc00/0x48868a4e43947df0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1114112->1196031) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ac expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.759290:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093eefc00/0x48868a4e43947df0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1114112->1196031) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ac expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.759312:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093eefc00/0x48868a4e43947df0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1114112->1196031) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ac expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129742.759322:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053199872:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129742.759361:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584300 going to sleep for 11 seconds 00010000:00010000:3.0:1746129742.759622:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129742.759641:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949051956608:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 508us (2016us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.759647:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4932 00000100:00100000:1.0:1746129742.762574:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129742.763193:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053199872:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129742.763212:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129742.763246:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949051956736:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4016us (4825us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129742.763255:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4933 00000100:00100000:3.0:1746129742.764786:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051956992 00000100:00100000:3.0:1746129742.764794:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051956992 00002000:00100000:3.0:1746129742.764828:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1114112->1118207) req@ffff880094d8c380 x1830949051956992/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.764837:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8c380 with x1830949051956992 ext(1114112->1118207) 00002000:00010000:3.0:1746129742.764841:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8c380 00000100:00100000:3.0:1746129742.764879:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3775 00000100:00100000:3.0:1746129742.764886:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949051956992:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129742.765010:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949051956992:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 124us (2450us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129742.765016:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3775 00002000:00100000:3.0:1746129742.765020:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1114112->1118207) req@ffff880094d8c380 x1830949051956992/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/4536 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.765027:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8c380 with x1830949051956992 ext(1114112->1118207) 00002000:00010000:3.0:1746129742.765029:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8c380 00000100:00100000:0.0:1746129742.769347:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129742.769581:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051957248 00000100:00100000:2.0:1746129742.769587:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051957248 00002000:00100000:2.0:1746129742.769623:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3ea:0x0] (1191936->1196031) req@ffff880094eb6d80 x1830949051957248/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129742.769632:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb6d80 with x1830949051957248 ext(1191936->1196031) 00002000:00010000:2.0:1746129742.769636:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb6d80 00000100:00100000:2.0:1746129742.769711:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3776 00000100:00100000:2.0:1746129742.769718:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1963:x1830949051957248:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129742.770201:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1963:x1830949051957248:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 482us (860us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129742.770207:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3776 00002000:00100000:2.0:1746129742.770213:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3ea:0x0] (1191936->1196031) req@ffff880094eb6d80 x1830949051957248/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/4536 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129742.770220:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb6d80 with x1830949051957248 ext(1191936->1196031) 00002000:00010000:2.0:1746129742.770223:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb6d80 00000100:00100000:1.0:1746129742.808339:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129742.808498:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051957376 00000100:00100000:2.0:1746129742.808505:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051957376 00000100:00100000:2.0:1746129742.808546:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10222 00000100:00100000:2.0:1746129742.808553:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:28349:x1830949051957376:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129742.808577:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129742.808590:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093eef000/0x48868a4e43947df7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e8b3 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.808613:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094fd9200/0x48868a4e43947d87 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e851 expref: 30 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129742.808621:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094fd9000/0x48868a4e43947da3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e87b expref: 17 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129742.808627:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129742.808628:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129742.808631:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093eef000/0x48868a4e43947df7 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1478656->2097151] (req 1478656->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8b3 expref: 30 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.808653:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094fd9000/0x48868a4e43947da3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e87b expref: 17 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129742.808663:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094fd9000/0x48868a4e43947da3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e87b expref: 17 pid: 3624 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746129742.808673:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053200000:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129742.808746:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094fd9200/0x48868a4e43947d87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e851 expref: 30 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129742.808753:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094fd9200/0x48868a4e43947d87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e851 expref: 30 pid: 20441 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746129742.808760:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053200128:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129742.808773:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129742.811775:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053200000:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129742.811785:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053200128:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129742.811806:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093eef000/0x48868a4e43947df7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1478656->2097151] (req 1478656->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8b3 expref: 30 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.811820:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093eef000, rc 0) 00000100:00100000:2.0:1746129742.811890:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:28349:x1830949051957376:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3336us (3556us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129742.811901:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10222 00000100:00100000:0.0:1746129742.812271:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129742.812545:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051957504 00000100:00100000:2.0:1746129742.812551:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051957504 00010000:00010000:2.0:1746129742.812577:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094fd9000/0x48868a4e43947da3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e87b expref: 18 pid: 3624 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746129742.812606:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4934 00000100:00100000:2.0:1746129742.812612:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949051957504:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129742.812621:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129742.812636:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094fd9000/0x48868a4e43947da3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e87b expref: 18 pid: 3624 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746129742.812644:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094fd9000/0x48868a4e43947da3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e87b expref: 18 pid: 3624 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746129742.812661:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094fd9000/0x48868a4e43947da3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e87b expref: 18 pid: 3624 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746129742.813537:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129742.814225:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949051957504:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1609us (1951us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129742.814235:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4934 00000100:00100000:0.0:1746129742.816762:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129742.817004:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051957632 00000100:00100000:2.0:1746129742.817011:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051957632 00010000:00010000:2.0:1746129742.817037:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094fd9200/0x48868a4e43947d87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e851 expref: 30 pid: 20441 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746129742.817077:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4935 00000100:00100000:2.0:1746129742.817085:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949051957632:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129742.817096:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129742.817114:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094fd9200/0x48868a4e43947d87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e851 expref: 30 pid: 20441 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746129742.817125:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094fd9200/0x48868a4e43947d87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e851 expref: 30 pid: 20441 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746129742.817146:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094fd9200/0x48868a4e43947d87 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e851 expref: 30 pid: 20441 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746129742.817158:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129742.817160:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129742.817165:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093eef000/0x48868a4e43947df7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8b3 expref: 29 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.817172:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093eef000/0x48868a4e43947df7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8b3 expref: 29 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.817201:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093eef000/0x48868a4e43947df7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8b3 expref: 29 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129742.817211:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053200256:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129742.817281:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129742.819341:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.819493:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051957888 00000100:00100000:3.0:1746129742.819500:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051957888 00002000:00100000:3.0:1746129742.819531:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (1478656->1482751) req@ffff880094eb6a00 x1830949051957888/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.819550:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb6a00 with x1830949051957888 ext(1478656->1482751) 00002000:00010000:3.0:1746129742.819555:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eb6a00 00000100:00100000:3.0:1746129742.819579:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3777 00000100:00100000:3.0:1746129742.819585:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949051957888:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129742.819610:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053200256:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129742.819626:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129742.819675:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949051957632:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2590us (2918us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129742.819682:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4935 00000100:00100000:3.0:1746129742.819697:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949051957888:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 112us (361us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129742.819702:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3777 00002000:00100000:3.0:1746129742.819706:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (1478656->1482751) req@ffff880094eb6a00 x1830949051957888/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/4536 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.819713:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb6a00 with x1830949051957888 ext(1478656->1482751) 00002000:00010000:3.0:1746129742.819716:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eb6a00 00000100:00100000:0.0:1746129742.824825:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129742.825011:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051958016 00000100:00100000:2.0:1746129742.825018:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051958016 00000100:00100000:2.0:1746129742.825050:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10223 00000100:00100000:2.0:1746129742.825055:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:28349:x1830949051958016:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129742.825069:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129742.825082:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093eeee00/0x48868a4e43947dfe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e8ba expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.825102:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094fd8a00/0x48868a4e43947d79 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e858 expref: 30 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129742.825109:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094fd8600/0x48868a4e43947daa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e882 expref: 16 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129742.825114:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129742.825115:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129742.825117:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093eeee00/0x48868a4e43947dfe lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->1409023] (req 1048576->1409023) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ba expref: 30 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.825139:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094fd8600/0x48868a4e43947daa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e882 expref: 16 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129742.825147:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094fd8600/0x48868a4e43947daa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e882 expref: 16 pid: 3624 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746129742.825157:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053200384:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129742.825226:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094fd8a00/0x48868a4e43947d79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e858 expref: 30 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129742.825232:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094fd8a00/0x48868a4e43947d79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e858 expref: 30 pid: 20441 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746129742.825238:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053200512:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129742.825253:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129742.828819:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.828880:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.828946:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051958144 00000100:00100000:3.0:1746129742.828952:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051958144 00010000:00010000:3.0:1746129742.828978:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094fd8600/0x48868a4e43947daa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e882 expref: 17 pid: 3624 timeout: 788 lvb_type: 1 00000100:00100000:3.0:1746129742.828995:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051958272 00000100:00100000:3.0:1746129742.828996:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051958272 00010000:00010000:3.0:1746129742.829004:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094fd8a00/0x48868a4e43947d79 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e858 expref: 31 pid: 20441 timeout: 788 lvb_type: 1 00000100:00100000:3.0:1746129742.829019:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4936 00000100:00100000:3.0:1746129742.829025:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949051958144:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129742.829035:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129742.829051:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094fd8600/0x48868a4e43947daa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e882 expref: 17 pid: 3624 timeout: 788 lvb_type: 1 00010000:00010000:3.0:1746129742.829060:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094fd8600/0x48868a4e43947daa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e882 expref: 17 pid: 3624 timeout: 788 lvb_type: 1 00010000:00010000:3.0:1746129742.829078:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129742.829108:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949051958144:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 83us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.829112:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4936 00000100:00100000:3.0:1746129742.829126:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4937 00000100:00100000:3.0:1746129742.829130:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949051958272:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129742.829135:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129742.829140:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094fd8a00/0x48868a4e43947d79 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e858 expref: 31 pid: 20441 timeout: 788 lvb_type: 1 00010000:00010000:3.0:1746129742.829147:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094fd8a00/0x48868a4e43947d79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e858 expref: 31 pid: 20441 timeout: 788 lvb_type: 1 00010000:00010000:3.0:1746129742.829155:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129742.829156:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129742.829161:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093eeee00/0x48868a4e43947dfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1409023) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ba expref: 31 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.829167:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093eeee00/0x48868a4e43947dfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1409023) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ba expref: 31 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.829187:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093eeee00/0x48868a4e43947dfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1409023) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ba expref: 31 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129742.829197:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053200640:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129742.829237:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f240 going to sleep for 11 seconds 00010000:00010000:2.0:1746129742.831305:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094fd8600/0x48868a4e43947daa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e882 expref: 16 pid: 3624 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746129742.832137:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053200384:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129742.832156:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094fd8a00/0x48868a4e43947d79 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e858 expref: 31 pid: 20441 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746129742.832166:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053200512:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129742.832186:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093eeee00/0x48868a4e43947dfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1409023) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ba expref: 30 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.832197:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093eeee00, rc 0) 00000100:00100000:2.0:1746129742.832247:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:28349:x1830949051958016:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 7190us (7427us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129742.832257:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10223 00000100:00100000:2.0:1746129742.836072:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.836334:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053200640:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129742.836349:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129742.836391:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949051958272:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7259us (7510us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.836401:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4937 00000100:00100000:0.0:1746129742.836482:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051958528 00000100:00100000:0.0:1746129742.836488:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051958528 00002000:00100000:0.0:1746129742.836530:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e7:0x0] (1404928->1409023) req@ffff8800a55a6a00 x1830949051958528/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129742.836549:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a6a00 with x1830949051958528 ext(1404928->1409023) 00002000:00010000:0.0:1746129742.836553:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a55a6a00 00000100:00100000:0.0:1746129742.836580:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3778 00000100:00100000:0.0:1746129742.836586:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1963:x1830949051958528:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129742.836700:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1963:x1830949051958528:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 114us (635us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129742.836705:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3778 00002000:00100000:0.0:1746129742.836709:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e7:0x0] (1404928->1409023) req@ffff8800a55a6a00 x1830949051958528/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/4536 e 0 to 0 dl 1746129753 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129742.836721:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a6a00 with x1830949051958528 ext(1404928->1409023) 00002000:00010000:0.0:1746129742.836724:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a55a6a00 00000100:00100000:0.0:1746129742.840744:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.840809:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051958784 00000100:00100000:3.0:1746129742.840816:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051958784 00000100:00100000:3.0:1746129742.840889:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3791 00000100:00100000:3.0:1746129742.840897:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:28349:x1830949051958784:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129742.841108:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:28349:x1830949051958784:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 211us (371us total) trans 8589943498 rc 0/0 00000100:00100000:3.0:1746129742.841114:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3791 00000100:00100000:0.0:1746129742.849980:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.850098:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051958912 00000100:00100000:3.0:1746129742.850106:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051958912 00000100:00100000:3.0:1746129742.850206:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9732 00000100:00100000:3.0:1746129742.850214:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+16:28356:x1830949051958912:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129742.850234:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129742.850248:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d800/0x48868a4e43947e05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e8c1 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.850299:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65c200/0x48868a4e43947e0c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.850314:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65c200/0x48868a4e43947e0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.850323:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65c200/0x48868a4e43947e0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.850333:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65cc00/0x48868a4e43947e13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.850338:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65cc00/0x48868a4e43947e13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.850342:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65cc00/0x48868a4e43947e13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.850437:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d000/0x48868a4e43947e1a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.850448:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e8000/0x48868a4e43947d3a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e835 expref: 17 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.850454:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d000/0x48868a4e43947e1a lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.850478:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e8000/0x48868a4e43947d3a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e835 expref: 17 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.850488:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e8000/0x48868a4e43947d3a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e835 expref: 17 pid: 15044 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.850498:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053200768:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129742.851288:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129742.858308:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129742.858384:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051959168 00000100:00100000:2.0:1746129742.858392:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051959168 00000100:00100000:2.0:1746129742.858429:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3792 00000100:00100000:2.0:1746129742.858436:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:27192:x1830949051959168:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746129742.858627:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:27192:x1830949051959168:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 190us (326us total) trans 8589943499 rc 0/0 00000100:00100000:2.0:1746129742.858634:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3792 00000100:00100000:3.0:1746129742.858755:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053200768:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129742.858773:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d000/0x48868a4e43947e1a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129742.861325:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.861409:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051959296 00000100:00100000:3.0:1746129742.861415:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051959296 00010000:00010000:3.0:1746129742.861451:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e8000/0x48868a4e43947d3a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e835 expref: 19 pid: 15044 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.861473:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4938 00000100:00100000:3.0:1746129742.861479:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130564050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1961:x1830949051959296:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129742.861490:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129742.861495:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e8000/0x48868a4e43947d3a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e835 expref: 19 pid: 15044 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.861504:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e8000/0x48868a4e43947d3a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e835 expref: 19 pid: 15044 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.861520:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e8000/0x48868a4e43947d3a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e835 expref: 19 pid: 15044 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.861544:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129742.861548:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d000/0x48868a4e43947e1a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.861555:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d000/0x48868a4e43947e1a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.861571:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d000/0x48868a4e43947e1a lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.861601:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129742.861632:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130564050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949051959296:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 152us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.861637:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4938 00010000:00010000:2.0:1746129742.861778:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d000/0x48868a4e43947e1a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129742.861785:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d000/0x48868a4e43947e1a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129742.861818:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:2.0:1746129742.861821:0:14315:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129742.861833:0:14315:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d000/0x48868a4e43947e1a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129742.861842:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d000/0x48868a4e43947e1a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129742.861869:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65c200/0x48868a4e43947e0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129742.861874:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65c200/0x48868a4e43947e0c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129742.861880:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65c200/0x48868a4e43947e0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129742.861885:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c65c200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129742.861888:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65c200/0x48868a4e43947e0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129742.861894:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65c200/0x48868a4e43947e0c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129742.861902:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129742.861904:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129742.861907:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65c200/0x48868a4e43947e0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129742.861911:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65c200/0x48868a4e43947e0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129742.861919:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65cc00/0x48868a4e43947e13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129742.861923:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65cc00/0x48868a4e43947e13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129742.861927:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65cc00/0x48868a4e43947e13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129742.861930:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c65cc00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129742.861931:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65cc00/0x48868a4e43947e13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129742.861935:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65cc00/0x48868a4e43947e13 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129742.861939:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008fe79c00) 00010000:00010000:2.0:1746129742.861941:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129742.861943:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65cc00/0x48868a4e43947e13 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129742.861946:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65cc00/0x48868a4e43947e13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129742.861970:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d800/0x48868a4e43947e05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8c1 expref: 18 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.861979:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d000/0x48868a4e43947e1a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8c1 expref: 17 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.861984:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129742.861986:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129742.861988:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c65d000, rc 0) 00000100:00100000:2.0:1746129742.862019:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+17:28356:x1830949051958912:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 11806us (12047us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129742.862025:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9732 00000100:00100000:0.0:1746129742.866089:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129742.866498:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051959424 00000100:00100000:2.0:1746129742.866506:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051959424 00000100:00100000:2.0:1746129742.866541:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10224 00000100:00100000:2.0:1746129742.866550:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949051959424:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129742.866577:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129742.866591:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093eeec00/0x48868a4e43947e21 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e8c8 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.866611:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129742.866613:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129742.866620:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093eeec00/0x48868a4e43947e21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8c8 expref: 10 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129742.866636:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093eeec00/0x48868a4e43947e21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8c8 expref: 10 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129742.866645:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093eeec00, rc 0) 00000100:00100000:2.0:1746129742.866695:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949051959424:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 147us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129742.866700:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10224 00000100:00100000:0.0:1746129742.867547:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.867782:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.867839:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.868540:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.868925:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129742.869029:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051959680 00000100:00100000:2.0:1746129742.869034:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051959680 00000100:00100000:2.0:1746129742.869059:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051959936 00000100:00100000:2.0:1746129742.869061:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051959936 00000100:00100000:2.0:1746129742.869069:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051959552 00000100:00100000:2.0:1746129742.869071:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051959552 00000100:00100000:2.0:1746129742.869085:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051959808 00000100:00100000:2.0:1746129742.869087:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051959808 00000100:00100000:2.0:1746129742.869099:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10225 00000100:00100000:2.0:1746129742.869105:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949051959680:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129742.869117:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129742.869127:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093eee800/0x48868a4e43947e28 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e8d6 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129742.869166:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053200896:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129742.869214:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129742.869229:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10226 00000100:00100000:2.0:1746129742.869234:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949051959936:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129742.869243:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129742.869250:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093eef200/0x48868a4e43947e2f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e8e4 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.869260:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129742.869262:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129742.869268:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093eef200/0x48868a4e43947e2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8e4 expref: 12 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129742.869280:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093eef200/0x48868a4e43947e2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8e4 expref: 12 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129742.869287:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093eef200, rc 0) 00000100:00100000:2.0:1746129742.869304:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949051959936:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 70us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129742.869309:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10226 00000100:00100000:2.0:1746129742.869320:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10227 00000100:00100000:2.0:1746129742.869324:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949051959552:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129742.869329:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129742.869334:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093eee600/0x48868a4e43947e36 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e8cf expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129742.869351:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053201024:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129742.869368:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129742.869657:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10228 00000100:00100000:1.0:1746129742.869663:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949051959808:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129742.869669:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129742.869676:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013585b200/0x48868a4e43947e3d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e8dd expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129742.869697:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053201152:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129742.869731:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129742.870237:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051960064 00000100:00100000:3.0:1746129742.870241:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051960064 00000100:00100000:3.0:1746129742.870258:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10229 00000100:00100000:3.0:1746129742.870263:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949051960064:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129742.870269:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129742.870275:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c65ca00/0x48868a4e43947e44 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e8eb expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.870285:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129742.870286:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129742.870290:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c65ca00/0x48868a4e43947e44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8eb expref: 14 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129742.870300:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c65ca00/0x48868a4e43947e44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8eb expref: 14 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129742.870306:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c65ca00, rc 0) 00000100:00100000:3.0:1746129742.870325:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+14:1962:x1830949051960064:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 61us (1400us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.870330:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10229 00002000:00010000:2.0:1746129742.871931:0:1877:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime: 1746129742 -> 1746129743 00002000:00010000:2.0:1746129742.871936:0:1877:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime: 1746129742 -> 1746129743 00002000:00010000:2.0:1746129742.871938:0:1877:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime: 1746129742 -> 1746129743 00000100:00100000:2.0:1746129742.871952:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053201024:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129742.871971:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093eee600/0x48868a4e43947e36 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8cf expref: 13 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129742.871980:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093eee600/0x48868a4e43947e36 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8cf expref: 13 pid: 1877 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746129742.872317:0:7976:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime: 1746129742 -> 1746129743 00002000:00010000:3.0:1746129742.872320:0:7976:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime: 1746129742 -> 1746129743 00002000:00010000:3.0:1746129742.872321:0:7976:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime: 1746129742 -> 1746129743 00000100:00100000:3.0:1746129742.872329:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053200896:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129742.872340:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093eee800/0x48868a4e43947e28 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8d6 expref: 12 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129742.872348:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093eee800/0x48868a4e43947e28 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8d6 expref: 12 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129742.872359:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093eee800, rc 0) 00000100:00100000:3.0:1746129742.872383:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949051959680:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3278us (4836us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129742.872389:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10225 00010000:00010000:2.0:1746129742.872541:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093eee600, rc 0) 00000100:00100000:2.0:1746129742.872569:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949051959552:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3235us (4720us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129742.872573:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10227 00002000:00010000:1.0:1746129742.872790:0:7975:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime: 1746129741 -> 1746129743 00002000:00010000:1.0:1746129742.872793:0:7975:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime: 1746129741 -> 1746129743 00002000:00010000:1.0:1746129742.872794:0:7975:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime: 1746129741 -> 1746129743 00000100:00100000:1.0:1746129742.872806:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053201152:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129742.872820:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013585b200/0x48868a4e43947e3d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8dd expref: 12 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.872828:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013585b200/0x48868a4e43947e3d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8dd expref: 12 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.873139:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013585b200, rc 0) 00000100:00100000:1.0:1746129742.873168:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949051959808:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3505us (4628us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129742.873173:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10228 00000100:00100000:0.0:1746129742.875926:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129742.876109:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051960320 00000100:00100000:2.0:1746129742.876116:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051960320 00000100:00100000:2.0:1746129742.876157:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9733 00000100:00100000:2.0:1746129742.876169:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+17:28356:x1830949051960320:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129742.876186:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129742.876205:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee800/0x48868a4e43947e4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e8f2 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.876278:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee600/0x48868a4e43947e52 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.876290:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d000/0x48868a4e43947e1a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8c1 expref: 18 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.876297:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee600/0x48868a4e43947e52 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.876322:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d000/0x48868a4e43947e1a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8c1 expref: 18 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.876330:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d000/0x48868a4e43947e1a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8c1 expref: 18 pid: 14315 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746129742.876337:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053201280:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129742.876396:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129742.881843:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.881976:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051960448 00000100:00100000:1.0:1746129742.881982:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051960448 00010000:00010000:1.0:1746129742.882009:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d000/0x48868a4e43947e1a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8c1 expref: 19 pid: 14315 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746129742.882043:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4939 00000100:00100000:1.0:1746129742.882050:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+19:1961:x1830949051960448:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129742.882060:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129742.882065:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d000/0x48868a4e43947e1a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8c1 expref: 19 pid: 14315 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746129742.882078:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d000/0x48868a4e43947e1a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8c1 expref: 19 pid: 14315 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746129742.882095:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129742.882099:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee600/0x48868a4e43947e52 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129742.882106:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee600/0x48868a4e43947e52 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129742.882111:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee600/0x48868a4e43947e52 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.882114:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65d000/0x48868a4e43947e1a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8c1 expref: 19 pid: 14315 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746129742.882125:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129742.882132:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053201280:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129742.882146:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee600/0x48868a4e43947e52 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.882153:0:15044:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee600/0x48868a4e43947e52 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000100:00100000:1.0:1746129742.882155:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+18:1961:x1830949051960448:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 106us (318us total) trans 0 rc 0/0 00010000:00010000:2.0:1746129742.882158:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee600/0x48868a4e43947e52 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000100:00100000:1.0:1746129742.882161:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4939 00000004:00200000:2.0:1746129742.882171:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129742.882272:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee800/0x48868a4e43947e4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8f2 expref: 19 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.882282:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee600/0x48868a4e43947e52 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8f2 expref: 18 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.882288:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129742.882290:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129742.882293:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093eee600, rc 0) 00000100:00100000:2.0:1746129742.882315:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+18:28356:x1830949051960320:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 6152us (6395us total) trans 8589943500 rc 0/0 00000100:00100000:2.0:1746129742.882321:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9733 00000100:00100000:0.0:1746129742.885079:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129742.885212:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051960576 00000100:00100000:2.0:1746129742.885219:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051960576 00000100:00100000:2.0:1746129742.885471:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9734 00000100:00100000:2.0:1746129742.885480:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+18:28356:x1830949051960576:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129742.885499:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129742.885513:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee000/0x48868a4e43947e60 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e8f9 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.885595:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee400/0x48868a4e43947e67 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.885608:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee600/0x48868a4e43947e52 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8f2 expref: 19 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.885614:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee400/0x48868a4e43947e67 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.885637:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee600/0x48868a4e43947e52 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8f2 expref: 19 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.885647:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee600/0x48868a4e43947e52 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8f2 expref: 19 pid: 15044 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746129742.885657:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053201408:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129742.885735:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129742.889362:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129742.889436:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051960704 00000100:00100000:2.0:1746129742.889442:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051960704 00010000:00010000:2.0:1746129742.889468:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee600/0x48868a4e43947e52 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8f2 expref: 20 pid: 15044 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746129742.889491:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4940 00000100:00100000:2.0:1746129742.889497:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+20:1962:x1830949051960704:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129742.889507:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129742.889512:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee600/0x48868a4e43947e52 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8f2 expref: 20 pid: 15044 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746129742.889521:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee600/0x48868a4e43947e52 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8f2 expref: 20 pid: 15044 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746129742.889537:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129742.889541:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee400/0x48868a4e43947e67 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.889550:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee400/0x48868a4e43947e67 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.889556:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee400/0x48868a4e43947e67 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129742.889579:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129742.889611:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+20:1962:x1830949051960704:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 113us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129742.889617:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4940 00010000:00010000:3.0:1746129742.890024:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee600/0x48868a4e43947e52 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8f2 expref: 19 pid: 15044 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.890039:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053201408:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129742.890052:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee400/0x48868a4e43947e67 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129742.890059:0:15044:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee400/0x48868a4e43947e67 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129742.890062:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee400/0x48868a4e43947e67 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:3.0:1746129742.890095:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:3.0:1746129742.890099:0:15044:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129742.890110:0:15044:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee400/0x48868a4e43947e67 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129742.890136:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee000/0x48868a4e43947e60 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8f9 expref: 19 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.890146:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee400/0x48868a4e43947e67 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8f9 expref: 18 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.890151:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129742.890154:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129742.890164:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093eee400, rc 0) 00000100:00100000:3.0:1746129742.891181:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+18:28356:x1830949051960576:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5700us (6104us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.891188:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9734 00000100:00100000:0.0:1746129742.893714:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.893748:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.893780:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.894024:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051960832 00000100:00100000:1.0:1746129742.894032:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051960832 00000100:00100000:1.0:1746129742.894068:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051960960 00000100:00100000:1.0:1746129742.894070:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051960960 00000100:00100000:1.0:1746129742.894574:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051961088 00000100:00100000:1.0:1746129742.894577:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051961088 00000100:00100000:2.0:1746129742.894610:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10230 00000100:00100000:2.0:1746129742.894619:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949051960832:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129742.894633:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129742.894646:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093eef800/0x48868a4e43947e6e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e900 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129742.894689:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053201536:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129742.894743:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129742.894772:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10231 00000100:00100000:2.0:1746129742.894777:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949051960960:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129742.894783:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129742.894789:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093eef400/0x48868a4e43947e75 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e907 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129742.894808:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053201664:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129742.894825:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510480 going to sleep for 11 seconds 00000100:00100000:3.0:1746129742.895070:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10232 00000100:00100000:3.0:1746129742.895076:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949051961088:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129742.895083:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129742.895092:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c65c400/0x48868a4e43947e7c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e90e expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129742.895114:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053201792:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129742.895141:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129742.898142:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053201536:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129742.898168:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093eef800/0x48868a4e43947e6e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e900 expref: 13 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129742.898179:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093eef800/0x48868a4e43947e6e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e900 expref: 13 pid: 1877 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129742.898242:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053201664:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129742.898259:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093eef400/0x48868a4e43947e75 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e907 expref: 12 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129742.898267:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093eef400/0x48868a4e43947e75 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e907 expref: 12 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129742.898281:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093eef400, rc 0) 00010000:00010000:2.0:1746129742.898452:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093eef800, rc 0) 00000100:00100000:3.0:1746129742.898651:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949051960960:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3871us (4900us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129742.898651:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949051960832:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4032us (4941us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129742.898658:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10231 00000100:00100000:2.0:1746129742.898660:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10230 00000100:00100000:3.0:1746129742.899387:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053201792:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129742.899405:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c65c400/0x48868a4e43947e7c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e90e expref: 12 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129742.899415:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c65c400/0x48868a4e43947e7c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e90e expref: 12 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129742.899423:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c65c400, rc 0) 00000100:00100000:3.0:1746129742.899442:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949051961088:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4367us (5662us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129742.899447:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10232 00000100:00100000:0.0:1746129742.906526:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.906770:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051961344 00000100:00100000:3.0:1746129742.906777:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051961344 00000100:00100000:3.0:1746129742.906815:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9735 00000100:00100000:3.0:1746129742.906822:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+18:28356:x1830949051961344:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129742.906839:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129742.906870:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65c600/0x48868a4e43947e83 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e915 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.906947:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65c800/0x48868a4e43947e8a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129742.906959:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65c800/0x48868a4e43947e8a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129742.906968:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65c800/0x48868a4e43947e8a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:3.0:1746129742.906978:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129742.907067:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65c600/0x48868a4e43947e83 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e915 expref: 21 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.907080:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65c800/0x48868a4e43947e8a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e915 expref: 20 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.907086:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129742.907089:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129742.907091:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c65c800, rc 0) 00000100:00100000:3.0:1746129742.907137:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+20:28356:x1830949051961344:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 316us (618us total) trans 8589943501 rc 0/0 00000100:00100000:3.0:1746129742.907142:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9735 00000100:00100000:1.0:1746129742.913139:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.913159:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.913185:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.913187:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051961472 00000100:00100000:3.0:1746129742.913195:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051961472 00000100:00100000:1.0:1746129742.913196:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.913218:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.913228:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051961984 00000100:00100000:0.0:1746129742.913228:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051961728 00000100:00100000:1.0:1746129742.913231:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051961984 00000100:00100000:0.0:1746129742.913231:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051961728 00000100:00100000:1.0:1746129742.913257:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051961600 00000100:00100000:1.0:1746129742.913258:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051961600 00000100:00100000:0.0:1746129742.913259:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051961856 00000100:00100000:0.0:1746129742.913261:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051961856 00000100:00100000:1.0:1746129742.913270:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10233 00000100:00100000:0.0:1746129742.913275:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10234 00000100:00100000:1.0:1746129742.913276:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+13:1961:x1830949051961984:12345-192.168.204.31@tcp:1:lfs.0 00000100:00100000:0.0:1746129742.913279:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949051961728:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:1.0:1746129742.913308:0:7975:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013585a800/0x48868a4e43947e9f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.913308:0:20441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e348800/0x48868a4e43947e98 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.913322:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f71600/0x48868a4e43947dbf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e897 expref: 30 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.913322:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093eeee00/0x48868a4e43947dfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1409023) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ba expref: 28 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.913328:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129742.913329:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093eef200/0x48868a4e43947e2f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8e4 expref: 13 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129742.913330:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129742.913332:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e348800/0x48868a4e43947e98 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.913335:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363cec00/0x48868a4e43947de9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8a5 expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.913339:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.913340:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.913341:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013585a800/0x48868a4e43947e9f lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.913354:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801363cec00/0x48868a4e43947de9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8a5 expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.913354:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093eeee00/0x48868a4e43947dfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1409023) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ba expref: 28 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.913364:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801363cec00/0x48868a4e43947de9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8a5 expref: 17 pid: 4589 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746129742.913364:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093eeee00/0x48868a4e43947dfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1409023) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ba expref: 28 pid: 4589 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746129742.913375:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053202048:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129742.913376:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053201920:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129742.913420:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10235 00000100:00100000:3.0:1746129742.913425:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949051961600:12345-192.168.204.31@tcp:1:lfs.0 00000100:00100000:2.0:1746129742.913429:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10236 00000100:00100000:2.0:1746129742.913436:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+13:1961:x1830949051961856:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:3.0:1746129742.913438:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c65d800/0x48868a4e43947ea6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.913446:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093eef000/0x48868a4e43947df7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8b3 expref: 28 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.913449:0:3624:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093eef600/0x48868a4e43947ead lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.913455:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129742.913456:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093eefc00/0x48868a4e43947df0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1196031) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ac expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.913457:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129742.913459:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c65d800/0x48868a4e43947ea6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.913461:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129742.913462:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129742.913464:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093eef600/0x48868a4e43947ead lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.913471:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093eef000/0x48868a4e43947df7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8b3 expref: 28 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.913474:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093eefc00/0x48868a4e43947df0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1196031) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ac expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.913478:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093eef000/0x48868a4e43947df7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8b3 expref: 28 pid: 4589 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746129742.913481:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093eefc00/0x48868a4e43947df0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1196031) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ac expref: 17 pid: 4589 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746129742.913485:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053202176:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129742.913487:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053202304:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129742.913658:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093eef200/0x48868a4e43947e2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8e4 expref: 13 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.913665:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093eef200/0x48868a4e43947e2f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8e4 expref: 13 pid: 1877 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746129742.913673:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053202432:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129742.913696:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f71600/0x48868a4e43947dbf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e897 expref: 30 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.913704:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f71600/0x48868a4e43947dbf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e897 expref: 30 pid: 4589 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746129742.913710:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053202560:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129742.913726:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129742.913743:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10237 00000100:00100000:1.0:1746129742.913748:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+13:1961:x1830949051961472:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:1.0:1746129742.913763:0:1140:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013585be00/0x48868a4e43947eb4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.913771:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094fd8800/0x48868a4e43947d72 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e84a expref: 30 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.913782:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093eeec00/0x48868a4e43947e21 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8c8 expref: 13 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.913788:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092af6600/0x48868a4e43947d9c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e874 expref: 17 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.913793:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.913794:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129742.913796:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013585be00/0x48868a4e43947eb4 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.913809:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092af6600/0x48868a4e43947d9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e874 expref: 17 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.913815:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092af6600/0x48868a4e43947d9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e874 expref: 17 pid: 1140 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746129742.913822:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053202688:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129742.913840:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135d2c900 going to sleep for 11 seconds 00010000:00010000:1.0:1746129742.913844:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093eeec00/0x48868a4e43947e21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8c8 expref: 13 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129742.913867:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093eeec00/0x48868a4e43947e21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8c8 expref: 13 pid: 4589 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746129742.913874:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053202816:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129742.913887:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129742.913899:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094fd8800/0x48868a4e43947d72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e84a expref: 30 pid: 4589 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129742.913900:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051962112 00000100:00100000:0.0:1746129742.913902:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051962112 00010000:00010000:1.0:1746129742.913906:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094fd8800/0x48868a4e43947d72 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e84a expref: 30 pid: 4589 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746129742.913912:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053202944:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129742.913916:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10238 00000100:00100000:0.0:1746129742.913921:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949051962112:12345-192.168.204.31@tcp:1:lfs.0 00000100:00100000:1.0:1746129742.913926:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584300 going to sleep for 11 seconds 00010000:00010000:0.0:1746129742.913933:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e349000/0x48868a4e43947ebb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.913945:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a510d400/0x48868a4e43947d95 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e86d expref: 28 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129742.913951:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c65ca00/0x48868a4e43947e44 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8eb expref: 12 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129742.913957:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a00afa00/0x48868a4e43947db8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e890 expref: 15 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129742.913962:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.913963:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.913964:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e349000/0x48868a4e43947ebb lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.913976:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a00afa00/0x48868a4e43947db8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e890 expref: 15 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129742.913984:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a00afa00/0x48868a4e43947db8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e890 expref: 15 pid: 3624 timeout: 788 lvb_type: 1 00000100:00100000:0.0:1746129742.913990:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053203072:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129742.914014:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c65ca00/0x48868a4e43947e44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8eb expref: 12 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129742.914020:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c65ca00/0x48868a4e43947e44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8eb expref: 12 pid: 3624 timeout: 788 lvb_type: 1 00000100:00100000:0.0:1746129742.914032:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053203200:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129742.914049:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a510d400/0x48868a4e43947d95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e86d expref: 28 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129742.914055:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a510d400/0x48868a4e43947d95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e86d expref: 28 pid: 7976 timeout: 788 lvb_type: 1 00000100:00100000:0.0:1746129742.914061:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053203328:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129742.914071:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135d2c840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129742.914741:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129742.915519:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129742.932310:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053201920:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129742.932318:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053202432:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129742.932322:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053202560:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129742.932341:0:7975:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013585a800/0x48868a4e43947e9f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129742.939902:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053202688:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129742.941066:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053202816:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129742.941066:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053203072:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129742.941075:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053202944:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129742.941094:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053203200:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129742.941097:0:1140:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013585be00/0x48868a4e43947eb4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129742.941114:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053203328:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129742.941131:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012e349000/0x48868a4e43947ebb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129742.941151:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.941179:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.941210:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129742.941212:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051962752 00000100:00100000:2.0:1746129742.941217:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051962752 00000100:00100000:0.0:1746129742.941223:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.941235:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.941237:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051963008 00000100:00100000:3.0:1746129742.941241:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051963008 00010000:00010000:2.0:1746129742.941243:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092af6600/0x48868a4e43947d9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e874 expref: 18 pid: 1140 timeout: 788 lvb_type: 1 00000100:00100000:0.0:1746129742.941248:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129742.941257:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a510d400/0x48868a4e43947d95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e86d expref: 29 pid: 7976 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746129742.941261:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051962880 00000100:00100000:2.0:1746129742.941263:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051962880 00010000:00010000:2.0:1746129742.941272:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c65ca00/0x48868a4e43947e44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8eb expref: 13 pid: 3624 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746129742.941320:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053202048:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129742.941331:0:20441:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012e348800/0x48868a4e43947e98 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129742.941813:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051962240 00000100:00100000:2.0:1746129742.941817:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051962240 00010000:00010000:2.0:1746129742.941829:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093eef200/0x48868a4e43947e2f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8e4 expref: 14 pid: 1877 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746129742.941839:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051962624 00000100:00100000:2.0:1746129742.941841:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051962624 00010000:00010000:2.0:1746129742.941860:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801363cec00/0x48868a4e43947de9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8a5 expref: 19 pid: 4589 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746129742.941871:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4941 00000100:00100000:2.0:1746129742.941876:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949051962752:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129742.941886:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129742.941892:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4942 00000100:00100000:0.0:1746129742.941898:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949051963008:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129742.941903:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880092af6600/0x48868a4e43947d9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e874 expref: 19 pid: 1140 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746129742.941906:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129742.941915:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092af6600/0x48868a4e43947d9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e874 expref: 19 pid: 1140 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746129742.941918:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8800a510d400/0x48868a4e43947d95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e86d expref: 29 pid: 7976 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746129742.941925:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a510d400/0x48868a4e43947d95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e86d expref: 29 pid: 7976 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746129742.941932:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092af6600/0x48868a4e43947d9c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e874 expref: 19 pid: 1140 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746129742.941937:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a510d400/0x48868a4e43947d95 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e86d expref: 29 pid: 7976 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746129742.941948:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129742.941949:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129742.941994:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949051962752:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 117us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129742.941994:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4943 00000100:00100000:1.0:1746129742.941999:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949051962880:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129742.942001:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4941 00010000:00010000:1.0:1746129742.942006:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129742.942013:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009c65ca00/0x48868a4e43947e44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8eb expref: 13 pid: 3624 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746129742.942015:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4944 00000100:00100000:2.0:1746129742.942020:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+14:1963:x1830949051962240:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129742.942025:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c65ca00/0x48868a4e43947e44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8eb expref: 13 pid: 3624 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746129742.942026:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129742.942035:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880093eef200/0x48868a4e43947e2f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8e4 expref: 14 pid: 1877 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746129742.942035:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c65ca00/0x48868a4e43947e44 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8eb expref: 13 pid: 3624 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746129742.942043:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093eef200/0x48868a4e43947e2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8e4 expref: 14 pid: 1877 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746129742.942047:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129742.942053:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093eef200/0x48868a4e43947e2f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8e4 expref: 14 pid: 1877 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746129742.942066:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129742.942175:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949051963008:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 275us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.942180:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4942 00000100:00100000:0.0:1746129742.942200:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4945 00000100:00100000:0.0:1746129742.942205:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130567c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1963:x1830949051962624:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129742.942211:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129742.942219:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff8801363cec00/0x48868a4e43947de9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8a5 expref: 17 pid: 4589 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746129742.942225:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801363cec00/0x48868a4e43947de9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8a5 expref: 17 pid: 4589 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746129742.942235:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363cec00/0x48868a4e43947de9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8a5 expref: 17 pid: 4589 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746129742.942246:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129742.942260:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130567c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1963:x1830949051962624:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 55us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.942265:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4945 00000100:00100000:0.0:1746129742.942334:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.942347:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051962496 00000100:00100000:0.0:1746129742.942350:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051962496 00010000:00010000:0.0:1746129742.942360:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f71600/0x48868a4e43947dbf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e897 expref: 31 pid: 4589 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746129742.942371:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4946 00000100:00100000:0.0:1746129742.942375:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949051962496:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129742.942382:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129742.942388:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f71600/0x48868a4e43947dbf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e897 expref: 31 pid: 4589 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746129742.942395:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4f71600/0x48868a4e43947dbf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e897 expref: 31 pid: 4589 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746129742.942405:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f71600/0x48868a4e43947dbf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e897 expref: 31 pid: 4589 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746129742.942412:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.942414:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.942417:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013585a800/0x48868a4e43947e9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.942427:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013585a800/0x48868a4e43947e9f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.942441:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129742.942455:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1963:x1830949051962496:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 80us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.942460:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4946 00000100:00100000:0.0:1746129742.942530:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.942538:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051963264 00000100:00100000:0.0:1746129742.942540:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051963264 00010000:00010000:0.0:1746129742.942549:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00afa00/0x48868a4e43947db8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e890 expref: 16 pid: 3624 timeout: 788 lvb_type: 1 00000100:00100000:0.0:1746129742.942577:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4947 00000100:00100000:0.0:1746129742.942582:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949051963264:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129742.942587:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129742.942593:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8800a00afa00/0x48868a4e43947db8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e890 expref: 16 pid: 3624 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746129742.942600:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a00afa00/0x48868a4e43947db8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e890 expref: 16 pid: 3624 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746129742.942610:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a00afa00/0x48868a4e43947db8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e890 expref: 16 pid: 3624 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746129742.942617:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.942619:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.942621:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e349000/0x48868a4e43947ebb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.942626:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e349000/0x48868a4e43947ebb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.942637:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129742.942649:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1964:x1830949051963264:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 67us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.942654:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4947 00010000:00010000:0.0:1746129742.942669:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012e349000/0x48868a4e43947ebb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.942676:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e349000/0x48868a4e43947ebb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.942692:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e349000/0x48868a4e43947ebb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.942698:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e349000/0x48868a4e43947ebb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.942704:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e349000/0x48868a4e43947ebb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.942710:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e349000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129742.942713:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e349000/0x48868a4e43947ebb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.942723:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e349000/0x48868a4e43947ebb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.942731:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e349000/0x48868a4e43947ebb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.942736:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e349000/0x48868a4e43947ebb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129742.942769:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949051962112:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 28847us (28881us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.942775:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10238 00000100:00100000:3.0:1746129742.942797:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053202176:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129742.942806:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129742.942808:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c65d800/0x48868a4e43947ea6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129742.942821:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051962368 00000100:00100000:0.0:1746129742.942823:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051962368 00000100:00100000:3.0:1746129742.942830:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051963392 00000100:00100000:3.0:1746129742.942833:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051963392 00002000:00100000:0.0:1746129742.942843:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->1409023) req@ffff880135d8d180 x1830949051962368/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129742.942867:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8d180 with x1830949051962368 ext(1048576->1409023) 00002000:00100000:3.0:1746129742.942870:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (1478656->2097151) req@ffff880135d8f800 x1830949051963392/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:0.0:1746129742.942872:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093eeee00/0x48868a4e43947dfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1409023) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ba expref: 29 pid: 4589 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746129742.942880:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093eeee00/0x48868a4e43947dfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1409023) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ba expref: 29 pid: 4589 timeout: 789 lvb_type: 0 00002000:00100000:3.0:1746129742.942881:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8f800 with x1830949051963392 ext(1478656->2097151) 00010000:00010000:3.0:1746129742.942885:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093eef000/0x48868a4e43947df7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8b3 expref: 29 pid: 4589 timeout: 788 lvb_type: 0 00002000:00010000:0.0:1746129742.942885:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135d8d180 00010000:00010000:3.0:1746129742.942892:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093eef000/0x48868a4e43947df7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8b3 expref: 29 pid: 4589 timeout: 789 lvb_type: 0 00002000:00010000:3.0:1746129742.942899:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135d8f800 00000100:00100000:0.0:1746129742.942904:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 517 00000100:00100000:0.0:1746129742.942909:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949051962368:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:3.0:1746129742.942915:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 518 00000100:00100000:3.0:1746129742.942919:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1963:x1830949051963392:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:0.0:1746129742.943240:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.943275:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129742.943320:0:7975:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013585a800/0x48868a4e43947e9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.943327:0:7975:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013585a800/0x48868a4e43947e9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.943339:0:7975:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013585a800/0x48868a4e43947e9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.943344:0:7975:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013585a800/0x48868a4e43947e9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.943350:0:7975:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013585a800/0x48868a4e43947e9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.943355:0:7975:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013585a800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129742.943357:0:7975:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013585a800/0x48868a4e43947e9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.943362:0:7975:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013585a800/0x48868a4e43947e9f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.943370:0:7975:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013585a800/0x48868a4e43947e9f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.943375:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013585a800/0x48868a4e43947e9f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129742.943406:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+13:1961:x1830949051961984:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 30130us (30220us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.943411:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10233 00000100:00100000:3.0:1746129742.943631:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051963520 00000100:00100000:3.0:1746129742.943634:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051963520 00002000:00100000:3.0:1746129742.943647:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3ea:0x0] (1114112->1196031) req@ffff88009a04e680 x1830949051963520/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/0 e 0 to 0 dl 1746129753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746129742.943650:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949051962880:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1649us (2424us total) trans 0 rc 0/0 00002000:00100000:3.0:1746129742.943653:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04e680 with x1830949051963520 ext(1114112->1196031) 00000100:00100000:1.0:1746129742.943656:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4943 00010000:00010000:3.0:1746129742.943657:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093eefc00/0x48868a4e43947df0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ac expref: 16 pid: 4589 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746129742.943664:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093eefc00/0x48868a4e43947df0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ac expref: 16 pid: 4589 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746129742.943667:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051963136 00002000:00010000:3.0:1746129742.943669:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a04e680 00000100:00100000:1.0:1746129742.943670:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051963136 00000100:00100000:3.0:1746129742.943678:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 519 00010000:00010000:1.0:1746129742.943679:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093eeec00/0x48868a4e43947e21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8c8 expref: 13 pid: 4589 timeout: 788 lvb_type: 1 00000100:00100000:3.0:1746129742.943681:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949051963520:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:1.0:1746129742.943692:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4948 00000100:00100000:1.0:1746129742.943697:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949051963136:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129742.943703:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129742.943711:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880093eeec00/0x48868a4e43947e21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8c8 expref: 13 pid: 4589 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746129742.943718:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093eeec00/0x48868a4e43947e21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8c8 expref: 13 pid: 4589 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746129742.943728:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093eeec00/0x48868a4e43947e21 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8c8 expref: 13 pid: 4589 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746129742.943737:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129742.943751:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949051963136:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 54us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129742.943755:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4948 00000100:00100000:3.0:1746129742.943795:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053202304:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129742.943824:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949051962240:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1803us (2586us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129742.943834:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4944 00000100:00100000:0.0:1746129742.946033:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129742.946463:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051963648 00000100:00100000:2.0:1746129742.946469:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051963648 00010000:00010000:2.0:1746129742.946492:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094fd8800/0x48868a4e43947d72 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e84a expref: 30 pid: 4589 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746129742.946523:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4949 00000100:00100000:2.0:1746129742.946528:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1964:x1830949051963648:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129742.946539:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129742.946554:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880094fd8800/0x48868a4e43947d72 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e84a expref: 30 pid: 4589 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746129742.946573:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094fd8800/0x48868a4e43947d72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e84a expref: 30 pid: 4589 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746129742.946589:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094fd8800/0x48868a4e43947d72 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e84a expref: 30 pid: 4589 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746129742.946601:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129742.946603:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129742.946606:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013585be00/0x48868a4e43947eb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.946612:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013585be00/0x48868a4e43947eb4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.946641:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129742.946661:0:1140:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013585be00/0x48868a4e43947eb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.946670:0:1140:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013585be00/0x48868a4e43947eb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129742.946683:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1964:x1830949051963648:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 154us (654us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129742.946687:0:1140:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013585be00/0x48868a4e43947eb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129742.946688:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4949 00010000:00010000:0.0:1746129742.946694:0:1140:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013585be00/0x48868a4e43947eb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.946700:0:1140:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013585be00/0x48868a4e43947eb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.946706:0:1140:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013585be00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129742.946709:0:1140:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013585be00/0x48868a4e43947eb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.946720:0:1140:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013585be00/0x48868a4e43947eb4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.946736:0:1140:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013585be00/0x48868a4e43947eb4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.946741:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013585be00/0x48868a4e43947eb4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129742.946777:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949051961472:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 33028us (33645us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.946785:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10237 00010000:00010000:3.0:1746129742.946978:0:3624:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093eef600/0x48868a4e43947ead lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129742.961287:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949051962368:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 18356us (20054us total) trans 21474840132 rc 0/0 00000100:00100000:2.0:1746129742.961299:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 517 00002000:00100000:2.0:1746129742.961309:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->1409023) req@ffff880135d8d180 x1830949051962368/t21474840132(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/448 e 0 to 0 dl 1746129753 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129742.961318:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8d180 with x1830949051962368 ext(1048576->1409023) 00010000:00010000:2.0:1746129742.961326:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093eeee00/0x48868a4e43947dfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1409023) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ba expref: 32 pid: 4589 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746129742.961340:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093eeee00/0x48868a4e43947dfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1409023) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ba expref: 32 pid: 4589 timeout: 789 lvb_type: 0 00002000:00010000:2.0:1746129742.961347:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135d8d180 00000100:00100000:2.0:1746129742.965728:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949051963520:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 22037us (22479us total) trans 17179872966 rc 0/0 00000100:00100000:2.0:1746129742.965739:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 519 00002000:00100000:2.0:1746129742.965748:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3ea:0x0] (1114112->1196031) req@ffff88009a04e680 x1830949051963520/t17179872966(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:483/0 lens 488/448 e 0 to 0 dl 1746129753 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129742.965757:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04e680 with x1830949051963520 ext(1114112->1196031) 00010000:00010000:2.0:1746129742.965766:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093eefc00/0x48868a4e43947df0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ac expref: 18 pid: 4589 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746129742.965781:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093eefc00/0x48868a4e43947df0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ac expref: 18 pid: 4589 timeout: 789 lvb_type: 0 00002000:00010000:2.0:1746129742.965787:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a04e680 00000100:00100000:3.0:1746129742.969648:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1963:x1830949051963392:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 26720us (26833us total) trans 21474840133 rc 0/0 00000100:00100000:3.0:1746129742.969658:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 518 00002000:00100000:3.0:1746129742.969667:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1478656->2097151) req@ffff880135d8f800 x1830949051963392/t21474840133(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:483/0 lens 488/448 e 0 to 0 dl 1746129753 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129742.969675:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8f800 with x1830949051963392 ext(1478656->2097151) 00010000:00010000:3.0:1746129742.969683:0:21600:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093eef000/0x48868a4e43947df7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8b3 expref: 32 pid: 4589 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746129742.969693:0:21600:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093eef000/0x48868a4e43947df7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8b3 expref: 32 pid: 4589 timeout: 789 lvb_type: 0 00002000:00010000:3.0:1746129742.969699:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135d8f800 00000100:00100000:0.0:1746129742.969817:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.969929:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.969946:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051963776 00000100:00100000:0.0:1746129742.969952:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051963776 00010000:00010000:0.0:1746129742.969972:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093eeee00/0x48868a4e43947dfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1409023) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ba expref: 32 pid: 4589 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746129742.970728:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051963904 00000100:00100000:0.0:1746129742.970732:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051963904 00010000:00010000:0.0:1746129742.970745:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093eefc00/0x48868a4e43947df0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ac expref: 18 pid: 4589 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746129742.971382:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4950 00000100:00100000:2.0:1746129742.971390:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949051963776:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129742.971402:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129742.971419:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093eeee00/0x48868a4e43947dfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1409023) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ba expref: 32 pid: 4589 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746129742.971429:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093eeee00/0x48868a4e43947dfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1409023) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ba expref: 32 pid: 4589 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746129742.971444:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093eeee00/0x48868a4e43947dfe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1409023) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ba expref: 32 pid: 4589 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746129742.971470:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129742.971471:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129742.971476:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e348800/0x48868a4e43947e98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.971483:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e348800/0x48868a4e43947e98 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.971499:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129742.971979:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4951 00000100:00100000:0.0:1746129742.971986:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1963:x1830949051963904:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129742.971996:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129742.972009:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093eefc00/0x48868a4e43947df0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1114112->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ac expref: 18 pid: 4589 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746129742.972016:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093eefc00/0x48868a4e43947df0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1114112->1196031) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ac expref: 18 pid: 4589 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746129742.972026:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093eefc00/0x48868a4e43947df0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1114112->1196031) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8ac expref: 18 pid: 4589 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746129742.972047:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.972049:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129742.972051:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093eef600/0x48868a4e43947ead lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.972056:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093eef600/0x48868a4e43947ead lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129742.972068:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129742.972578:0:3624:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093eef600/0x48868a4e43947ead lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.972586:0:3624:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093eef600/0x48868a4e43947ead lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.972604:0:3624:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093eef600/0x48868a4e43947ead lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.972614:0:3624:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093eef600/0x48868a4e43947ead lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.972620:0:3624:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093eef600/0x48868a4e43947ead lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.972626:0:3624:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093eef600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129742.972630:0:3624:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093eef600/0x48868a4e43947ead lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.972636:0:3624:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093eef600/0x48868a4e43947ead lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.972645:0:3624:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093eef600/0x48868a4e43947ead lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.972650:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093eef600/0x48868a4e43947ead lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129742.972713:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949051961856:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 59276us (59492us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.972720:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10236 00010000:00010000:1.0:1746129742.972754:0:20441:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012e348800/0x48868a4e43947e98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.972762:0:20441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e348800/0x48868a4e43947e98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.972775:0:20441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e348800/0x48868a4e43947e98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.972781:0:20441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e348800/0x48868a4e43947e98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.972787:0:20441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e348800/0x48868a4e43947e98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.972792:0:20441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e348800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129742.972795:0:20441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e348800/0x48868a4e43947e98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.972800:0:20441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e348800/0x48868a4e43947e98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.972814:0:20441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e348800/0x48868a4e43947e98 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129742.972820:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e348800/0x48868a4e43947e98 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129742.973095:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949051963776:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1706us (3278us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129742.973102:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4950 00000100:00100000:3.0:1746129742.973305:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1963:x1830949051963904:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1319us (3375us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.973311:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4951 00000100:00100000:1.0:1746129742.973416:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949051961728:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 60136us (60255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129742.973421:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10234 00000100:00100000:0.0:1746129742.974184:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129742.974269:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051964032 00000100:00100000:2.0:1746129742.974275:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051964032 00010000:00010000:2.0:1746129742.974294:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093eef000/0x48868a4e43947df7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8b3 expref: 31 pid: 4589 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746129742.974364:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4952 00000100:00100000:2.0:1746129742.974369:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130567850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949051964032:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129742.974378:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129742.974390:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093eef000/0x48868a4e43947df7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8b3 expref: 31 pid: 4589 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746129742.974398:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093eef000/0x48868a4e43947df7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8b3 expref: 31 pid: 4589 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746129742.974413:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093eef000/0x48868a4e43947df7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8b3 expref: 31 pid: 4589 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746129742.974588:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129742.974589:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129742.974593:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c65d800/0x48868a4e43947ea6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.974600:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c65d800/0x48868a4e43947ea6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.974731:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129742.974754:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130567850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1963:x1830949051964032:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 384us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129742.974760:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4952 00010000:00010000:3.0:1746129742.974827:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c65d800/0x48868a4e43947ea6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.974835:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c65d800/0x48868a4e43947ea6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.974868:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c65d800/0x48868a4e43947ea6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.974874:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c65d800/0x48868a4e43947ea6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.974879:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c65d800/0x48868a4e43947ea6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.974883:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c65d800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129742.974885:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c65d800/0x48868a4e43947ea6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.974891:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c65d800/0x48868a4e43947ea6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.974900:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c65d800/0x48868a4e43947ea6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129742.974905:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c65d800/0x48868a4e43947ea6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129742.974935:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949051961600:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 61510us (61737us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.974941:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10235 00000100:00100000:0.0:1746129742.976912:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129742.977141:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051964288 00000100:00100000:2.0:1746129742.977146:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051964288 00000100:00100000:2.0:1746129742.977177:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9736 00000100:00100000:2.0:1746129742.977183:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+20:28356:x1830949051964288:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:2.0:1746129742.977224:0:14315:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129742.977244:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093eee400/0x48868a4e43947e67 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e8f9 expref: 20 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.977257:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129742.977260:0:14315:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129742.977282:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4a00/0x48868a4e43947ec2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129742.977292:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e43947894 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e533 expref: 299 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.977298:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28e00/0x48868a4e439478a2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e541 expref: 17 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.977303:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28a00/0x48868a4e439478b0 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e54f expref: 299 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.977309:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e43947a5b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e660 expref: 299 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.977314:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85000/0x48868a4e43947aaf lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e683 expref: 17 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.977321:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9400/0x48868a4e43947d64 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e843 expref: 299 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.977326:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4a00/0x48868a4e43947ec2 lrc: 9/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129742.977349:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9400/0x48868a4e43947d64 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e843 expref: 299 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.977359:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9400/0x48868a4e43947d64 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e843 expref: 299 pid: 15044 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746129742.977369:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053203456:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129742.977455:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85000/0x48868a4e43947aaf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e683 expref: 17 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.977462:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85000/0x48868a4e43947aaf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e683 expref: 17 pid: 14315 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746129742.978608:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053203584:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129742.978692:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e43947a5b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e660 expref: 299 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.978700:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e43947a5b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e660 expref: 299 pid: 14315 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746129742.978707:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053203712:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129742.978730:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28a00/0x48868a4e439478b0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e54f expref: 299 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.978736:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28a00/0x48868a4e439478b0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e54f expref: 299 pid: 16808 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746129742.978741:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053203840:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129742.978756:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28e00/0x48868a4e439478a2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e541 expref: 17 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.978762:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28e00/0x48868a4e439478a2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e541 expref: 17 pid: 16808 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746129742.978768:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053203968:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129742.978782:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e43947894 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e533 expref: 299 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129742.978788:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e43947894 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e533 expref: 299 pid: 15044 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746129742.978793:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053204096:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129742.978805:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129742.982062:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.982092:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.982112:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.982116:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051964800 00000100:00100000:1.0:1746129742.982123:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051964800 00000100:00100000:0.0:1746129742.982125:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129742.982165:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3793 00000100:00100000:1.0:1746129742.982172:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba7c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:27195:x1830949051964800:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746129742.982185:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.982243:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051964544 00000100:00100000:3.0:1746129742.982246:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051964544 00010000:00010000:3.0:1746129742.982265:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85000/0x48868a4e43947aaf lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e683 expref: 18 pid: 14315 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746129742.982282:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051964416 00000100:00100000:3.0:1746129742.982284:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051964416 00010000:00010000:3.0:1746129742.982291:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9400/0x48868a4e43947d64 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e843 expref: 301 pid: 15044 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746129742.982312:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051964928 00000100:00100000:3.0:1746129742.982314:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051964928 00010000:00010000:3.0:1746129742.982321:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28a00/0x48868a4e439478b0 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e54f expref: 302 pid: 16808 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746129742.982327:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051965056 00000100:00100000:3.0:1746129742.982329:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051965056 00010000:00010000:3.0:1746129742.982335:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28e00/0x48868a4e439478a2 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e541 expref: 19 pid: 16808 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746129742.982343:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4953 00000100:00100000:3.0:1746129742.982347:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949051964544:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129742.982355:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129742.982360:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85000/0x48868a4e43947aaf lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e683 expref: 19 pid: 14315 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746129742.982366:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4954 00010000:00010000:3.0:1746129742.982368:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85000/0x48868a4e43947aaf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e683 expref: 19 pid: 14315 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746129742.982375:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+302:1962:x1830949051964416:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129742.982383:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129742.982386:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129742.982388:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9400/0x48868a4e43947d64 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e843 expref: 302 pid: 15044 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746129742.982391:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4a00/0x48868a4e43947ec2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.982398:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129742.982400:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9400/0x48868a4e43947d64 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e843 expref: 302 pid: 15044 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746129742.982410:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129742.982414:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4a00/0x48868a4e43947ec2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129742.982419:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129742.982431:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949051964544:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 83us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.982435:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+302:1962:x1830949051964416:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 62us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.982437:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4953 00000100:00100000:0.0:1746129742.982440:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4954 00000100:00100000:3.0:1746129742.982454:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4955 00000100:00100000:3.0:1746129742.982459:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+301:1962:x1830949051964928:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129742.982466:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4956 00000100:00100000:0.0:1746129742.982471:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949051965056:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129742.982477:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129742.982482:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28e00/0x48868a4e439478a2 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e541 expref: 18 pid: 16808 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746129742.982489:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28e00/0x48868a4e439478a2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e541 expref: 18 pid: 16808 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746129742.982498:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129742.982501:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4a00/0x48868a4e43947ec2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129742.982509:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129742.982523:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949051965056:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 52us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.982528:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4956 00000100:00100000:1.0:1746129742.982585:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba7c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+302:27195:x1830949051964800:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 413us (530us total) trans 8589943502 rc 0/0 00000100:00100000:1.0:1746129742.982590:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3793 00010000:00010000:2.0:1746129742.982741:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52e9400/0x48868a4e43947d64 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e843 expref: 301 pid: 15044 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746129742.982751:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053203456:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129742.982759:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd85000/0x48868a4e43947aaf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e683 expref: 17 pid: 14315 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746129742.982766:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053203584:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129742.982771:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053203712:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129742.982777:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053203840:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129742.982783:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28e00/0x48868a4e439478a2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e541 expref: 16 pid: 16808 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746129742.982791:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053203968:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129742.983180:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053204096:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129742.983205:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4a00/0x48868a4e43947ec2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.983370:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129742.983375:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28a00/0x48868a4e439478b0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e54f expref: 300 pid: 16808 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746129742.983383:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28a00/0x48868a4e439478b0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e54f expref: 300 pid: 16808 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746129742.983394:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28a00/0x48868a4e439478b0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e54f expref: 300 pid: 16808 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746129742.983406:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129742.983409:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4a00/0x48868a4e43947ec2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.983414:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129742.983433:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:1962:x1830949051964928:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 974us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.983441:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4955 00000100:00100000:0.0:1746129742.983520:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129742.983742:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051965184 00000100:00100000:3.0:1746129742.983745:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051965184 00010000:00010000:3.0:1746129742.983756:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e43947894 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e533 expref: 299 pid: 15044 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746129742.983803:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4957 00000100:00100000:3.0:1746129742.983808:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:1962:x1830949051965184:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129742.983815:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129742.983818:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e43947894 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e533 expref: 299 pid: 15044 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746129742.983825:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e43947894 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e533 expref: 299 pid: 15044 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746129742.983835:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e43947894 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e533 expref: 299 pid: 15044 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746129742.983844:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129742.983867:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4a00/0x48868a4e43947ec2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129742.983872:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129742.983892:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:1962:x1830949051965184:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 83us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129742.983897:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4957 00000100:00100000:2.0:1746129742.985075:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129742.985136:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051965312 00000100:00100000:0.0:1746129742.985142:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051965312 00010000:00010000:0.0:1746129742.985159:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e43947a5b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e660 expref: 298 pid: 14315 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746129742.985188:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4958 00000100:00100000:0.0:1746129742.985193:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:1962:x1830949051965312:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129742.985201:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129742.985205:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e43947a5b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e660 expref: 298 pid: 14315 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746129742.985218:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e43947a5b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e660 expref: 298 pid: 14315 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746129742.985230:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e43947a5b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e660 expref: 298 pid: 14315 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746129742.985242:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129742.985246:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4a00/0x48868a4e43947ec2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129742.985252:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4a00/0x48868a4e43947ec2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129742.985258:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4a00/0x48868a4e43947ec2 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129742.985271:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129742.985304:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:1962:x1830949051965312:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 111us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129742.985310:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4958 00010000:00010000:2.0:1746129742.985398:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4a00/0x48868a4e43947ec2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129742.985405:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4a00/0x48868a4e43947ec2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000040:00080000:2.0:1746129742.985973:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2678, 88 off222504 00000004:00080000:2.0:1746129742.985981:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689044132506ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129742.986016:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2628, 88 off218184 00000004:00080000:2.0:1746129742.986020:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689044172277ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129742.986037:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2629, 88 off218272 00000004:00080000:2.0:1746129742.986040:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689044192012ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129742.986046:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2679, 88 off222592 00000004:00080000:2.0:1746129742.986049:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689044201571ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129742.986055:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2680, 88 off222680 00000004:00080000:2.0:1746129742.986058:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689044209912ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129742.986064:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2630, 88 off218360 00000004:00080000:2.0:1746129742.986066:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689044218254ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129742.986072:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2631, 88 off218448 00000004:00080000:2.0:1746129742.986074:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689044226501ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129742.986080:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2632, 88 off218536 00000004:00080000:2.0:1746129742.986082:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689044234202ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129742.986088:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2681, 88 off222768 00000004:00080000:2.0:1746129742.986090:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689044242219ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129742.986096:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2633, 88 off218624 00000004:00080000:2.0:1746129742.986098:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689044250570ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129742.986105:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2682, 88 off222856 00000004:00080000:2.0:1746129742.986107:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689044259151ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129742.986113:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2634, 88 off218712 00000004:00080000:2.0:1746129742.986115:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689044267439ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129742.986121:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2683, 88 off222944 00000004:00080000:2.0:1746129742.986124:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689044276130ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129742.986130:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2684, 88 off223032 00000004:00080000:2.0:1746129742.986132:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689044283856ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129742.986137:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2685, 88 off223120 00000004:00080000:2.0:1746129742.986139:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689044291580ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129742.986145:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2686, 88 off223208 00000004:00080000:2.0:1746129742.986147:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689044298754ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129742.986152:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2635, 88 off218800 00000004:00080000:2.0:1746129742.986154:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689044305686ns, next at 641623252291ns, rc = 0 00010000:00010000:2.0:1746129743.014351:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1746129743.022145:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943479 is committed 00000001:00080000:1.0:1746129743.022155:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943472 is committed 00000001:00080000:1.0:1746129743.022160:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943502 is committed 00000001:00080000:1.0:1746129743.022171:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943503 is committed 00000004:00080000:1.0:1746129743.022175:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1822 committed 00000004:00080000:1.0:1746129743.022182:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1869 committed 00000004:00080000:1.0:1746129743.022186:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1868 committed 00000004:00080000:1.0:1746129743.022188:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1867 committed 00000004:00080000:1.0:1746129743.022190:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1866 committed 00000004:00080000:1.0:1746129743.022191:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1821 committed 00000004:00080000:1.0:1746129743.022194:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1865 committed 00000004:00080000:1.0:1746129743.022195:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1820 committed 00000004:00080000:1.0:1746129743.022197:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1864 committed 00000004:00080000:1.0:1746129743.022199:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1819 committed 00000004:00080000:1.0:1746129743.022200:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1818 committed 00000004:00080000:1.0:1746129743.022201:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1817 committed 00000004:00080000:1.0:1746129743.022202:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1863 committed 00000004:00080000:1.0:1746129743.022204:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1862 committed 00000004:00080000:1.0:1746129743.022205:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1816 committed 00000004:00080000:1.0:1746129743.022207:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1815 committed 00000004:00080000:1.0:1746129743.022208:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1861 committed 00000001:00080000:1.0:1746129743.022213:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943499 is committed 00000004:00010000:2.0:1746129743.022376:0:14315:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009a04dc00 reply state ffff88009242bc00 transno 8589943503 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4a00/0x48868a4e43947ec2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:2.0:1746129743.022386:0:14315:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746129743.022755:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053204480:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129743.022945:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053204352:0@lo:2:osp-syn-0-0.0 00010000:00080000:2.0:1746129743.023213:0:14315:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746129743.023225:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28356:x1830949051964288:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 46040us (46316us total) trans 8589943503 rc 0/0 00000100:00100000:2.0:1746129743.023232:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9736 00000100:00100000:2.0:1746129743.023256:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053204224:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129743.023342:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129743.023373:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053204992:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129743.023388:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129743.023398:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053205504:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129743.023411:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129743.023420:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053206016:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129743.023432:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129743.023450:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053204608:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129743.023464:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129743.023475:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053205120:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129743.023486:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129743.023494:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053205632:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129743.023506:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129743.023514:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053206144:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129743.023531:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746129743.023551:0:3283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4a00/0x48868a4e43947ec2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.023572:0:3283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4a00/0x48868a4e43947ec2 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.023578:0:3283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4a00/0x48868a4e43947ec2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.023582:0:3283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a49b4a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129743.023586:0:3283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4a00/0x48868a4e43947ec2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.023595:0:3283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4a00/0x48868a4e43947ec2 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.023606:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129743.023608:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129743.023612:0:3283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4a00/0x48868a4e43947ec2 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.023616:0:3283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4a00/0x48868a4e43947ec2 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00000100:00100000:3.0:1746129743.023634:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053204480 00000100:00100000:3.0:1746129743.023639:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053204480 00000100:00100000:3.0:1746129743.023665:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053204992 00000100:00100000:3.0:1746129743.023667:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053204992 00000100:00100000:3.0:1746129743.023677:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053205504 00000100:00100000:3.0:1746129743.023679:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053205504 00000100:00100000:3.0:1746129743.023687:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053206016 00000100:00100000:3.0:1746129743.023688:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053206016 00000100:00100000:3.0:1746129743.023695:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053204608 00000100:00100000:3.0:1746129743.023697:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053204608 00000100:00100000:3.0:1746129743.023702:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053205120 00000100:00100000:3.0:1746129743.023704:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053205120 00000100:00100000:3.0:1746129743.023709:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053205632 00000100:00100000:3.0:1746129743.023710:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053205632 00000100:00100000:3.0:1746129743.023715:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053206144 00000100:00100000:3.0:1746129743.023716:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053206144 00000100:00100000:3.0:1746129743.023724:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10239 00000100:00100000:3.0:1746129743.023729:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3297:x1830949053204480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129743.023913:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+42:3297:x1830949053204480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 183us (570us total) trans 21474840134 rc 0/0 00000100:00100000:3.0:1746129743.023921:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10239 00000100:00100000:3.0:1746129743.023935:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10240 00000100:00100000:3.0:1746129743.023940:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:3297:x1830949053204992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129743.024640:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129743.024656:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053204864:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129743.024674:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129743.024681:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053205376:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129743.024694:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129743.024702:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053205888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129743.024718:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129743.024742:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053204352 00000100:00100000:1.0:1746129743.024746:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053204352 00000100:00100000:1.0:1746129743.024759:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053204864 00000100:00100000:1.0:1746129743.024761:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053204864 00000100:00100000:1.0:1746129743.024767:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053205376 00000100:00100000:1.0:1746129743.024768:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053205376 00000100:00100000:1.0:1746129743.024773:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053205888 00000100:00100000:1.0:1746129743.024774:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053205888 00002000:00010000:3.0:1746129743.024779:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1746129743.024780:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10241 00002000:00010000:3.0:1746129743.024782:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746129743.024784:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1746129743.024784:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:3297:x1830949053205504:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129743.024785:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746129743.024787:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746129743.024807:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:3297:x1830949053204992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 867us (1418us total) trans 17179872967 rc 0/0 00000100:00100000:3.0:1746129743.024814:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10240 00000100:00100000:3.0:1746129743.024826:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10242 00000100:00100000:3.0:1746129743.024830:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:3297:x1830949053206016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129743.024920:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3297:x1830949053206016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (1485us total) trans 21474840135 rc 0/0 00000100:00100000:3.0:1746129743.024924:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10242 00000100:00100000:3.0:1746129743.024934:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10243 00000100:00100000:3.0:1746129743.024939:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:3298:x1830949053204608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129743.024939:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10244 00000100:00100000:0.0:1746129743.024946:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+46:3298:x1830949053205120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129743.025017:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3298:x1830949053204608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (1551us total) trans 21474840136 rc 0/0 00000100:00100000:3.0:1746129743.025022:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10243 00000100:00100000:0.0:1746129743.025029:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+47:3298:x1830949053205120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (1541us total) trans 17179872969 rc 0/0 00000100:00100000:3.0:1746129743.025031:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10245 00000100:00100000:0.0:1746129743.025035:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10244 00000100:00100000:3.0:1746129743.025036:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:3298:x1830949053205632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129743.025045:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10246 00000100:00100000:0.0:1746129743.025049:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+43:3298:x1830949053206144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129743.025096:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10247 00000100:00100000:3.0:1746129743.025101:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3296:x1830949053204352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129743.025126:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:3297:x1830949053205504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 104us (1477us total) trans 17179872968 rc 0/0 00000100:00100000:1.0:1746129743.025131:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10241 00000100:00100000:2.0:1746129743.025132:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129743.025141:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053204224 00000100:00100000:1.0:1746129743.025143:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053204224 00000100:00100000:1.0:1746129743.025155:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10248 00000100:00100000:1.0:1746129743.025158:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:3296:x1830949053204864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.025160:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053204736:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.025177:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129743.025183:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053205248:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.025193:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129743.025198:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053205760:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129743.025209:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129743.025224:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053204736 00000100:00100000:2.0:1746129743.025226:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053204736 00000100:00100000:2.0:1746129743.025236:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053205248 00000100:00100000:2.0:1746129743.025238:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053205248 00000100:00100000:1.0:1746129743.025241:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3296:x1830949053204864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (566us total) trans 17179872970 rc 0/0 00000100:00100000:2.0:1746129743.025242:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053205760 00000100:00100000:2.0:1746129743.025244:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053205760 00000100:00100000:1.0:1746129743.025246:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10248 00000100:00100000:2.0:1746129743.025250:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10249 00000100:00100000:2.0:1746129743.025254:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+48:3296:x1830949053205376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129743.025256:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10250 00000100:00100000:1.0:1746129743.025260:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3296:x1830949053205888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129743.025298:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10251 00000100:00100000:1.0:1746129743.025303:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3299:x1830949053204224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.025336:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+49:3296:x1830949053205376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (640us total) trans 17179872971 rc 0/0 00000100:00100000:2.0:1746129743.025341:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10249 00000100:00100000:2.0:1746129743.025351:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10252 00000100:00100000:2.0:1746129743.025355:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+48:3299:x1830949053204736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129743.025422:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+47:3298:x1830949053206144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 372us (1889us total) trans 21474840138 rc 0/0 00000100:00100000:0.0:1746129743.025426:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10246 00000100:00100000:0.0:1746129743.025436:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10253 00000100:00100000:3.0:1746129743.025439:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+46:3296:x1830949053204352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 338us (799us total) trans 21474840139 rc 0/0 00000100:00100000:0.0:1746129743.025439:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+48:3299:x1830949053205248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129743.025445:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10247 00000100:00100000:3.0:1746129743.025454:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10254 00000100:00100000:3.0:1746129743.025458:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3299:x1830949053205760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129743.025502:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3299:x1830949053205248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (308us total) trans 17179872972 rc 0/0 00000100:00100000:0.0:1746129743.025507:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10253 00002000:00010000:3.0:1746129743.025513:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129743.025515:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746129743.025517:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746129743.025518:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746129743.025520:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746129743.025535:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+46:3299:x1830949053205760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (325us total) trans 21474840140 rc 0/0 00000100:00100000:3.0:1746129743.025539:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10254 00000100:00100000:0.0:1746129743.025543:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:3298:x1830949053205632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 507us (2036us total) trans 21474840137 rc 0/0 00000100:00100000:0.0:1746129743.025548:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10245 00000100:00080000:3.0:1746129743.025555:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746129743.025576:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1746129743.025606:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284dc00/2, rc 0, transno 21474840136 00000100:00100000:3.0:1746129743.025611:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053204608:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129743.025619:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04d880/2, rc 0, transno 17179872969 00000100:00100000:3.0:1746129743.025627:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053205120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129743.025769:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3296:x1830949053205888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 509us (1050us total) trans 21474840141 rc 0/0 00000100:00100000:0.0:1746129743.025774:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10250 00000100:00100000:2.0:1746129743.025894:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+49:3299:x1830949053204736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 538us (715us total) trans 17179872973 rc 0/0 00000100:00100000:2.0:1746129743.025899:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10252 00000100:00100000:2.0:1746129743.025970:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.026000:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053206272:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.026016:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746129743.026036:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04ce00/2, rc 0, transno 17179872973 00000100:00100000:1.0:1746129743.026039:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3299:x1830949053204224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 735us (905us total) trans 17179872974 rc 0/0 00000100:00100000:2.0:1746129743.026040:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053204736:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129743.026044:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10251 00000004:00080000:2.0:1746129743.026046:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04d180/2, rc 0, transno 17179872972 00000100:00100000:2.0:1746129743.026049:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053205248:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129743.026052:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053206272 00000004:00080000:2.0:1746129743.026055:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284d500/2, rc 0, transno 21474840140 00000100:00100000:1.0:1746129743.026055:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053206272 00000100:00100000:2.0:1746129743.026057:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053205760:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129743.026065:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04ea00/2, rc 0, transno 17179872974 00000100:00100000:1.0:1746129743.026067:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10255 00000100:00100000:2.0:1746129743.026068:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053204224:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129743.026071:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3299:x1830949053206272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.026078:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051965440 00000100:00100000:2.0:1746129743.026081:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051965440 00000100:00100000:2.0:1746129743.026101:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9737 00000100:00100000:2.0:1746129743.026105:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+7:28356:x1830949051965440:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129743.026115:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129743.026127:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadae00/0x48868a4e43947ec9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e91c expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129743.026148:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3299:x1830949053206272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (130us total) trans 17179872975 rc 0/0 00000100:00100000:1.0:1746129743.026153:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10255 00010000:00010000:2.0:1746129743.026164:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadae00/0x48868a4e43947ec9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e91c expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.026176:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadae00/0x48868a4e43947ec9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e91c expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746129743.026178:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284f480/2, rc 0, transno 21474840139 00000100:00100000:1.0:1746129743.026182:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053204352:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746129743.026189:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00000004:00080000:1.0:1746129743.026189:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04ed80/2, rc 0, transno 17179872970 00000100:00100000:1.0:1746129743.026191:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053204864:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746129743.026192:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129743.026194:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fadae00, rc 0) 00000004:00080000:1.0:1746129743.026196:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04c380/2, rc 0, transno 17179872971 00000100:00100000:1.0:1746129743.026198:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053205376:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129743.026203:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284f100/2, rc 0, transno 21474840141 00000100:00100000:1.0:1746129743.026206:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053205888:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129743.026215:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28356:x1830949051965440:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 109us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129743.026220:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9737 00000100:00080000:2.0:1746129743.026230:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1746129743.026239:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04c700/2, rc 0, transno 17179872975 00000100:00100000:2.0:1746129743.026242:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053206272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129743.028303:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.028401:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051965568 00000100:00100000:2.0:1746129743.028407:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051965568 00000100:00100000:2.0:1746129743.028436:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9738 00000100:00100000:2.0:1746129743.028442:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28356:x1830949051965568:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129743.028454:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129743.028466:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb000/0x48868a4e43947ed0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e923 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.028524:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbe00/0x48868a4e43947ed7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129743.028534:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbe00/0x48868a4e43947ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129743.028543:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbe00/0x48868a4e43947ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129743.028573:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:2.0:1746129743.028577:0:14315:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129743.028589:0:14315:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbe00/0x48868a4e43947ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129743.028606:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb000/0x48868a4e43947ed0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e923 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.028636:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbe00/0x48868a4e43947ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e923 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.028642:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129743.028644:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129743.028646:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fadbe00, rc 0) 00000100:00100000:2.0:1746129743.028684:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:28356:x1830949051965568:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 241us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129743.028688:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9738 00000004:00080000:3.0:1746129743.028959:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284f800/2, rc 0, transno 21474840137 00000100:00100000:3.0:1746129743.028967:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053205632:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129743.028989:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284e680/2, rc 0, transno 21474840138 00000100:00100000:3.0:1746129743.028992:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053206144:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129743.029055:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284ce00/2, rc 0, transno 21474840134 00000100:00100000:3.0:1746129743.029059:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053204480:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129743.029068:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04c000/2, rc 0, transno 17179872967 00000100:00100000:3.0:1746129743.029071:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053204992:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129743.029078:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04ca80/2, rc 0, transno 17179872968 00000100:00100000:3.0:1746129743.029080:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053205504:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129743.029087:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284c000/2, rc 0, transno 21474840135 00000100:00100000:3.0:1746129743.029089:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053206016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129743.032543:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.035001:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051965696 00000100:00100000:2.0:1746129743.035012:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051965696 00000100:00080000:3.0:1746129743.035067:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746129743.035072:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10256 00000100:00100000:2.0:1746129743.035079:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949051965696:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129743.035097:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129743.035113:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fadb600/0x48868a4e43947ede lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e92a expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129743.035134:0:20441:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e8:0x0] initial LVB size: 1048576, mtime: 0x6813d34e, atime: 0x6813d34e, ctime: 0x6813d34e, blocks: 0x7b7 00000100:00100000:0.0:1746129743.035139:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129743.035149:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129743.035151:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129743.035158:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fadb600/0x48868a4e43947ede lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e92a expref: 10 pid: 20441 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129743.035159:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.035169:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129743.035171:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fadb600/0x48868a4e43947ede lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e92a expref: 10 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129743.035181:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fadb600, rc 0) 00000100:00100000:2.0:1746129743.035226:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949051965696:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 147us (2689us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129743.035232:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10256 00000100:00100000:2.0:1746129743.035383:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051965952 00000100:00100000:2.0:1746129743.035386:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051965952 00000100:00100000:0.0:1746129743.035400:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.035499:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129743.035517:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051966208 00000100:00100000:1.0:1746129743.035521:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051966208 00000100:00100000:1.0:1746129743.035536:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051965824 00000100:00100000:1.0:1746129743.035538:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051965824 00000100:00100000:1.0:1746129743.035545:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051966080 00000100:00100000:1.0:1746129743.035546:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051966080 00000100:00100000:1.0:1746129743.035555:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10257 00000100:00100000:1.0:1746129743.035570:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+10:1963:x1830949051965952:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129743.035577:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129743.035586:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013585a600/0x48868a4e43947ee5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e938 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129743.035601:0:10930:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e7:0x0] initial LVB size: 2097152, mtime: 0x6813d34f, atime: 0x6813d34e, ctime: 0x6813d34f, blocks: 0x821 00010000:00010000:1.0:1746129743.035608:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129743.035610:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129743.035614:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013585a600/0x48868a4e43947ee5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e938 expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129743.035624:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013585a600/0x48868a4e43947ee5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e938 expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129743.035635:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013585a600, rc 0) 00000100:00100000:1.0:1746129743.035650:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949051965952:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 81us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129743.035655:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10257 00000100:00100000:1.0:1746129743.035664:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10258 00000100:00100000:1.0:1746129743.035667:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949051966208:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129743.035672:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129743.035678:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013585be00/0x48868a4e43947eec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e946 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129743.035687:0:10930:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3eb:0x0] initial LVB size: 4960928, mtime: 0x6813d34f, atime: 0x6813d34f, ctime: 0x6813d34f, blocks: 0x1627 00010000:00010000:1.0:1746129743.035692:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129743.035693:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129743.035696:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013585be00/0x48868a4e43947eec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e946 expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129743.035703:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013585be00/0x48868a4e43947eec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e946 expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129743.035709:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013585be00, rc 0) 00000100:00100000:1.0:1746129743.035718:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+12:1963:x1830949051966208:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 51us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129743.035722:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10258 00000100:00100000:1.0:1746129743.035730:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10259 00000100:00100000:1.0:1746129743.035733:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+10:1963:x1830949051965824:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129743.035738:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129743.035743:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013585ae00/0x48868a4e43947ef3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e931 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129743.035750:0:10930:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e6:0x0] initial LVB size: 2097152, mtime: 0x6813d34f, atime: 0x6813d34e, ctime: 0x6813d34f, blocks: 0x821 00010000:00010000:1.0:1746129743.035755:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129743.035756:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129743.035758:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013585ae00/0x48868a4e43947ef3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e931 expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129743.035822:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10260 00000100:00100000:3.0:1746129743.035827:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949051966080:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129743.035832:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129743.035839:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094b2ce00/0x48868a4e43947efa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e93f expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129743.035863:0:1877:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3ea:0x0] initial LVB size: 2097152, mtime: 0x6813d34f, atime: 0x6813d34d, ctime: 0x6813d34f, blocks: 0x81f 00010000:00010000:3.0:1746129743.035870:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129743.035871:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129743.035875:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094b2ce00/0x48868a4e43947efa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e93f expref: 12 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129743.035882:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094b2ce00/0x48868a4e43947efa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e93f expref: 12 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129743.035887:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094b2ce00, rc 0) 00000100:00100000:3.0:1746129743.035900:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+12:1963:x1830949051966080:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 73us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129743.035905:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10260 00000100:00080000:3.0:1746129743.035918:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1746129743.035998:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013585ae00/0x48868a4e43947ef3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e931 expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129743.036005:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013585ae00, rc 0) 00000100:00100000:1.0:1746129743.036021:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949051965824:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 286us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129743.036025:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10259 00000100:00100000:1.0:1746129743.036207:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051966336 00000100:00100000:1.0:1746129743.036210:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051966336 00000100:00100000:1.0:1746129743.036235:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10261 00000100:00100000:1.0:1746129743.036240:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949051966336:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129743.036246:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129743.036254:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013585a800/0x48868a4e43947f01 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e94d expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129743.036263:0:8435:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e8:0x0] initial LVB size: 4194304, mtime: 0x6813d34e, atime: 0x6813d34e, ctime: 0x6813d34e, blocks: 0x1029 00010000:00010000:1.0:1746129743.036270:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129743.036272:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129743.036276:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013585a800/0x48868a4e43947f01 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e94d expref: 12 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129743.036283:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013585a800/0x48868a4e43947f01 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e94d expref: 12 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129743.036289:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013585a800, rc 0) 00000100:00100000:1.0:1746129743.036307:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+12:1963:x1830949051966336:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 67us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129743.036310:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10261 00000100:00100000:0.0:1746129743.053473:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.055312:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.055648:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.056621:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.056739:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.056798:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051966720 00000100:00100000:3.0:1746129743.056805:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051966720 00000100:00100000:3.0:1746129743.056855:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051966976 00000100:00100000:3.0:1746129743.056857:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051966976 00000100:00100000:3.0:1746129743.056869:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051966848 00000100:00100000:3.0:1746129743.056870:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051966848 00000100:00100000:3.0:1746129743.056878:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051967360 00000100:00100000:3.0:1746129743.056879:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051967360 00000100:00100000:3.0:1746129743.056890:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3779 00000100:00100000:3.0:1746129743.056896:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949051966720:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129743.056921:0:21600:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c65de00/0x48868a4e43947f08 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.056932:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129743.056933:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129743.056937:0:21600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c65de00/0x48868a4e43947f08 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.056947:0:21600:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c65de00/0x48868a4e43947f08 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129743.058653:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3780 00000100:00100000:2.0:1746129743.058666:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949051966976:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:2.0:1746129743.058691:0:21603:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008fadac00/0x48868a4e43947f0f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.058701:0:21603:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129743.058702:0:21603:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129743.058706:0:21603:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fadac00/0x48868a4e43947f0f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.058723:0:21603:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fadac00/0x48868a4e43947f0f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129743.059261:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051967616 00000100:00100000:0.0:1746129743.059267:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051967616 00000100:00100000:0.0:1746129743.059300:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3781 00000100:00100000:0.0:1746129743.059305:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949051966848:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:0.0:1746129743.059319:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012e348000/0x48868a4e43947f16 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.059325:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129743.059327:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129743.059329:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e348000/0x48868a4e43947f16 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.059337:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e348000/0x48868a4e43947f16 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129743.059918:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3782 00000100:00100000:1.0:1746129743.059926:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949051967360:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:1.0:1746129743.059943:0:21599:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88013585ac00/0x48868a4e43947f1d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129743.059950:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129743.059951:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129743.059953:0:21599:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013585ac00/0x48868a4e43947f1d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129743.059960:0:21599:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013585ac00/0x48868a4e43947f1d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129743.060961:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3783 00000100:00100000:1.0:1746129743.060968:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6141239f-0c60-480d-830c-e22ba61457b0+16:1962:x1830949051967616:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:1.0:1746129743.060983:0:21605:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88013585a200/0x48868a4e43947f24 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129743.060991:0:21605:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129743.060992:0:21605:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129743.060994:0:21605:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013585a200/0x48868a4e43947f24 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129743.061001:0:21605:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013585a200/0x48868a4e43947f24 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129743.063766:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.064640:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051968000 00000100:00100000:2.0:1746129743.064648:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051968000 00000100:00100000:2.0:1746129743.064706:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3784 00000100:00100000:2.0:1746129743.064714:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6141239f-0c60-480d-830c-e22ba61457b0+18:1961:x1830949051968000:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:2.0:1746129743.064740:0:25617:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008fadb200/0x48868a4e43947f2b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.064751:0:25617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129743.064753:0:25617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129743.064757:0:25617:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fadb200/0x48868a4e43947f2b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.064768:0:25617:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fadb200/0x48868a4e43947f2b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129743.066661:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.066965:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051968128 00000100:00100000:3.0:1746129743.066971:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051968128 00000100:00100000:3.0:1746129743.067008:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3785 00000100:00100000:3.0:1746129743.067015:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6141239f-0c60-480d-830c-e22ba61457b0+16:1961:x1830949051968128:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129743.067040:0:21601:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009c65dc00/0x48868a4e43947f32 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.067051:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129743.067053:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129743.067056:0:21601:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c65dc00/0x48868a4e43947f32 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.067066:0:21601:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c65dc00/0x48868a4e43947f32 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129743.070382:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.072976:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051968256 00000100:00100000:3.0:1746129743.072986:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051968256 00000100:00100000:3.0:1746129743.073039:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3786 00000100:00100000:3.0:1746129743.073046:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c089500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6141239f-0c60-480d-830c-e22ba61457b0+18:1961:x1830949051968256:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129743.073074:0:21604:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8801310eda00/0x48868a4e43947f39 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.073084:0:21604:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129743.073086:0:21604:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129743.073090:0:21604:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801310eda00/0x48868a4e43947f39 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.073102:0:21604:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801310eda00/0x48868a4e43947f39 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.081121:0:21599:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88013585ac00/0x48868a4e43947f1d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.081135:0:21599:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013585ac00/0x48868a4e43947f1d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.081143:0:21599:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013585ac00/0x48868a4e43947f1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.081149:0:21599:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013585ac00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129743.081153:0:21599:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013585ac00/0x48868a4e43947f1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.081159:0:21599:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013585ac00/0x48868a4e43947f1d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.081174:0:21599:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013585ac00/0x48868a4e43947f1d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.081181:0:21599:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013585ac00/0x48868a4e43947f1d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129743.081254:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6141239f-0c60-480d-830c-e22ba61457b0+18:1962:x1830949051967360:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 21326us (24631us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129743.081263:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3782 00010000:00010000:2.0:1746129743.089100:0:21605:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88013585a200/0x48868a4e43947f24 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.089114:0:21605:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013585a200/0x48868a4e43947f24 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.089121:0:21605:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013585a200/0x48868a4e43947f24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.089126:0:21605:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013585a200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129743.089129:0:21605:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013585a200/0x48868a4e43947f24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.089135:0:21605:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013585a200/0x48868a4e43947f24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.089150:0:21605:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013585a200/0x48868a4e43947f24 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.089154:0:21605:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013585a200/0x48868a4e43947f24 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129743.089230:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6141239f-0c60-480d-830c-e22ba61457b0+16:1962:x1830949051967616:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 28259us (32487us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129743.089239:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3783 00010000:00010000:2.0:1746129743.093679:0:21600:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c65de00/0x48868a4e43947f08 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.093694:0:21600:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c65de00/0x48868a4e43947f08 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.093701:0:21600:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c65de00/0x48868a4e43947f08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.093707:0:21600:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c65de00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129743.093710:0:21600:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c65de00/0x48868a4e43947f08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.093717:0:21600:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c65de00/0x48868a4e43947f08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.093732:0:21600:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c65de00/0x48868a4e43947f08 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.093738:0:21600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c65de00/0x48868a4e43947f08 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129743.095197:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6141239f-0c60-480d-830c-e22ba61457b0+14:1962:x1830949051966720:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 38294us (41724us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129743.095209:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3779 00010000:00010000:3.0:1746129743.097659:0:21603:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008fadac00/0x48868a4e43947f0f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.097672:0:21603:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008fadac00/0x48868a4e43947f0f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.097685:0:21603:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008fadac00/0x48868a4e43947f0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.097690:0:21603:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fadac00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129743.097694:0:21603:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fadac00/0x48868a4e43947f0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.097700:0:21603:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fadac00/0x48868a4e43947f0f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.097715:0:21603:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008fadac00/0x48868a4e43947f0f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.097721:0:21603:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fadac00/0x48868a4e43947f0f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129743.098204:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6141239f-0c60-480d-830c-e22ba61457b0+18:1962:x1830949051966976:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 39538us (42893us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129743.098213:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3780 00010000:00010000:0.0:1746129743.099506:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012e348000/0x48868a4e43947f16 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.099517:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e348000/0x48868a4e43947f16 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.099528:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e348000/0x48868a4e43947f16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.099533:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e348000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129743.099536:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e348000/0x48868a4e43947f16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.099542:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e348000/0x48868a4e43947f16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.099553:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e348000/0x48868a4e43947f16 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.099569:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e348000/0x48868a4e43947f16 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129743.099625:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6141239f-0c60-480d-830c-e22ba61457b0+16:1962:x1830949051966848:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 40317us (43975us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129743.099634:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3781 00010000:00010000:2.0:1746129743.103081:0:25617:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008fadb200/0x48868a4e43947f2b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.103097:0:25617:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008fadb200/0x48868a4e43947f2b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.103104:0:25617:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008fadb200/0x48868a4e43947f2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.103110:0:25617:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fadb200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129743.103114:0:25617:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fadb200/0x48868a4e43947f2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.103120:0:25617:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fadb200/0x48868a4e43947f2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.103135:0:25617:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008fadb200/0x48868a4e43947f2b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.103141:0:25617:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fadb200/0x48868a4e43947f2b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129743.103337:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949051968000:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 38620us (39574us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129743.103346:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3784 00010000:00010000:3.0:1746129743.106978:0:21601:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009c65dc00/0x48868a4e43947f32 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.106993:0:21601:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c65dc00/0x48868a4e43947f32 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.107000:0:21601:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c65dc00/0x48868a4e43947f32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.107006:0:21601:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c65dc00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129743.107008:0:21601:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c65dc00/0x48868a4e43947f32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.107015:0:21601:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c65dc00/0x48868a4e43947f32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.107029:0:21601:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c65dc00/0x48868a4e43947f32 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.107034:0:21601:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c65dc00/0x48868a4e43947f32 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129743.107108:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6141239f-0c60-480d-830c-e22ba61457b0+14:1961:x1830949051968128:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 40089us (40448us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129743.107118:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3785 00010000:00010000:3.0:1746129743.112013:0:21604:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8801310eda00/0x48868a4e43947f39 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.112028:0:21604:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801310eda00/0x48868a4e43947f39 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.112036:0:21604:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801310eda00/0x48868a4e43947f39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.112042:0:21604:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801310eda00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129743.112047:0:21604:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801310eda00/0x48868a4e43947f39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.112058:0:21604:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801310eda00/0x48868a4e43947f39 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.112073:0:21604:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801310eda00/0x48868a4e43947f39 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.112079:0:21604:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801310eda00/0x48868a4e43947f39 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129743.112148:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c089500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949051968256:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 39098us (41770us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129743.112157:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3786 00000100:00100000:0.0:1746129743.119814:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.119929:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051968640 00000100:00100000:2.0:1746129743.119937:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051968640 00000100:00100000:2.0:1746129743.119979:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9739 00000100:00100000:2.0:1746129743.119986:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+9:28356:x1830949051968640:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:2.0:1746129743.120027:0:15044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129743.120047:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbe00/0x48868a4e43947ed7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e923 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.120076:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129743.120080:0:15044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129743.120112:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fada200/0x48868a4e43947f40 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129743.120122:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fada200/0x48868a4e43947f40 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129743.120130:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fada200/0x48868a4e43947f40 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00010000:2.0:1746129743.120270:0:15044:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880094d8f480 reply state ffff880131473000 transno 8589943504 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fada200/0x48868a4e43947f40 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000100:00100000:2.0:1746129743.120276:0:15044:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746129743.120344:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+10:28356:x1830949051968640:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 358us (536us total) trans 8589943504 rc 0/0 00000100:00100000:2.0:1746129743.120349:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9739 00010000:00010000:3.0:1746129743.127640:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fada200/0x48868a4e43947f40 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129743.127653:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fada200/0x48868a4e43947f40 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129743.127658:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fada200/0x48868a4e43947f40 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129743.127663:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fada200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129743.127667:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fada200/0x48868a4e43947f40 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129743.127672:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fada200/0x48868a4e43947f40 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129743.127690:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129743.127692:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129743.127696:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fada200/0x48868a4e43947f40 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129743.127700:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fada200/0x48868a4e43947f40 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00000100:00100000:2.0:1746129743.128248:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.128284:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.128309:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.128323:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.128334:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.128399:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.128427:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051968768 00000100:00100000:2.0:1746129743.128433:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051968768 00000100:00100000:0.0:1746129743.128445:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051969024 00000100:00100000:0.0:1746129743.128450:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051969024 00000100:00100000:2.0:1746129743.128460:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051969280 00000100:00100000:2.0:1746129743.128462:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051969280 00000100:00100000:0.0:1746129743.128469:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051968896 00000100:00100000:0.0:1746129743.128470:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051968896 00000100:00100000:2.0:1746129743.128471:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051969152 00000100:00100000:2.0:1746129743.128473:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051969152 00000100:00100000:0.0:1746129743.128479:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051969408 00000100:00100000:0.0:1746129743.128481:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051969408 00000100:00100000:2.0:1746129743.128487:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10262 00000100:00100000:0.0:1746129743.128500:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10263 00000100:00100000:0.0:1746129743.128506:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+14:1963:x1830949051969024:12345-192.168.204.31@tcp:2:lfs.0 00000100:00100000:3.0:1746129743.128525:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10264 00000100:00100000:3.0:1746129743.128531:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+14:1963:x1830949051969280:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129743.128648:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129743.128651:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:0.0:1746129743.128651:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129743 -> 1746129743 00002000:00010000:0.0:1746129743.128653:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129742 -> 1746129743 00002000:00010000:3.0:1746129743.128654:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129743 -> 1746129743 00002000:00010000:0.0:1746129743.128654:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129743 -> 1746129743 00002000:00010000:3.0:1746129743.128656:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129743 -> 1746129743 00002000:00010000:0.0:1746129743.128656:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:3.0:1746129743.128657:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129743 -> 1746129743 00002000:00010000:3.0:1746129743.128659:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5671 -> 5671 00000100:00100000:3.0:1746129743.128698:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+15:1963:x1830949051969280:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 167us (388us total) trans 17179872976 rc 0/0 00000100:00100000:3.0:1746129743.128704:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10264 00000100:00100000:3.0:1746129743.128718:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10265 00000100:00100000:3.0:1746129743.128728:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+15:1963:x1830949051968896:12345-192.168.204.31@tcp:2:lfs.0 00000100:00100000:0.0:1746129743.128731:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+15:1963:x1830949051969024:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 225us (445us total) trans 21474840142 rc 0/0 00000100:00100000:0.0:1746129743.128738:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10263 00000100:00100000:0.0:1746129743.128748:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10266 00000100:00100000:0.0:1746129743.128753:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+14:1963:x1830949051969152:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:3.0:1746129743.128795:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129743.128798:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129743 -> 1746129743 00002000:00010000:3.0:1746129743.128799:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129742 -> 1746129743 00002000:00010000:3.0:1746129743.128801:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129743 -> 1746129743 00002000:00010000:3.0:1746129743.128802:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:0.0:1746129743.128812:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129743.128815:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129743 -> 1746129743 00002000:00010000:0.0:1746129743.128816:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746129741 -> 1746129743 00002000:00010000:0.0:1746129743.128818:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129743 -> 1746129743 00000100:00100000:3.0:1746129743.128820:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+15:1963:x1830949051968896:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 92us (495us total) trans 21474840143 rc 0/0 00002000:00010000:0.0:1746129743.128820:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746129743.128824:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10265 00000100:00100000:3.0:1746129743.128834:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10267 00000100:00100000:0.0:1746129743.128837:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+15:1963:x1830949051969152:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 83us (501us total) trans 17179872977 rc 0/0 00000100:00100000:3.0:1746129743.128839:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+14:1963:x1830949051969408:12345-192.168.204.31@tcp:2:lfs.0 00000100:00100000:0.0:1746129743.128842:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10266 00002000:00010000:3.0:1746129743.128925:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746129743.128927:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129742 -> 1746129743 00002000:00010000:3.0:1746129743.128928:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129742 -> 1746129743 00002000:00010000:3.0:1746129743.128930:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129742 -> 1746129743 00002000:00010000:3.0:1746129743.128931:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746129743.128950:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+15:1963:x1830949051969408:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 111us (550us total) trans 21474840144 rc 0/0 00000100:00100000:3.0:1746129743.128955:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10267 00000100:00100000:2.0:1746129743.129350:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+14:1963:x1830949051968768:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:2.0:1746129743.129436:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746129743.129439:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129742 -> 1746129743 00002000:00010000:2.0:1746129743.129444:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129742 -> 1746129743 00002000:00010000:2.0:1746129743.129445:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129742 -> 1746129743 00002000:00010000:2.0:1746129743.129447:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 1975 -> 1975 00000100:00100000:2.0:1746129743.129479:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+15:1963:x1830949051968768:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 985us (1235us total) trans 17179872978 rc 0/0 00000100:00100000:2.0:1746129743.129484:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10262 00000100:00100000:0.0:1746129743.130447:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.130489:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051969664 00000100:00100000:2.0:1746129743.130494:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051969664 00000100:00100000:2.0:1746129743.130528:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3794 00000100:00100000:2.0:1746129743.130533:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:28356:x1830949051969664:12345-192.168.204.31@tcp:35:lfs.0 00000004:00010000:2.0:1746129743.130577:0:14317:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x368:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65c800/0x48868a4e43947e8a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e915 expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.130652:0:14317:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbc00/0x48868a4e43947f47 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14317 initiator: MDT0 00010000:00010000:2.0:1746129743.130661:0:14317:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadae00/0x48868a4e43947ec9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e91c expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.130667:0:14317:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbc00/0x48868a4e43947f47 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 00010000:00010000:2.0:1746129743.130689:0:14317:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadae00/0x48868a4e43947ec9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e91c expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.130697:0:14317:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadae00/0x48868a4e43947ec9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e91c expref: 9 pid: 14315 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746129743.130707:0:14317:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d637800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14317:1830949053206400:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129743.131791:0:14317:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa48c540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129743.132005:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.132050:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051969792 00000100:00100000:3.0:1746129743.132056:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051969792 00010000:00010000:3.0:1746129743.132076:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadae00/0x48868a4e43947ec9 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e91c expref: 10 pid: 14315 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746129743.132106:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4959 00000100:00100000:3.0:1746129743.132112:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130567450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949051969792:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129743.132121:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129743.132125:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadae00/0x48868a4e43947ec9 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e91c expref: 10 pid: 14315 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746129743.132165:0:14317:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d637800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14317:1830949053206400:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129743.132178:0:14317:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbc00/0x48868a4e43947f47 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 00010000:00010000:3.0:1746129743.132247:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadae00/0x48868a4e43947ec9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e91c expref: 10 pid: 14315 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746129743.132264:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadae00/0x48868a4e43947ec9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e91c expref: 10 pid: 14315 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746129743.132275:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129743.132279:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbc00/0x48868a4e43947f47 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 00010000:00010000:3.0:1746129743.132284:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbc00/0x48868a4e43947f47 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14317 initiator: MDT0 00010000:00010000:3.0:1746129743.132289:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbc00/0x48868a4e43947f47 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14317 initiator: MDT0 00010000:00010000:3.0:1746129743.134379:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129743.134433:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130567450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949051969792:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2316us (2425us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129743.134443:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4959 00010000:00010000:2.0:1746129743.134549:0:14317:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbc00/0x48868a4e43947f47 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 00010000:00010000:2.0:1746129743.134566:0:14317:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbc00/0x48868a4e43947f47 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 00000040:00080000:2.0:1746129743.135093:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2687, 88 off223296 00000004:00080000:2.0:1746129743.135100:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689193251644ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129743.135152:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2636, 88 off218888 00000004:00080000:2.0:1746129743.135156:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689193308051ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129743.135269:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2637, 88 off218976 00000004:00080000:2.0:1746129743.135273:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689193424844ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129743.135280:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2688, 88 off223384 00000004:00080000:2.0:1746129743.135283:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689193434847ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129743.135290:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2689, 88 off223472 00000004:00080000:2.0:1746129743.135293:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689193444986ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129743.135299:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2638, 88 off219064 00000004:00080000:2.0:1746129743.135301:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689193453364ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129743.135307:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2639, 88 off219152 00000004:00080000:2.0:1746129743.135310:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689193461677ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129743.135315:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2640, 88 off219240 00000004:00080000:2.0:1746129743.135318:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689193469770ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129743.135323:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2690, 88 off223560 00000004:00080000:2.0:1746129743.135326:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689193477716ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129743.135331:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2641, 88 off219328 00000004:00080000:2.0:1746129743.135333:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689193485572ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129743.135339:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2691, 88 off223648 00000004:00080000:2.0:1746129743.135341:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689193493322ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129743.135347:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2642, 88 off219416 00000004:00080000:2.0:1746129743.135351:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689193502634ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129743.135356:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2692, 88 off223736 00000004:00080000:2.0:1746129743.135358:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689193510429ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129743.135364:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2693, 88 off223824 00000004:00080000:2.0:1746129743.135366:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689193518099ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129743.135371:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2694, 88 off223912 00000004:00080000:2.0:1746129743.135374:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689193525737ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129743.135379:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2695, 88 off224000 00000004:00080000:2.0:1746129743.135381:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689193533492ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129743.135387:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2643, 88 off219504 00000004:00080000:2.0:1746129743.135389:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689193541562ns, next at 641623252291ns, rc = 0 00000001:00080000:1.0:1746129743.176401:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943505 is committed 00000004:00080000:1.0:1746129743.176412:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1830 committed 00000004:00010000:2.0:1746129743.176421:0:14317:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880094d8ce00 reply state ffff880094d61000 transno 8589943505 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbc00/0x48868a4e43947f47 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 00000004:00080000:1.0:1746129743.176430:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1878 committed 00000100:00100000:2.0:1746129743.176432:0:14317:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746129743.176440:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129743.176442:0:14317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000004:00080000:1.0:1746129743.176443:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1877 committed 00000004:00080000:1.0:1746129743.176444:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1876 committed 00000004:00080000:1.0:1746129743.176446:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1875 committed 00000004:00080000:1.0:1746129743.176447:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1829 committed 00000004:00080000:1.0:1746129743.176449:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1874 committed 00010000:00010000:2.0:1746129743.176450:0:14317:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c65c800/0x48868a4e43947e8a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e915 expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746129743.176450:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1828 committed 00000004:00080000:1.0:1746129743.176452:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1873 committed 00000004:00080000:1.0:1746129743.176453:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1827 committed 00000004:00080000:1.0:1746129743.176455:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1826 committed 00000004:00080000:1.0:1746129743.176456:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1825 committed 00000004:00080000:1.0:1746129743.176457:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1872 committed 00000004:00080000:1.0:1746129743.176459:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1871 committed 00000004:00080000:1.0:1746129743.176460:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1824 committed 00000004:00080000:1.0:1746129743.176461:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1823 committed 00000004:00080000:1.0:1746129743.176463:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1870 committed 00010000:00080000:2.0:1746129743.176535:0:14317:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746129743.176546:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+7:28356:x1830949051969664:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 46012us (46101us total) trans 8589943505 rc 0/0 00000100:00100000:2.0:1746129743.176567:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3794 00010000:00010000:2.0:1746129743.176594:0:3283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbc00/0x48868a4e43947f47 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 00010000:00010000:2.0:1746129743.176600:0:3283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbc00/0x48868a4e43947f47 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14317 initiator: MDT0 00010000:00010000:2.0:1746129743.176605:0:3283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbc00/0x48868a4e43947f47 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 00010000:00010000:2.0:1746129743.176609:0:3283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fadbc00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129743.176612:0:3283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbc00/0x48868a4e43947f47 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 00010000:00010000:2.0:1746129743.176617:0:3283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbc00/0x48868a4e43947f47 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14317 initiator: MDT0 00010000:00010000:2.0:1746129743.176627:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129743.176629:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129743.176632:0:3283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbc00/0x48868a4e43947f47 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 00010000:00010000:2.0:1746129743.176636:0:3283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbc00/0x48868a4e43947f47 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 00000100:00100000:2.0:1746129743.176652:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053206912:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129743.176653:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053206656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129743.176685:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129743.176705:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129743.176724:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053206656 00000100:00100000:2.0:1746129743.176729:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053206656 00000100:00100000:0.0:1746129743.176736:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053207168:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.176750:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053206912 00000100:00100000:2.0:1746129743.176752:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053206912 00000100:00100000:0.0:1746129743.176752:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129743.176767:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746129743.176772:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053206528:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129743.176786:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129743.176968:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053206784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129743.177228:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053207040:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129743.177244:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129743.177273:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053207168 00000100:00100000:1.0:1746129743.177276:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053207552:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129743.177277:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053207168 00000100:00100000:2.0:1746129743.177293:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053206528 00000100:00100000:2.0:1746129743.177294:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053206528 00000100:00100000:2.0:1746129743.177304:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10268 00000100:00100000:2.0:1746129743.177309:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3297:x1830949053206656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129743.177349:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053207680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129743.177364:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129743.177374:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053208192:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129743.177384:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129743.177400:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053207040 00000100:00100000:0.0:1746129743.177404:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053207040 00000100:00100000:3.0:1746129743.177444:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053207680 00000100:00100000:3.0:1746129743.177447:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053207680 00002000:00010000:2.0:1746129743.177449:0:3623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129743.177452:0:3623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129743 -> 1746129743 00002000:00010000:2.0:1746129743.177454:0:3623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746129743 -> 1746129743 00002000:00010000:2.0:1746129743.177456:0:3623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129743 -> 1746129743 00002000:00010000:2.0:1746129743.177457:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746129743.177471:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10269 00000100:00100000:1.0:1746129743.177477:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+55:3299:x1830949053206912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.177480:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+55:3297:x1830949053206656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 171us (794us total) trans 17179872979 rc 0/0 00000100:00100000:2.0:1746129743.177485:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10268 00000100:00100000:2.0:1746129743.177493:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053208192 00000100:00100000:2.0:1746129743.177496:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053208192 00000100:00100000:2.0:1746129743.177506:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10270 00000100:00100000:2.0:1746129743.177510:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+54:3297:x1830949053207168:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129743.177566:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746129743.177569:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746129743.177570:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746129743.177572:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746129743.177573:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129743.177596:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+56:3299:x1830949053206912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 119us (890us total) trans 17179872980 rc 0/0 00000100:00100000:2.0:1746129743.177597:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:3297:x1830949053207168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (843us total) trans 17179872981 rc 0/0 00000100:00100000:1.0:1746129743.177600:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10269 00000100:00100000:2.0:1746129743.177603:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10270 00000100:00100000:1.0:1746129743.177611:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10271 00000100:00100000:2.0:1746129743.177613:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10272 00000100:00100000:1.0:1746129743.177615:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+54:3297:x1830949053206528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.177618:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+46:3297:x1830949053208192:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129743.177678:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746129743.177680:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129743 -> 1746129743 00002000:00010000:1.0:1746129743.177682:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129743 -> 1746129743 00002000:00010000:1.0:1746129743.177683:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129743 -> 1746129743 00002000:00010000:1.0:1746129743.177685:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 1975 -> 1975 00000100:00100000:2.0:1746129743.177695:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+47:3297:x1830949053208192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (309us total) trans 21474840145 rc 0/0 00000100:00100000:2.0:1746129743.177700:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10272 00000100:00100000:1.0:1746129743.177702:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+55:3297:x1830949053206528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (915us total) trans 17179872982 rc 0/0 00000100:00100000:1.0:1746129743.177706:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10271 00000004:00080000:2.0:1746129743.177727:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8fd2680/2, rc 0, transno 17179872980 00000100:00100000:2.0:1746129743.177734:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053206912:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.177739:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053207424:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.177752:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129743.177763:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053207936:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129743.177776:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129743.177783:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053208448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129743.177791:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053207424 00000100:00100000:2.0:1746129743.177793:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129743.177794:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053207424 00000100:00100000:0.0:1746129743.177804:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053207936 00000100:00100000:2.0:1746129743.177806:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053208448 00000100:00100000:0.0:1746129743.177806:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053207936 00000100:00100000:2.0:1746129743.177808:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053208448 00000100:00100000:0.0:1746129743.177813:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10273 00000100:00100000:0.0:1746129743.177817:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+55:3297:x1830949053207040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.177819:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10274 00000100:00100000:2.0:1746129743.177823:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+55:3299:x1830949053207424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129743.177912:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+56:3297:x1830949053207040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (666us total) trans 17179872983 rc 0/0 00000100:00100000:0.0:1746129743.177918:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10273 00000100:00100000:0.0:1746129743.177928:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10275 00000100:00100000:0.0:1746129743.177932:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+48:3299:x1830949053207936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129743.178006:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3299:x1830949053207936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (228us total) trans 21474840146 rc 0/0 00000100:00100000:0.0:1746129743.178010:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10275 00000100:00100000:0.0:1746129743.178018:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10276 00000100:00100000:0.0:1746129743.178021:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+48:3299:x1830949053208448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129743.178077:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3299:x1830949053208448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (283us total) trans 21474840147 rc 0/0 00000100:00100000:0.0:1746129743.178082:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10276 00000100:00100000:0.0:1746129743.178101:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129743.178114:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053208064:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129743.178127:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129743.178139:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053207552 00000100:00100000:0.0:1746129743.178141:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053207552 00000100:00100000:0.0:1746129743.178149:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053208064 00000100:00100000:0.0:1746129743.178150:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053208064 00000100:00100000:0.0:1746129743.178156:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10277 00000100:00100000:0.0:1746129743.178160:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3296:x1830949053207552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129743.178215:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129743.178217:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129743 -> 1746129743 00002000:00010000:0.0:1746129743.178219:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129743 -> 1746129743 00002000:00010000:0.0:1746129743.178220:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129743 -> 1746129743 00002000:00010000:0.0:1746129743.178222:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129743.178237:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+51:3296:x1830949053207552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (136us total) trans 21474840148 rc 0/0 00000100:00100000:0.0:1746129743.178242:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10277 00000100:00100000:0.0:1746129743.178250:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10278 00000100:00100000:0.0:1746129743.178254:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3296:x1830949053208064:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129743.178303:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129743.178305:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129743.178307:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129743.178308:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129743.178310:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129743.178324:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+51:3296:x1830949053208064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (196us total) trans 21474840149 rc 0/0 00000100:00100000:0.0:1746129743.178328:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10278 00000004:00080000:0.0:1746129743.178350:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284d180/2, rc 0, transno 21474840148 00000100:00100000:0.0:1746129743.178354:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053207552:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129743.178362:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284d880/2, rc 0, transno 21474840149 00000100:00100000:0.0:1746129743.178364:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053208064:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129743.178438:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10279 00000100:00100000:3.0:1746129743.178443:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+50:3297:x1830949053207680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129743.178504:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129743.178506:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129743 -> 1746129743 00002000:00010000:3.0:1746129743.178508:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129743 -> 1746129743 00002000:00010000:3.0:1746129743.178510:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129743 -> 1746129743 00002000:00010000:3.0:1746129743.178511:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746129743.178527:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+51:3297:x1830949053207680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (1162us total) trans 21474840150 rc 0/0 00000100:00100000:3.0:1746129743.178531:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10279 00000100:00100000:3.0:1746129743.178546:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129743.178567:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053207296:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129743.178579:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129743.178587:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053207808:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129743.178596:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129743.178603:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053208320:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129743.178614:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129743.178626:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053206784 00000100:00100000:3.0:1746129743.178628:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053206784 00000100:00100000:3.0:1746129743.178637:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053207296 00000100:00100000:3.0:1746129743.178638:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053207296 00000100:00100000:3.0:1746129743.178643:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053207808 00000100:00100000:3.0:1746129743.178644:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053207808 00000100:00100000:3.0:1746129743.178648:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053208320 00000100:00100000:3.0:1746129743.178649:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053208320 00000100:00100000:3.0:1746129743.178655:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10280 00000100:00100000:3.0:1746129743.178658:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+57:3298:x1830949053206784:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129743.178714:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:3.0:1746129743.178716:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129743 -> 1746129743 00002000:00010000:3.0:1746129743.178718:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129743 -> 1746129743 00002000:00010000:3.0:1746129743.178719:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129743 -> 1746129743 00002000:00010000:3.0:1746129743.178721:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5671 -> 5671 00000100:00100000:3.0:1746129743.178737:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3298:x1830949053206784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (190us total) trans 17179872984 rc 0/0 00000100:00100000:3.0:1746129743.178743:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10280 00000100:00100000:3.0:1746129743.178750:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10281 00000100:00100000:3.0:1746129743.178754:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+57:3298:x1830949053207296:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.179131:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10282 00000100:00100000:2.0:1746129743.179138:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3298:x1830949053207808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129743.179188:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10283 00000100:00100000:1.0:1746129743.179193:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:3298:x1830949053208320:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129743.179207:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746129743.179210:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129743 -> 1746129743 00002000:00010000:2.0:1746129743.179212:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129743 -> 1746129743 00002000:00010000:2.0:1746129743.179214:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129743 -> 1746129743 00002000:00010000:2.0:1746129743.179215:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746129743.179236:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3298:x1830949053207808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (638us total) trans 21474840151 rc 0/0 00000100:00100000:2.0:1746129743.179241:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10282 00000100:00100000:1.0:1746129743.179260:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3298:x1830949053208320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (645us total) trans 21474840152 rc 0/0 00000100:00100000:1.0:1746129743.179264:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10283 00000004:00080000:2.0:1746129743.179270:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284fb80/2, rc 0, transno 21474840146 00000100:00100000:2.0:1746129743.179274:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053207936:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129743.179280:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04f800/2, rc 0, transno 21474840147 00000100:00100000:2.0:1746129743.179282:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053208448:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129743.179324:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284c380/2, rc 0, transno 21474840150 00000100:00100000:2.0:1746129743.179327:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053207680:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129743.179333:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284e300/2, rc 0, transno 21474840145 00000100:00100000:2.0:1746129743.179335:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053208192:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129743.179341:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094d8f800/2, rc 0, transno 17179872982 00000100:00100000:2.0:1746129743.179343:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053206528:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129743.179349:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8fd0a80/2, rc 0, transno 17179872983 00000100:00100000:2.0:1746129743.179351:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053207040:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129743.179357:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094d8e300/2, rc 0, transno 17179872979 00000100:00100000:2.0:1746129743.179359:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053206656:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129743.179365:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8fd3100/2, rc 0, transno 17179872981 00000100:00100000:2.0:1746129743.179366:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053207168:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.179372:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746129743.179376:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053208576:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.179393:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746129743.179844:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094d8f100/2, rc 0, transno 17179872984 00000100:00100000:3.0:1746129743.179857:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053206784:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129743.179864:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284c700/2, rc 0, transno 21474840151 00000100:00100000:3.0:1746129743.179866:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053207808:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129743.179871:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284ca80/2, rc 0, transno 21474840152 00000100:00100000:3.0:1746129743.179873:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053208320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129743.180112:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053208576 00000100:00100000:0.0:1746129743.180116:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053208576 00000100:00100000:0.0:1746129743.180133:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10284 00000100:00100000:0.0:1746129743.180137:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+60:3297:x1830949053208576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.180202:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3299:x1830949053207424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2324us (2394us total) trans 17179872986 rc 0/0 00000100:00100000:3.0:1746129743.180203:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+60:3298:x1830949053207296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1448us (1622us total) trans 17179872985 rc 0/0 00000100:00100000:3.0:1746129743.180208:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10281 00000100:00100000:2.0:1746129743.180255:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10274 00000004:00080000:2.0:1746129743.180349:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8fd0700/2, rc 0, transno 17179872986 00000100:00100000:2.0:1746129743.180353:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053207424:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129743.180394:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8fd3800/2, rc 0, transno 17179872985 00000100:00100000:3.0:1746129743.180398:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053207296:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129743.180576:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+59:3297:x1830949053208576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 438us (1181us total) trans 17179872987 rc 0/0 00000100:00100000:0.0:1746129743.180582:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10284 00000004:00080000:2.0:1746129743.180664:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135d8ce00/2, rc 0, transno 17179872987 00000100:00100000:2.0:1746129743.180668:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053208576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129743.182931:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.182980:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051969920 00000100:00100000:2.0:1746129743.182986:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051969920 00000100:00100000:2.0:1746129743.183019:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9740 00000100:00100000:2.0:1746129743.183025:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+6:28356:x1830949051969920:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129743.183042:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129743.183056:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4600/0x48868a4e43947f4e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e954 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.183105:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4600/0x48868a4e43947f4e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e954 expref: 7 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.183116:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4600/0x48868a4e43947f4e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e954 expref: 7 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.183132:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129743.183134:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129743.183137:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a49b4600, rc 0) 00000100:00100000:2.0:1746129743.183224:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+7:28356:x1830949051969920:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 198us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129743.183230:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9740 00000100:00100000:2.0:1746129743.187620:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.187644:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051970176 00000100:00100000:2.0:1746129743.187651:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051970176 00000100:00100000:2.0:1746129743.187687:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3795 00000100:00100000:2.0:1746129743.187694:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+7:28356:x1830949051970176:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:2.0:1746129743.187916:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+8:28356:x1830949051970176:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 222us (304us total) trans 8589943506 rc 0/0 00000100:00100000:2.0:1746129743.187922:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3795 00000100:00100000:0.0:1746129743.220923:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.220976:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.220989:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051970432 00000100:00100000:2.0:1746129743.221002:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051970432 00000100:00080000:3.0:1746129743.222201:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746129743.222281:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051970688 00000100:00100000:2.0:1746129743.222286:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051970688 00000100:00080000:3.0:1746129743.223390:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129743.223761:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9741 00000100:00100000:0.0:1746129743.223772:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+281:28367:x1830949051970432:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129743.223794:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129743.223810:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e2600/0x48868a4e43947f55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e95b expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.223914:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e2a00/0x48868a4e43947f5c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129743.223924:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e2a00/0x48868a4e43947f5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129743.223933:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e2a00/0x48868a4e43947f5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129743.223945:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947f63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129743.223950:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947f63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129743.223955:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947f63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129743.224041:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e43947f6a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129743.224047:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e43947f6a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129743.224052:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e43947f6a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:0.0:1746129743.224060:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129743.224132:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e2a00/0x48868a4e43947f5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129743.224138:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e2a00/0x48868a4e43947f5c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129743.224143:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e2a00/0x48868a4e43947f5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129743.224148:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801356e2a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129743.224151:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e2a00/0x48868a4e43947f5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129743.224156:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e2a00/0x48868a4e43947f5c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129743.224165:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:0.0:1746129743.224168:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129743.224171:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e2a00/0x48868a4e43947f5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129743.224175:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e2a00/0x48868a4e43947f5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129743.224207:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947f63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129743.224212:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947f63 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129743.224217:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947f63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129743.224224:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801356e3e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129743.224226:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947f63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129743.224231:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947f63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129743.224236:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f99be00) 00010000:00010000:0.0:1746129743.224238:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129743.224239:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947f63 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129743.224243:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947f63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129743.224273:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e2600/0x48868a4e43947f55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e95b expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.224284:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e43947f6a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e95b expref: 283 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.224290:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129743.224291:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129743.224293:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919ec000, rc 0) 00000100:00100000:2.0:1746129743.225419:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9742 00000100:00100000:2.0:1746129743.225426:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:28368:x1830949051970688:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129743.225439:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129743.225446:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbce00/0x48868a4e43947f78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e962 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.225498:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947f7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129743.225506:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947f7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129743.225512:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947f7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129743.225521:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbc800/0x48868a4e43947f86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129743.225526:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbc800/0x48868a4e43947f86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129743.225531:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbc800/0x48868a4e43947f86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129743.225603:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbc00/0x48868a4e43947f8d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129743.225610:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbc00/0x48868a4e43947f8d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129743.225615:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbc00/0x48868a4e43947f8d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:2.0:1746129743.225621:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129743.225662:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947f7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129743.225667:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947f7f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129743.225672:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947f7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129743.225676:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ffbd800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129743.225678:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947f7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129743.225682:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947f7f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129743.225689:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129743.225692:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129743.225694:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947f7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129743.225698:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbd800/0x48868a4e43947f7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00000100:00100000:0.0:1746129743.230497:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28367:x1830949051970432:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6719us (9573us total) trans 8589943507 rc 0/0 00000100:00100000:0.0:1746129743.230507:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9741 00010000:00010000:2.0:1746129743.231103:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbc800/0x48868a4e43947f86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129743.231114:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbc800/0x48868a4e43947f86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129743.231120:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbc800/0x48868a4e43947f86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129743.231125:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ffbc800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129743.231128:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbc800/0x48868a4e43947f86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129743.231134:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbc800/0x48868a4e43947f86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129743.231146:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012bfca000) 00010000:00010000:2.0:1746129743.231149:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129743.231151:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbc800/0x48868a4e43947f86 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129743.231156:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbc800/0x48868a4e43947f86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129743.231204:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbce00/0x48868a4e43947f78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e962 expref: 10 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.231218:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbc00/0x48868a4e43947f8d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e962 expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.231224:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129743.231226:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129743.231228:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fadbc00, rc 0) 00000100:00100000:2.0:1746129743.231269:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28368:x1830949051970688:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5844us (10293us total) trans 8589943508 rc 0/0 00000100:00100000:2.0:1746129743.231275:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9742 00000100:00100000:0.0:1746129743.236033:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.236376:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051970944 00000100:00100000:2.0:1746129743.236384:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051970944 00000100:00100000:2.0:1746129743.236428:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3796 00000100:00100000:2.0:1746129743.236435:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28368:x1830949051970944:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129743.237685:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28368:x1830949051970944:12345-192.168.204.31@tcp:35:cat.0 Request processed in 1244us (1653us total) trans 8589943509 rc 0/0 00000100:00100000:2.0:1746129743.237693:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3796 00000100:00100000:3.0:1746129743.237752:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.237782:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051971200 00000100:00100000:2.0:1746129743.237785:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051971200 00000100:00100000:2.0:1746129743.237810:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9743 00000100:00100000:2.0:1746129743.237815:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28369:x1830949051971200:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129743.237825:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129743.237837:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadae00/0x48868a4e43947f9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e969 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.237899:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadba00/0x48868a4e43947fa2 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129743.237910:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadba00/0x48868a4e43947fa2 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129743.237917:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadba00/0x48868a4e43947fa2 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:2.0:1746129743.237925:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129743.237968:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadae00/0x48868a4e43947f9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e969 expref: 286 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.237979:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadba00/0x48868a4e43947fa2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e969 expref: 285 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.237985:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129743.237988:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746129743.237990:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fadba00, rc 0) 00000100:00100000:2.0:1746129743.238009:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28369:x1830949051971200:12345-192.168.204.31@tcp:101:cat.0 Request processed in 193us (256us total) trans 8589943510 rc 0/0 00000100:00100000:2.0:1746129743.238014:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9743 00000100:00100000:1.0:1746129743.247665:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129743.247717:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129743.247746:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129743.247769:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051971328 00000100:00100000:1.0:1746129743.247775:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051971328 00000100:00100000:0.0:1746129743.247926:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051971712 00000100:00100000:2.0:1746129743.248067:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051971456 00000100:00100000:2.0:1746129743.248071:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051971456 00000100:00100000:0.0:1746129743.248092:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051971712 00000100:00100000:1.0:1746129743.248154:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10285 00000100:00100000:1.0:1746129743.248160:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:28369:x1830949051971328:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129743.248176:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129743.248191:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013585bc00/0x48868a4e43947fb0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e970 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129743.248212:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129743.248214:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129743.248220:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013585bc00/0x48868a4e43947fb0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e970 expref: 30 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129743.248233:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013585bc00/0x48868a4e43947fb0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e970 expref: 30 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129743.248241:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013585bc00, rc 0) 00000100:00100000:2.0:1746129743.248401:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10286 00000100:00100000:2.0:1746129743.248406:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28368:x1830949051971456:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129743.248412:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129743.248417:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fada000/0x48868a4e43947fb7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e977 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.248428:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129743.248430:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129743.248433:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fada000/0x48868a4e43947fb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e977 expref: 18 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.248441:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fada000/0x48868a4e43947fb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e977 expref: 18 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.248448:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fada000, rc 0) 00000100:00100000:0.0:1746129743.248486:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9744 00000100:00100000:0.0:1746129743.248492:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28364:x1830949051971712:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129743.248502:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129743.248512:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e2600/0x48868a4e43947fbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e97e expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.248653:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947fc5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129743.248664:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e43947f6a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e95b expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.248670:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbc00/0x48868a4e43947f8d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e962 expref: 11 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.248675:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947fc5 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129743.248696:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbc00/0x48868a4e43947f8d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e962 expref: 11 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.248707:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbc00/0x48868a4e43947f8d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e962 expref: 11 pid: 15044 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746129743.248717:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053208704:192.168.204.31@tcp:104: 00000100:00080000:3.0:1746129743.248794:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129743.249110:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:28369:x1830949051971328:12345-192.168.204.31@tcp:101:cat.0 Request processed in 949us (1452us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129743.249116:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10285 00000100:00100000:2.0:1746129743.249171:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28368:x1830949051971456:12345-192.168.204.31@tcp:101:cat.0 Request processed in 764us (1424us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129743.249177:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10286 00010000:00010000:0.0:1746129743.249668:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e43947f6a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e95b expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.249677:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e43947f6a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e95b expref: 284 pid: 14315 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746129743.249686:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053208832:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129743.249708:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aba900 going to sleep for 11 seconds 00000100:00100000:2.0:1746129743.253287:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053208832:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129743.253808:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.254118:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051971840 00000100:00100000:3.0:1746129743.254124:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051971840 00010000:00010000:3.0:1746129743.254155:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e43947f6a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e95b expref: 285 pid: 14315 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746129743.254178:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4960 00000100:00100000:3.0:1746129743.254185:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:1963:x1830949051971840:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129743.254197:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129743.254201:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e43947f6a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e95b expref: 285 pid: 14315 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746129743.254210:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e43947f6a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e95b expref: 285 pid: 14315 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746129743.254227:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e43947f6a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e95b expref: 285 pid: 14315 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746129743.254242:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129743.254246:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947fc5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.254253:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947fc5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.254257:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129743.254300:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:1963:x1830949051971840:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 115us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129743.254306:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4960 00000100:00100000:1.0:1746129743.254469:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.254527:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051971968 00000100:00100000:2.0:1746129743.254531:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051971968 00010000:00010000:2.0:1746129743.254544:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbc00/0x48868a4e43947f8d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e962 expref: 12 pid: 15044 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746129743.254570:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4961 00000100:00100000:2.0:1746129743.254576:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949051971968:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129743.254583:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129743.254586:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbc00/0x48868a4e43947f8d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e962 expref: 12 pid: 15044 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746129743.254594:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbc00/0x48868a4e43947f8d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e962 expref: 12 pid: 15044 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746129743.254604:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129743.254607:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947fc5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129743.254613:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947fc5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129743.254619:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947fc5 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129743.254633:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129743.254652:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949051971968:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 76us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129743.254657:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4961 00010000:00010000:3.0:1746129743.255120:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadbc00/0x48868a4e43947f8d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e962 expref: 11 pid: 15044 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746129743.255131:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053208704:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129743.255149:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947fc5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.255292:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947fc5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.255298:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947fc5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129743.255311:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129743.255412:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e2600/0x48868a4e43947fbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e97e expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.255423:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947fc5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e97e expref: 11 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.255430:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129743.255432:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129743.255434:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356e3e00, rc 0) 00000100:00100000:3.0:1746129743.255468:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28364:x1830949051971712:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6976us (7750us total) trans 8589943511 rc 0/0 00000100:00100000:3.0:1746129743.255473:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9744 00000100:00100000:0.0:1746129743.258018:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.258128:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.258487:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051972224 00000100:00100000:3.0:1746129743.258496:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051972224 00002000:00100000:3.0:1746129743.258535:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800a8fd1500 x1830949051972224/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129743.258544:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd1500 with x1830949051972224 ext(0->1048575) 00002000:00010000:3.0:1746129743.258548:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8fd1500 00000100:00100000:3.0:1746129743.258583:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051972480 00000100:00100000:3.0:1746129743.258586:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051972480 00002000:00100000:3.0:1746129743.258597:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800a8fd2a00 x1830949051972480/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129743.258603:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd2a00 with x1830949051972480 ext(0->1048575) 00002000:00010000:3.0:1746129743.258606:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8fd2a00 00000100:00100000:3.0:1746129743.259139:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3787 00000100:00100000:3.0:1746129743.259148:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949051972224:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129743.260702:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3788 00000100:00100000:2.0:1746129743.260713:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949051972480:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129743.270372:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.270419:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.271202:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051972736 00000100:00100000:2.0:1746129743.271211:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051972736 00000100:00100000:2.0:1746129743.271246:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051972864 00000100:00100000:2.0:1746129743.271248:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051972864 00000100:00100000:2.0:1746129743.271274:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9745 00000100:00100000:2.0:1746129743.271281:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28364:x1830949051972736:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129743.271304:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129743.271318:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb400/0x48868a4e43947fd3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e985 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.271366:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb400/0x48868a4e43947fd3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e985 expref: 12 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.271377:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb400/0x48868a4e43947fd3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e985 expref: 12 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.271397:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129743.271399:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129743.271402:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fadb400, rc 0) 00000100:00100000:2.0:1746129743.271443:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28364:x1830949051972736:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 162us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129743.271449:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9745 00000100:00100000:2.0:1746129743.271464:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9746 00000100:00100000:2.0:1746129743.271469:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28367:x1830949051972864:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129743.271476:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129743.271478:0:15044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746129743.271490:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadba00/0x48868a4e43947fa2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e969 expref: 284 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.271505:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129743.271507:0:15044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129743.271511:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb200/0x48868a4e43947fda lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e98c expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.271535:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb000/0x48868a4e43947fe1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129743.271544:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4600/0x48868a4e43947f4e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e954 expref: 7 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.271550:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb400/0x48868a4e43947fd3 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e985 expref: 11 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.271571:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb000/0x48868a4e43947fe1 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129743.271593:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb400/0x48868a4e43947fd3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e985 expref: 11 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.271601:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb400/0x48868a4e43947fd3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e985 expref: 11 pid: 15044 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746129743.271611:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053208960:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129743.271671:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4600/0x48868a4e43947f4e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e954 expref: 7 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.271678:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4600/0x48868a4e43947f4e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e954 expref: 7 pid: 15044 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746129743.271685:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053209088:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129743.271702:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8e480 going to sleep for 11 seconds 00000100:00100000:3.0:1746129743.278234:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949051972224:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19077us (20213us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129743.278245:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3787 00002000:00100000:3.0:1746129743.278255:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800a8fd1500 x1830949051972224/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/440 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129743.278264:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd1500 with x1830949051972224 ext(0->1048575) 00002000:00010000:3.0:1746129743.278269:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8fd1500 00000100:00100000:2.0:1746129743.283438:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949051972480:12345-192.168.204.31@tcp:3:cat.0 Request processed in 22720us (25301us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129743.283450:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3788 00002000:00100000:2.0:1746129743.283459:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800a8fd2a00 x1830949051972480/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/440 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.283467:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd2a00 with x1830949051972480 ext(0->1048575) 00002000:00010000:2.0:1746129743.283472:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8fd2a00 00000100:00100000:2.0:1746129743.284901:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.284962:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.285086:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051973248 00000100:00100000:0.0:1746129743.285093:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051973248 00010000:00010000:0.0:1746129743.285117:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4600/0x48868a4e43947f4e lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e954 expref: 8 pid: 15044 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746129743.285148:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4962 00000100:00100000:0.0:1746129743.285155:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949051973248:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129743.285166:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129743.285171:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4600/0x48868a4e43947f4e lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e954 expref: 8 pid: 15044 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746129743.285180:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4600/0x48868a4e43947f4e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e954 expref: 8 pid: 15044 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746129743.285196:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129743.285200:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb000/0x48868a4e43947fe1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129743.285206:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb000/0x48868a4e43947fe1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129743.285211:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129743.285240:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949051973248:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 86us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129743.285246:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4962 00000100:00100000:0.0:1746129743.285263:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051973120 00000100:00100000:0.0:1746129743.285265:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051973120 00000100:00100000:0.0:1746129743.285280:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9747 00000100:00100000:0.0:1746129743.285284:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28364:x1830949051973120:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129743.285297:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129743.285298:0:16808:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746129743.285304:0:16808:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb400/0x48868a4e43947fd3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e985 expref: 12 pid: 15044 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746129743.285313:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129743.285315:0:16808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb000/0x48868a4e43947fe1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129743.285322:0:16808:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb000/0x48868a4e43947fe1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129743.285327:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb000/0x48868a4e43947fe1 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129743.285339:0:16808:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129743.285347:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3e00/0x48868a4e43947fe8 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e993 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.285380:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3c00/0x48868a4e43947fef lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129743.285389:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb000/0x48868a4e43947fe1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129743.285393:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3c00/0x48868a4e43947fef lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129743.285402:0:16808:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb000/0x48868a4e43947fe1 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129743.285408:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3c00/0x48868a4e43947fef lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.285493:0:15044:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.31@tcp) returned -22 from blocking AST (req@ffff880135d8ed80 x1830949053208960) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb400/0x48868a4e43947fd3 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e985 expref: 13 pid: 15044 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746129743.285502:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb400/0x48868a4e43947fd3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e985 expref: 13 pid: 15044 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746129743.285515:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053208960:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129743.285525:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4600/0x48868a4e43947f4e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e954 expref: 7 pid: 15044 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746129743.285531:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053209088:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129743.285545:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129743.285548:0:15044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3c00/0x48868a4e43947fef lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.285567:0:15044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3c00/0x48868a4e43947fef lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.285572:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb000/0x48868a4e43947fe1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129743.285577:0:15044:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb000/0x48868a4e43947fe1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129743.285581:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb000/0x48868a4e43947fe1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00000004:02000000:3.0:1746129743.285614:0:15044:0:(lod_object.c:7771:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00000040:00080000:3.0:1746129743.306812:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2696, 88 off224088 00000004:00080000:3.0:1746129743.306821:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689364972381ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129743.306890:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2644, 88 off219592 00000004:00080000:3.0:1746129743.306893:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689365045200ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129743.306938:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2645, 88 off219680 00000004:00080000:3.0:1746129743.306941:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689365092781ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129743.306951:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2697, 88 off224176 00000004:00080000:3.0:1746129743.306953:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689365105386ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129743.306959:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2698, 88 off224264 00000004:00080000:3.0:1746129743.306961:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689365113499ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129743.306967:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2646, 88 off219768 00000004:00080000:3.0:1746129743.306970:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689365121796ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129743.306979:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2647, 88 off219856 00000004:00080000:3.0:1746129743.306981:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689365133666ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129743.307001:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2648, 88 off219944 00000004:00080000:3.0:1746129743.307004:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689365155981ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129743.307019:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2699, 88 off224352 00000004:00080000:3.0:1746129743.307022:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689365174002ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129743.307029:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2649, 88 off220032 00000004:00080000:3.0:1746129743.307031:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689365183450ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129743.307046:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2700, 88 off224440 00000004:00080000:3.0:1746129743.307049:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689365200911ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129743.307055:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2650, 88 off220120 00000004:00080000:3.0:1746129743.307058:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689365209974ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129743.307067:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2701, 88 off224528 00000004:00080000:3.0:1746129743.307069:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689365221434ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129743.307075:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2702, 88 off224616 00000004:00080000:3.0:1746129743.307078:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689365229834ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129743.307084:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2703, 88 off224704 00000004:00080000:3.0:1746129743.307086:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689365238042ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129743.307091:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2704, 88 off224792 00000004:00080000:3.0:1746129743.307094:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689365245850ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129743.307100:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2651, 88 off220208 00000004:00080000:3.0:1746129743.307102:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689365254521ns, next at 641623252291ns, rc = 0 00000100:00100000:3.0:1746129743.307632:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.307654:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051973376 00000100:00100000:3.0:1746129743.307661:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051973376 00000100:00100000:3.0:1746129743.307698:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10287 00000100:00100000:3.0:1746129743.307704:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28368:x1830949051973376:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129743.307717:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129743.307732:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094fd9400/0x48868a4e43947ff6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e99a expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.307757:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129743.307759:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129743.307766:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fd9400/0x48868a4e43947ff6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e99a expref: 16 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.307778:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094fd9400/0x48868a4e43947ff6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e99a expref: 16 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.307786:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fd9400, rc 0) 00000100:00100000:3.0:1746129743.307820:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28368:x1830949051973376:12345-192.168.204.31@tcp:101:cat.0 Request processed in 116us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129743.307825:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10287 00000100:00080000:3.0:1746129743.307871:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746129743.307939:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.307953:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051973504 00000100:00100000:3.0:1746129743.307955:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051973504 00000100:00100000:3.0:1746129743.307972:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10288 00000100:00100000:3.0:1746129743.307977:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:28369:x1830949051973504:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129743.307983:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129743.307989:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094fd9200/0x48868a4e43947ffd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e9a1 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.307998:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129743.307999:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129743.308002:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fd9200/0x48868a4e43947ffd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9a1 expref: 31 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.308014:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094fd9200/0x48868a4e43947ffd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9a1 expref: 31 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.308021:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fd9200, rc 0) 00000100:00100000:3.0:1746129743.308035:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:28369:x1830949051973504:12345-192.168.204.31@tcp:101:cat.0 Request processed in 58us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129743.308039:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10288 00000100:00080000:3.0:1746129743.308051:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129743.312122:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.312188:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051973632 00000100:00100000:0.0:1746129743.312195:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051973632 00000100:00100000:0.0:1746129743.312226:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9748 00000100:00100000:0.0:1746129743.312234:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28368:x1830949051973632:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129743.312248:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129743.312268:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2e00/0x48868a4e43948004 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e9a8 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.312313:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3c00/0x48868a4e43947fef lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129743.312321:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2e00/0x48868a4e43948004 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9a8 expref: 14 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.312334:0:1851:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3c00/0x48868a4e43947fef lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129743.312343:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2e00/0x48868a4e43948004 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9a8 expref: 14 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.312355:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129743.312358:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129743.312360:0:1851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3c00/0x48868a4e43947fef lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129743.312365:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094bb2e00, rc 0) 00000100:00100000:0.0:1746129743.312399:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28368:x1830949051973632:12345-192.168.204.31@tcp:101:cat.0 Request processed in 166us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129743.312404:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9748 00000100:00100000:0.0:1746129743.312472:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.312485:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051973760 00000100:00100000:0.0:1746129743.312488:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051973760 00000100:00100000:0.0:1746129743.312504:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9749 00000100:00100000:0.0:1746129743.312509:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:28369:x1830949051973760:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129743.312516:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129743.312522:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2c00/0x48868a4e4394800b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e9af expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.312541:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2c00/0x48868a4e4394800b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9af expref: 287 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.312548:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2c00/0x48868a4e4394800b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9af expref: 287 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.312565:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129743.312567:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129743.312570:0:1851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3c00/0x48868a4e43947fef lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129743.312574:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094bb2c00, rc 0) 00000100:00100000:0.0:1746129743.312589:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:28369:x1830949051973760:12345-192.168.204.31@tcp:101:cat.0 Request processed in 80us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129743.312594:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9749 00010000:00010000:3.0:1746129743.334813:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb000/0x48868a4e43947fe1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e98c expref: 287 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.334826:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129743.334829:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746129743.334831:0:15044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3c00/0x48868a4e43947fef lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.334839:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb000/0x48868a4e43947fe1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e98c expref: 287 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.334844:0:15044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3c00/0x48868a4e43947fef lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.334897:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb000/0x48868a4e43947fe1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e98c expref: 287 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.334907:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb000/0x48868a4e43947fe1 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e98c expref: 287 pid: 15044 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746129743.334923:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053209216:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129743.334992:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942000 going to sleep for 11 seconds 00000001:00080000:1.0:1746129743.335042:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943507 is committed 00000001:00080000:1.0:1746129743.335053:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943510 is committed 00000001:00080000:1.0:1746129743.335056:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943509 is committed 00000001:00080000:1.0:1746129743.335060:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943506 is committed 00000001:00080000:1.0:1746129743.335064:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943512 is committed 00000004:00080000:1.0:1746129743.335067:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1838 committed 00000004:00080000:1.0:1746129743.335073:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1887 committed 00000004:00080000:1.0:1746129743.335078:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1886 committed 00000004:00080000:1.0:1746129743.335079:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1885 committed 00000004:00080000:1.0:1746129743.335081:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1884 committed 00000004:00080000:1.0:1746129743.335082:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1837 committed 00000004:00080000:1.0:1746129743.335084:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1883 committed 00000004:00080000:1.0:1746129743.335085:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1836 committed 00000004:00080000:1.0:1746129743.335086:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1882 committed 00000004:00080000:1.0:1746129743.335088:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1835 committed 00000004:00080000:1.0:1746129743.335089:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1834 committed 00000004:00080000:1.0:1746129743.335091:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1833 committed 00000004:00080000:1.0:1746129743.335093:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1881 committed 00000004:00080000:1.0:1746129743.335094:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1880 committed 00000004:00080000:1.0:1746129743.335096:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1832 committed 00000004:00080000:1.0:1746129743.335097:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1831 committed 00000004:00080000:1.0:1746129743.335098:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1879 committed 00000001:00080000:1.0:1746129743.335103:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943511 is committed 00000100:00100000:2.0:1746129743.335206:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053209344:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.335239:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129743.335257:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053209856:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.335270:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129743.335284:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746129743.335288:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053209728:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.335300:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129743.335310:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053210240:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.335322:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129743.335339:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053209600:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.335353:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129743.335361:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053210112:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.335374:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129743.335385:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746129743.335388:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053209472:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.335401:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129743.335410:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053209984:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.335421:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129743.335438:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053209344 00000100:00100000:2.0:1746129743.335443:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053209344 00000100:00100000:2.0:1746129743.335467:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053209856 00000100:00100000:2.0:1746129743.335468:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053209856 00000100:00100000:2.0:1746129743.335477:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053209728 00000100:00100000:2.0:1746129743.335478:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053209728 00000100:00100000:2.0:1746129743.335485:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053210240 00000100:00100000:2.0:1746129743.335487:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053210240 00000100:00100000:2.0:1746129743.335493:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053209600 00000100:00100000:2.0:1746129743.335494:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053209600 00000100:00100000:2.0:1746129743.335499:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053210112 00000100:00100000:2.0:1746129743.335500:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053210112 00000100:00100000:2.0:1746129743.335505:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053209472 00000100:00100000:2.0:1746129743.335506:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053209472 00000100:00100000:2.0:1746129743.335511:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053209984 00000100:00100000:2.0:1746129743.335512:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053209984 00000100:00100000:2.0:1746129743.335521:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10289 00000100:00100000:2.0:1746129743.335525:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3297:x1830949053209344:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129743.335676:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746129743.335679:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129743 -> 1746129743 00002000:00010000:2.0:1746129743.335681:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129743 -> 1746129743 00002000:00010000:2.0:1746129743.335683:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129743 -> 1746129743 00002000:00010000:2.0:1746129743.335684:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 1975 -> 1975 00000100:00100000:2.0:1746129743.335709:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3297:x1830949053209344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 183us (469us total) trans 17179872988 rc 0/0 00000100:00100000:2.0:1746129743.335714:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10289 00000100:00100000:2.0:1746129743.335726:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10290 00000100:00100000:2.0:1746129743.335730:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3297:x1830949053209856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.335800:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3297:x1830949053209856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (529us total) trans 17179872989 rc 0/0 00000100:00100000:2.0:1746129743.335805:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10290 00000100:00100000:2.0:1746129743.335814:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10291 00000100:00100000:2.0:1746129743.335818:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3297:x1830949053209728:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129743.335895:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746129743.335898:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746129743.335900:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746129743.335901:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746129743.335902:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746129743.335919:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3297:x1830949053209728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (618us total) trans 17179872990 rc 0/0 00000100:00100000:2.0:1746129743.335924:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10291 00000100:00100000:2.0:1746129743.335933:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10292 00000100:00100000:2.0:1746129743.335937:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3297:x1830949053210240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.336008:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3297:x1830949053210240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (684us total) trans 17179872991 rc 0/0 00000100:00100000:2.0:1746129743.336013:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10292 00000100:00100000:2.0:1746129743.336021:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10293 00000100:00100000:2.0:1746129743.336025:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3299:x1830949053209600:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129743.336086:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:2.0:1746129743.336089:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129743 -> 1746129743 00002000:00010000:2.0:1746129743.336091:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129743 -> 1746129743 00002000:00010000:2.0:1746129743.336092:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129743 -> 1746129743 00002000:00010000:2.0:1746129743.336094:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5671 -> 5671 00000100:00100000:2.0:1746129743.336113:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3299:x1830949053209600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (760us total) trans 17179872992 rc 0/0 00000100:00100000:2.0:1746129743.336119:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10293 00000100:00100000:2.0:1746129743.336127:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10294 00000100:00100000:2.0:1746129743.336131:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3299:x1830949053210112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.336198:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3299:x1830949053210112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (822us total) trans 17179872993 rc 0/0 00000100:00100000:2.0:1746129743.336203:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10294 00000100:00100000:2.0:1746129743.336213:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10295 00000100:00100000:2.0:1746129743.336217:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3299:x1830949053209472:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129743.336277:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129743.336279:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129743 -> 1746129743 00002000:00010000:2.0:1746129743.336281:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746129743 -> 1746129743 00002000:00010000:2.0:1746129743.336282:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129743 -> 1746129743 00002000:00010000:2.0:1746129743.336283:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746129743.336300:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3299:x1830949053209472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (898us total) trans 17179872994 rc 0/0 00000100:00100000:2.0:1746129743.336304:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10295 00000100:00100000:2.0:1746129743.336313:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10296 00000100:00100000:2.0:1746129743.336317:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3299:x1830949053209984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.336384:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3299:x1830949053209984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (960us total) trans 17179872995 rc 0/0 00000100:00100000:2.0:1746129743.336389:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10296 00000004:00080000:2.0:1746129743.336423:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135d8ca80/2, rc 0, transno 17179872994 00000100:00100000:2.0:1746129743.336431:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053209472:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129743.336439:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135d8ed80/2, rc 0, transno 17179872995 00000100:00100000:2.0:1746129743.336441:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053209984:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129743.336448:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135d8dc00/2, rc 0, transno 17179872992 00000100:00100000:2.0:1746129743.336450:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053209600:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129743.336455:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a645dc00/2, rc 0, transno 17179872993 00000100:00100000:2.0:1746129743.336458:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053210112:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129743.336470:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135d8df80/2, rc 0, transno 17179872990 00000100:00100000:2.0:1746129743.336473:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053209728:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129743.336478:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a645d180/2, rc 0, transno 17179872991 00000100:00100000:2.0:1746129743.336481:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053210240:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129743.336486:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135d8f480/2, rc 0, transno 17179872988 00000100:00100000:2.0:1746129743.336488:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053209344:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129743.336492:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135d8fb80/2, rc 0, transno 17179872989 00000100:00100000:2.0:1746129743.336494:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053209856:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.336520:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746129743.336525:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053210368:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.336542:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129743.336573:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053210368 00000100:00100000:2.0:1746129743.336576:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053210368 00000100:00100000:2.0:1746129743.336590:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10297 00000100:00100000:2.0:1746129743.336594:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3296:x1830949053210368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.336669:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:3296:x1830949053210368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (126us total) trans 17179872996 rc 0/0 00000100:00100000:2.0:1746129743.336674:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10297 00000004:00080000:2.0:1746129743.336693:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d637800/2, rc 0, transno 17179872996 00000100:00100000:2.0:1746129743.336696:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053210368:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129743.336895:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053210496:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129743.336915:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129743.336927:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053211008:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129743.336937:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129743.336946:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746129743.336949:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053210624:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129743.336960:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129743.336968:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053211136:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129743.336979:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129743.336993:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053210496 00000100:00100000:3.0:1746129743.336996:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053210496 00000100:00100000:3.0:1746129743.337008:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053211008 00000100:00100000:3.0:1746129743.337010:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053211008 00000100:00100000:3.0:1746129743.337015:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053210624 00000100:00100000:3.0:1746129743.337016:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053210624 00000100:00100000:3.0:1746129743.337021:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053211136 00000100:00100000:3.0:1746129743.337022:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053211136 00000100:00100000:3.0:1746129743.337029:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10298 00000100:00100000:3.0:1746129743.337033:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+56:3298:x1830949053210496:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129743.337118:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129743.337120:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129743 -> 1746129743 00002000:00010000:3.0:1746129743.337122:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129743 -> 1746129743 00002000:00010000:3.0:1746129743.337124:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129743 -> 1746129743 00002000:00010000:3.0:1746129743.337125:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746129743.337146:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+57:3298:x1830949053210496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 112us (229us total) trans 21474840153 rc 0/0 00000100:00100000:3.0:1746129743.337151:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10298 00000100:00100000:3.0:1746129743.337163:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10299 00000100:00100000:3.0:1746129743.337166:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+56:3298:x1830949053211008:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129743.337222:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129743.337224:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746129743.337226:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746129743.337227:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746129743.337229:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746129743.337245:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+57:3298:x1830949053211008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (307us total) trans 21474840154 rc 0/0 00000100:00100000:3.0:1746129743.337249:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10299 00000100:00100000:3.0:1746129743.337258:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10300 00000100:00100000:3.0:1746129743.337262:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+56:3298:x1830949053210624:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129743.337321:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129743.337323:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129743 -> 1746129743 00002000:00010000:3.0:1746129743.337325:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129743 -> 1746129743 00002000:00010000:3.0:1746129743.337326:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129743 -> 1746129743 00002000:00010000:3.0:1746129743.337328:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746129743.337343:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+57:3298:x1830949053210624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (382us total) trans 21474840155 rc 0/0 00000100:00100000:3.0:1746129743.337348:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10300 00000100:00100000:3.0:1746129743.337358:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10301 00000100:00100000:3.0:1746129743.337362:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+56:3298:x1830949053211136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129743.337427:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+57:3298:x1830949053211136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (446us total) trans 21474840156 rc 0/0 00000100:00100000:3.0:1746129743.337432:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10301 00000004:00080000:3.0:1746129743.337462:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a6300/2, rc 0, transno 21474840155 00000100:00100000:3.0:1746129743.337465:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053210624:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129743.337471:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a4380/2, rc 0, transno 21474840156 00000100:00100000:3.0:1746129743.337474:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053211136:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129743.337478:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a6d80/2, rc 0, transno 21474840153 00000100:00100000:3.0:1746129743.337481:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053210496:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129743.337485:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a4700/2, rc 0, transno 21474840154 00000100:00100000:3.0:1746129743.337487:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053211008:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129743.339138:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053209216:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129743.339167:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb200/0x48868a4e43947fda lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e98c expref: 284 pid: 15044 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746129743.339182:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb000/0x48868a4e43947fe1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e98c expref: 283 pid: 15044 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746129743.339188:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb000/0x48868a4e43947fe1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e98c expref: 283 pid: 15044 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746129743.339211:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fadb000, rc 0) 00000100:00100000:3.0:1746129743.339241:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28367:x1830949051972864:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 67772us (68822us total) trans 8589943512 rc 0/0 00000100:00100000:3.0:1746129743.339247:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9746 00000100:00100000:0.0:1746129743.340827:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.340983:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051973888 00000100:00100000:3.0:1746129743.340989:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051973888 00010000:00010000:3.0:1746129743.341012:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb000/0x48868a4e43947fe1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e98c expref: 283 pid: 15044 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746129743.341034:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4963 00000100:00100000:3.0:1746129743.341040:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:1961:x1830949051973888:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129743.341050:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129743.341055:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb000/0x48868a4e43947fe1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e98c expref: 283 pid: 15044 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746129743.341063:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb000/0x48868a4e43947fe1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e98c expref: 283 pid: 15044 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746129743.341077:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fadb000/0x48868a4e43947fe1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e98c expref: 283 pid: 15044 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746129743.341086:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129743.341090:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3c00/0x48868a4e43947fef lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.341098:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3c00/0x48868a4e43947fef lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.341104:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3c00/0x48868a4e43947fef lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.341111:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2e00/0x48868a4e43948004 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9a8 expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.341125:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129743.341149:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:1961:x1830949051973888:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 109us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129743.341154:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4963 00010000:00010000:0.0:1746129743.341296:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3c00/0x48868a4e43947fef lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129743.341302:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3c00/0x48868a4e43947fef lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00000040:00080000:0.0:1746129743.341825:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2705, 88 off224880 00000004:00080000:0.0:1746129743.341830:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689399981530ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129743.341883:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2652, 88 off220296 00000004:00080000:0.0:1746129743.341886:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689400038280ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129743.341908:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2653, 88 off220384 00000004:00080000:0.0:1746129743.341912:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689400064440ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129743.341919:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2706, 88 off224968 00000004:00080000:0.0:1746129743.341921:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689400073310ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129743.341927:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2707, 88 off225056 00000004:00080000:0.0:1746129743.341929:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689400081212ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129743.341935:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2654, 88 off220472 00000004:00080000:0.0:1746129743.341936:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689400088704ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129743.341941:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2655, 88 off220560 00000004:00080000:0.0:1746129743.341943:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689400095506ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129743.341949:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2656, 88 off220648 00000004:00080000:0.0:1746129743.341952:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689400103701ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129743.341957:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2708, 88 off225144 00000004:00080000:0.0:1746129743.341959:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689400111202ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129743.341964:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2657, 88 off220736 00000004:00080000:0.0:1746129743.341966:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689400118614ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129743.341972:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2709, 88 off225232 00000004:00080000:0.0:1746129743.341974:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689400126452ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129743.341980:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2658, 88 off220824 00000004:00080000:0.0:1746129743.341982:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689400134474ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129743.341989:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2710, 88 off225320 00000004:00080000:0.0:1746129743.341991:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689400143004ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129743.341996:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2711, 88 off225408 00000004:00080000:0.0:1746129743.341998:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689400150522ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129743.342004:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2712, 88 off225496 00000004:00080000:0.0:1746129743.342007:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689400158736ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129743.342012:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2713, 88 off225584 00000004:00080000:0.0:1746129743.342014:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689400166541ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129743.342021:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2659, 88 off220912 00000004:00080000:0.0:1746129743.342024:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689400175706ns, next at 641623252291ns, rc = 0 00000100:00100000:2.0:1746129743.343713:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053210752:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129743.343755:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129743.343783:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053211264:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129743.343798:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129743.343812:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746129743.343816:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053210880:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129743.343830:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129743.343887:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053210752 00000100:00100000:3.0:1746129743.343892:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053210752 00000100:00100000:3.0:1746129743.344360:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053211264 00000100:00100000:3.0:1746129743.344364:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053211264 00000100:00100000:0.0:1746129743.344389:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053210880 00000100:00100000:0.0:1746129743.344392:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053210880 00000100:00100000:0.0:1746129743.344508:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10302 00000100:00100000:0.0:1746129743.344515:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+59:3296:x1830949053210752:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129743.344669:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746129743.344672:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129743 -> 1746129743 00002000:00010000:0.0:1746129743.344674:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129743 -> 1746129743 00002000:00010000:0.0:1746129743.344676:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129743 -> 1746129743 00002000:00010000:0.0:1746129743.344678:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746129743.344706:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+60:3296:x1830949053210752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 191us (950us total) trans 21474840157 rc 0/0 00000100:00100000:0.0:1746129743.344712:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10302 00000100:00100000:0.0:1746129743.344727:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10303 00000100:00100000:0.0:1746129743.344731:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+59:3296:x1830949053211264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129743.344805:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+60:3296:x1830949053211264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (1005us total) trans 21474840158 rc 0/0 00000100:00100000:0.0:1746129743.344809:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10303 00000100:00100000:0.0:1746129743.344819:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10304 00000100:00100000:0.0:1746129743.344823:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+59:3296:x1830949053210880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129743.344911:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+60:3296:x1830949053210880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (1080us total) trans 21474840159 rc 0/0 00000100:00100000:0.0:1746129743.344915:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10304 00000100:00100000:2.0:1746129743.344954:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053211392:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129743.344976:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746129743.346250:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a7800/2, rc 0, transno 21474840157 00000100:00100000:2.0:1746129743.346258:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053210752:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129743.346265:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a4e00/2, rc 0, transno 21474840158 00000100:00100000:2.0:1746129743.346267:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053211264:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129743.346274:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a7480/2, rc 0, transno 21474840159 00000100:00100000:2.0:1746129743.346276:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053210880:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129743.346305:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053211392 00000100:00100000:3.0:1746129743.346309:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053211392 00000100:00100000:3.0:1746129743.346327:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10305 00000100:00100000:3.0:1746129743.346331:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3296:x1830949053211392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129743.346420:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+61:3296:x1830949053211392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (1444us total) trans 21474840160 rc 0/0 00000100:00100000:3.0:1746129743.346425:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10305 00000004:00080000:2.0:1746129743.346758:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a5f80/2, rc 0, transno 21474840160 00000100:00100000:2.0:1746129743.346763:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053211392:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129743.365020:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000001:00080000:1.0:1746129743.365583:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943513 is committed 00000004:00080000:1.0:1746129743.365589:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1846 committed 00000004:00080000:1.0:1746129743.365595:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1896 committed 00000004:00080000:1.0:1746129743.365599:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1895 committed 00000004:00080000:1.0:1746129743.365601:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1894 committed 00000004:00080000:1.0:1746129743.365603:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1893 committed 00000004:00080000:1.0:1746129743.365604:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1845 committed 00000004:00080000:1.0:1746129743.365606:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1892 committed 00000004:00080000:1.0:1746129743.365607:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1844 committed 00000004:00080000:1.0:1746129743.365609:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1891 committed 00000004:00080000:1.0:1746129743.365610:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1843 committed 00000004:00080000:1.0:1746129743.365611:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1842 committed 00000004:00080000:1.0:1746129743.365613:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1841 committed 00000004:00080000:1.0:1746129743.365614:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1890 committed 00000004:00080000:1.0:1746129743.365616:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1889 committed 00000004:00080000:1.0:1746129743.365618:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1840 committed 00000004:00080000:1.0:1746129743.365619:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1839 committed 00000004:00080000:1.0:1746129743.365621:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1888 committed 00000100:00100000:1.0:1746129743.365705:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053211776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129743.365743:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129743.365764:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053212288:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129743.365777:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129743.365792:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746129743.365797:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053211904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129743.365809:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129743.365819:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053212416:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129743.365831:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129743.365865:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053211776 00000100:00100000:1.0:1746129743.365871:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053211776 00000100:00100000:1.0:1746129743.365896:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053212288 00000100:00100000:1.0:1746129743.365898:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053212288 00000100:00100000:1.0:1746129743.365907:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053211904 00000100:00100000:1.0:1746129743.365909:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053211904 00000100:00100000:1.0:1746129743.365916:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053212416 00000100:00100000:1.0:1746129743.365917:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053212416 00000100:00100000:1.0:1746129743.365927:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10306 00000100:00100000:1.0:1746129743.365933:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+71:3296:x1830949053211776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129743.366078:0:3623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:1.0:1746129743.366081:0:3623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129743 -> 1746129743 00002000:00010000:1.0:1746129743.366083:0:3623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129743 -> 1746129743 00002000:00010000:1.0:1746129743.366084:0:3623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129743 -> 1746129743 00002000:00010000:1.0:1746129743.366086:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5671 -> 5671 00000100:00100000:1.0:1746129743.366113:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+72:3296:x1830949053211776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 180us (369us total) trans 17179872997 rc 0/0 00000100:00100000:1.0:1746129743.366119:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10306 00000100:00100000:1.0:1746129743.366130:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10307 00000100:00100000:1.0:1746129743.366134:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+71:3296:x1830949053212288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.366306:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053211648:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.366327:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129743.366339:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053212160:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.366351:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129743.366361:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746129743.366364:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053211520:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.366375:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129743.366384:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053212032:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.366394:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129743.366412:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053211648 00000100:00100000:2.0:1746129743.366415:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053211648 00000100:00100000:2.0:1746129743.366425:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053212160 00000100:00100000:2.0:1746129743.366427:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053212160 00000100:00100000:2.0:1746129743.366432:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053211520 00000100:00100000:2.0:1746129743.366433:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053211520 00000100:00100000:2.0:1746129743.366439:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053212032 00000100:00100000:2.0:1746129743.366440:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053212032 00000100:00100000:2.0:1746129743.366446:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10308 00000100:00100000:2.0:1746129743.366450:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3296:x1830949053211904:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129743.366515:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746129743.366517:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746129743.366518:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746129743.366520:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746129743.366521:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746129743.366538:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3296:x1830949053211904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (728us total) trans 17179872999 rc 0/0 00000100:00100000:2.0:1746129743.366542:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10308 00000100:00100000:2.0:1746129743.366564:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10309 00000100:00100000:2.0:1746129743.366568:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3296:x1830949053212416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.366640:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3296:x1830949053212416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (808us total) trans 17179873000 rc 0/0 00000100:00100000:2.0:1746129743.366645:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10309 00000100:00100000:2.0:1746129743.366654:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10310 00000100:00100000:2.0:1746129743.366658:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3299:x1830949053211648:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129743.366721:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129743.366723:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129743 -> 1746129743 00002000:00010000:2.0:1746129743.366725:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746129743 -> 1746129743 00002000:00010000:2.0:1746129743.366727:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129743 -> 1746129743 00002000:00010000:2.0:1746129743.366728:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746129743.366749:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3299:x1830949053211648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (421us total) trans 17179873001 rc 0/0 00000100:00100000:2.0:1746129743.366753:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10310 00000100:00100000:2.0:1746129743.366762:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10311 00000100:00100000:2.0:1746129743.366767:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3299:x1830949053212160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.366833:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3299:x1830949053212160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (480us total) trans 17179873002 rc 0/0 00000100:00100000:2.0:1746129743.366837:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10311 00000100:00100000:2.0:1746129743.366845:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10312 00000100:00100000:2.0:1746129743.366865:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3299:x1830949053211520:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129743.366920:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746129743.366922:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129743 -> 1746129743 00002000:00010000:2.0:1746129743.366923:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129743 -> 1746129743 00002000:00010000:2.0:1746129743.366925:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129743 -> 1746129743 00002000:00010000:2.0:1746129743.366926:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 1975 -> 1975 00000100:00100000:2.0:1746129743.366940:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3299:x1830949053211520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (564us total) trans 17179873003 rc 0/0 00000100:00100000:2.0:1746129743.366944:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10312 00000100:00100000:2.0:1746129743.366950:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10313 00000100:00100000:2.0:1746129743.366954:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3299:x1830949053212032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.367007:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3299:x1830949053212032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (611us total) trans 17179873004 rc 0/0 00000100:00100000:2.0:1746129743.367011:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10313 00000004:00080000:2.0:1746129743.367037:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adad500/2, rc 0, transno 17179873003 00000100:00100000:2.0:1746129743.367044:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053211520:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129743.367050:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adaed80/2, rc 0, transno 17179873004 00000100:00100000:2.0:1746129743.367053:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053212032:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129743.367057:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adad880/2, rc 0, transno 17179873001 00000100:00100000:2.0:1746129743.367060:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053211648:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129743.367064:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adace00/2, rc 0, transno 17179873002 00000100:00100000:2.0:1746129743.367067:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053212160:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.367093:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746129743.367097:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053212544:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.367112:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129743.367125:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053212544 00000100:00100000:2.0:1746129743.367128:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053212544 00000100:00100000:2.0:1746129743.367140:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10314 00000100:00100000:2.0:1746129743.367144:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+77:3299:x1830949053212544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129743.367217:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+78:3299:x1830949053212544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (103us total) trans 17179873005 rc 0/0 00000100:00100000:2.0:1746129743.367222:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10314 00000004:00080000:2.0:1746129743.367239:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c137100/2, rc 0, transno 17179873005 00000100:00100000:2.0:1746129743.367242:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053212544:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129743.367356:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053213056:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129743.367377:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129743.367389:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053213568:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129743.367403:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129743.367412:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746129743.367415:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053212672:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129743.367426:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129743.367434:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053213184:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129743.367444:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129743.367458:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053213056 00000100:00100000:3.0:1746129743.367460:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053213056 00000100:00100000:3.0:1746129743.367472:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053213568 00000100:00100000:3.0:1746129743.367474:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053213568 00000100:00100000:3.0:1746129743.367479:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053212672 00000100:00100000:3.0:1746129743.367480:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053212672 00000100:00100000:3.0:1746129743.367486:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053213184 00000100:00100000:3.0:1746129743.367487:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053213184 00000100:00100000:3.0:1746129743.367494:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10315 00000100:00100000:3.0:1746129743.367497:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+64:3298:x1830949053213056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129743.367609:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:3298:x1830949053213056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 110us (231us total) trans 21474840161 rc 0/0 00000100:00100000:3.0:1746129743.367613:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10315 00000100:00100000:3.0:1746129743.367627:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10316 00000100:00100000:3.0:1746129743.367631:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+64:3298:x1830949053213568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129743.367702:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:3298:x1830949053213568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (298us total) trans 21474840162 rc 0/0 00000100:00100000:3.0:1746129743.367707:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10316 00000100:00100000:3.0:1746129743.367716:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10317 00000100:00100000:3.0:1746129743.367719:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+64:3298:x1830949053212672:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129743.367783:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129743.367785:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129743 -> 1746129743 00002000:00010000:3.0:1746129743.367787:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129743 -> 1746129743 00002000:00010000:3.0:1746129743.367788:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129743 -> 1746129743 00002000:00010000:3.0:1746129743.367790:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746129743.367806:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:3298:x1830949053212672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (380us total) trans 21474840163 rc 0/0 00000100:00100000:3.0:1746129743.367811:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10317 00000100:00100000:3.0:1746129743.367819:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10318 00000100:00100000:3.0:1746129743.367823:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+64:3298:x1830949053213184:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129743.367906:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129743.367908:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746129743.367910:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746129743.367911:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746129743.367913:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746129743.367929:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:3298:x1830949053213184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (484us total) trans 21474840164 rc 0/0 00000100:00100000:3.0:1746129743.367934:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10318 00000004:00080000:3.0:1746129743.367959:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eb4000/2, rc 0, transno 21474840163 00000100:00100000:3.0:1746129743.367963:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053212672:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129743.367968:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04f480/2, rc 0, transno 21474840164 00000100:00100000:3.0:1746129743.367970:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053213184:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129743.367975:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eb4e00/2, rc 0, transno 21474840161 00000100:00100000:3.0:1746129743.367977:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053213056:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129743.367982:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fad3100/2, rc 0, transno 21474840162 00000100:00100000:3.0:1746129743.367985:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053213568:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746129743.368094:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3c00/0x48868a4e43947fef lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e993 expref: 11 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.368104:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129743.368106:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746129743.368109:0:16808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2e00/0x48868a4e43948004 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9a8 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.368117:0:16808:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2e00/0x48868a4e43948004 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9a8 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.368123:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2e00/0x48868a4e43948004 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9a8 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.368132:0:16808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2c00/0x48868a4e4394800b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9af expref: 281 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.368137:0:16808:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2c00/0x48868a4e4394800b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9af expref: 281 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.368142:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2c00/0x48868a4e4394800b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9af expref: 281 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.368162:0:16808:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2c00/0x48868a4e4394800b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9af expref: 281 pid: 1851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129743.368171:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053213696:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129743.368221:0:16808:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2e00/0x48868a4e43948004 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9a8 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129743.368228:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053213824:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129743.368242:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129743.368374:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+77:3296:x1830949053212288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (426us total) trans 17179872998 rc 0/0 00000100:00100000:1.0:1746129743.368382:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10307 00000100:00100000:1.0:1746129743.368415:0:14311:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051974016 00000100:00100000:1.0:1746129743.368419:0:14311:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051974016 00000100:00100000:1.0:1746129743.368440:0:14311:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 163 00000100:00100000:1.0:1746129743.368446:0:14311:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5278c6ae-40e3-4880-9941-e4a223d3f965+15:1962:x1830949051974016:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1746129743.368473:0:14311:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5278c6ae-40e3-4880-9941-e4a223d3f965+15:1962:x1830949051974016:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (3461us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129743.368478:0:14311:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 163 00000100:00100000:1.0:1746129743.368527:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053212800:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129743.369710:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053213824:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129743.370179:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053212928:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129743.370208:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129743.370633:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129743.371086:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053213440:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129743.371090:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053213312:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129743.371104:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129743.371123:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053212928 00000100:00100000:1.0:1746129743.371127:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053212928 00000100:00100000:2.0:1746129743.371136:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053212800 00000100:00100000:2.0:1746129743.371139:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053212800 00000100:00100000:1.0:1746129743.371147:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053213440 00000100:00100000:1.0:1746129743.371149:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053213440 00000100:00100000:2.0:1746129743.371157:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10319 00000100:00100000:1.0:1746129743.371160:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10320 00000100:00100000:2.0:1746129743.371162:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+67:3297:x1830949053212928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129743.371165:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+67:3296:x1830949053212800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129743.371205:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10321 00000100:00100000:2.0:1746129743.371209:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+67:3297:x1830949053213440:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129743.371306:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129743.371309:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129743 -> 1746129743 00002000:00010000:1.0:1746129743.371312:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129743 -> 1746129743 00000100:00100000:2.0:1746129743.371313:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+69:3297:x1830949053213440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (208us total) trans 21474840165 rc 0/0 00002000:00010000:1.0:1746129743.371313:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129743 -> 1746129743 00002000:00010000:1.0:1746129743.371315:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746129743.371319:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10321 00000100:00100000:1.0:1746129743.371339:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+68:3296:x1830949053212800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 173us (2788us total) trans 21474840166 rc 0/0 00000100:00100000:1.0:1746129743.371344:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10320 00002000:00010000:2.0:1746129743.371383:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746129743.371385:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129743 -> 1746129743 00002000:00010000:2.0:1746129743.371387:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129743 -> 1746129743 00002000:00010000:2.0:1746129743.371389:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129743 -> 1746129743 00002000:00010000:2.0:1746129743.371390:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746129743.371407:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+68:3297:x1830949053212928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 246us (1199us total) trans 21474840167 rc 0/0 00000100:00100000:2.0:1746129743.371412:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10319 00000100:00100000:1.0:1746129743.371426:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129743.371434:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053213312 00000100:00100000:2.0:1746129743.371437:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053213312 00000004:00080000:1.0:1746129743.371449:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adac380/2, rc 0, transno 17179872999 00000100:00100000:2.0:1746129743.371450:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10322 00000100:00100000:2.0:1746129743.371453:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+68:3296:x1830949053213312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129743.371454:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053211904:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129743.371462:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adac700/2, rc 0, transno 17179873000 00000100:00100000:1.0:1746129743.371464:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053212416:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129743.371471:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adadc00/2, rc 0, transno 17179872997 00000100:00100000:1.0:1746129743.371473:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053211776:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129743.371479:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adad180/2, rc 0, transno 17179872998 00000100:00100000:1.0:1746129743.371481:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053212288:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129743.371489:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eb7480/2, rc 0, transno 21474840166 00000100:00100000:1.0:1746129743.371492:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053212800:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129743.371526:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+69:3296:x1830949053213312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (98us total) trans 21474840168 rc 0/0 00000100:00100000:2.0:1746129743.371530:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10322 00000004:00080000:1.0:1746129743.371531:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fad2d80/2, rc 0, transno 21474840168 00000100:00100000:1.0:1746129743.371534:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053213312:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129743.371562:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eb5f80/2, rc 0, transno 21474840167 00000100:00100000:1.0:1746129743.373612:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129743.373628:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129743.373649:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.373844:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051974272 00000100:00100000:3.0:1746129743.373862:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051974272 00000100:00100000:3.0:1746129743.373893:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9750 00000100:00100000:3.0:1746129743.373900:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:28367:x1830949051974272:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129743.373915:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129743.373928:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801363cf000/0x48868a4e43948012 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e9b6 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.373971:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801363cf000/0x48868a4e43948012 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9b6 expref: 283 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.373986:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801363cf000/0x48868a4e43948012 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9b6 expref: 283 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.374000:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129743.374003:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129743.374005:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801363cf000, rc 0) 00000100:00100000:0.0:1746129743.374102:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051974144 00000100:00100000:0.0:1746129743.374105:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051974144 00000100:00100000:2.0:1746129743.374160:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053212928:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129743.374187:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fad0e00/2, rc 0, transno 21474840165 00000100:00100000:2.0:1746129743.374191:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053213440:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129743.374834:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28367:x1830949051974272:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 932us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129743.374840:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9750 00000100:00100000:0.0:1746129743.375692:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051974400 00000100:00100000:0.0:1746129743.375697:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051974400 00000100:00100000:2.0:1746129743.375775:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3797 00000100:00100000:2.0:1746129743.375783:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28369:x1830949051974144:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:2.0:1746129743.375891:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28369:x1830949051974144:12345-192.168.204.31@tcp:49:cat.0 Request processed in 109us (2283us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129743.375896:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3797 00000100:00100000:2.0:1746129743.375908:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3798 00000100:00100000:2.0:1746129743.375913:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba7fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28368:x1830949051974400:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:2.0:1746129743.375943:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba7fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28368:x1830949051974400:12345-192.168.204.31@tcp:49:cat.0 Request processed in 30us (2314us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129743.375947:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3798 00000100:00100000:0.0:1746129743.376278:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053213696:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129743.376305:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3e00/0x48868a4e43947fe8 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e993 expref: 11 pid: 16808 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746129743.376324:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3c00/0x48868a4e43947fef lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e993 expref: 10 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.376339:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094bb3c00, rc 0) 00000100:00100000:0.0:1746129743.376356:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28364:x1830949051973120:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 91071us (91459us total) trans 8589943513 rc 0/0 00000100:00100000:0.0:1746129743.376361:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9747 00000100:00100000:0.0:1746129743.377718:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.377812:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051974528 00000100:00100000:2.0:1746129743.377816:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051974528 00000100:00100000:1.0:1746129743.378088:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3799 00000100:00100000:1.0:1746129743.378096:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28367:x1830949051974528:12345-192.168.204.31@tcp:49:multiop.0 00000100:00100000:1.0:1746129743.378162:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28367:x1830949051974528:12345-192.168.204.31@tcp:49:multiop.0 Request processed in 66us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129743.378167:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3799 00000100:00100000:0.0:1746129743.379032:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129743.379167:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051974656 00000100:00100000:1.0:1746129743.379174:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051974656 00000100:00100000:1.0:1746129743.379254:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 554 00000100:00100000:1.0:1746129743.379260:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:1962:x1830949051974656:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129743.379270:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129743.379287:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801363cf000/0x48868a4e43948012 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9b6 expref: 283 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129743.379407:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129743.379411:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129743.379808:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:1962:x1830949051974656:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 546us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129743.379813:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 554 00000100:00100000:0.0:1746129743.380197:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.380359:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051974784 00000100:00100000:2.0:1746129743.380363:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051974784 00000100:00100000:2.0:1746129743.380395:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3800 00000100:00100000:2.0:1746129743.380401:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28364:x1830949051974784:12345-192.168.204.31@tcp:49:multiop.0 00000100:00100000:2.0:1746129743.380670:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28364:x1830949051974784:12345-192.168.204.31@tcp:49:multiop.0 Request processed in 267us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129743.380676:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3800 00000100:00100000:0.0:1746129743.384682:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.384744:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051974912 00000100:00100000:3.0:1746129743.384753:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051974912 00000100:00100000:3.0:1746129743.384799:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10323 00000100:00100000:3.0:1746129743.384807:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28364:x1830949051974912:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129743.384823:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129743.384837:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363cf400/0x48868a4e43948019 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e9bd expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.385150:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094b2ce00/0x48868a4e43947efa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e93f expref: 14 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129743.385158:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129743.385160:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129743.385162:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363cf400/0x48868a4e43948019 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1314816->1490943] (req 1314816->1490943) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9bd expref: 19 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.385187:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094b2ce00/0x48868a4e43947efa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e93f expref: 14 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129743.385198:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094b2ce00/0x48868a4e43947efa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e93f expref: 14 pid: 1877 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746129743.385208:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053213952:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129743.385286:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129743.386691:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.386739:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051975168 00000100:00100000:2.0:1746129743.386744:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051975168 00002000:00100000:2.0:1746129743.386776:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012ba1ad80 x1830949051975168/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.386790:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba1ad80 with x1830949051975168 ext(1048576->2097151) 00002000:00010000:2.0:1746129743.386794:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba1ad80 00000100:00100000:2.0:1746129743.386810:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3789 00000100:00100000:2.0:1746129743.386816:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949051975168:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129743.387140:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053213952:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129743.387160:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801363cf400/0x48868a4e43948019 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1314816->1490943] (req 1314816->1490943) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9bd expref: 19 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.387172:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801363cf400, rc 0) 00000100:00100000:3.0:1746129743.387201:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:28364:x1830949051974912:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2396us (2527us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129743.387207:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10323 00000100:00100000:0.0:1746129743.387923:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129743.388139:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051975296 00000100:00100000:1.0:1746129743.388143:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051975296 00010000:00010000:1.0:1746129743.388160:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094b2ce00/0x48868a4e43947efa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e93f expref: 15 pid: 1877 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746129743.388189:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4964 00000100:00100000:1.0:1746129743.388194:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949051975296:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129743.388203:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129743.388219:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094b2ce00/0x48868a4e43947efa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e93f expref: 15 pid: 1877 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746129743.388233:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094b2ce00/0x48868a4e43947efa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e93f expref: 15 pid: 1877 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746129743.388253:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094b2ce00/0x48868a4e43947efa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e93f expref: 15 pid: 1877 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746129743.388265:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129743.388267:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129743.388272:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363cf400/0x48868a4e43948019 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->1490943) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9bd expref: 18 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129743.388278:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363cf400/0x48868a4e43948019 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->1490943) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9bd expref: 18 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129743.388683:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801363cf400/0x48868a4e43948019 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->1490943) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9bd expref: 18 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129743.388695:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053214080:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129743.388744:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1abaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129743.394644:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.394708:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051975552 00000100:00100000:2.0:1746129743.394716:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051975552 00002000:00100000:2.0:1746129743.394758:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012ba1bb80 x1830949051975552/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.394767:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba1bb80 with x1830949051975552 ext(1048576->2097151) 00002000:00010000:2.0:1746129743.394772:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba1bb80 00000100:00100000:2.0:1746129743.394803:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3790 00000100:00100000:2.0:1746129743.394810:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949051975552:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129743.396832:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053214080:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129743.396874:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129743.396916:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+14:1962:x1830949051975296:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8720us (8992us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129743.396924:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4964 00000100:00100000:3.0:1746129743.397511:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949051975168:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 10694us (10824us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129743.397520:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3789 00002000:00100000:3.0:1746129743.397528:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012ba1ad80 x1830949051975168/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/440 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129743.397536:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba1ad80 with x1830949051975168 ext(1048576->2097151) 00002000:00010000:3.0:1746129743.397540:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba1ad80 00000100:00100000:0.0:1746129743.401059:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.401128:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051975808 00000100:00100000:3.0:1746129743.401136:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051975808 00002000:00100000:3.0:1746129743.401169:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1314816->1318911) req@ffff88012ba18000 x1830949051975808/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129743.401179:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba18000 with x1830949051975808 ext(1314816->1318911) 00002000:00010000:3.0:1746129743.401184:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba18000 00000100:00100000:3.0:1746129743.401213:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3791 00000100:00100000:3.0:1746129743.401221:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1961:x1830949051975808:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129743.401537:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1961:x1830949051975808:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 316us (484us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129743.401543:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3791 00002000:00100000:3.0:1746129743.401548:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1314816->1318911) req@ffff88012ba18000 x1830949051975808/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/4536 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129743.401567:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba18000 with x1830949051975808 ext(1314816->1318911) 00002000:00010000:3.0:1746129743.401570:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba18000 00000100:00100000:0.0:1746129743.404748:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.405020:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051975936 00000100:00100000:3.0:1746129743.405028:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051975936 00000100:00100000:3.0:1746129743.405140:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10324 00000100:00100000:3.0:1746129743.405148:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28368:x1830949051975936:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129743.405162:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129743.405176:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ffbd800/0x48868a4e43948020 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e9c4 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.405194:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129743.405196:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129743.405202:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffbd800/0x48868a4e43948020 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9c4 expref: 17 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.405216:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ffbd800/0x48868a4e43948020 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9c4 expref: 17 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.405224:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffbd800, rc 0) 00000100:00100000:3.0:1746129743.405322:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28368:x1830949051975936:12345-192.168.204.31@tcp:101:cat.0 Request processed in 173us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129743.405327:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10324 00000100:00100000:2.0:1746129743.405837:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949051975552:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 11027us (11200us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129743.405844:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3790 00002000:00100000:2.0:1746129743.405871:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012ba1bb80 x1830949051975552/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/440 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.405879:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba1bb80 with x1830949051975552 ext(1048576->2097151) 00002000:00010000:2.0:1746129743.405883:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba1bb80 00000100:00100000:0.0:1746129743.408472:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.409799:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051976192 00000100:00100000:2.0:1746129743.409807:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051976192 00002000:00100000:2.0:1746129743.409876:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3ea:0x0] (1486848->1490943) req@ffff88012ba18e00 x1830949051976192/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.409890:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba18e00 with x1830949051976192 ext(1486848->1490943) 00002000:00010000:2.0:1746129743.409895:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba18e00 00000100:00100000:2.0:1746129743.409922:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3792 00000100:00100000:2.0:1746129743.409929:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1963:x1830949051976192:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129743.410082:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1963:x1830949051976192:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 152us (1614us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129743.410089:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3792 00002000:00100000:2.0:1746129743.410094:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3ea:0x0] (1486848->1490943) req@ffff88012ba18e00 x1830949051976192/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/4536 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.410100:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba18e00 with x1830949051976192 ext(1486848->1490943) 00002000:00010000:2.0:1746129743.410103:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba18e00 00000100:00100000:0.0:1746129743.411290:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.411593:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051976320 00000100:00100000:3.0:1746129743.411598:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051976320 00000100:00100000:3.0:1746129743.411633:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10325 00000100:00100000:3.0:1746129743.411646:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:28369:x1830949051976320:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129743.411656:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129743.411670:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801363cf000/0x48868a4e43948027 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e9cb expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.411689:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129743.411691:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129743.411698:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801363cf000/0x48868a4e43948027 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9cb expref: 32 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.411710:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801363cf000/0x48868a4e43948027 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9cb expref: 32 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.411719:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801363cf000, rc 0) 00000100:00100000:3.0:1746129743.411756:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:28369:x1830949051976320:12345-192.168.204.31@tcp:101:cat.0 Request processed in 110us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129743.411762:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10325 00000100:00100000:0.0:1746129743.412547:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.412588:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.412627:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.412680:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051976704 00000100:00100000:2.0:1746129743.412684:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051976704 00000100:00100000:2.0:1746129743.412713:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10326 00000100:00100000:2.0:1746129743.412719:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:28367:x1830949051976704:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129743.412727:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129743.412735:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013585b800/0x48868a4e4394802e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e9d2 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.412751:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013585ae00/0x48868a4e43947ef3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e931 expref: 14 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129743.412758:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094fd9200/0x48868a4e43947ffd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9a1 expref: 33 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.412769:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094fd9400/0x48868a4e43947ff6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e99a expref: 16 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.412774:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129743.412775:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129743.412778:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013585b800/0x48868a4e4394802e lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1810432->2097151] (req 1810432->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d2 expref: 33 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.412800:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094fd9400/0x48868a4e43947ff6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e99a expref: 16 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.412810:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094fd9400/0x48868a4e43947ff6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e99a expref: 16 pid: 7975 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746129743.412819:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053214208:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129743.412906:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094fd9200/0x48868a4e43947ffd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9a1 expref: 33 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.412914:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094fd9200/0x48868a4e43947ffd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9a1 expref: 33 pid: 7975 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746129743.412922:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136318a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053214336:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129743.412947:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013585ae00/0x48868a4e43947ef3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e931 expref: 14 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129743.412957:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013585ae00/0x48868a4e43947ef3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e931 expref: 14 pid: 10930 timeout: 789 lvb_type: 1 00000100:00100000:2.0:1746129743.412963:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136318700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053214464:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129743.412979:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8e480 going to sleep for 11 seconds 00000100:00100000:3.0:1746129743.413229:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051976832 00000100:00100000:3.0:1746129743.413233:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051976832 00002000:00100000:3.0:1746129743.413255:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1314815) req@ffff88012ba19880 x1830949051976832/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129743.413264:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba19880 with x1830949051976832 ext(1048576->1314815) 00002000:00010000:3.0:1746129743.413268:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba19880 00000100:00100000:3.0:1746129743.413575:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051976960 00000100:00100000:3.0:1746129743.413579:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051976960 00002000:00100000:3.0:1746129743.413593:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880092ad9500 x1830949051976960/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129743.413600:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad9500 with x1830949051976960 ext(1048576->2097151) 00002000:00010000:3.0:1746129743.413603:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad9500 00000100:00100000:3.0:1746129743.413943:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3793 00000100:00100000:3.0:1746129743.413950:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949051976832:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129743.414359:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3794 00000100:00100000:1.0:1746129743.414367:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949051976960:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129743.422010:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.422161:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053214208:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129743.422171:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136318a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053214336:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129743.422933:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051977216 00000100:00100000:1.0:1746129743.422940:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051977216 00002000:00100000:1.0:1746129743.422973:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880092ad9880 x1830949051977216/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129743.422981:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad9880 with x1830949051977216 ext(1048576->2097151) 00002000:00010000:1.0:1746129743.422985:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad9880 00000100:00100000:1.0:1746129743.423017:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3795 00000100:00100000:1.0:1746129743.423023:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1963:x1830949051977216:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129743.423305:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949051976832:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 9354us (10714us total) trans 0 rc 266240/266240 00000100:00100000:3.0:1746129743.423311:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3793 00002000:00100000:3.0:1746129743.423317:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1314815) req@ffff88012ba19880 x1830949051976832/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/440 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 266240/266240 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129743.423323:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba19880 with x1830949051976832 ext(1048576->1314815) 00002000:00010000:3.0:1746129743.423326:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba19880 00000100:00100000:0.0:1746129743.423821:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129743.424154:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051977344 00000100:00100000:1.0:1746129743.424158:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051977344 00010000:00010000:1.0:1746129743.424176:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094fd9400/0x48868a4e43947ff6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e99a expref: 19 pid: 7975 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746129743.424195:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4965 00000100:00100000:1.0:1746129743.424199:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130567050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1961:x1830949051977344:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129743.424207:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129743.424220:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094fd9400/0x48868a4e43947ff6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e99a expref: 19 pid: 7975 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746129743.424230:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094fd9400/0x48868a4e43947ff6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e99a expref: 19 pid: 7975 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746129743.424246:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094fd9400/0x48868a4e43947ff6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e99a expref: 19 pid: 7975 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746129743.424266:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129743.424286:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130567050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949051977344:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 86us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129743.424291:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4965 00000100:00100000:0.0:1746129743.424362:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129743.424639:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051977472 00000100:00100000:1.0:1746129743.424642:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051977472 00010000:00010000:1.0:1746129743.424653:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094fd9200/0x48868a4e43947ffd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9a1 expref: 36 pid: 7975 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746129743.424659:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136318700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053214464:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129743.424667:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4966 00000100:00100000:1.0:1746129743.424671:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1963:x1830949051977472:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129743.424676:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129743.424682:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094fd9200/0x48868a4e43947ffd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9a1 expref: 36 pid: 7975 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746129743.424687:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013585b800/0x48868a4e4394802e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [1810432->2097151] (req 1810432->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d2 expref: 36 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129743.424689:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094fd9200/0x48868a4e43947ffd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9a1 expref: 36 pid: 7975 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746129743.424700:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013585b800, rc 0) 00010000:00010000:1.0:1746129743.424700:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094fd9200/0x48868a4e43947ffd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9a1 expref: 36 pid: 7975 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746129743.424706:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129743.424730:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:28367:x1830949051976704:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 12008us (12181us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129743.424735:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10326 00000100:00100000:1.0:1746129743.424914:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1963:x1830949051977472:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 240us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129743.424919:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4966 00000100:00100000:1.0:1746129743.427633:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949051976960:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 13258us (14996us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129743.427643:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3794 00002000:00100000:1.0:1746129743.427653:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880092ad9500 x1830949051976960/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/440 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129743.427662:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad9500 with x1830949051976960 ext(1048576->2097151) 00002000:00010000:1.0:1746129743.427667:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad9500 00000100:00100000:0.0:1746129743.428545:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129743.428594:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051977600 00000100:00100000:1.0:1746129743.428602:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051977600 00010000:00010000:1.0:1746129743.428629:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013585ae00/0x48868a4e43947ef3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e931 expref: 15 pid: 10930 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746129743.428659:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4967 00000100:00100000:1.0:1746129743.428666:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949051977600:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129743.428677:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129743.428695:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013585ae00/0x48868a4e43947ef3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e931 expref: 15 pid: 10930 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746129743.428706:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013585ae00/0x48868a4e43947ef3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e931 expref: 15 pid: 10930 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746129743.428725:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013585ae00/0x48868a4e43947ef3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e931 expref: 15 pid: 10930 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746129743.428736:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129743.428738:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129743.428747:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013585b800/0x48868a4e4394802e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d2 expref: 33 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129743.428755:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013585b800/0x48868a4e4394802e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d2 expref: 33 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129743.428782:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013585b800/0x48868a4e4394802e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d2 expref: 33 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129743.428793:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053214592:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129743.428885:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aba0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129743.434304:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1963:x1830949051977216:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 11271us (12292us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129743.434315:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3795 00002000:00100000:1.0:1746129743.434327:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880092ad9880 x1830949051977216/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/440 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129743.434336:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad9880 with x1830949051977216 ext(1048576->2097151) 00002000:00010000:1.0:1746129743.434341:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad9880 00000100:00100000:0.0:1746129743.434534:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.434571:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.434601:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051977856 00000100:00100000:0.0:1746129743.434607:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051977856 00002000:00100000:0.0:1746129743.434633:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e6:0x0] (1810432->1814527) req@ffff880092ad9f80 x1830949051977856/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746129743.434638:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053214592:192.168.204.31@tcp:105: 00002000:00100000:0.0:1746129743.434641:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad9f80 with x1830949051977856 ext(1810432->1814527) 00002000:00010000:0.0:1746129743.434643:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad9f80 00010000:00010000:2.0:1746129743.434653:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129743.434665:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051978112 00000100:00100000:0.0:1746129743.434667:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051978112 00002000:00100000:0.0:1746129743.434678:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1490944->2097151) req@ffff880092adaa00 x1830949051978112/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746129743.434679:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+14:1962:x1830949051977600:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6013us (6136us total) trans 0 rc 0/0 00002000:00100000:0.0:1746129743.434684:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092adaa00 with x1830949051978112 ext(1490944->2097151) 00002000:00010000:0.0:1746129743.434686:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092adaa00 00000100:00100000:2.0:1746129743.434687:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4967 00000100:00100000:0.0:1746129743.434696:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3796 00000100:00100000:0.0:1746129743.434703:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949051977856:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129743.434717:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3797 00000100:00100000:2.0:1746129743.434724:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1961:x1830949051978112:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129743.434808:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949051977856:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 105us (273us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129743.434813:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3796 00002000:00100000:0.0:1746129743.434818:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e6:0x0] (1810432->1814527) req@ffff880092ad9f80 x1830949051977856/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/4536 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129743.434825:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad9f80 with x1830949051977856 ext(1810432->1814527) 00002000:00010000:0.0:1746129743.434827:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad9f80 00000100:00100000:0.0:1746129743.441998:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.442234:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.442275:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1961:x1830949051978112:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 7550us (7701us total) trans 0 rc 606208/606208 00000100:00100000:2.0:1746129743.442284:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3797 00002000:00100000:2.0:1746129743.442293:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3ea:0x0] (1490944->2097151) req@ffff880092adaa00 x1830949051978112/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/440 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 606208/606208 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.442301:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092adaa00 with x1830949051978112 ext(1490944->2097151) 00002000:00010000:2.0:1746129743.442306:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092adaa00 00000100:00100000:3.0:1746129743.442363:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051978240 00000100:00100000:3.0:1746129743.442370:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051978240 00000100:00100000:3.0:1746129743.442409:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051978368 00000100:00100000:3.0:1746129743.442411:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051978368 00000100:00100000:3.0:1746129743.442426:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10327 00000100:00100000:2.0:1746129743.442431:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10328 00000100:00100000:3.0:1746129743.442432:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:28369:x1830949051978240:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:2.0:1746129743.442436:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:28367:x1830949051978368:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129743.442444:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129743.442444:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129743.442457:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ffbce00/0x48868a4e43948035 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e9d9 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.442457:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013585ac00/0x48868a4e4394803c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e9e0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.442477:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363cf400/0x48868a4e43948019 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->1490943) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9bd expref: 18 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.442477:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013585a600/0x48868a4e43947ee5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e938 expref: 13 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129743.442483:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129743.442484:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129743.442484:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801363cf000/0x48868a4e43948027 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9cb expref: 33 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.442487:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffbce00/0x48868a4e43948035 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d9 expref: 31 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.442490:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ffbd800/0x48868a4e43948020 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9c4 expref: 15 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.442494:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129743.442495:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129743.442497:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013585ac00/0x48868a4e4394803c lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->1077247] (req 1048576->1077247) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9e0 expref: 33 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.442509:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801363cf400/0x48868a4e43948019 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->1490943) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9bd expref: 18 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.442509:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ffbd800/0x48868a4e43948020 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9c4 expref: 15 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.442518:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ffbd800/0x48868a4e43948020 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9c4 expref: 15 pid: 7975 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746129743.442520:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801363cf400/0x48868a4e43948019 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->1490943) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9bd expref: 18 pid: 7975 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746129743.442528:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053214848:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129743.442528:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053214720:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129743.442606:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801363cf000/0x48868a4e43948027 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9cb expref: 33 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.442614:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801363cf000/0x48868a4e43948027 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9cb expref: 33 pid: 7975 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746129743.442621:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053214976:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129743.442747:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942a80 going to sleep for 11 seconds 00010000:00010000:2.0:1746129743.443946:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013585a600/0x48868a4e43947ee5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e938 expref: 13 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129743.443956:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013585a600/0x48868a4e43947ee5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e938 expref: 13 pid: 10930 timeout: 789 lvb_type: 1 00000100:00100000:2.0:1746129743.443965:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053215104:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129743.444112:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8e480 going to sleep for 11 seconds 00000100:00100000:3.0:1746129743.449646:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053214848:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129743.449674:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ffbce00/0x48868a4e43948035 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d9 expref: 31 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.449690:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffbce00, rc 0) 00000100:00100000:3.0:1746129743.449728:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:28369:x1830949051978240:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7294us (7737us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129743.449736:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10327 00000100:00100000:0.0:1746129743.449884:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.450136:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053214720:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129743.450146:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053214976:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129743.450152:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053215104:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129743.450170:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013585ac00/0x48868a4e4394803c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->1077247] (req 1048576->1077247) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9e0 expref: 33 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.450179:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013585ac00, rc 0) 00000100:00100000:2.0:1746129743.450213:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:28367:x1830949051978368:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 7777us (7978us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129743.450221:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10328 00000100:00100000:0.0:1746129743.450723:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.450875:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.450921:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051978496 00000100:00100000:2.0:1746129743.450926:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051978496 00010000:00010000:2.0:1746129743.450950:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffbd800/0x48868a4e43948020 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9c4 expref: 16 pid: 7975 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746129743.450979:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051978752 00000100:00100000:2.0:1746129743.450981:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051978752 00010000:00010000:2.0:1746129743.450990:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013585a600/0x48868a4e43947ee5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e938 expref: 14 pid: 10930 timeout: 789 lvb_type: 1 00000100:00100000:2.0:1746129743.451003:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4968 00000100:00100000:2.0:1746129743.451007:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949051978496:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129743.451017:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129743.451034:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ffbd800/0x48868a4e43948020 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9c4 expref: 16 pid: 7975 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746129743.451042:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ffbd800/0x48868a4e43948020 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9c4 expref: 16 pid: 7975 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746129743.451058:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ffbd800/0x48868a4e43948020 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9c4 expref: 16 pid: 7975 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746129743.451068:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129743.451085:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949051978496:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 78us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129743.451093:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4968 00000100:00100000:2.0:1746129743.451103:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4969 00000100:00100000:2.0:1746129743.451106:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+14:1964:x1830949051978752:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129743.451111:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129743.451117:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013585a600/0x48868a4e43947ee5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e938 expref: 14 pid: 10930 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746129743.451123:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013585a600/0x48868a4e43947ee5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e938 expref: 14 pid: 10930 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746129743.451132:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013585a600/0x48868a4e43947ee5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e938 expref: 14 pid: 10930 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746129743.451138:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129743.451148:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+13:1964:x1830949051978752:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 42us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129743.451152:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4969 00000100:00100000:0.0:1746129743.451252:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.451262:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.451273:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.451283:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.451306:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.451318:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051978880 00000100:00100000:0.0:1746129743.451321:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051978880 00000100:00100000:0.0:1746129743.451334:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051979008 00000100:00100000:0.0:1746129743.451335:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051979008 00000100:00100000:0.0:1746129743.451342:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051979136 00000100:00100000:0.0:1746129743.451343:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051979136 00000100:00100000:0.0:1746129743.451352:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051979264 00000100:00100000:0.0:1746129743.451353:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051979264 00000100:00100000:0.0:1746129743.451360:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051979392 00000100:00100000:0.0:1746129743.451361:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051979392 00000100:00100000:0.0:1746129743.451369:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10329 00000100:00100000:0.0:1746129743.451374:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949051978880:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129743.451385:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129743.451394:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094bb2600/0x48868a4e43948043 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e9e7 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129743.451424:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053215232:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129743.451469:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129743.451484:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10330 00000100:00100000:0.0:1746129743.451489:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949051979008:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129743.451495:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129743.451501:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094bb2200/0x48868a4e4394804a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e9ee expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.451510:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129743.451516:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094bb2200/0x48868a4e4394804a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9ee expref: 19 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129743.451524:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094bb2200/0x48868a4e4394804a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9ee expref: 19 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129743.451534:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094bb2200, rc 0) 00000100:00100000:0.0:1746129743.451559:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949051979008:12345-192.168.204.31@tcp:101:cat.0 Request processed in 61us (286us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129743.451564:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10330 00000100:00100000:0.0:1746129743.451573:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10331 00000100:00100000:0.0:1746129743.451577:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949051979136:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129743.451587:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129743.451595:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094bb3a00/0x48868a4e43948051 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e9f5 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129743.451615:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053215360:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129743.451635:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129743.451738:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10332 00000100:00100000:3.0:1746129743.451744:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1962:x1830949051979264:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129743.451750:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129743.451756:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013261ac00/0x48868a4e43948058 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34e9fc expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.451765:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129743.451767:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129743.451772:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013261ac00/0x48868a4e43948058 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9fc expref: 22 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129743.451786:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013261ac00/0x48868a4e43948058 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9fc expref: 22 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129743.451793:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013261ac00, rc 0) 00000100:00100000:3.0:1746129743.451809:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949051979264:12345-192.168.204.31@tcp:101:cat.0 Request processed in 66us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129743.451813:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10332 00000100:00100000:3.0:1746129743.451821:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10333 00000100:00100000:3.0:1746129743.451825:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949051979392:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129743.451830:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129743.451836:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801363cee00/0x48868a4e4394805f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ea03 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.451843:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129743.451844:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129743.451871:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801363cee00/0x48868a4e4394805f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea03 expref: 18 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129743.451881:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801363cee00/0x48868a4e4394805f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea03 expref: 18 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129743.451887:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801363cee00, rc 0) 00000100:00100000:3.0:1746129743.451901:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949051979392:12345-192.168.204.31@tcp:101:cat.0 Request processed in 75us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129743.451905:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10333 00000100:00100000:2.0:1746129743.452299:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051978624 00000100:00100000:2.0:1746129743.452303:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051978624 00002000:00100000:2.0:1746129743.452323:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3ea:0x0] (1314816->1490943) req@ffff880092adb100 x1830949051978624/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.452331:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092adb100 with x1830949051978624 ext(1314816->1490943) 00010000:00010000:2.0:1746129743.452335:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801363cf400/0x48868a4e43948019 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1314816->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9bd expref: 22 pid: 7975 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746129743.452347:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801363cf400/0x48868a4e43948019 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1314816->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9bd expref: 22 pid: 7975 timeout: 789 lvb_type: 0 00002000:00010000:2.0:1746129743.452352:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092adb100 00000100:00100000:2.0:1746129743.452372:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 520 00000100:00100000:2.0:1746129743.452376:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1964:x1830949051978624:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:0.0:1746129743.453829:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129743.454621:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051979520 00000100:00100000:1.0:1746129743.454626:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051979520 00010000:00010000:1.0:1746129743.454647:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801363cf000/0x48868a4e43948027 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9cb expref: 33 pid: 7975 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746129743.454669:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4970 00000100:00100000:1.0:1746129743.454675:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949051979520:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129743.454684:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129743.454700:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801363cf000/0x48868a4e43948027 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9cb expref: 33 pid: 7975 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746129743.454709:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801363cf000/0x48868a4e43948027 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9cb expref: 33 pid: 7975 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746129743.454725:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801363cf000/0x48868a4e43948027 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9cb expref: 33 pid: 7975 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746129743.454739:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129743.454741:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129743.454746:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013585ac00/0x48868a4e4394803c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9e0 expref: 32 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129743.454753:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013585ac00/0x48868a4e4394803c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9e0 expref: 32 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129743.454778:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013585ac00/0x48868a4e4394803c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9e0 expref: 32 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129743.454788:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053215488:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129743.454868:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aba900 going to sleep for 11 seconds 00002000:00010000:0.0:1746129743.455818:0:8435:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime: 1746129743 -> 1746129744 00002000:00010000:0.0:1746129743.455821:0:8435:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime: 1746129743 -> 1746129744 00002000:00010000:0.0:1746129743.455823:0:8435:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime: 1746129743 -> 1746129744 00000100:00100000:0.0:1746129743.455832:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053215360:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129743.455863:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094bb3a00/0x48868a4e43948051 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9f5 expref: 23 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129743.455872:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094bb3a00/0x48868a4e43948051 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9f5 expref: 23 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129743.455879:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094bb3a00, rc 0) 00000100:00100000:0.0:1746129743.455907:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949051979136:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4329us (4633us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129743.455913:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10331 00002000:00010000:1.0:1746129743.457449:0:4589:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime: 1746129743 -> 1746129744 00002000:00010000:1.0:1746129743.457453:0:4589:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime: 1746129743 -> 1746129744 00002000:00010000:1.0:1746129743.457455:0:4589:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime: 1746129743 -> 1746129744 00000100:00100000:1.0:1746129743.457471:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053215232:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129743.457491:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094bb2600/0x48868a4e43948043 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9e7 expref: 17 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129743.457502:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094bb2600/0x48868a4e43948043 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9e7 expref: 17 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129743.457510:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094bb2600, rc 0) 00000100:00100000:1.0:1746129743.457567:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949051978880:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6190us (6312us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129743.457573:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10329 00000100:00100000:0.0:1746129743.459591:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129743.459686:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053215488:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129743.459701:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129743.460131:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051979776 00000100:00100000:0.0:1746129743.460136:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051979776 00002000:00100000:0.0:1746129743.460163:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1073152->1077247) req@ffff88009f6a4a80 x1830949051979776/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129743.460171:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a4a80 with x1830949051979776 ext(1073152->1077247) 00002000:00010000:0.0:1746129743.460175:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6a4a80 00000100:00100000:0.0:1746129743.460190:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3798 00000100:00100000:0.0:1746129743.460196:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949051979776:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129743.460759:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1964:x1830949051978624:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 8381us (9883us total) trans 17179873006 rc 0/0 00000100:00100000:1.0:1746129743.460759:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949051979520:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6082us (6930us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129743.460767:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 520 00000100:00100000:1.0:1746129743.460767:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4970 00002000:00100000:2.0:1746129743.460774:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3ea:0x0] (1314816->1490943) req@ffff880092adb100 x1830949051978624/t17179873006(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/448 e 0 to 0 dl 1746129754 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.460780:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092adb100 with x1830949051978624 ext(1314816->1490943) 00010000:00010000:2.0:1746129743.460786:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801363cf400/0x48868a4e43948019 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9bd expref: 22 pid: 7975 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746129743.460797:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801363cf400/0x48868a4e43948019 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9bd expref: 22 pid: 7975 timeout: 789 lvb_type: 0 00002000:00010000:2.0:1746129743.460802:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092adb100 00000100:00100000:0.0:1746129743.460863:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949051979776:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 666us (1277us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129743.460868:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3798 00002000:00100000:0.0:1746129743.460873:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1073152->1077247) req@ffff88009f6a4a80 x1830949051979776/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/4536 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129743.460879:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a4a80 with x1830949051979776 ext(1073152->1077247) 00002000:00010000:0.0:1746129743.460882:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6a4a80 00000100:00100000:0.0:1746129743.466950:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129743.466982:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051979904 00000100:00100000:1.0:1746129743.466990:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051979904 00000100:00100000:0.0:1746129743.467007:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.467092:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051980160 00000100:00100000:2.0:1746129743.467096:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051980160 00010000:00010000:1.0:1746129743.467163:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801363cf400/0x48868a4e43948019 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9bd expref: 22 pid: 7975 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746129743.467227:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4971 00000100:00100000:1.0:1746129743.467234:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949051979904:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129743.467237:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3801 00000100:00100000:2.0:1746129743.467242:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:28367:x1830949051980160:12345-192.168.204.31@tcp:35:multiop.0 00010000:00010000:1.0:1746129743.467247:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129743.467264:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801363cf400/0x48868a4e43948019 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1314816->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9bd expref: 22 pid: 7975 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746129743.467275:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801363cf400/0x48868a4e43948019 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1314816->1490943) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9bd expref: 22 pid: 7975 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746129743.467292:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363cf400/0x48868a4e43948019 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1314816->1490943) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9bd expref: 22 pid: 7975 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746129743.467303:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129743.467305:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129743.467310:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ffbce00/0x48868a4e43948035 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d9 expref: 30 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129743.467316:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffbce00/0x48868a4e43948035 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d9 expref: 30 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129743.467341:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ffbce00/0x48868a4e43948035 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d9 expref: 30 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129743.467350:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053215616:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129743.467457:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28367:x1830949051980160:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 214us (448us total) trans 8589943514 rc 0/0 00000100:00100000:2.0:1746129743.467463:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3801 00000100:00100000:1.0:1746129743.467690:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aba900 going to sleep for 11 seconds 00000100:00100000:1.0:1746129743.480320:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053215616:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129743.480339:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129743.480373:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1962:x1830949051979904:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 13139us (13429us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129743.480382:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4971 00000100:00100000:0.0:1746129743.482663:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.482704:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.482732:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.482768:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.482842:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051980416 00000100:00100000:2.0:1746129743.482871:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051980416 00002000:00100000:2.0:1746129743.482904:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009f6a4700 x1830949051980416/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.482913:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a4700 with x1830949051980416 ext(2097152->3145727) 00002000:00010000:2.0:1746129743.482917:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a4700 00000100:00100000:2.0:1746129743.482930:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051980672 00000100:00100000:2.0:1746129743.482931:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051980672 00002000:00100000:2.0:1746129743.482938:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009f6a5180 x1830949051980672/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.482945:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a5180 with x1830949051980672 ext(3145728->4194303) 00002000:00010000:2.0:1746129743.482947:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a5180 00000100:00100000:2.0:1746129743.482953:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051980928 00000100:00100000:2.0:1746129743.482954:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051980928 00002000:00100000:2.0:1746129743.482962:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f6a7800 x1830949051980928/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.482968:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a7800 with x1830949051980928 ext(2097152->3145727) 00002000:00010000:2.0:1746129743.482970:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6a7800 00000100:00100000:2.0:1746129743.482976:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051981440 00000100:00100000:2.0:1746129743.482977:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051981440 00002000:00100000:2.0:1746129743.482985:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009f6a5c00 x1830949051981440/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.482997:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a5c00 with x1830949051981440 ext(1048576->2097151) 00002000:00010000:2.0:1746129743.483000:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a5c00 00000100:00100000:2.0:1746129743.483008:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3799 00000100:00100000:2.0:1746129743.483014:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1964:x1830949051980416:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129743.483199:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3800 00000100:00100000:1.0:1746129743.483207:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1964:x1830949051980672:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129743.483530:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3801 00000100:00100000:0.0:1746129743.483536:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949051980928:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129743.483717:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3802 00000100:00100000:3.0:1746129743.483724:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949051981440:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129743.491391:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.492496:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051981184 00000100:00100000:3.0:1746129743.492506:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051981184 00002000:00100000:3.0:1746129743.492542:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009f6a4e00 x1830949051981184/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129743.492560:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a4e00 with x1830949051981184 ext(3145728->4194303) 00002000:00010000:3.0:1746129743.492565:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6a4e00 00000100:00100000:3.0:1746129743.492596:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3803 00000100:00100000:3.0:1746129743.492603:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949051981184:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129743.500075:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949051980928:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16532us (17334us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129743.500086:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3801 00002000:00100000:0.0:1746129743.500095:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f6a7800 x1830949051980928/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/440 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129743.500104:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a7800 with x1830949051980928 ext(2097152->3145727) 00002000:00010000:0.0:1746129743.500109:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6a7800 00000100:00100000:3.0:1746129743.506806:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949051981440:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 23073us (24027us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129743.506817:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3802 00002000:00100000:3.0:1746129743.506827:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009f6a5c00 x1830949051981440/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/440 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129743.506836:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a5c00 with x1830949051981440 ext(1048576->2097151) 00002000:00010000:3.0:1746129743.506841:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a5c00 00000100:00100000:0.0:1746129743.512769:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1964:x1830949051980672:12345-192.168.204.31@tcp:3:cat.0 Request processed in 29552us (30053us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129743.512779:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3800 00002000:00100000:0.0:1746129743.512790:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009f6a5180 x1830949051980672/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/440 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129743.512798:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a5180 with x1830949051980672 ext(3145728->4194303) 00002000:00010000:0.0:1746129743.512803:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a5180 00000100:00100000:0.0:1746129743.520623:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.520697:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.520704:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051981568 00000100:00100000:2.0:1746129743.520711:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051981568 00000100:00100000:2.0:1746129743.520747:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9751 00000100:00100000:2.0:1746129743.520754:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+6:28374:x1830949051981568:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129743.520773:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129743.520774:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129743.520787:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095345800/0x48868a4e43948066 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ea0a expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129743.520795:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051981696 00000100:00100000:0.0:1746129743.520798:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051981696 00000100:00100000:0.0:1746129743.520817:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051981824 00000100:00100000:0.0:1746129743.520820:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051981824 00000100:00100000:0.0:1746129743.520831:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10334 00010000:00010000:2.0:1746129743.520832:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095345c00/0x48868a4e4394806d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00000100:00100000:0.0:1746129743.520836:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949051981696:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129743.520843:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095345c00/0x48868a4e4394806d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129743.520843:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129743.520874:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095345c00/0x48868a4e4394806d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129743.520874:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fadb000/0x48868a4e43948074 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ea11 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.520886:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095345a00/0x48868a4e4394807b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129743.520887:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129743.520889:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129743.520891:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095345a00/0x48868a4e4394807b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129743.520895:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fadb000/0x48868a4e43948074 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea11 expref: 32 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129743.520896:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095345a00/0x48868a4e4394807b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129743.520905:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fadb000/0x48868a4e43948074 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea11 expref: 32 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129743.520913:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fadb000, rc 0) 00000100:00100000:0.0:1746129743.520947:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949051981696:12345-192.168.204.31@tcp:101:cat.0 Request processed in 110us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129743.520952:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10334 00000100:00100000:0.0:1746129743.520964:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10335 00000100:00100000:0.0:1746129743.520968:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949051981824:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129743.520974:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129743.520982:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fadb200/0x48868a4e43948082 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ea18 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.520990:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129743.520991:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129743.520994:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fadb200/0x48868a4e43948082 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea18 expref: 33 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129743.521002:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fadb200/0x48868a4e43948082 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea18 expref: 33 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129743.521008:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fadb200, rc 0) 00000100:00100000:0.0:1746129743.521019:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949051981824:12345-192.168.204.31@tcp:101:cat.0 Request processed in 50us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129743.521023:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10335 00010000:00010000:2.0:1746129743.521467:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43948089 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129743.521477:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947fc5 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e97e expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.521484:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43948089 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129743.521506:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947fc5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e97e expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.521516:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947fc5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e97e expref: 9 pid: 14315 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746129743.521526:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053215744:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129743.521600:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8e480 going to sleep for 11 seconds 00000100:00100000:3.0:1746129743.521880:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949051981184:12345-192.168.204.31@tcp:3:cat.0 Request processed in 29275us (30494us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129743.521887:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3803 00002000:00100000:3.0:1746129743.521894:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009f6a4e00 x1830949051981184/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/440 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129743.521902:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a4e00 with x1830949051981184 ext(3145728->4194303) 00002000:00010000:3.0:1746129743.521907:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6a4e00 00000100:00100000:0.0:1746129743.532467:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.532499:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051982080 00000100:00100000:0.0:1746129743.532506:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051982080 00000100:00100000:0.0:1746129743.532539:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3802 00000100:00100000:0.0:1746129743.532545:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:7659:x1830949051982080:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746129743.532703:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:7659:x1830949051982080:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 157us (242us total) trans 8589943515 rc 0/0 00000100:00100000:0.0:1746129743.532708:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3802 00000100:00100000:2.0:1746129743.532771:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053215744:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129743.532790:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43948089 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:3.0:1746129743.533045:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1964:x1830949051980416:12345-192.168.204.31@tcp:3:cat.0 Request processed in 50030us (50388us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129743.533052:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3799 00002000:00100000:3.0:1746129743.533059:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009f6a4700 x1830949051980416/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/440 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129743.533417:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a4700 with x1830949051980416 ext(2097152->3145727) 00002000:00010000:3.0:1746129743.533421:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a4700 00000100:00100000:0.0:1746129743.539622:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.541020:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.541056:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129743.541172:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051982208 00000100:00100000:1.0:1746129743.541180:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051982208 00010000:00010000:1.0:1746129743.541207:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947fc5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e97e expref: 11 pid: 14315 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746129743.541238:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4972 00000100:00100000:1.0:1746129743.541245:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130566c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949051982208:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129743.541256:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129743.541261:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947fc5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e97e expref: 11 pid: 14315 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746129743.541272:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947fc5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e97e expref: 11 pid: 14315 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746129743.541291:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801356e3e00/0x48868a4e43947fc5 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e97e expref: 11 pid: 14315 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746129743.541308:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129743.541313:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43948089 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129743.541321:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43948089 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129743.541326:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43948089 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129743.541357:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129743.541393:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130566c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949051982208:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 148us (1778us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129743.541399:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4972 00010000:00010000:3.0:1746129743.542016:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43948089 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.542024:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43948089 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:3.0:1746129743.542058:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:3.0:1746129743.542062:0:16808:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129743.542076:0:16808:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43948089 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.542084:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43948089 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.542092:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095345c00/0x48868a4e4394806d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.542098:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095345c00/0x48868a4e4394806d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.542103:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095345c00/0x48868a4e4394806d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.542108:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095345c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129743.542111:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095345c00/0x48868a4e4394806d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.542116:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095345c00/0x48868a4e4394806d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.542125:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129743.542127:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129743.542130:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095345c00/0x48868a4e4394806d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.542140:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095345c00/0x48868a4e4394806d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.542156:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095345a00/0x48868a4e4394807b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.542160:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095345a00/0x48868a4e4394807b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.542165:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095345a00/0x48868a4e4394807b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.542169:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095345a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129743.542171:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095345a00/0x48868a4e4394807b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.542175:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095345a00/0x48868a4e4394807b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.542181:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a8177a00) 00010000:00010000:3.0:1746129743.542183:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129743.542185:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095345a00/0x48868a4e4394807b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.542192:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095345a00/0x48868a4e4394807b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.542218:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095345800/0x48868a4e43948066 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea0a expref: 8 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.542227:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43948089 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea0a expref: 7 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.542233:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129743.542235:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129743.542236:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095344200, rc 0) 00000100:00100000:3.0:1746129743.542263:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+7:28374:x1830949051981568:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 21509us (21653us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129743.542269:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9751 00000100:00100000:2.0:1746129743.542414:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051982336 00000100:00100000:2.0:1746129743.542418:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051982336 00000100:00100000:2.0:1746129743.542440:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051982592 00000100:00100000:2.0:1746129743.542442:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051982592 00000100:00100000:2.0:1746129743.542455:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10336 00000100:00100000:2.0:1746129743.542460:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949051982336:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129743.542472:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129743.542480:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129743.542484:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013585b600/0x48868a4e43948090 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ea1f expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129743.542499:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.542513:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.542518:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053215872:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129743.542526:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.542539:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051982848 00000100:00100000:0.0:1746129743.542542:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051982848 00002000:00100000:0.0:1746129743.542578:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009f6a4380 x1830949051982848/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746129743.542580:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8e480 going to sleep for 11 seconds 00002000:00100000:0.0:1746129743.542586:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a4380 with x1830949051982848 ext(2097152->3145727) 00002000:00010000:0.0:1746129743.542590:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a4380 00000100:00100000:2.0:1746129743.542593:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051982464 00000100:00100000:2.0:1746129743.542596:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051982464 00000100:00100000:0.0:1746129743.542600:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051983104 00000100:00100000:0.0:1746129743.542602:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051983104 00000100:00100000:2.0:1746129743.542611:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10337 00002000:00100000:0.0:1746129743.542611:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009f6a5500 x1830949051983104/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746129743.542616:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1962:x1830949051982592:12345-192.168.204.31@tcp:101:cat.0 00002000:00100000:0.0:1746129743.542617:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a5500 with x1830949051983104 ext(3145728->4194303) 00002000:00010000:0.0:1746129743.542619:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a5500 00010000:00010000:2.0:1746129743.542623:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129743.542626:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051983360 00000100:00100000:0.0:1746129743.542627:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051983360 00010000:00010000:2.0:1746129743.542632:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e102400/0x48868a4e43948097 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ea2d expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746129743.542635:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009c1c7b80 x1830949051983360/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129743.542641:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c7b80 with x1830949051983360 ext(2097152->3145727) 00010000:00010000:2.0:1746129743.542643:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1746129743.542643:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1c7b80 00010000:00010000:2.0:1746129743.542644:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129743.542651:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e102400/0x48868a4e43948097 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea2d expref: 22 pid: 8435 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129743.542652:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3804 00000100:00100000:0.0:1746129743.542657:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949051982848:12345-192.168.204.31@tcp:3:cat.0 00010000:00010000:2.0:1746129743.542661:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e102400/0x48868a4e43948097 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea2d expref: 22 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129743.542668:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e102400, rc 0) 00000100:00100000:2.0:1746129743.542683:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949051982592:12345-192.168.204.31@tcp:101:cat.0 Request processed in 67us (1627us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129743.542688:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10337 00000100:00100000:2.0:1746129743.542697:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10338 00000100:00100000:2.0:1746129743.542701:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949051982464:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129743.542708:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129743.542714:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e102600/0x48868a4e4394809e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ea26 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129743.542732:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053216000:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129743.542749:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129743.542765:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3805 00000100:00100000:2.0:1746129743.542770:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949051983104:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129743.543366:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129743.543384:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051983616 00000100:00100000:1.0:1746129743.543387:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051983616 00002000:00100000:1.0:1746129743.543403:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009adae680 x1830949051983616/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129743.543411:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adae680 with x1830949051983616 ext(3145728->4194303) 00002000:00010000:1.0:1746129743.543414:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adae680 00000100:00100000:1.0:1746129743.543425:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3806 00000100:00100000:1.0:1746129743.543430:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949051983360:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129743.543917:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3807 00000100:00100000:0.0:1746129743.543924:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949051983616:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129743.550986:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.551024:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.551046:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.551091:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051983744 00000100:00100000:2.0:1746129743.551098:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051983744 00000100:00100000:2.0:1746129743.551129:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051984000 00000100:00100000:2.0:1746129743.551130:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051984000 00000100:00100000:2.0:1746129743.551142:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051983872 00000100:00100000:2.0:1746129743.551144:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051983872 00000100:00100000:2.0:1746129743.551155:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10339 00000100:00100000:2.0:1746129743.551162:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+14:1961:x1830949051983744:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129743.551177:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129743.551191:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e103200/0x48868a4e439480a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ea34 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129743.551240:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136318700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053216128:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129743.551301:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129743.551316:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10340 00000100:00100000:2.0:1746129743.551321:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+14:1961:x1830949051984000:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129743.551327:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129743.551335:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e103800/0x48868a4e439480ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ea42 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.551344:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129743.551346:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129743.551352:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e103800/0x48868a4e439480ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea42 expref: 15 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129743.551364:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e103800/0x48868a4e439480ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea42 expref: 15 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129743.551372:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e103800, rc 0) 00000100:00100000:2.0:1746129743.551388:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949051984000:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 67us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129743.551393:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10340 00000100:00100000:2.0:1746129743.551405:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10341 00000100:00100000:2.0:1746129743.551408:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949051983872:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129743.551413:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129743.551417:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e102e00/0x48868a4e439480b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ea3b expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129743.551432:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136318a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053216256:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129743.551447:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8e900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129743.552125:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.555250:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051984256 00000100:00100000:3.0:1746129743.555259:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051984256 00000100:00100000:3.0:1746129743.555297:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9752 00000100:00100000:3.0:1746129743.555304:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28376:x1830949051984256:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129743.555320:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129743.555334:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101800/0x48868a4e439480ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ea49 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.555412:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101a00/0x48868a4e439480c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.555421:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101a00/0x48868a4e439480c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.555433:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101a00/0x48868a4e439480c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.555443:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101c00/0x48868a4e439480c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.555448:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101c00/0x48868a4e439480c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.555453:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101c00/0x48868a4e439480c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.555535:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439480cf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.555542:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439480cf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.555558:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439480cf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:3.0:1746129743.555567:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129743.555626:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101a00/0x48868a4e439480c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.555632:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101a00/0x48868a4e439480c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.555638:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101a00/0x48868a4e439480c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.555642:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b101a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129743.555645:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101a00/0x48868a4e439480c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.555651:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101a00/0x48868a4e439480c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.555659:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129743.555661:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129743.555664:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101a00/0x48868a4e439480c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.555668:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101a00/0x48868a4e439480c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.555680:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101c00/0x48868a4e439480c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.555685:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101c00/0x48868a4e439480c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.555689:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101c00/0x48868a4e439480c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.555693:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b101c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129743.555695:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101c00/0x48868a4e439480c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.555699:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101c00/0x48868a4e439480c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.555703:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009c253d00) 00010000:00010000:3.0:1746129743.555705:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129743.555707:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101c00/0x48868a4e439480c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.555711:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101c00/0x48868a4e439480c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129743.555739:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101800/0x48868a4e439480ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea49 expref: 13 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.555749:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439480cf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea49 expref: 12 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.555754:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129743.555756:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129743.555758:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b101e00, rc 0) 00000100:00100000:3.0:1746129743.555789:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28376:x1830949051984256:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 486us (4804us total) trans 8589943516 rc 0/0 00000100:00100000:3.0:1746129743.555795:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9752 00002000:00010000:3.0:1746129743.555843:0:8435:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime: 1746129743 -> 1746129744 00002000:00010000:3.0:1746129743.555867:0:8435:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime: 1746129743 -> 1746129744 00002000:00010000:3.0:1746129743.555869:0:8435:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime: 1746129743 -> 1746129744 00000100:00100000:3.0:1746129743.555881:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053216000:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129743.555900:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e102600/0x48868a4e4394809e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea26 expref: 19 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129743.555909:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e102600/0x48868a4e4394809e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea26 expref: 19 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129743.555916:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e102600, rc 0) 00000100:00100000:3.0:1746129743.555934:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949051982464:12345-192.168.204.31@tcp:101:cat.0 Request processed in 13233us (13456us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129743.555942:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10338 00000100:00100000:2.0:1746129743.556019:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053215872:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129743.556034:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013585b600/0x48868a4e43948090 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea1f expref: 17 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129743.556041:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013585b600/0x48868a4e43948090 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea1f expref: 17 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129743.556058:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013585b600, rc 0) 00000100:00100000:2.0:1746129743.556073:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949051982336:12345-192.168.204.31@tcp:101:cat.0 Request processed in 13613us (15057us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129743.556077:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10336 00000100:00100000:1.0:1746129743.557999:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949051982848:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15336us (15493us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129743.558007:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3804 00002000:00100000:1.0:1746129743.558015:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009f6a4380 x1830949051982848/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/440 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129743.558023:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a4380 with x1830949051982848 ext(2097152->3145727) 00002000:00010000:1.0:1746129743.558027:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a4380 00000100:00100000:3.0:1746129743.558646:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136318700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053216128:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129743.558675:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e103200/0x48868a4e439480a5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea34 expref: 16 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129743.558687:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e103200/0x48868a4e439480a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea34 expref: 16 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129743.558697:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e103200, rc 0) 00000100:00100000:3.0:1746129743.558718:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949051983744:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 7556us (7741us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129743.558725:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10339 00000100:00100000:3.0:1746129743.558979:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136318a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053216256:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129743.558992:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e102e00/0x48868a4e439480b3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea3b expref: 14 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129743.559000:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e102e00/0x48868a4e439480b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea3b expref: 14 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129743.559007:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e102e00, rc 0) 00000100:00100000:3.0:1746129743.559038:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+13:1961:x1830949051983872:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 7627us (7990us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129743.559043:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10341 00000100:00100000:2.0:1746129743.560818:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949051983360:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17383us (18286us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129743.560826:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3806 00002000:00100000:2.0:1746129743.560835:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009c1c7b80 x1830949051983360/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/440 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.560842:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c7b80 with x1830949051983360 ext(2097152->3145727) 00002000:00010000:2.0:1746129743.560859:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1c7b80 00000100:00100000:0.0:1746129743.566410:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.566498:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051984512 00000100:00100000:2.0:1746129743.566505:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051984512 00002000:00100000:2.0:1746129743.566535:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009c1c4700 x1830949051984512/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.566543:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c4700 with x1830949051984512 ext(4194304->4964351) 00002000:00010000:2.0:1746129743.566556:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1c4700 00000100:00100000:2.0:1746129743.566580:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3808 00000100:00100000:2.0:1746129743.566586:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949051984512:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129743.575486:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.578473:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051984768 00000100:00100000:3.0:1746129743.578484:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051984768 00000100:00100000:3.0:1746129743.579702:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9753 00000100:00100000:3.0:1746129743.579717:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+7:28374:x1830949051984768:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129743.579735:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129743.579752:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101000/0x48868a4e439480dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ea50 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.579827:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100e00/0x48868a4e439480e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.579838:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43948089 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea0a expref: 8 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.579845:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439480cf lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea49 expref: 11 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.579866:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100e00/0x48868a4e439480e4 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.579892:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439480cf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea49 expref: 11 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.579902:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439480cf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea49 expref: 11 pid: 16808 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746129743.579911:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053216384:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129743.579993:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949051983104:12345-192.168.204.31@tcp:3:cat.0 Request processed in 37220us (37476us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129743.580002:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3805 00002000:00100000:2.0:1746129743.580010:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009f6a5500 x1830949051983104/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/440 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.580017:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a5500 with x1830949051983104 ext(3145728->4194303) 00002000:00010000:2.0:1746129743.580021:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a5500 00000100:00100000:1.0:1746129743.580747:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949051983616:12345-192.168.204.31@tcp:3:cat.0 Request processed in 36822us (37380us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129743.580753:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3807 00002000:00100000:1.0:1746129743.580758:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009adae680 x1830949051983616/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/440 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129743.580763:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adae680 with x1830949051983616 ext(3145728->4194303) 00002000:00010000:1.0:1746129743.580766:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adae680 00010000:00010000:3.0:1746129743.581268:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43948089 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea0a expref: 8 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.581277:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43948089 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea0a expref: 8 pid: 16808 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746129743.581287:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053216512:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129743.581310:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129743.582457:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949051984512:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15867us (16050us total) trans 0 rc 770048/770048 00000100:00100000:3.0:1746129743.582464:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3808 00002000:00100000:3.0:1746129743.582471:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009c1c4700 x1830949051984512/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/440 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129743.582478:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c4700 with x1830949051984512 ext(4194304->4964351) 00002000:00010000:3.0:1746129743.582481:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1c4700 00000100:00100000:0.0:1746129743.584099:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129743.584179:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051984896 00000100:00100000:1.0:1746129743.584187:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051984896 00010000:00010000:1.0:1746129743.584213:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439480cf lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea49 expref: 12 pid: 16808 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746129743.584238:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4973 00000100:00100000:1.0:1746129743.584246:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1963:x1830949051984896:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129743.584263:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129743.584268:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439480cf lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea49 expref: 12 pid: 16808 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746129743.584277:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439480cf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea49 expref: 12 pid: 16808 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746129743.584296:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129743.584300:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439480cf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea49 expref: 12 pid: 16808 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746129743.584301:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100e00/0x48868a4e439480e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129743.584308:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100e00/0x48868a4e439480e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129743.584313:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129743.584341:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1963:x1830949051984896:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 96us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129743.584347:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4973 00000100:00100000:3.0:1746129743.584663:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053216384:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129743.590358:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.590392:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.590432:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.590466:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051985280 00000100:00100000:0.0:1746129743.590472:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051985280 00000100:00100000:0.0:1746129743.590501:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051985536 00000100:00100000:0.0:1746129743.590502:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051985536 00000100:00100000:0.0:1746129743.590514:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10342 00000100:00100000:0.0:1746129743.590520:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949051985280:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129743.590534:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129743.590558:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fadbe00/0x48868a4e439480eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ea57 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129743.590597:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053216640:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129743.590656:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129743.590694:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10343 00000100:00100000:2.0:1746129743.590703:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949051985536:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129743.590711:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129743.590719:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e102600/0x48868a4e439480f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ea5e expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129743.590742:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053216768:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129743.590769:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8e480 going to sleep for 11 seconds 00000100:00100000:3.0:1746129743.590812:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053216512:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129743.590829:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100e00/0x48868a4e439480e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:1.0:1746129743.590884:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051985408 00000100:00100000:1.0:1746129743.590888:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051985408 00010000:00010000:1.0:1746129743.590902:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43948089 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea0a expref: 9 pid: 16808 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746129743.590927:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4974 00000100:00100000:1.0:1746129743.590932:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949051985408:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129743.590941:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129743.590945:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43948089 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea0a expref: 9 pid: 16808 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746129743.590953:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43948089 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea0a expref: 9 pid: 16808 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746129743.590966:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43948089 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea0a expref: 9 pid: 16808 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746129743.590979:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129743.590983:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100e00/0x48868a4e439480e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129743.590990:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100e00/0x48868a4e439480e4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129743.590994:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100e00/0x48868a4e439480e4 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129743.591003:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129743.591019:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949051985408:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 87us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129743.591024:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4974 00010000:00010000:3.0:1746129743.591108:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100e00/0x48868a4e439480e4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.591114:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100e00/0x48868a4e439480e4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129743.591128:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129743.591229:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101000/0x48868a4e439480dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea50 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.591257:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100e00/0x48868a4e439480e4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea50 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.591263:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129743.591266:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129743.591268:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b100e00, rc 0) 00000100:00100000:3.0:1746129743.591298:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28374:x1830949051984768:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 11585us (15820us total) trans 8589943517 rc 0/0 00000100:00100000:3.0:1746129743.591304:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9753 00000100:00100000:0.0:1746129743.591767:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.591784:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051985664 00000100:00100000:2.0:1746129743.591788:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051985664 00000100:00100000:2.0:1746129743.591815:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10344 00000100:00100000:2.0:1746129743.591821:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:28376:x1830949051985664:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129743.591829:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129743.591839:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e102800/0x48868a4e43948100 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ea65 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.591879:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013585be00/0x48868a4e43947eec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e946 expref: 14 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129743.591891:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fadb000/0x48868a4e43948074 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea11 expref: 31 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129743.591898:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013261ac00/0x48868a4e43948058 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9fc expref: 23 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129743.591903:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129743.591905:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129743.591908:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e102800/0x48868a4e43948100 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3284992->3534847] (req 3284992->3534847) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea65 expref: 23 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.591924:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013261ac00/0x48868a4e43948058 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9fc expref: 23 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129743.591933:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013261ac00/0x48868a4e43948058 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9fc expref: 23 pid: 1877 timeout: 789 lvb_type: 1 00000100:00100000:2.0:1746129743.591942:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053216896:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129743.592010:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fadb000/0x48868a4e43948074 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea11 expref: 31 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129743.592018:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fadb000/0x48868a4e43948074 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea11 expref: 31 pid: 8435 timeout: 789 lvb_type: 1 00000100:00100000:2.0:1746129743.592025:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136318a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053217024:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129743.592049:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013585be00/0x48868a4e43947eec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e946 expref: 14 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129743.592056:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013585be00/0x48868a4e43947eec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e946 expref: 14 pid: 10930 timeout: 789 lvb_type: 1 00000100:00100000:2.0:1746129743.592065:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136318700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053217152:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129743.592079:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129743.593464:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.593525:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051985152 00000100:00100000:3.0:1746129743.593530:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051985152 00002000:00100000:3.0:1746129743.593564:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009c1c7480 x1830949051985152/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129743.593572:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c7480 with x1830949051985152 ext(4194304->4964351) 00010000:00010000:3.0:1746129743.593578:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fadb000/0x48868a4e43948074 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea11 expref: 32 pid: 8435 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746129743.593587:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fadb000/0x48868a4e43948074 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea11 expref: 32 pid: 8435 timeout: 789 lvb_type: 1 00002000:00010000:3.0:1746129743.593593:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c1c7480 00000100:00100000:3.0:1746129743.593615:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 521 00000100:00100000:3.0:1746129743.593620:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1963:x1830949051985152:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129743.599063:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.599431:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053216768:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129743.599457:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e102600/0x48868a4e439480f2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea5e expref: 19 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129743.599469:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e102600/0x48868a4e439480f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea5e expref: 19 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129743.599480:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e102600, rc 0) 00000100:00100000:1.0:1746129743.599534:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053216640:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129743.599560:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fadbe00/0x48868a4e439480eb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea57 expref: 18 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129743.599575:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fadbe00/0x48868a4e439480eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea57 expref: 18 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129743.599586:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fadbe00, rc 0) 00000100:00100000:1.0:1746129743.599618:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949051985280:12345-192.168.204.31@tcp:101:cat.0 Request processed in 9097us (9267us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129743.599626:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10342 00000100:00100000:0.0:1746129743.599939:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.599968:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949051985536:12345-192.168.204.31@tcp:101:cat.0 Request processed in 9266us (9534us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129743.599972:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.599974:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10343 00000100:00100000:0.0:1746129743.599987:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051985792 00000100:00100000:0.0:1746129743.599991:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051985792 00000100:00100000:2.0:1746129743.600002:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053216896:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129743.600010:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136318a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053217024:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129743.600011:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013585be00/0x48868a4e43947eec lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e946 expref: 15 pid: 10930 timeout: 789 lvb_type: 1 00000100:00100000:2.0:1746129743.600017:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136318700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053217152:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129743.600030:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051986176 00000100:00100000:0.0:1746129743.600031:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051986176 00010000:00010000:2.0:1746129743.600034:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e102800/0x48868a4e43948100 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3284992->3534847] (req 3284992->3534847) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea65 expref: 23 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.600038:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013261ac00/0x48868a4e43948058 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9fc expref: 24 pid: 1877 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746129743.600048:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e102800, rc 0) 00000100:00100000:0.0:1746129743.600048:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4975 00000100:00100000:0.0:1746129743.600053:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949051985792:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129743.600062:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129743.600064:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:28376:x1830949051985664:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 8244us (8298us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129743.600073:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013585be00/0x48868a4e43947eec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e946 expref: 15 pid: 10930 timeout: 789 lvb_type: 1 00010000:00010000:0.0:1746129743.600081:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013585be00/0x48868a4e43947eec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e946 expref: 15 pid: 10930 timeout: 789 lvb_type: 1 00010000:00010000:0.0:1746129743.600094:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013585be00/0x48868a4e43947eec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e946 expref: 15 pid: 10930 timeout: 789 lvb_type: 1 00010000:00010000:0.0:1746129743.600105:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129743.600119:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+14:1961:x1830949051985792:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 67us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129743.600124:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4975 00000100:00100000:2.0:1746129743.600130:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10344 00000100:00100000:0.0:1746129743.600133:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4976 00000100:00100000:0.0:1746129743.600136:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1963:x1830949051986176:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129743.600141:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129743.600147:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013261ac00/0x48868a4e43948058 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9fc expref: 23 pid: 1877 timeout: 789 lvb_type: 1 00010000:00010000:0.0:1746129743.600153:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013261ac00/0x48868a4e43948058 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9fc expref: 23 pid: 1877 timeout: 789 lvb_type: 1 00010000:00010000:0.0:1746129743.600162:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013261ac00/0x48868a4e43948058 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9fc expref: 23 pid: 1877 timeout: 789 lvb_type: 1 00010000:00010000:0.0:1746129743.600168:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129743.600178:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1963:x1830949051986176:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 42us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129743.600182:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4976 00000100:00100000:3.0:1746129743.600670:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051986048 00000100:00100000:3.0:1746129743.600674:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051986048 00000100:00100000:3.0:1746129743.600710:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9754 00000100:00100000:3.0:1746129743.600716:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28374:x1830949051986048:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129743.600731:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129743.600732:0:14315:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746129743.600745:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100e00/0x48868a4e439480e4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea50 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.600755:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129743.600759:0:14315:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129743.600768:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100600/0x48868a4e43948107 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ea6c expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.600834:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100c00/0x48868a4e4394810e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.600844:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100c00/0x48868a4e4394810e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.600875:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100c00/0x48868a4e4394810e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.600885:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100c00/0x48868a4e4394810e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.600890:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100c00/0x48868a4e4394810e lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.600895:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100c00/0x48868a4e4394810e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.600900:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b100c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129743.600903:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100c00/0x48868a4e4394810e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.600909:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100c00/0x48868a4e4394810e lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.600915:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129743.600917:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129743.600919:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100c00/0x48868a4e4394810e lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.600922:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100c00/0x48868a4e4394810e lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.600939:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100600/0x48868a4e43948107 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea6c expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.600945:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100600/0x48868a4e43948107 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea6c expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.600951:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b100600, rc 0) 00000100:00100000:3.0:1746129743.601411:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+7:28374:x1830949051986048:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 693us (2354us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129743.601417:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9754 00000100:00100000:3.0:1746129743.602596:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1963:x1830949051985152:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8971us (9132us total) trans 0 rc 770048/770048 00000100:00100000:3.0:1746129743.602605:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 521 00002000:00100000:3.0:1746129743.602613:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009c1c7480 x1830949051985152/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/440 e 0 to 0 dl 1746129754 ref 1 fl Complete:H/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129743.602621:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c7480 with x1830949051985152 ext(4194304->4964351) 00010000:00010000:3.0:1746129743.602629:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fadb000/0x48868a4e43948074 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea11 expref: 32 pid: 8435 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746129743.602642:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fadb000/0x48868a4e43948074 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea11 expref: 32 pid: 8435 timeout: 789 lvb_type: 1 00002000:00010000:3.0:1746129743.602648:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c1c7480 00000100:00100000:0.0:1746129743.605251:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.605337:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051986304 00000100:00100000:2.0:1746129743.605345:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051986304 00000100:00100000:2.0:1746129743.605378:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10345 00000100:00100000:2.0:1746129743.605384:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:28368:x1830949051986304:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129743.605398:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129743.605411:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e102c00/0x48868a4e43948115 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ea73 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.605432:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129743.605434:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129743.605440:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e102c00/0x48868a4e43948115 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3534848->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea73 expref: 23 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.605452:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e102c00/0x48868a4e43948115 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3534848->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea73 expref: 23 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.605460:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e102c00, rc 0) 00000100:00100000:2.0:1746129743.605764:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:28368:x1830949051986304:12345-192.168.204.31@tcp:101:cat.0 Request processed in 379us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129743.605770:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10345 00000100:00100000:0.0:1746129743.606499:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.608962:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.609166:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051986560 00000100:00100000:2.0:1746129743.609173:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051986560 00000100:00100000:2.0:1746129743.609221:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3803 00000100:00100000:2.0:1746129743.609227:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c562450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6141239f-0c60-480d-830c-e22ba61457b0+7:28374:x1830949051986560:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:2.0:1746129743.609379:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c562450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6141239f-0c60-480d-830c-e22ba61457b0+8:28374:x1830949051986560:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 152us (2881us total) trans 8589943518 rc 0/0 00000100:00100000:2.0:1746129743.609385:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3803 00000100:00100000:3.0:1746129743.609516:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051986688 00000100:00100000:3.0:1746129743.609520:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051986688 00000100:00100000:3.0:1746129743.609539:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10346 00000100:00100000:3.0:1746129743.609544:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949051986688:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129743.609563:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129743.609575:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b100800/0x48868a4e4394811c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ea7a expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.609592:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129743.609600:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b100800/0x48868a4e4394811c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea7a expref: 33 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129743.609609:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b100800/0x48868a4e4394811c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea7a expref: 33 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129743.609616:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b100800, rc 0) 00000100:00100000:3.0:1746129743.609634:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949051986688:12345-192.168.204.31@tcp:101:cat.0 Request processed in 90us (679us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129743.609640:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10346 00000100:00100000:0.0:1746129743.610012:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.610038:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.610067:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129743.610203:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051986816 00000100:00100000:1.0:1746129743.610206:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051986816 00000100:00100000:1.0:1746129743.610224:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051986944 00000100:00100000:1.0:1746129743.610226:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051986944 00000100:00100000:1.0:1746129743.610236:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051987072 00000100:00100000:1.0:1746129743.610237:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051987072 00000100:00100000:1.0:1746129743.610542:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10347 00000100:00100000:1.0:1746129743.610559:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949051986816:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:3.0:1746129743.610564:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10348 00010000:00010000:1.0:1746129743.610568:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129743.610570:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949051986944:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129743.610577:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129743.610577:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093d56a00/0x48868a4e43948123 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ea81 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.610582:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b101200/0x48868a4e4394812a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ea88 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129743.610609:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053217280:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129743.610609:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053217408:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129743.610650:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10349 00000100:00100000:3.0:1746129743.610655:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129743.610655:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1964:x1830949051987072:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129743.610661:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129743.610665:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aba600 going to sleep for 11 seconds 00010000:00010000:1.0:1746129743.610668:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093d57200/0x48868a4e43948131 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ea8f expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129743.610682:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129743.610689:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093d57200/0x48868a4e43948131 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea8f expref: 24 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129743.610696:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093d57200/0x48868a4e43948131 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea8f expref: 24 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129743.610706:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093d57200, rc 0) 00000100:00100000:1.0:1746129743.610723:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1964:x1830949051987072:12345-192.168.204.31@tcp:101:cat.0 Request processed in 68us (655us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129743.610728:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10349 00000100:00100000:0.0:1746129743.612773:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129743.613410:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051987200 00000100:00100000:1.0:1746129743.613418:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051987200 00010000:00010000:1.0:1746129743.613446:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fadb000/0x48868a4e43948074 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea11 expref: 32 pid: 8435 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746129743.613482:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4977 00000100:00100000:1.0:1746129743.613490:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949051987200:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129743.613501:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129743.613520:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fadb000/0x48868a4e43948074 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea11 expref: 32 pid: 8435 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746129743.613530:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fadb000/0x48868a4e43948074 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea11 expref: 32 pid: 8435 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746129743.613563:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fadb000/0x48868a4e43948074 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea11 expref: 32 pid: 8435 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746129743.613576:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129743.613577:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129743.613582:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e102800/0x48868a4e43948100 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3284992->3534847] (req 3284992->3534847) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea65 expref: 22 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129743.613588:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e102800/0x48868a4e43948100 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3284992->3534847] (req 3284992->3534847) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea65 expref: 22 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129743.613613:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e102800/0x48868a4e43948100 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3284992->3534847] (req 3284992->3534847) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea65 expref: 22 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129743.613623:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adaea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053217536:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129743.613703:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aba840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129743.619085:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.619123:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.619224:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053217408:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129743.619251:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093d56a00/0x48868a4e43948123 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea81 expref: 19 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129743.619262:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093d56a00/0x48868a4e43948123 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea81 expref: 19 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129743.619271:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093d56a00, rc 0) 00000100:00100000:3.0:1746129743.619310:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949051986816:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8752us (9298us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129743.619318:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10347 00000100:00100000:3.0:1746129743.619342:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051987328 00000100:00100000:3.0:1746129743.619346:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051987328 00000100:00100000:3.0:1746129743.619370:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10350 00000100:00100000:3.0:1746129743.619375:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:28369:x1830949051987328:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129743.619387:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129743.619399:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b100000/0x48868a4e43948138 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ea96 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.619421:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129743.619423:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129743.619429:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b100000/0x48868a4e43948138 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4960256->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea96 expref: 33 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.619442:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b100000/0x48868a4e43948138 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4960256->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea96 expref: 33 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.619450:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b100000, rc 0) 00000100:00100000:3.0:1746129743.619467:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:28369:x1830949051987328:12345-192.168.204.31@tcp:101:cat.0 Request processed in 92us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129743.619471:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10350 00000100:00100000:3.0:1746129743.619494:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051987584 00000100:00100000:3.0:1746129743.619497:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051987584 00002000:00100000:3.0:1746129743.619517:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (3284992->3289087) req@ffff88009fbec000 x1830949051987584/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129743.619524:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbec000 with x1830949051987584 ext(3284992->3289087) 00002000:00010000:3.0:1746129743.619528:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbec000 00000100:00100000:3.0:1746129743.619540:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3809 00000100:00100000:3.0:1746129743.619557:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1961:x1830949051987584:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129743.619678:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1961:x1830949051987584:12345-192.168.204.31@tcp:3:cat.0 Request processed in 132us (553us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129743.619683:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3809 00002000:00100000:3.0:1746129743.619688:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (3284992->3289087) req@ffff88009fbec000 x1830949051987584/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/4536 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129743.619695:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbec000 with x1830949051987584 ext(3284992->3289087) 00002000:00010000:3.0:1746129743.619698:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbec000 00000100:00100000:1.0:1746129743.619778:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adaea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053217536:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129743.619787:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129743.619821:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949051987200:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6332us (7053us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129743.619828:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4977 00000100:00100000:2.0:1746129743.619880:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053217280:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129743.619894:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b101200/0x48868a4e4394812a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea88 expref: 17 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129743.619902:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b101200/0x48868a4e4394812a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea88 expref: 17 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129743.619917:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b101200, rc 0) 00000100:00100000:2.0:1746129743.619936:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949051986944:12345-192.168.204.31@tcp:101:cat.0 Request processed in 9366us (9897us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129743.619940:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10348 00000100:00100000:0.0:1746129743.622917:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.622994:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051987712 00000100:00100000:3.0:1746129743.623001:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051987712 00000100:00100000:3.0:1746129743.623040:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10351 00000100:00100000:3.0:1746129743.623047:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949051987712:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129743.623059:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129743.623071:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b101800/0x48868a4e4394813f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ea9d expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.623095:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b101800/0x48868a4e4394813f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea9d expref: 33 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129743.623105:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b101800/0x48868a4e4394813f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea9d expref: 33 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129743.623112:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b101800, rc 0) 00000100:00100000:3.0:1746129743.623139:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949051987712:12345-192.168.204.31@tcp:101:cat.0 Request processed in 93us (229us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129743.623144:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10351 00000100:00100000:0.0:1746129743.624404:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129743.624468:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051987968 00000100:00100000:1.0:1746129743.624473:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051987968 00002000:00100000:1.0:1746129743.624496:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (4960256->4964351) req@ffff88009fbef800 x1830949051987968/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129743.624510:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbef800 with x1830949051987968 ext(4960256->4964351) 00002000:00010000:1.0:1746129743.624514:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbef800 00000100:00100000:1.0:1746129743.624537:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3810 00000100:00100000:1.0:1746129743.624542:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1964:x1830949051987968:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129743.624692:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1964:x1830949051987968:12345-192.168.204.31@tcp:3:cat.0 Request processed in 149us (289us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129743.624697:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3810 00002000:00100000:1.0:1746129743.624701:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (4960256->4964351) req@ffff88009fbef800 x1830949051987968/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/4536 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129743.624707:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbef800 with x1830949051987968 ext(4960256->4964351) 00002000:00010000:1.0:1746129743.624710:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbef800 00000100:00100000:0.0:1746129743.627197:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.627242:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.627263:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051988352 00000100:00100000:3.0:1746129743.627269:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051988352 00002000:00100000:3.0:1746129743.627350:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (4960256->4964351) req@ffff88009fbef480 x1830949051988352/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129743.627358:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbef480 with x1830949051988352 ext(4960256->4964351) 00002000:00010000:3.0:1746129743.627363:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbef480 00000100:00100000:3.0:1746129743.627387:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051988480 00000100:00100000:3.0:1746129743.627390:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051988480 00002000:00100000:3.0:1746129743.627402:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (3530752->3534847) req@ffff880095243480 x1830949051988480/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129743.627408:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095243480 with x1830949051988480 ext(3530752->3534847) 00002000:00010000:3.0:1746129743.627411:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095243480 00000100:00100000:3.0:1746129743.627424:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3811 00000100:00100000:3.0:1746129743.627430:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949051988352:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129743.627559:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949051988352:12345-192.168.204.31@tcp:3:cat.0 Request processed in 116us (355us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129743.627566:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3811 00002000:00100000:3.0:1746129743.627571:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (4960256->4964351) req@ffff88009fbef480 x1830949051988352/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/4536 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129743.627578:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbef480 with x1830949051988352 ext(4960256->4964351) 00002000:00010000:3.0:1746129743.627580:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbef480 00000100:00100000:3.0:1746129743.627596:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3812 00000100:00100000:3.0:1746129743.627601:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1962:x1830949051988480:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129743.627656:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1962:x1830949051988480:12345-192.168.204.31@tcp:3:cat.0 Request processed in 55us (414us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129743.627662:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3812 00002000:00100000:3.0:1746129743.627667:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (3530752->3534847) req@ffff880095243480 x1830949051988480/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/4536 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129743.627673:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095243480 with x1830949051988480 ext(3530752->3534847) 00002000:00010000:3.0:1746129743.627676:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095243480 00000100:00100000:0.0:1746129743.637937:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.638505:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129743.639000:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051988736 00000100:00100000:1.0:1746129743.639008:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051988736 00000100:00100000:1.0:1746129743.639044:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051988992 00000100:00100000:1.0:1746129743.639046:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051988992 00000100:00100000:1.0:1746129743.639061:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3804 00000100:00100000:1.0:1746129743.639068:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28369:x1830949051988736:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129743.639231:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28369:x1830949051988736:12345-192.168.204.31@tcp:35:cat.0 Request processed in 163us (1301us total) trans 8589943519 rc 0/0 00000100:00100000:1.0:1746129743.639238:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3804 00000100:00100000:1.0:1746129743.639252:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3805 00000100:00100000:1.0:1746129743.639270:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28376:x1830949051988992:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129743.639332:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28376:x1830949051988992:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 74us (827us total) trans 8589943520 rc 0/0 00000100:00100000:1.0:1746129743.639338:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3805 00000100:00100000:0.0:1746129743.708975:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.709341:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051989248 00000100:00100000:3.0:1746129743.709350:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051989248 00000100:00100000:3.0:1746129743.709401:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9755 00000100:00100000:3.0:1746129743.709410:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28382:x1830949051989248:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129743.709430:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129743.709444:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101400/0x48868a4e43948146 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eaa4 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.709529:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101800/0x48868a4e4394814d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.709540:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101800/0x48868a4e4394814d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.709558:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101800/0x48868a4e4394814d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.709568:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101600/0x48868a4e43948154 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.709574:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101600/0x48868a4e43948154 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.709578:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101600/0x48868a4e43948154 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.709661:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101a00/0x48868a4e4394815b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.709668:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101a00/0x48868a4e4394815b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.709677:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101a00/0x48868a4e4394815b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129743.709684:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129743.709750:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101800/0x48868a4e4394814d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.709755:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101800/0x48868a4e4394814d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.709760:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101800/0x48868a4e4394814d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.709765:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b101800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129743.709768:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101800/0x48868a4e4394814d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.709773:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101800/0x48868a4e4394814d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.709781:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129743.709783:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129743.709787:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101800/0x48868a4e4394814d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.709791:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101800/0x48868a4e4394814d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.711844:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101600/0x48868a4e43948154 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.711866:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101600/0x48868a4e43948154 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.711876:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101600/0x48868a4e43948154 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.711880:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b101600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129743.711884:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101600/0x48868a4e43948154 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.711890:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101600/0x48868a4e43948154 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.711902:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009cae5300) 00010000:00010000:3.0:1746129743.711904:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129743.711907:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101600/0x48868a4e43948154 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.711911:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101600/0x48868a4e43948154 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.711963:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101400/0x48868a4e43948146 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaa4 expref: 287 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.711980:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101a00/0x48868a4e4394815b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaa4 expref: 286 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.711986:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129743.711988:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129743.711990:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b101a00, rc 0) 00000100:00100000:3.0:1746129743.712089:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:28382:x1830949051989248:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2678us (3119us total) trans 8589943521 rc 0/0 00000100:00100000:3.0:1746129743.712096:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9755 00000100:00100000:0.0:1746129743.718000:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.718117:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051989376 00000100:00100000:2.0:1746129743.718125:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051989376 00000100:00100000:2.0:1746129743.718170:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10352 00000100:00100000:2.0:1746129743.718177:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:28382:x1830949051989376:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129743.718192:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129743.718205:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e103e00/0x48868a4e43948169 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eaab expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.718226:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129743.718228:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129743.718234:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e103e00/0x48868a4e43948169 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2252800->3284991] (req 2252800->2318335) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaab expref: 33 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.718245:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e103e00/0x48868a4e43948169 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2252800->3284991] (req 2252800->2318335) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaab expref: 33 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.718254:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e103e00, rc 0) 00000100:00100000:2.0:1746129743.718297:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:28382:x1830949051989376:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 120us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129743.718302:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10352 00000100:00100000:0.0:1746129743.720934:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.721007:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051989632 00000100:00100000:2.0:1746129743.721013:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051989632 00002000:00100000:2.0:1746129743.721046:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2252800->2256895) req@ffff880095242d80 x1830949051989632/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.721054:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095242d80 with x1830949051989632 ext(2252800->2256895) 00002000:00010000:2.0:1746129743.721058:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095242d80 00000100:00100000:2.0:1746129743.721171:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3813 00000100:00100000:2.0:1746129743.721177:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949051989632:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129743.721305:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949051989632:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 127us (376us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129743.721310:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3813 00002000:00100000:2.0:1746129743.721314:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2252800->2256895) req@ffff880095242d80 x1830949051989632/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/4536 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.721321:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095242d80 with x1830949051989632 ext(2252800->2256895) 00002000:00010000:2.0:1746129743.721324:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095242d80 00000100:00100000:0.0:1746129743.723503:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129743.723649:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051989888 00000100:00100000:1.0:1746129743.723655:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051989888 00002000:00100000:1.0:1746129743.723684:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (2314240->2318335) req@ffff880095243b80 x1830949051989888/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129743.723693:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095243b80 with x1830949051989888 ext(2314240->2318335) 00002000:00010000:1.0:1746129743.723697:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095243b80 00000100:00100000:1.0:1746129743.723758:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3814 00000100:00100000:1.0:1746129743.723766:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949051989888:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129743.724151:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949051989888:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 385us (652us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129743.724157:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3814 00002000:00100000:1.0:1746129743.724163:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (2314240->2318335) req@ffff880095243b80 x1830949051989888/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/4536 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129743.724169:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095243b80 with x1830949051989888 ext(2314240->2318335) 00002000:00010000:1.0:1746129743.724171:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095243b80 00000100:00100000:0.0:1746129743.728258:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.728352:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051990144 00000100:00100000:2.0:1746129743.728359:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051990144 00000100:00100000:2.0:1746129743.728780:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3806 00000100:00100000:2.0:1746129743.728788:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:28382:x1830949051990144:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129743.729140:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:28382:x1830949051990144:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 352us (888us total) trans 8589943522 rc 0/0 00000100:00100000:2.0:1746129743.729146:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3806 00000100:00100000:0.0:1746129743.772290:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.772378:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051990400 00000100:00100000:3.0:1746129743.772386:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051990400 00000100:00100000:3.0:1746129743.772433:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9756 00000100:00100000:3.0:1746129743.772440:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:28386:x1830949051990400:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129743.772459:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129743.772474:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100200/0x48868a4e43948170 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eab2 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.772558:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100800/0x48868a4e43948177 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.772568:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100800/0x48868a4e43948177 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.772577:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100800/0x48868a4e43948177 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129743.772587:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129743.772673:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100200/0x48868a4e43948170 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eab2 expref: 290 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.772979:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100800/0x48868a4e43948177 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eab2 expref: 289 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.772987:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129743.772989:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746129743.772991:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b100800, rc 0) 00000100:00100000:3.0:1746129743.773035:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:28386:x1830949051990400:12345-192.168.204.31@tcp:101:cat.0 Request processed in 595us (751us total) trans 8589943523 rc 0/0 00000100:00100000:3.0:1746129743.773041:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9756 00000100:00100000:0.0:1746129743.779249:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.779384:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051990528 00000100:00100000:3.0:1746129743.779393:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051990528 00000100:00100000:3.0:1746129743.779429:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10353 00000100:00100000:3.0:1746129743.779436:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949051990528:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129743.779453:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129743.779466:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b100a00/0x48868a4e43948185 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eab9 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.779492:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b100a00/0x48868a4e43948185 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eab9 expref: 34 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129743.779502:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b100a00/0x48868a4e43948185 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eab9 expref: 34 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129743.779511:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b100a00, rc 0) 00000100:00100000:3.0:1746129743.779687:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949051990528:12345-192.168.204.31@tcp:101:cat.0 Request processed in 250us (444us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129743.779693:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10353 00000100:00100000:0.0:1746129743.787052:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.787085:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.787114:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129743.787188:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051990912 00000100:00100000:1.0:1746129743.787195:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051990912 00002000:00100000:1.0:1746129743.787231:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880095241f80 x1830949051990912/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129743.787239:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095241f80 with x1830949051990912 ext(0->1048575) 00002000:00010000:1.0:1746129743.787244:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095241f80 00000100:00100000:1.0:1746129743.787255:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051991168 00000100:00100000:1.0:1746129743.787257:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051991168 00002000:00100000:1.0:1746129743.787265:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1077248->2097151) req@ffff880095241c00 x1830949051991168/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129743.787271:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095241c00 with x1830949051991168 ext(1077248->2097151) 00002000:00010000:1.0:1746129743.787274:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095241c00 00000100:00100000:1.0:1746129743.787280:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051991040 00000100:00100000:1.0:1746129743.787281:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051991040 00002000:00100000:1.0:1746129743.787287:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1810431) req@ffff880095242680 x1830949051991040/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129743.787292:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095242680 with x1830949051991040 ext(1048576->1810431) 00002000:00010000:1.0:1746129743.787294:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095242680 00000100:00100000:1.0:1746129743.787303:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3815 00000100:00100000:1.0:1746129743.787309:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949051990912:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129743.788411:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3816 00000100:00100000:1.0:1746129743.788420:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949051991168:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129743.788633:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3817 00000100:00100000:2.0:1746129743.788642:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949051991040:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129743.809980:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949051991040:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21332us (22855us total) trans 0 rc 761856/761856 00000100:00100000:2.0:1746129743.809990:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3817 00002000:00100000:2.0:1746129743.810000:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1810431) req@ffff880095242680 x1830949051991040/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/440 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.810009:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095242680 with x1830949051991040 ext(1048576->1810431) 00002000:00010000:2.0:1746129743.810014:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095242680 00000100:00100000:1.0:1746129743.810321:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949051990912:12345-192.168.204.31@tcp:3:cat.0 Request processed in 23010us (23275us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129743.810328:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3815 00002000:00100000:1.0:1746129743.810333:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880095241f80 x1830949051990912/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/440 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129743.810340:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095241f80 with x1830949051990912 ext(0->1048575) 00002000:00010000:1.0:1746129743.810343:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095241f80 00000100:00100000:2.0:1746129743.815958:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949051991168:12345-192.168.204.31@tcp:3:cat.0 Request processed in 27530us (28861us total) trans 0 rc 1019904/1019904 00000100:00100000:2.0:1746129743.815968:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3816 00002000:00100000:2.0:1746129743.815979:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e7:0x0] (1077248->2097151) req@ffff880095241c00 x1830949051991168/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/440 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 1019904/1019904 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.815988:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095241c00 with x1830949051991168 ext(1077248->2097151) 00002000:00010000:2.0:1746129743.815994:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095241c00 00000100:00100000:0.0:1746129743.827390:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.827564:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051991424 00000100:00100000:3.0:1746129743.827573:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051991424 00000100:00100000:3.0:1746129743.827623:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10354 00000100:00100000:3.0:1746129743.827629:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:28386:x1830949051991424:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129743.827647:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129743.827663:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f08ee00/0x48868a4e4394818c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eac0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.827688:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e103e00/0x48868a4e43948169 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2252800->3284991] (req 2252800->2318335) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaab expref: 34 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.827696:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129743.827697:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129743.827700:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f08ee00/0x48868a4e4394818c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eac0 expref: 34 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.827729:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e103e00/0x48868a4e43948169 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2252800->3284991] (req 2252800->2318335) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaab expref: 34 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.827739:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e103e00/0x48868a4e43948169 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2252800->3284991] (req 2252800->2318335) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaab expref: 34 pid: 8436 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746129743.827750:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053217664:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129743.827824:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942540 going to sleep for 11 seconds 00000100:00100000:3.0:1746129743.831039:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053217664:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129743.831064:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f08ee00/0x48868a4e4394818c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eac0 expref: 34 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.831079:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f08ee00, rc 0) 00000100:00100000:3.0:1746129743.831116:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:28386:x1830949051991424:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3486us (3733us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129743.831124:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10354 00000100:00100000:0.0:1746129743.831363:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.831447:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051991552 00000100:00100000:2.0:1746129743.831453:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051991552 00002000:00100000:2.0:1746129743.831484:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2252800->2318335) req@ffff880095240380 x1830949051991552/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.831493:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095240380 with x1830949051991552 ext(2252800->2318335) 00010000:00010000:2.0:1746129743.831499:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e103e00/0x48868a4e43948169 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2252800->3284991] (req 2252800->2318335) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaab expref: 34 pid: 8436 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746129743.831510:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e103e00/0x48868a4e43948169 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2252800->3284991] (req 2252800->2318335) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaab expref: 34 pid: 8436 timeout: 789 lvb_type: 0 00002000:00010000:2.0:1746129743.831516:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095240380 00000100:00100000:2.0:1746129743.831555:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 522 00000100:00100000:2.0:1746129743.831562:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949051991552:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129743.834063:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949051991552:12345-192.168.204.31@tcp:4:cat.0 Request processed in 2493us (2692us total) trans 17179873007 rc 0/0 00000100:00100000:2.0:1746129743.834072:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 522 00002000:00100000:2.0:1746129743.834080:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2252800->2318335) req@ffff880095240380 x1830949051991552/t17179873007(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/448 e 0 to 0 dl 1746129754 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.834089:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095240380 with x1830949051991552 ext(2252800->2318335) 00010000:00010000:2.0:1746129743.834097:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e103e00/0x48868a4e43948169 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2252800->3284991] (req 2252800->2318335) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaab expref: 36 pid: 8436 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746129743.834109:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e103e00/0x48868a4e43948169 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2252800->3284991] (req 2252800->2318335) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaab expref: 36 pid: 8436 timeout: 789 lvb_type: 0 00002000:00010000:2.0:1746129743.834115:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095240380 00000100:00100000:0.0:1746129743.835727:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129743.835807:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051991680 00000100:00100000:1.0:1746129743.835814:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051991680 00010000:00010000:1.0:1746129743.835837:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e103e00/0x48868a4e43948169 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2252800->3284991] (req 2252800->2318335) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaab expref: 36 pid: 8436 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746129743.835880:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4978 00000100:00100000:1.0:1746129743.835886:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131462680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1963:x1830949051991680:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129743.835897:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746129743.835910:0:7108:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129743 -> 1746129744 00010000:00010000:1.0:1746129743.835915:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e103e00/0x48868a4e43948169 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2252800->3284991] (req 2252800->2318335) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaab expref: 36 pid: 8436 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746129743.835924:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e103e00/0x48868a4e43948169 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2252800->3284991] (req 2252800->2318335) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaab expref: 36 pid: 8436 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746129743.835943:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e103e00/0x48868a4e43948169 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2252800->3284991] (req 2252800->2318335) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaab expref: 36 pid: 8436 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746129743.835972:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129743.835974:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129743.835979:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f08ee00/0x48868a4e4394818c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eac0 expref: 35 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129743.835986:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f08ee00/0x48868a4e4394818c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eac0 expref: 35 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129743.836011:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f08ee00/0x48868a4e4394818c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eac0 expref: 35 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129743.836022:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adaea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053217792:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129743.836271:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1abaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129743.841483:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adaea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053217792:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129743.841503:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129743.841558:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131462680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1963:x1830949051991680:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5670us (5833us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129743.841567:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4978 00000100:00100000:0.0:1746129743.844933:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.845026:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051991936 00000100:00100000:2.0:1746129743.845032:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051991936 00002000:00100000:2.0:1746129743.845066:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880131463800 x1830949051991936/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.845075:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131463800 with x1830949051991936 ext(2097152->3145727) 00002000:00010000:2.0:1746129743.845079:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131463800 00000100:00100000:2.0:1746129743.846235:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3818 00000100:00100000:2.0:1746129743.846247:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949051991936:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129743.862563:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949051991936:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16312us (17629us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129743.862574:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3818 00002000:00100000:2.0:1746129743.862583:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880131463800 x1830949051991936/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/440 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.862591:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131463800 with x1830949051991936 ext(2097152->3145727) 00002000:00010000:2.0:1746129743.862597:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131463800 00000100:00100000:0.0:1746129743.862989:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.863046:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051992192 00000100:00100000:3.0:1746129743.863053:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051992192 00000100:00100000:3.0:1746129743.863096:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9757 00000100:00100000:3.0:1746129743.863103:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28390:x1830949051992192:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129743.863121:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129743.863136:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e800/0x48868a4e43948193 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eac7 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.863226:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e600/0x48868a4e4394819a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.863236:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e600/0x48868a4e4394819a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.863245:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e600/0x48868a4e4394819a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.863254:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e400/0x48868a4e439481a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.863259:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e400/0x48868a4e439481a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.863263:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e400/0x48868a4e439481a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.863347:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e200/0x48868a4e439481a8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.863354:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e200/0x48868a4e439481a8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.863359:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e200/0x48868a4e439481a8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129743.863365:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129743.863427:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e600/0x48868a4e4394819a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.863436:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e600/0x48868a4e4394819a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.863441:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e600/0x48868a4e4394819a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.863446:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f08e600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129743.863449:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e600/0x48868a4e4394819a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.863455:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e600/0x48868a4e4394819a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.863463:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129743.863465:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129743.863468:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e600/0x48868a4e4394819a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.863472:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e600/0x48868a4e4394819a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.863781:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e400/0x48868a4e439481a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.863786:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e400/0x48868a4e439481a1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.863791:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e400/0x48868a4e439481a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.863794:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f08e400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129743.863796:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e400/0x48868a4e439481a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.863804:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e400/0x48868a4e439481a1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.863811:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012db30100) 00010000:00010000:3.0:1746129743.863813:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129743.863815:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e400/0x48868a4e439481a1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.863820:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e400/0x48868a4e439481a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129743.863883:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e800/0x48868a4e43948193 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eac7 expref: 15 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.863893:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e200/0x48868a4e439481a8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eac7 expref: 14 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.863898:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129743.863900:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129743.863902:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f08e200, rc 0) 00000100:00100000:3.0:1746129743.863925:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28390:x1830949051992192:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 822us (936us total) trans 8589943524 rc 0/0 00000100:00100000:3.0:1746129743.863930:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9757 00000100:00100000:0.0:1746129743.869338:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.869936:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051992320 00000100:00100000:3.0:1746129743.869945:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051992320 00000100:00100000:3.0:1746129743.869997:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10355 00000100:00100000:3.0:1746129743.870005:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1963:x1830949051992320:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129743.870020:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129743.870034:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f08f200/0x48868a4e439481b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eace expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129743.870081:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053217920:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129743.871725:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19426c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129743.871949:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.872463:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.872483:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051992448 00000100:00100000:0.0:1746129743.872488:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051992448 00000100:00100000:0.0:1746129743.872515:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051992576 00000100:00100000:0.0:1746129743.872517:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051992576 00000100:00100000:0.0:1746129743.872531:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10356 00000100:00100000:0.0:1746129743.872539:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949051992448:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129743.872562:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129743.872574:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a2ea00/0x48868a4e439481bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ead5 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129743.872611:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053218048:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129743.872700:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10357 00000100:00100000:3.0:1746129743.872707:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1964:x1830949051992576:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129743.872715:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129743.872725:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f08fa00/0x48868a4e439481c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eadc expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.872742:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f08fa00/0x48868a4e439481c4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eadc expref: 24 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129743.872751:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f08fa00/0x48868a4e439481c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eadc expref: 24 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129743.872760:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f08fa00, rc 0) 00000100:00100000:3.0:1746129743.872783:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1964:x1830949051992576:12345-192.168.204.31@tcp:101:cat.0 Request processed in 77us (321us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129743.872788:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10357 00000100:00100000:3.0:1746129743.872864:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.872879:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051992704 00000100:00100000:3.0:1746129743.872883:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051992704 00000100:00100000:3.0:1746129743.872900:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10358 00000100:00100000:3.0:1746129743.872905:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:28386:x1830949051992704:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129743.872915:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129743.872921:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f08f600/0x48868a4e439481cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eae3 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.872935:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e102800/0x48868a4e43948100 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3284992->3534847] (req 3284992->3534847) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea65 expref: 22 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.872941:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129743.872942:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129743.872945:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f08f600/0x48868a4e439481cb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eae3 expref: 36 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.872962:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e102800/0x48868a4e43948100 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3284992->3534847] (req 3284992->3534847) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea65 expref: 22 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.872972:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e102800/0x48868a4e43948100 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3284992->3534847] (req 3284992->3534847) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea65 expref: 22 pid: 8435 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746129743.872980:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053218176:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129743.876466:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129743.876874:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053217920:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129743.876883:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053218048:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129743.876899:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f08f200/0x48868a4e439481b6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eace expref: 19 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129743.876899:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a2ea00/0x48868a4e439481bd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ead5 expref: 19 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129743.876910:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f08f200/0x48868a4e439481b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eace expref: 19 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129743.876910:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a2ea00/0x48868a4e439481bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ead5 expref: 19 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129743.876921:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f08f200, rc 0) 00010000:00010000:1.0:1746129743.876921:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2ea00, rc 0) 00000100:00100000:2.0:1746129743.876957:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1963:x1830949051992320:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6953us (7628us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129743.876967:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10355 00000100:00100000:1.0:1746129743.877039:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949051992448:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4499us (5091us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129743.877047:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10356 00000100:00100000:3.0:1746129743.878182:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129743.878198:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053218176:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129743.878214:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f08f600/0x48868a4e439481cb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eae3 expref: 36 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.878225:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f08f600, rc 0) 00000100:00100000:3.0:1746129743.879671:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:28386:x1830949051992704:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6762us (6821us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129743.879682:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10358 00000100:00100000:1.0:1746129743.879868:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.879911:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051992832 00000100:00100000:2.0:1746129743.879917:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051992832 00002000:00100000:2.0:1746129743.879949:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3284992->3534847) req@ffff88009adae300 x1830949051992832/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.879958:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adae300 with x1830949051992832 ext(3284992->3534847) 00010000:00010000:2.0:1746129743.879969:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e102800/0x48868a4e43948100 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3284992->3534847] (req 3284992->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea65 expref: 23 pid: 8435 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746129743.879980:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e102800/0x48868a4e43948100 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3284992->3534847] (req 3284992->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea65 expref: 23 pid: 8435 timeout: 789 lvb_type: 0 00002000:00010000:2.0:1746129743.879987:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009adae300 00000100:00100000:2.0:1746129743.880016:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 523 00000100:00100000:2.0:1746129743.880023:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1961:x1830949051992832:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129743.881275:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.881445:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051992960 00000100:00100000:3.0:1746129743.881450:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051992960 00000100:00100000:3.0:1746129743.881482:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10359 00000100:00100000:3.0:1746129743.881488:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28390:x1830949051992960:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129743.881498:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129743.881510:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f08fe00/0x48868a4e439481d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eaea expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.881530:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013585b800/0x48868a4e4394802e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d2 expref: 32 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.881537:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129743.881538:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129743.881551:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f08fe00/0x48868a4e439481d2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1810432->2097151] (req 1810432->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaea expref: 17 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.881574:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013585b800/0x48868a4e4394802e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d2 expref: 32 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.881582:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013585b800/0x48868a4e4394802e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d2 expref: 32 pid: 10930 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746129743.881592:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053218304:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129743.882147:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129743.884221:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129743.885001:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051993216 00000100:00100000:2.0:1746129743.885009:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051993216 00002000:00100000:2.0:1746129743.885041:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880131462d80 x1830949051993216/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.885050:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131462d80 with x1830949051993216 ext(0->1048575) 00002000:00010000:2.0:1746129743.885055:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131462d80 00000100:00100000:2.0:1746129743.885076:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3819 00000100:00100000:2.0:1746129743.885082:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:1963:x1830949051993216:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129743.897042:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129743.899022:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053218304:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129743.899048:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f08fe00/0x48868a4e439481d2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1810432->2097151] (req 1810432->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaea expref: 17 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129743.899064:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f08fe00, rc 0) 00000100:00100000:3.0:1746129743.899102:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28390:x1830949051992960:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 17614us (17830us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129743.899109:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10359 00000100:00100000:3.0:1746129743.903812:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051993344 00000100:00100000:3.0:1746129743.903821:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051993344 00002000:00100000:3.0:1746129743.903873:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1810432->2097151) req@ffff880131463480 x1830949051993344/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129743.903883:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131463480 with x1830949051993344 ext(1810432->2097151) 00010000:00010000:3.0:1746129743.903892:0:21600:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013585b800/0x48868a4e4394802e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d2 expref: 33 pid: 10930 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746129743.903903:0:21600:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013585b800/0x48868a4e4394802e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d2 expref: 33 pid: 10930 timeout: 789 lvb_type: 0 00002000:00010000:3.0:1746129743.903909:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131463480 00000100:00100000:3.0:1746129743.903932:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 524 00000100:00100000:3.0:1746129743.903939:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1964:x1830949051993344:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129743.905687:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+27:1961:x1830949051992832:12345-192.168.204.31@tcp:4:cat.0 Request processed in 25660us (25815us total) trans 17179873008 rc 0/0 00000100:00100000:3.0:1746129743.905695:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 523 00002000:00100000:3.0:1746129743.905703:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3284992->3534847) req@ffff88009adae300 x1830949051992832/t17179873008(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/448 e 0 to 0 dl 1746129754 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129743.905711:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adae300 with x1830949051992832 ext(3284992->3534847) 00010000:00010000:3.0:1746129743.905719:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e102800/0x48868a4e43948100 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3284992->3534847] (req 3284992->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea65 expref: 27 pid: 8435 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746129743.905729:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e102800/0x48868a4e43948100 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3284992->3534847] (req 3284992->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea65 expref: 27 pid: 8435 timeout: 789 lvb_type: 0 00002000:00010000:3.0:1746129743.905735:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009adae300 00000100:00100000:0.0:1746129743.919711:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.919734:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051993472 00000100:00100000:0.0:1746129743.919740:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051993472 00010000:00010000:0.0:1746129743.919767:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e102800/0x48868a4e43948100 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3284992->3534847] (req 3284992->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea65 expref: 27 pid: 8435 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746129743.919789:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4979 00000100:00100000:0.0:1746129743.919795:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130566850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+27:1961:x1830949051993472:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129743.919804:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129743.919820:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e102800/0x48868a4e43948100 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3284992->3534847] (req 3284992->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea65 expref: 27 pid: 8435 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746129743.919829:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e102800/0x48868a4e43948100 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3284992->3534847] (req 3284992->3534847) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea65 expref: 27 pid: 8435 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746129743.919862:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e102800/0x48868a4e43948100 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3284992->3534847] (req 3284992->3534847) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea65 expref: 27 pid: 8435 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746129743.919875:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129743.919878:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129743.919884:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f08f600/0x48868a4e439481cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eae3 expref: 35 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.919892:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f08f600/0x48868a4e439481cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eae3 expref: 35 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.919917:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f08f600/0x48868a4e439481cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eae3 expref: 35 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129743.919927:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131463b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053218432:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129743.919974:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129743.921218:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:1963:x1830949051993216:12345-192.168.204.31@tcp:3:cat.0 Request processed in 36132us (36999us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129743.921226:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3819 00002000:00100000:2.0:1746129743.921235:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880131462d80 x1830949051993216/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/440 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.921242:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131462d80 with x1830949051993216 ext(0->1048575) 00002000:00010000:2.0:1746129743.921246:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131462d80 00000100:00100000:0.0:1746129743.927379:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131463b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053218432:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129743.927397:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129743.927429:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130566850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1961:x1830949051993472:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7632us (7723us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129743.927438:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4979 00000100:00100000:2.0:1746129743.932688:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1964:x1830949051993344:12345-192.168.204.31@tcp:4:cat.0 Request processed in 28742us (35644us total) trans 21474840169 rc 0/0 00000100:00100000:2.0:1746129743.932699:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 524 00002000:00100000:2.0:1746129743.932708:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e6:0x0] (1810432->2097151) req@ffff880131463480 x1830949051993344/t21474840169(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/448 e 0 to 0 dl 1746129754 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129743.932716:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131463480 with x1830949051993344 ext(1810432->2097151) 00010000:00010000:2.0:1746129743.932726:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013585b800/0x48868a4e4394802e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d2 expref: 35 pid: 10930 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746129743.932739:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013585b800/0x48868a4e4394802e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d2 expref: 35 pid: 10930 timeout: 789 lvb_type: 0 00002000:00010000:2.0:1746129743.932746:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131463480 00000100:00100000:0.0:1746129743.934747:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.936960:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.936987:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051993856 00000100:00100000:0.0:1746129743.936994:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051993856 00000100:00100000:0.0:1746129743.937023:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10360 00000100:00100000:0.0:1746129743.937030:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28391:x1830949051993856:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129743.937043:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129743.937057:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a2ea00/0x48868a4e439481d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eaf1 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.937081:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129743.937086:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f08fe00/0x48868a4e439481d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1810432->2097151] (req 1810432->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaea expref: 18 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.937091:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746129743.937094:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a2ea00/0x48868a4e439481d9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaf1 expref: 18 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.937119:0:8435:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f08fe00/0x48868a4e439481d2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1810432->2097151] (req 1810432->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaea expref: 18 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.937129:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a2ea00/0x48868a4e439481d9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaf1 expref: 18 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.937138:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2ea00, rc 0) 00000100:00100000:0.0:1746129743.937170:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28391:x1830949051993856:12345-192.168.204.31@tcp:101:cat.0 Request processed in 141us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129743.937176:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10360 00000100:00100000:0.0:1746129743.937920:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051993728 00000100:00100000:0.0:1746129743.937925:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051993728 00002000:00100000:0.0:1746129743.937948:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880131462680 x1830949051993728/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129743.937956:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131462680 with x1830949051993728 ext(3145728->4194303) 00002000:00010000:0.0:1746129743.937960:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131462680 00000100:00100000:0.0:1746129743.937972:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3820 00000100:00100000:0.0:1746129743.937977:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1962:x1830949051993728:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129743.956175:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.956491:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051993984 00000100:00100000:0.0:1746129743.956499:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051993984 00010000:00010000:0.0:1746129743.956552:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013585b800/0x48868a4e4394802e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d2 expref: 35 pid: 10930 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746129743.956576:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4980 00000100:00100000:0.0:1746129743.956582:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131462300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949051993984:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129743.956592:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129743.956609:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88013585b800/0x48868a4e4394802e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d2 expref: 35 pid: 10930 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746129743.956620:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013585b800/0x48868a4e4394802e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d2 expref: 35 pid: 10930 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746129743.956639:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013585b800/0x48868a4e4394802e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d2 expref: 35 pid: 10930 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746129743.956652:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129743.956654:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129743.956659:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f08fe00/0x48868a4e439481d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaea expref: 17 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.956667:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f08fe00/0x48868a4e439481d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaea expref: 17 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.956694:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f08fe00/0x48868a4e439481d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaea expref: 17 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.956705:0:7108:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f08fe00/0x48868a4e439481d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaea expref: 17 pid: 8435 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746129743.956716:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053218688:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129743.956771:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129743.957159:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1962:x1830949051993728:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19180us (22414us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129743.957166:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3820 00002000:00100000:0.0:1746129743.957173:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880131462680 x1830949051993728/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/440 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129743.957181:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131462680 with x1830949051993728 ext(3145728->4194303) 00002000:00010000:0.0:1746129743.957185:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131462680 00000100:00100000:1.0:1746129743.961590:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053218688:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129743.961610:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129743.961648:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131462300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949051993984:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5065us (5481us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129743.961657:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4980 00000100:00100000:0.0:1746129743.969732:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.969940:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.969960:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051994368 00000100:00100000:0.0:1746129743.969968:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051994368 00000100:00100000:0.0:1746129743.970001:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10361 00000100:00100000:0.0:1746129743.970007:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1963:x1830949051994368:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129743.970022:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129743.970037:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135677400/0x48868a4e439481e0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eaf8 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129743.970077:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131460a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053218816:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129743.970141:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129743.970159:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051994240 00000100:00100000:0.0:1746129743.970162:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051994240 00002000:00100000:0.0:1746129743.970184:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e6:0x0] (1810432->1814527) req@ffff880131460e00 x1830949051994240/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129743.970191:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131460e00 with x1830949051994240 ext(1810432->1814527) 00010000:00010000:0.0:1746129743.970197:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f08fe00/0x48868a4e439481d2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaea expref: 18 pid: 8435 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129743.970207:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f08fe00/0x48868a4e439481d2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaea expref: 18 pid: 8435 timeout: 790 lvb_type: 0 00002000:00010000:0.0:1746129743.970213:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131460e00 00000100:00100000:0.0:1746129743.970229:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 525 00000100:00100000:0.0:1746129743.970234:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949051994240:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129743.974379:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949051994240:12345-192.168.204.31@tcp:3:cat.0 Request processed in 4139us (4648us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129743.974391:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 525 00002000:00100000:0.0:1746129743.974400:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (1810432->1814527) req@ffff880131460e00 x1830949051994240/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/4536 e 0 to 0 dl 1746129754 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129743.974408:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131460e00 with x1830949051994240 ext(1810432->1814527) 00010000:00010000:0.0:1746129743.974418:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f08fe00/0x48868a4e439481d2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaea expref: 18 pid: 8435 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129743.974430:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f08fe00/0x48868a4e439481d2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaea expref: 18 pid: 8435 timeout: 790 lvb_type: 0 00002000:00010000:0.0:1746129743.974437:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131460e00 00000100:00100000:0.0:1746129743.977100:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131460a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053218816:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129743.977129:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135677400/0x48868a4e439481e0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaf8 expref: 35 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129743.977143:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135677400/0x48868a4e439481e0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaf8 expref: 35 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129743.977151:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135677400, rc 0) 00000100:00100000:0.0:1746129743.977193:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1963:x1830949051994368:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7185us (7253us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129743.977201:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10361 00000100:00100000:0.0:1746129743.981176:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.981202:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.981233:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.981259:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051994752 00000100:00100000:0.0:1746129743.981267:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051994752 00000100:00100000:0.0:1746129743.981300:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10362 00000100:00100000:0.0:1746129743.981306:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28390:x1830949051994752:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129743.981322:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129743.981335:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135677800/0x48868a4e439481e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eaff expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.981362:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013585ac00/0x48868a4e4394803c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9e0 expref: 33 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.981373:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129743.981375:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129743.981378:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135677800/0x48868a4e439481e7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->1089535] (req 1048576->1089535) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaff expref: 19 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.981400:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013585ac00/0x48868a4e4394803c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9e0 expref: 33 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.981408:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013585ac00/0x48868a4e4394803c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9e0 expref: 33 pid: 3623 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746129743.981418:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053218944:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129743.981468:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129743.981524:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051994624 00000100:00100000:0.0:1746129743.981527:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051994624 00002000:00100000:0.0:1746129743.981560:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e6:0x0] (1810432->2097151) req@ffff880131460380 x1830949051994624/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129743.981569:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131460380 with x1830949051994624 ext(1810432->2097151) 00010000:00010000:0.0:1746129743.981575:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f08fe00/0x48868a4e439481d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaea expref: 20 pid: 8435 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129743.981584:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f08fe00/0x48868a4e439481d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaea expref: 20 pid: 8435 timeout: 790 lvb_type: 0 00002000:00010000:0.0:1746129743.981589:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131460380 00000100:00100000:0.0:1746129743.981603:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 526 00000100:00100000:0.0:1746129743.981609:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949051994624:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129743.984634:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051995008 00000100:00100000:2.0:1746129743.984644:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051995008 00000100:00100000:2.0:1746129743.984682:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9758 00000100:00100000:2.0:1746129743.984690:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:28393:x1830949051995008:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129743.984710:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129743.984724:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101000/0x48868a4e439481ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eb06 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.984798:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439481f5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129743.984811:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101a00/0x48868a4e4394815b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaa4 expref: 290 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.984818:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e200/0x48868a4e439481a8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eac7 expref: 13 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.984823:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439481f5 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129743.984863:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e200/0x48868a4e439481a8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eac7 expref: 13 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.984872:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e200/0x48868a4e439481a8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eac7 expref: 13 pid: 14315 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129743.984882:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136318700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053219072:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129743.989468:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101a00/0x48868a4e4394815b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaa4 expref: 290 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129743.989485:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101a00/0x48868a4e4394815b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaa4 expref: 290 pid: 14315 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129743.989498:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136318a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053219200:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129743.989533:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129743.994234:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.994256:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129743.994295:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051995392 00000100:00100000:0.0:1746129743.994301:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051995392 00002000:00100000:0.0:1746129743.994335:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4960255) req@ffff88009fbed180 x1830949051995392/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129743.994344:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbed180 with x1830949051995392 ext(4194304->4960255) 00002000:00010000:0.0:1746129743.994348:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbed180 00000100:00100000:0.0:1746129743.994360:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051995136 00000100:00100000:0.0:1746129743.994363:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051995136 00002000:00100000:0.0:1746129743.994372:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->1077247) req@ffff88009fbefb80 x1830949051995136/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/0 e 0 to 0 dl 1746129754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129743.994378:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbefb80 with x1830949051995136 ext(1048576->1077247) 00010000:00010000:0.0:1746129743.994384:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013585ac00/0x48868a4e4394803c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9e0 expref: 34 pid: 3623 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129743.994400:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013585ac00/0x48868a4e4394803c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9e0 expref: 34 pid: 3623 timeout: 790 lvb_type: 0 00002000:00010000:0.0:1746129743.994405:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fbefb80 00000100:00100000:0.0:1746129743.994418:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 527 00000100:00100000:0.0:1746129743.994428:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1964:x1830949051995136:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129743.994557:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053218944:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129743.994576:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135677800/0x48868a4e439481e7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->1089535] (req 1048576->1089535) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaff expref: 21 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129743.994587:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135677800, rc 0) 00000100:00100000:0.0:1746129743.994605:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:28390:x1830949051994752:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 13299us (13372us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129743.994611:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10362 00000100:00100000:3.0:1746129743.995435:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3821 00000100:00100000:3.0:1746129743.995443:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949051995392:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129743.999978:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.000387:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1964:x1830949051995136:12345-192.168.204.31@tcp:4:cat.0 Request processed in 5957us (6128us total) trans 21474840170 rc 0/0 00000100:00100000:0.0:1746129744.000397:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 527 00002000:00100000:0.0:1746129744.000407:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->1077247) req@ffff88009fbefb80 x1830949051995136/t21474840170(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/448 e 0 to 0 dl 1746129754 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129744.000415:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbefb80 with x1830949051995136 ext(1048576->1077247) 00010000:00010000:0.0:1746129744.000424:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013585ac00/0x48868a4e4394803c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9e0 expref: 36 pid: 3623 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.000435:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013585ac00/0x48868a4e4394803c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9e0 expref: 36 pid: 3623 timeout: 790 lvb_type: 0 00002000:00010000:0.0:1746129744.000441:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fbefb80 00000100:00100000:0.0:1746129744.001207:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1964:x1830949051994624:12345-192.168.204.31@tcp:4:cat.0 Request processed in 19595us (20001us total) trans 21474840171 rc 0/0 00000100:00100000:0.0:1746129744.001213:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 526 00002000:00100000:0.0:1746129744.001218:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e6:0x0] (1810432->2097151) req@ffff880131460380 x1830949051994624/t21474840171(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:484/0 lens 488/448 e 0 to 0 dl 1746129754 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129744.001225:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131460380 with x1830949051994624 ext(1810432->2097151) 00010000:00010000:0.0:1746129744.001230:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f08fe00/0x48868a4e439481d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaea expref: 21 pid: 8435 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.001238:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f08fe00/0x48868a4e439481d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaea expref: 21 pid: 8435 timeout: 790 lvb_type: 0 00002000:00010000:0.0:1746129744.001243:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131460380 00000100:00100000:1.0:1746129744.001438:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051995520 00000100:00100000:1.0:1746129744.001445:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051995520 00010000:00010000:1.0:1746129744.001466:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101a00/0x48868a4e4394815b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaa4 expref: 291 pid: 14315 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746129744.001486:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4981 00000100:00100000:1.0:1746129744.001491:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:1961:x1830949051995520:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129744.001502:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129744.001507:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101a00/0x48868a4e4394815b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaa4 expref: 291 pid: 14315 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746129744.001515:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101a00/0x48868a4e4394815b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaa4 expref: 291 pid: 14315 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746129744.001534:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129744.001549:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439481f5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129744.001555:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439481f5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129744.001559:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129744.001577:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:1961:x1830949051995520:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 86us (1606us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129744.001582:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4981 00000100:00100000:3.0:1746129744.004772:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136318700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053219072:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129744.004787:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101a00/0x48868a4e4394815b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaa4 expref: 290 pid: 14315 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746129744.004802:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136318a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053219200:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129744.004822:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439481f5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:2.0:1746129744.005751:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.005830:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.005870:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051995648 00000100:00100000:2.0:1746129744.005875:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051995648 00010000:00010000:2.0:1746129744.005900:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e200/0x48868a4e439481a8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eac7 expref: 14 pid: 14315 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.005919:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051995776 00000100:00100000:2.0:1746129744.005921:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051995776 00010000:00010000:2.0:1746129744.005931:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013585ac00/0x48868a4e4394803c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9e0 expref: 36 pid: 3623 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.005945:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4982 00000100:00100000:2.0:1746129744.005951:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949051995648:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129744.005963:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.005967:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e200/0x48868a4e439481a8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eac7 expref: 14 pid: 14315 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.005975:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e200/0x48868a4e439481a8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eac7 expref: 14 pid: 14315 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.005992:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f08e200/0x48868a4e439481a8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eac7 expref: 14 pid: 14315 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.006002:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129744.006007:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439481f5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.006014:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439481f5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.006020:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439481f5 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.006034:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129744.006063:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949051995648:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 112us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.006068:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4982 00000100:00100000:2.0:1746129744.006079:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4983 00000100:00100000:2.0:1746129744.006084:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1964:x1830949051995776:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129744.006090:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.006107:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013585ac00/0x48868a4e4394803c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9e0 expref: 36 pid: 3623 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.006115:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013585ac00/0x48868a4e4394803c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9e0 expref: 36 pid: 3623 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.006127:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013585ac00/0x48868a4e4394803c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9e0 expref: 36 pid: 3623 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.006136:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.006137:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.006142:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135677800/0x48868a4e439481e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaff expref: 20 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.006149:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135677800/0x48868a4e439481e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaff expref: 20 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.006173:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135677800/0x48868a4e439481e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaff expref: 20 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129744.006183:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053219328:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129744.006226:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8e900 going to sleep for 11 seconds 00010000:00010000:3.0:1746129744.006363:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439481f5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.006369:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439481f5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:3.0:1746129744.006384:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129744.006490:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101000/0x48868a4e439481ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb06 expref: 291 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.006501:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439481f5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb06 expref: 290 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.006507:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129744.006509:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129744.006511:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b101e00, rc 0) 00000100:00100000:3.0:1746129744.006556:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:28393:x1830949051995008:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 21866us (25387us total) trans 8589943525 rc 0/0 00000100:00100000:3.0:1746129744.006563:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9758 00010000:00010000:2.0:1746129744.013111:0:12137:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129744.013779:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.014124:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051995904 00000100:00100000:2.0:1746129744.014132:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051995904 00010000:00010000:2.0:1746129744.014165:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f08fe00/0x48868a4e439481d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaea expref: 21 pid: 8435 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.014190:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4984 00000100:00100000:2.0:1746129744.014196:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1962:x1830949051995904:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129744.014208:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.014225:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f08fe00/0x48868a4e439481d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaea expref: 21 pid: 8435 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.014235:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f08fe00/0x48868a4e439481d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaea expref: 21 pid: 8435 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.014252:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f08fe00/0x48868a4e439481d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaea expref: 21 pid: 8435 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.014265:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.014266:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.014272:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a2ea00/0x48868a4e439481d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaf1 expref: 20 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.014279:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a2ea00/0x48868a4e439481d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaf1 expref: 20 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.014307:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130a2ea00/0x48868a4e439481d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaf1 expref: 20 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129744.014317:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136318a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053219456:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129744.014368:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129744.016406:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949051995392:12345-192.168.204.31@tcp:3:cat.0 Request processed in 20959us (22173us total) trans 0 rc 765952/765952 00000100:00100000:3.0:1746129744.016415:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3821 00002000:00100000:3.0:1746129744.016423:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4960255) req@ffff88009fbed180 x1830949051995392/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:484/0 lens 488/440 e 0 to 0 dl 1746129754 ref 1 fl Complete:/200/0 rc 765952/765952 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129744.016431:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbed180 with x1830949051995392 ext(4194304->4960255) 00002000:00010000:3.0:1746129744.016436:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbed180 00000100:00100000:0.0:1746129744.017244:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.017293:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051996160 00000100:00100000:2.0:1746129744.017300:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051996160 00002000:00100000:2.0:1746129744.017326:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e7:0x0] (1085440->1089535) req@ffff88009be65c00 x1830949051996160/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129744.017333:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be65c00 with x1830949051996160 ext(1085440->1089535) 00002000:00010000:2.0:1746129744.017336:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009be65c00 00000100:00100000:2.0:1746129744.017348:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3822 00000100:00100000:2.0:1746129744.017353:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1961:x1830949051996160:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129744.017640:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1961:x1830949051996160:12345-192.168.204.31@tcp:3:cat.0 Request processed in 285us (396us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129744.017645:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3822 00002000:00100000:2.0:1746129744.017651:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e7:0x0] (1085440->1089535) req@ffff88009be65c00 x1830949051996160/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/4536 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129744.017657:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be65c00 with x1830949051996160 ext(1085440->1089535) 00002000:00010000:2.0:1746129744.017660:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009be65c00 00000100:00100000:2.0:1746129744.017693:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136318a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053219456:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129744.017707:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129744.017727:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949051995904:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3531us (3953us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.017733:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4984 00000100:00100000:3.0:1746129744.018036:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053219328:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129744.018047:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129744.018068:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1964:x1830949051995776:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 11983us (12238us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.018074:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4983 00000100:00100000:1.0:1746129744.026494:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.026530:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.026560:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051996288 00000100:00100000:1.0:1746129744.026567:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051996288 00000100:00100000:1.0:1746129744.026598:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051996416 00000100:00100000:1.0:1746129744.026600:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051996416 00000100:00100000:1.0:1746129744.026612:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10363 00000100:00100000:1.0:1746129744.026619:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949051996288:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129744.026633:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129744.026646:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b101c00/0x48868a4e43948203 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eb0d expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.026668:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129744.026670:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129744.026677:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b101c00/0x48868a4e43948203 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb0d expref: 37 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.026690:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b101c00/0x48868a4e43948203 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb0d expref: 37 pid: 8435 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129744.026698:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10364 00010000:00010000:1.0:1746129744.026699:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b101c00, rc 0) 00000100:00100000:0.0:1746129744.026704:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1961:x1830949051996416:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129744.026711:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.026717:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093d57600/0x48868a4e4394820a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eb14 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.026732:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1961:x1830949051996288:12345-192.168.204.31@tcp:101:cat.0 Request processed in 114us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129744.026737:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10363 00000100:00100000:0.0:1746129744.026748:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be64380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053219584:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129744.026784:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.029627:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.029776:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be64380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053219584:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129744.029800:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093d57600/0x48868a4e4394820a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb14 expref: 37 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.029812:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093d57600/0x48868a4e4394820a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb14 expref: 37 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.029821:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093d57600, rc 0) 00000100:00100000:1.0:1746129744.031409:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051996672 00000100:00100000:1.0:1746129744.031418:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051996672 00002000:00100000:1.0:1746129744.031456:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009be64700 x1830949051996672/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129744.031465:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be64700 with x1830949051996672 ext(1048576->2097151) 00002000:00010000:1.0:1746129744.031469:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009be64700 00000100:00100000:1.0:1746129744.031502:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3823 00000100:00100000:1.0:1746129744.031509:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949051996672:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129744.032143:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949051996416:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5436us (5610us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129744.032151:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10364 00000100:00100000:1.0:1746129744.034354:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.034996:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051996928 00000100:00100000:3.0:1746129744.035004:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051996928 00000100:00100000:3.0:1746129744.035050:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3807 00000100:00100000:3.0:1746129744.035058:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28390:x1830949051996928:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129744.035208:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28390:x1830949051996928:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 149us (858us total) trans 8589943526 rc 0/0 00000100:00100000:3.0:1746129744.035214:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3807 00000100:00100000:0.0:1746129744.042733:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.043437:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051997056 00000100:00100000:0.0:1746129744.043447:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051997056 00000100:00100000:0.0:1746129744.043492:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10365 00000100:00100000:0.0:1746129744.043502:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1962:x1830949051997056:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129744.043520:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.043551:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093d56e00/0x48868a4e43948211 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eb1b expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.043609:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be64380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053219712:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129744.043695:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1abac00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129744.050798:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949051996672:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19282us (21173us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129744.050810:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3823 00002000:00100000:3.0:1746129744.050818:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009be64700 x1830949051996672/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129744.050826:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be64700 with x1830949051996672 ext(1048576->2097151) 00002000:00010000:3.0:1746129744.050831:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009be64700 00000100:00100000:0.0:1746129744.051240:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be64380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053219712:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129744.051262:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093d56e00/0x48868a4e43948211 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb1b expref: 37 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.051274:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093d56e00/0x48868a4e43948211 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb1b expref: 37 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.051282:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093d56e00, rc 0) 00000100:00100000:0.0:1746129744.051310:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1962:x1830949051997056:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7811us (8587us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129744.051316:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10365 00000100:00100000:0.0:1746129744.063922:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.064115:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051997312 00000100:00100000:3.0:1746129744.064124:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051997312 00002000:00100000:3.0:1746129744.064160:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1089536->2097151) req@ffff88009be64380 x1830949051997312/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129744.064168:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be64380 with x1830949051997312 ext(1089536->2097151) 00002000:00010000:3.0:1746129744.064173:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009be64380 00000100:00100000:3.0:1746129744.064200:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3824 00000100:00100000:3.0:1746129744.064206:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949051997312:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129744.065362:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000001:00080000:2.0:1746129744.065786:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872987 is committed 00000001:00080000:2.0:1746129744.065800:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872977 is committed 00000001:00080000:2.0:1746129744.065808:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872964 is committed 00000001:00080000:2.0:1746129744.065827:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872929 is committed 00000001:00080000:2.0:1746129744.065834:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872998 is committed 00000001:00080000:2.0:1746129744.065920:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873007 is committed 00000001:00080000:2.0:1746129744.065927:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873006 is committed 00000001:00080000:2.0:1746129744.065932:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873005 is committed 00000001:00080000:2.0:1746129744.065964:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872978 is committed 00000100:00100000:2.0:1746129744.066059:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051997568 00000100:00100000:2.0:1746129744.066066:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051997568 00002000:00100000:2.0:1746129744.066097:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009adaf480 x1830949051997568/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129744.066106:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adaf480 with x1830949051997568 ext(1048576->2097151) 00002000:00010000:2.0:1746129744.066110:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adaf480 00000100:00100000:2.0:1746129744.066135:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3825 00000100:00100000:2.0:1746129744.066143:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949051997568:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129744.081897:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949051997568:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15749us (16531us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129744.081905:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3825 00002000:00100000:0.0:1746129744.081913:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009adaf480 x1830949051997568/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129744.081919:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adaf480 with x1830949051997568 ext(1048576->2097151) 00002000:00010000:0.0:1746129744.081923:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adaf480 00000100:00100000:3.0:1746129744.085266:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949051997312:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21053us (21344us total) trans 0 rc 1007616/1007616 00000100:00100000:3.0:1746129744.085274:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3824 00002000:00100000:3.0:1746129744.085282:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1089536->2097151) req@ffff88009be64380 x1830949051997312/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 1007616/1007616 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129744.085292:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be64380 with x1830949051997312 ext(1089536->2097151) 00002000:00010000:3.0:1746129744.085296:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009be64380 00000100:00100000:0.0:1746129744.095427:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.095535:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051997696 00000100:00100000:2.0:1746129744.095551:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051997696 00000100:00100000:2.0:1746129744.095589:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10366 00000100:00100000:2.0:1746129744.095596:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28391:x1830949051997696:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129744.095612:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129744.095626:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa78600/0x48868a4e43948218 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eb22 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.095645:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.095647:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.095654:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa78600/0x48868a4e43948218 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb22 expref: 11 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.095665:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa78600/0x48868a4e43948218 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb22 expref: 11 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.095673:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa78600, rc 0) 00000100:00100000:2.0:1746129744.096285:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28391:x1830949051997696:12345-192.168.204.31@tcp:101:cat.0 Request processed in 687us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.096291:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10366 00000100:00100000:0.0:1746129744.101740:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.101775:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.101800:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051997952 00000100:00100000:3.0:1746129744.101808:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051997952 00002000:00100000:3.0:1746129744.101843:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009be65180 x1830949051997952/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129744.101883:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be65180 with x1830949051997952 ext(2097152->3145727) 00002000:00010000:3.0:1746129744.101888:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009be65180 00000100:00100000:3.0:1746129744.101915:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051998080 00000100:00100000:3.0:1746129744.101918:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051998080 00002000:00100000:3.0:1746129744.101930:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009be66a00 x1830949051998080/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129744.101936:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be66a00 with x1830949051998080 ext(3145728->4194303) 00002000:00010000:3.0:1746129744.101938:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009be66a00 00000100:00100000:3.0:1746129744.101951:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3826 00000100:00100000:3.0:1746129744.101958:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1963:x1830949051997952:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129744.102094:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3827 00000100:00100000:1.0:1746129744.102101:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1964:x1830949051998080:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129744.112611:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1963:x1830949051997952:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10645us (10869us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129744.112621:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3826 00002000:00100000:3.0:1746129744.112630:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009be65180 x1830949051997952/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129744.112638:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be65180 with x1830949051997952 ext(2097152->3145727) 00002000:00010000:3.0:1746129744.112643:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009be65180 00000100:00100000:2.0:1746129744.119686:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949051998080:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17579us (17902us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129744.119696:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3827 00002000:00100000:2.0:1746129744.119705:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009be66a00 x1830949051998080/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129744.119713:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be66a00 with x1830949051998080 ext(3145728->4194303) 00002000:00010000:2.0:1746129744.119718:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009be66a00 00000100:00100000:0.0:1746129744.129545:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.129693:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051998336 00000100:00100000:2.0:1746129744.129724:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051998336 00000100:00100000:2.0:1746129744.129824:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10367 00000100:00100000:2.0:1746129744.129831:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:28393:x1830949051998336:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129744.129865:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129744.129879:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b101600/0x48868a4e4394821f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eb29 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.129903:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f08f600/0x48868a4e439481cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eae3 expref: 23 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.129911:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa78600/0x48868a4e43948218 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb22 expref: 10 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.129916:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e102c00/0x48868a4e43948115 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3534848->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea73 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.129921:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129744.129922:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129744.129925:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b101600/0x48868a4e4394821f lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3698688->4194303] (req 3698688->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb29 expref: 23 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.129945:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e102c00/0x48868a4e43948115 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3534848->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea73 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.129954:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e102c00/0x48868a4e43948115 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3534848->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea73 expref: 10 pid: 8435 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.129963:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136318a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053219840:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.130944:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa78600/0x48868a4e43948218 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb22 expref: 10 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.130958:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa78600/0x48868a4e43948218 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb22 expref: 10 pid: 3624 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.130967:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136318700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053219968:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129744.132041:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129744.132156:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f08f600/0x48868a4e439481cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eae3 expref: 23 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.132166:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f08f600/0x48868a4e439481cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eae3 expref: 23 pid: 8435 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.132174:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053220096:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129744.132300:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129744.133810:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051998592 00000100:00100000:3.0:1746129744.133818:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051998592 00002000:00100000:3.0:1746129744.133883:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4960255) req@ffff88009adaea00 x1830949051998592/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129744.133891:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adaea00 with x1830949051998592 ext(4194304->4960255) 00010000:00010000:3.0:1746129744.133898:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa78600/0x48868a4e43948218 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb22 expref: 11 pid: 3624 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746129744.133907:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa78600/0x48868a4e43948218 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb22 expref: 11 pid: 3624 timeout: 790 lvb_type: 0 00002000:00010000:3.0:1746129744.133912:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009adaea00 00000100:00100000:3.0:1746129744.133931:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 528 00000100:00100000:3.0:1746129744.133938:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949051998592:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129744.135329:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.135361:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051998720 00000100:00100000:1.0:1746129744.135366:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051998720 00010000:00010000:1.0:1746129744.135387:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e102c00/0x48868a4e43948115 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3534848->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea73 expref: 13 pid: 8435 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746129744.135405:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4985 00000100:00100000:1.0:1746129744.135410:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1964:x1830949051998720:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129744.135418:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746129744.135429:0:7109:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5671 -> 5673 00010000:00010000:1.0:1746129744.135434:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e102c00/0x48868a4e43948115 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [3534848->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea73 expref: 13 pid: 8435 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746129744.135444:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e102c00/0x48868a4e43948115 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [3534848->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea73 expref: 13 pid: 8435 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746129744.135465:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129744.135497:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1964:x1830949051998720:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 87us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129744.135503:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4985 00010000:00010000:1.0:1746129744.135554:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e102c00/0x48868a4e43948115 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3534848->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea73 expref: 12 pid: 8435 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746129744.135568:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136318a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053219840:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129744.135576:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136318700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053219968:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129744.135584:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053220096:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129744.135607:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b101600/0x48868a4e4394821f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3698688->4194303] (req 3698688->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb29 expref: 23 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.135616:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b101600, rc 0) 00000100:00100000:1.0:1746129744.135633:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:28393:x1830949051998336:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5803us (6104us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129744.135638:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10367 00000100:00100000:0.0:1746129744.141447:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.141516:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051998848 00000100:00100000:2.0:1746129744.141524:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051998848 00010000:00010000:2.0:1746129744.141563:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f08f600/0x48868a4e439481cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eae3 expref: 23 pid: 8435 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.141925:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4986 00000100:00100000:2.0:1746129744.141934:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130566450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949051998848:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129744.141946:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.141963:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f08f600/0x48868a4e439481cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eae3 expref: 23 pid: 8435 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.141974:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f08f600/0x48868a4e439481cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eae3 expref: 23 pid: 8435 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.141994:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f08f600/0x48868a4e439481cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eae3 expref: 23 pid: 8435 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.142021:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129744.142052:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130566450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949051998848:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 120us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.142058:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4986 00000100:00100000:3.0:1746129744.143400:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949051998592:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9457us (11354us total) trans 0 rc 765952/765952 00000100:00100000:3.0:1746129744.143410:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 528 00002000:00100000:3.0:1746129744.143418:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4960255) req@ffff88009adaea00 x1830949051998592/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:H/200/0 rc 765952/765952 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129744.143427:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adaea00 with x1830949051998592 ext(4194304->4960255) 00010000:00010000:3.0:1746129744.143434:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa78600/0x48868a4e43948218 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb22 expref: 10 pid: 3624 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746129744.143446:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa78600/0x48868a4e43948218 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb22 expref: 10 pid: 3624 timeout: 790 lvb_type: 0 00002000:00010000:3.0:1746129744.143456:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009adaea00 00000100:00100000:1.0:1746129744.156772:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.156845:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.156882:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051999104 00000100:00100000:1.0:1746129744.156889:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051999104 00010000:00010000:1.0:1746129744.156916:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa78600/0x48868a4e43948218 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb22 expref: 10 pid: 3624 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746129744.156942:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4987 00000100:00100000:1.0:1746129744.156949:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949051999104:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129744.157247:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051998976 00000100:00100000:0.0:1746129744.157250:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051998976 00000100:00100000:0.0:1746129744.157271:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10368 00000100:00100000:0.0:1746129744.157276:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1963:x1830949051998976:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129744.157288:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.157298:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093d56c00/0x48868a4e43948226 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eb30 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.157313:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.157321:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093d56c00/0x48868a4e43948226 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb30 expref: 12 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.157333:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093d56c00/0x48868a4e43948226 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb30 expref: 12 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.157344:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093d56c00, rc 0) 00000100:00100000:0.0:1746129744.157379:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1963:x1830949051998976:12345-192.168.204.31@tcp:101:cat.0 Request processed in 102us (615us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129744.157384:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10368 00010000:00010000:1.0:1746129744.158052:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129744.158073:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa78600/0x48868a4e43948218 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb22 expref: 10 pid: 3624 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746129744.158084:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa78600/0x48868a4e43948218 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb22 expref: 10 pid: 3624 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746129744.158098:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa78600/0x48868a4e43948218 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb22 expref: 10 pid: 3624 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746129744.158124:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129744.158126:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129744.158132:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b101600/0x48868a4e4394821f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3698688->4960255] (req 3698688->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb29 expref: 21 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.158138:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b101600/0x48868a4e4394821f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3698688->4960255] (req 3698688->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb29 expref: 21 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.158164:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b101600/0x48868a4e4394821f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3698688->4960255] (req 3698688->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb29 expref: 21 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.158173:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053220224:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129744.158556:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.166588:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.166729:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053220224:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129744.166747:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129744.166780:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1961:x1830949051999104:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 9832us (9935us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129744.166790:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4987 00000100:00100000:1.0:1746129744.166881:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.167333:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051999488 00000100:00100000:0.0:1746129744.167337:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051999488 00000100:00100000:0.0:1746129744.167363:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10369 00000100:00100000:0.0:1746129744.167369:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28391:x1830949051999488:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129744.167382:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.167394:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093d57000/0x48868a4e4394822d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eb3e expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.167413:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.167415:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.167421:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093d57000/0x48868a4e4394822d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4960256->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb3e expref: 10 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.167433:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093d57000/0x48868a4e4394822d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4960256->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb3e expref: 10 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.167440:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093d57000, rc 0) 00000100:00100000:0.0:1746129744.167462:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28391:x1830949051999488:12345-192.168.204.31@tcp:101:cat.0 Request processed in 92us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.167466:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10369 00000100:00100000:3.0:1746129744.167722:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051999360 00000100:00100000:3.0:1746129744.167727:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051999360 00000100:00100000:3.0:1746129744.167754:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9759 00000100:00100000:3.0:1746129744.167759:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28397:x1830949051999360:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129744.167770:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.167780:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5800/0x48868a4e43948234 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eb37 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.167873:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4a00/0x48868a4e4394823b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.167882:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4a00/0x48868a4e4394823b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.167890:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4a00/0x48868a4e4394823b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.167901:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5000/0x48868a4e43948242 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.167906:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5000/0x48868a4e43948242 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.167911:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5000/0x48868a4e43948242 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.167992:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4200/0x48868a4e43948249 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.167998:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4200/0x48868a4e43948249 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.168004:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4200/0x48868a4e43948249 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:3.0:1746129744.168012:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129744.168083:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4a00/0x48868a4e4394823b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.168089:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4a00/0x48868a4e4394823b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.168094:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4a00/0x48868a4e4394823b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.168099:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b22c4a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129744.168103:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4a00/0x48868a4e4394823b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.168108:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4a00/0x48868a4e4394823b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.168117:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129744.168119:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129744.168122:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4a00/0x48868a4e4394823b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.168127:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4a00/0x48868a4e4394823b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.168135:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5000/0x48868a4e43948242 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.168139:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5000/0x48868a4e43948242 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.168146:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5000/0x48868a4e43948242 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.168150:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b22c5000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129744.168152:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5000/0x48868a4e43948242 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.168156:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5000/0x48868a4e43948242 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.168162:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e8c7a00) 00010000:00010000:3.0:1746129744.168163:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129744.168165:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5000/0x48868a4e43948242 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.168169:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5000/0x48868a4e43948242 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.168199:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5800/0x48868a4e43948234 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb37 expref: 17 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.168208:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4200/0x48868a4e43948249 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb37 expref: 16 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.168213:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129744.168215:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129744.168217:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b22c4200, rc 0) 00000100:00100000:3.0:1746129744.168255:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28397:x1830949051999360:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 494us (1672us total) trans 8589943527 rc 0/0 00000100:00100000:3.0:1746129744.168261:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9759 00000100:00100000:0.0:1746129744.174528:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.178564:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051999744 00000100:00100000:2.0:1746129744.178575:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051999744 00002000:00100000:2.0:1746129744.178615:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3698688->3702783) req@ffff88009be64e00 x1830949051999744/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129744.178624:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be64e00 with x1830949051999744 ext(3698688->3702783) 00002000:00010000:2.0:1746129744.178628:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009be64e00 00000100:00100000:2.0:1746129744.178647:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3828 00000100:00100000:2.0:1746129744.178652:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949051999744:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129744.178779:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949051999744:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 126us (4257us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129744.178785:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3828 00002000:00100000:2.0:1746129744.178790:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3698688->3702783) req@ffff88009be64e00 x1830949051999744/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/4536 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129744.178796:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be64e00 with x1830949051999744 ext(3698688->3702783) 00002000:00010000:2.0:1746129744.178799:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009be64e00 00000100:00100000:0.0:1746129744.183471:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.183498:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051999872 00000100:00100000:0.0:1746129744.183505:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051999872 00000100:00100000:0.0:1746129744.183548:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10370 00000100:00100000:0.0:1746129744.183555:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949051999872:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129744.183569:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.183584:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093d56000/0x48868a4e43948257 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eb45 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.183610:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093d56000/0x48868a4e43948257 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb45 expref: 11 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.183619:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093d56000/0x48868a4e43948257 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb45 expref: 11 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.183628:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093d56000, rc 0) 00000100:00100000:0.0:1746129744.183661:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949051999872:12345-192.168.204.31@tcp:101:cat.0 Request processed in 106us (197us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129744.183667:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10370 00000100:00100000:0.0:1746129744.195272:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.195298:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052000128 00000100:00100000:0.0:1746129744.195305:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052000128 00002000:00100000:0.0:1746129744.195340:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (4960256->4964351) req@ffff88009be64a80 x1830949052000128/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129744.195351:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be64a80 with x1830949052000128 ext(4960256->4964351) 00002000:00010000:0.0:1746129744.195355:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009be64a80 00000100:00100000:0.0:1746129744.195371:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3829 00000100:00100000:0.0:1746129744.195379:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949052000128:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129744.195505:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949052000128:12345-192.168.204.31@tcp:3:cat.0 Request processed in 126us (238us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129744.195511:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3829 00002000:00100000:0.0:1746129744.195516:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (4960256->4964351) req@ffff88009be64a80 x1830949052000128/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/4536 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129744.195524:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be64a80 with x1830949052000128 ext(4960256->4964351) 00002000:00010000:0.0:1746129744.195527:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009be64a80 00000100:00100000:0.0:1746129744.208355:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.208382:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052000256 00000100:00100000:0.0:1746129744.208389:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052000256 00000100:00100000:2.0:1746129744.210703:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10371 00000100:00100000:2.0:1746129744.210714:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:28393:x1830949052000256:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129744.210729:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129744.210742:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b100200/0x48868a4e4394825e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eb4c expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.210766:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013585a800/0x48868a4e43947f01 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e94d expref: 12 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.210774:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fadb200/0x48868a4e43948082 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea18 expref: 37 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.210780:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801363cee00/0x48868a4e4394805f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea03 expref: 19 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.210785:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.210786:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.210789:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b100200/0x48868a4e4394825e lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->3432447] (req 3145728->3432447) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb4c expref: 37 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.210812:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801363cee00/0x48868a4e4394805f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea03 expref: 19 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.210821:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801363cee00/0x48868a4e4394805f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea03 expref: 19 pid: 1877 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746129744.210830:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053220352:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.212413:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fadb200/0x48868a4e43948082 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea18 expref: 37 pid: 8435 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129744.212498:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.212598:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052000384 00000100:00100000:0.0:1746129744.212604:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052000384 00000100:00100000:0.0:1746129744.212636:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10372 00000100:00100000:0.0:1746129744.212643:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:28397:x1830949052000384:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129744.212652:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.212661:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093d57a00/0x48868a4e43948265 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eb53 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.212678:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a2ea00/0x48868a4e439481d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaf1 expref: 21 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.212685:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b101c00/0x48868a4e43948203 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb0d expref: 37 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.212690:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.212691:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.212694:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093d57a00/0x48868a4e43948265 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1425408->1888255] (req 1425408->1888255) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb53 expref: 21 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.212708:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b101c00/0x48868a4e43948203 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb0d expref: 37 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.212716:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b101c00/0x48868a4e43948203 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb0d expref: 37 pid: 8435 timeout: 790 lvb_type: 1 00000100:00100000:0.0:1746129744.212725:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053220608:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.212818:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fadb200/0x48868a4e43948082 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea18 expref: 37 pid: 8435 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746129744.212827:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053220480:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129744.212887:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130a2ea00/0x48868a4e439481d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaf1 expref: 21 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.212895:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130a2ea00/0x48868a4e439481d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaf1 expref: 21 pid: 8435 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746129744.212903:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053220736:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129744.212919:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1abae40 going to sleep for 11 seconds 00010000:00010000:2.0:1746129744.212952:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013585a800/0x48868a4e43947f01 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e94d expref: 12 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.212960:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013585a800/0x48868a4e43947f01 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e94d expref: 12 pid: 8435 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746129744.212968:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053220864:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129744.213361:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129744.213379:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053220352:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129744.215179:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.217288:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052000512 00000100:00100000:1.0:1746129744.217297:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052000512 00010000:00010000:1.0:1746129744.217326:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801363cee00/0x48868a4e4394805f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea03 expref: 22 pid: 1877 timeout: 790 lvb_type: 1 00000100:00100000:1.0:1746129744.217355:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4988 00000100:00100000:1.0:1746129744.217362:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052000512:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129744.217373:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129744.217389:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801363cee00/0x48868a4e4394805f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea03 expref: 22 pid: 1877 timeout: 790 lvb_type: 1 00010000:00010000:1.0:1746129744.217399:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801363cee00/0x48868a4e4394805f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea03 expref: 22 pid: 1877 timeout: 790 lvb_type: 1 00010000:00010000:1.0:1746129744.217417:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801363cee00/0x48868a4e4394805f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea03 expref: 22 pid: 1877 timeout: 790 lvb_type: 1 00010000:00010000:1.0:1746129744.217428:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129744.217468:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1962:x1830949052000512:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 105us (2294us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129744.217473:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4988 00000100:00100000:0.0:1746129744.219293:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.219313:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.219329:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052000640 00000100:00100000:0.0:1746129744.219333:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052000640 00010000:00010000:0.0:1746129744.219354:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b101c00/0x48868a4e43948203 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb0d expref: 38 pid: 8435 timeout: 790 lvb_type: 1 00000100:00100000:0.0:1746129744.219372:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052000768 00000100:00100000:0.0:1746129744.219374:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052000768 00010000:00010000:0.0:1746129744.219381:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a2ea00/0x48868a4e439481d9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaf1 expref: 21 pid: 8435 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746129744.219394:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4989 00000100:00100000:0.0:1746129744.219399:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1962:x1830949052000640:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129744.219407:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129744.219420:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b101c00/0x48868a4e43948203 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb0d expref: 38 pid: 8435 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.219429:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b101c00/0x48868a4e43948203 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb0d expref: 38 pid: 8435 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.219457:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129744.219481:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1962:x1830949052000640:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 81us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.219487:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4989 00000100:00100000:0.0:1746129744.219497:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4990 00000100:00100000:0.0:1746129744.219501:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1964:x1830949052000768:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129744.219507:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129744.219514:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a2ea00/0x48868a4e439481d9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaf1 expref: 21 pid: 8435 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.219521:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a2ea00/0x48868a4e439481d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaf1 expref: 21 pid: 8435 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.219530:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.219532:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.219548:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093d57a00/0x48868a4e43948265 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1425408->1888255) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb53 expref: 21 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.219555:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093d57a00/0x48868a4e43948265 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1425408->1888255) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb53 expref: 21 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.219579:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093d57a00/0x48868a4e43948265 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1425408->1888255) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb53 expref: 21 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.219589:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbeea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053220992:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129744.219626:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aba840 going to sleep for 11 seconds 00010000:00010000:0.0:1746129744.219699:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b101c00/0x48868a4e43948203 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb0d expref: 37 pid: 8435 timeout: 790 lvb_type: 1 00000100:00100000:0.0:1746129744.219709:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053220608:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129744.219716:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a2ea00/0x48868a4e439481d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaf1 expref: 21 pid: 8435 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746129744.219722:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053220736:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129744.219739:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093d57a00/0x48868a4e43948265 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->1888255) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb53 expref: 20 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.219746:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093d57a00, rc 0) 00000100:00100000:0.0:1746129744.219764:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:28397:x1830949052000384:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 7122us (7268us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.219769:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10372 00000100:00100000:0.0:1746129744.219827:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053220480:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129744.224235:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053220864:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.224270:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b100200/0x48868a4e4394825e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->3432447] (req 3145728->3432447) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb4c expref: 36 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.224284:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b100200, rc 0) 00000100:00100000:2.0:1746129744.224323:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:28393:x1830949052000256:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 13611us (15975us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.224330:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10371 00000100:00100000:0.0:1746129744.224993:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.225013:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.225027:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052000896 00000100:00100000:0.0:1746129744.225032:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052000896 00010000:00010000:0.0:1746129744.225049:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013585a800/0x48868a4e43947f01 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e94d expref: 13 pid: 8435 timeout: 790 lvb_type: 1 00000100:00100000:0.0:1746129744.225066:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052001024 00000100:00100000:0.0:1746129744.225068:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052001024 00010000:00010000:0.0:1746129744.225074:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fadb200/0x48868a4e43948082 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea18 expref: 36 pid: 8435 timeout: 790 lvb_type: 1 00000100:00100000:0.0:1746129744.225086:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4991 00000100:00100000:0.0:1746129744.225091:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949052000896:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129744.225100:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129744.225115:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013585a800/0x48868a4e43947f01 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e94d expref: 13 pid: 8435 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.225127:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013585a800/0x48868a4e43947f01 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e94d expref: 13 pid: 8435 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.225145:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013585a800/0x48868a4e43947f01 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e94d expref: 13 pid: 8435 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.225153:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129744.226995:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949052000896:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1895us (1995us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.227004:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4991 00000100:00100000:0.0:1746129744.227028:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4992 00000100:00100000:0.0:1746129744.227036:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949052001024:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129744.227047:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129744.227064:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fadb200/0x48868a4e43948082 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea18 expref: 36 pid: 8435 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.227075:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fadb200/0x48868a4e43948082 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea18 expref: 36 pid: 8435 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.227092:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fadb200/0x48868a4e43948082 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea18 expref: 36 pid: 8435 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.227102:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.227104:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.227109:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b100200/0x48868a4e4394825e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb4c expref: 35 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.227118:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b100200/0x48868a4e4394825e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb4c expref: 35 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.227144:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b100200/0x48868a4e4394825e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb4c expref: 35 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.227155:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbedc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053221120:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129744.227203:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1abae40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.227346:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053220992:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129744.227357:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129744.227373:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1964:x1830949052000768:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7872us (8060us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.227379:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4990 00000100:00100000:1.0:1746129744.235568:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.235658:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.235680:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052001280 00000100:00100000:1.0:1746129744.235686:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052001280 00002000:00100000:1.0:1746129744.235722:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e6:0x0] (1884160->1888255) req@ffff88009c1c5180 x1830949052001280/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129744.235731:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c5180 with x1830949052001280 ext(1884160->1888255) 00002000:00010000:1.0:1746129744.235736:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1c5180 00000100:00100000:1.0:1746129744.235751:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052001536 00000100:00100000:1.0:1746129744.235753:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052001536 00002000:00100000:1.0:1746129744.235764:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3428352->3432447) req@ffff88009c1c5880 x1830949052001536/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129744.235775:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c5880 with x1830949052001536 ext(3428352->3432447) 00002000:00010000:1.0:1746129744.235778:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1c5880 00000100:00100000:1.0:1746129744.235791:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3830 00000100:00100000:1.0:1746129744.235798:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949052001280:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129744.235949:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949052001280:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 151us (385us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129744.235955:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3830 00002000:00100000:1.0:1746129744.235960:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e6:0x0] (1884160->1888255) req@ffff88009c1c5180 x1830949052001280/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/4536 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129744.235966:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c5180 with x1830949052001280 ext(1884160->1888255) 00002000:00010000:1.0:1746129744.235968:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1c5180 00000100:00100000:1.0:1746129744.235982:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3831 00000100:00100000:1.0:1746129744.235987:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949052001536:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129744.236048:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949052001536:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 60us (389us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129744.236053:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3831 00002000:00100000:1.0:1746129744.236057:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3428352->3432447) req@ffff88009c1c5880 x1830949052001536/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/4536 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129744.236063:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c5880 with x1830949052001536 ext(3428352->3432447) 00002000:00010000:1.0:1746129744.236065:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1c5880 00000100:00100000:1.0:1746129744.236099:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbedc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053221120:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129744.236115:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129744.238875:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949052001024:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 11833us (13853us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129744.238885:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4992 00000100:00100000:1.0:1746129744.245722:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.246107:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.246343:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052001920 00000100:00100000:0.0:1746129744.246351:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052001920 00000100:00100000:3.0:1746129744.246421:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052001664 00000100:00100000:3.0:1746129744.246424:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052001664 00000100:00100000:3.0:1746129744.246449:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9760 00000100:00100000:3.0:1746129744.246456:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28399:x1830949052001664:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129744.246475:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.246490:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5200/0x48868a4e4394826c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eb5a expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.246546:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4600/0x48868a4e43948273 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129744.246557:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4600/0x48868a4e43948273 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129744.246565:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4600/0x48868a4e43948273 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129744.246576:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4400/0x48868a4e4394827a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129744.246581:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4400/0x48868a4e4394827a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129744.246586:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4400/0x48868a4e4394827a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129744.246669:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5600/0x48868a4e43948281 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129744.246678:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439481f5 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb06 expref: 289 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.246684:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5600/0x48868a4e43948281 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129744.246708:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439481f5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb06 expref: 289 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.246718:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439481f5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb06 expref: 289 pid: 16808 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746129744.246727:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053221248:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129744.246781:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.247140:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3808 00000100:00100000:0.0:1746129744.247146:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28397:x1830949052001920:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:0.0:1746129744.247384:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28397:x1830949052001920:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 237us (1276us total) trans 8589943528 rc 0/0 00000100:00100000:0.0:1746129744.247390:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3808 00000100:00100000:0.0:1746129744.251552:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.251585:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053221248:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129744.251602:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5600/0x48868a4e43948281 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:3.0:1746129744.251659:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052002176 00000100:00100000:3.0:1746129744.251664:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052002176 00000100:00100000:3.0:1746129744.251691:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3809 00000100:00100000:3.0:1746129744.251696:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c560850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:27195:x1830949052002176:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746129744.251828:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c560850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:27195:x1830949052002176:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 131us (280us total) trans 8589943529 rc 0/0 00000100:00100000:3.0:1746129744.251833:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3809 00000100:00100000:1.0:1746129744.257739:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.257763:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052002304 00000100:00100000:1.0:1746129744.257770:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052002304 00010000:00010000:1.0:1746129744.257795:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439481f5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb06 expref: 291 pid: 16808 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746129744.257816:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4993 00000100:00100000:1.0:1746129744.257822:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130566050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:1963:x1830949052002304:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129744.257832:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129744.257836:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439481f5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb06 expref: 291 pid: 16808 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746129744.257859:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439481f5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb06 expref: 291 pid: 16808 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746129744.257876:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b101e00/0x48868a4e439481f5 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb06 expref: 291 pid: 16808 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746129744.257887:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129744.257891:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5600/0x48868a4e43948281 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129744.257902:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5600/0x48868a4e43948281 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129744.257907:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5600/0x48868a4e43948281 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129744.257921:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129744.257952:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130566050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:1963:x1830949052002304:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 129us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129744.257957:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4993 00010000:00010000:0.0:1746129744.258569:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5600/0x48868a4e43948281 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.258576:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5600/0x48868a4e43948281 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:0.0:1746129744.258609:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:0.0:1746129744.258613:0:14315:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129744.258627:0:14315:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5600/0x48868a4e43948281 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.258635:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5600/0x48868a4e43948281 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.258644:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4600/0x48868a4e43948273 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.258649:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4600/0x48868a4e43948273 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.258653:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4600/0x48868a4e43948273 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.258658:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b22c4600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129744.258661:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4600/0x48868a4e43948273 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.258666:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4600/0x48868a4e43948273 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.258673:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:0.0:1746129744.258675:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129744.258677:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4600/0x48868a4e43948273 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.258682:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4600/0x48868a4e43948273 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.258689:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4400/0x48868a4e4394827a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.258694:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4400/0x48868a4e4394827a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.258697:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4400/0x48868a4e4394827a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.258701:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b22c4400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129744.258703:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4400/0x48868a4e4394827a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.258707:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4400/0x48868a4e4394827a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.258712:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e8c7e00) 00010000:00010000:0.0:1746129744.258714:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129744.258716:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4400/0x48868a4e4394827a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.258720:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4400/0x48868a4e4394827a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.258743:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5200/0x48868a4e4394826c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb5a expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.258753:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5600/0x48868a4e43948281 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb5a expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.258762:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129744.258764:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129744.258765:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b22c5600, rc 0) 00000100:00100000:0.0:1746129744.258981:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:28399:x1830949052001664:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 12524us (13264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.258988:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9760 00000100:00100000:2.0:1746129744.263041:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.263070:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.263095:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052002432 00000100:00100000:0.0:1746129744.263121:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052002560 00000100:00100000:0.0:1746129744.263124:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052002560 00000100:00100000:0.0:1746129744.263158:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10373 00000100:00100000:0.0:1746129744.263165:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+12:1963:x1830949052002560:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129744.263178:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.263192:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009faeba00/0x48868a4e43948288 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eb68 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129744.263218:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052002432 00000100:00100000:2.0:1746129744.263237:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10374 00000100:00100000:2.0:1746129744.263242:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+14:1964:x1830949052002432:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129744.263248:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129744.263254:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b101800/0x48868a4e4394828f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eb61 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129744.263288:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053221376:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129744.263340:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.263486:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053221504:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129744.263510:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aba0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129744.264838:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.265143:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.265156:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052002688 00000100:00100000:2.0:1746129744.265160:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052002688 00000100:00100000:2.0:1746129744.265180:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052002816 00000100:00100000:2.0:1746129744.265182:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052002816 00000100:00100000:2.0:1746129744.265193:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10375 00000100:00100000:2.0:1746129744.265199:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+8:1963:x1830949052002688:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129744.265209:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129744.265219:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b100e00/0x48868a4e43948296 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eb6f expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.265239:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b100e00/0x48868a4e43948296 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb6f expref: 9 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.265248:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b100e00/0x48868a4e43948296 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb6f expref: 9 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.265260:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b100e00, rc 0) 00000100:00100000:2.0:1746129744.265285:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+8:1963:x1830949052002688:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 85us (449us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129744.265290:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10375 00000100:00100000:2.0:1746129744.265303:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10376 00000100:00100000:2.0:1746129744.265307:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+16:1963:x1830949052002816:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129744.265313:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129744.265319:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b101c00/0x48868a4e4394829d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eb76 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129744.265344:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053221632:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129744.265379:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129744.270225:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053221376:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129744.270254:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b101800/0x48868a4e4394828f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb61 expref: 17 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.270267:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b101800/0x48868a4e4394828f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb61 expref: 17 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.270276:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b101800, rc 0) 00000100:00100000:3.0:1746129744.270308:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+16:1964:x1830949052002432:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 7065us (7274us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129744.270319:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10374 00000100:00100000:3.0:1746129744.270354:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053221504:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129744.270366:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009faeba00/0x48868a4e43948288 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb68 expref: 15 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.270374:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009faeba00/0x48868a4e43948288 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb68 expref: 15 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.270381:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faeba00, rc 0) 00000100:00100000:3.0:1746129744.270396:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+14:1963:x1830949052002560:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 7231us (7325us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129744.270401:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10373 00002000:00010000:3.0:1746129744.270420:0:8435:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime: 1746129743 -> 1746129744 00002000:00010000:3.0:1746129744.270423:0:8435:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746129743 -> 1746129744 00002000:00010000:3.0:1746129744.270425:0:8435:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime: 1746129743 -> 1746129744 00000100:00100000:3.0:1746129744.270431:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053221632:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129744.270444:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b101c00/0x48868a4e4394829d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb76 expref: 13 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.270452:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b101c00/0x48868a4e4394829d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb76 expref: 13 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.270458:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b101c00, rc 0) 00000100:00100000:3.0:1746129744.270472:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+12:1963:x1830949052002816:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5164us (5329us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129744.270479:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10376 00000100:00100000:1.0:1746129744.273816:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.273927:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052003072 00000100:00100000:0.0:1746129744.273934:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052003072 00000100:00100000:0.0:1746129744.273967:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9761 00000100:00100000:0.0:1746129744.273973:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:28399:x1830949052003072:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129744.273988:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.274002:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea200/0x48868a4e439482a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eb7d expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.274075:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeae00/0x48868a4e439482ab lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.274086:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5600/0x48868a4e43948281 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb5a expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.274092:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeae00/0x48868a4e439482ab lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.274115:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5600/0x48868a4e43948281 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb5a expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.274124:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5600/0x48868a4e43948281 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb5a expref: 10 pid: 14315 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746129744.274135:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbeea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053221760:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129744.274181:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aba240 going to sleep for 11 seconds 00000100:00100000:2.0:1746129744.278090:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.278494:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052003200 00000100:00100000:0.0:1746129744.278501:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052003200 00010000:00010000:0.0:1746129744.278525:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5600/0x48868a4e43948281 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb5a expref: 11 pid: 14315 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746129744.278556:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4994 00000100:00100000:0.0:1746129744.278562:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052003200:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129744.278573:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129744.278578:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5600/0x48868a4e43948281 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb5a expref: 11 pid: 14315 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.278588:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5600/0x48868a4e43948281 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb5a expref: 11 pid: 14315 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.278609:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129744.278613:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeae00/0x48868a4e439482ab lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.278620:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeae00/0x48868a4e439482ab lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.278625:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeae00/0x48868a4e439482ab lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.278637:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129744.278667:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052003200:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 105us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.278672:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4994 00010000:00010000:0.0:1746129744.278744:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5600/0x48868a4e43948281 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb5a expref: 10 pid: 14315 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746129744.278754:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053221760:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129744.278765:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeae00/0x48868a4e439482ab lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.278771:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeae00/0x48868a4e439482ab lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.278775:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeae00/0x48868a4e439482ab lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:0.0:1746129744.278788:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129744.278894:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea200/0x48868a4e439482a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb7d expref: 11 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.278908:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeae00/0x48868a4e439482ab lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb7d expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.278913:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129744.278915:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129744.278917:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faeae00, rc 0) 00000100:00100000:0.0:1746129744.278947:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+10:28399:x1830949052003072:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4974us (5136us total) trans 8589943530 rc 0/0 00000100:00100000:0.0:1746129744.278953:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9761 00000100:00100000:3.0:1746129744.285715:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.285747:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052003328 00000100:00100000:3.0:1746129744.285754:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052003328 00000100:00100000:3.0:1746129744.285785:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9762 00000100:00100000:3.0:1746129744.285791:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+10:28399:x1830949052003328:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129744.285809:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.285822:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5800/0x48868a4e439482b9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eb84 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.285913:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e439482c0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129744.285924:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeae00/0x48868a4e439482ab lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb7d expref: 11 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.285929:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e439482c0 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129744.285952:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeae00/0x48868a4e439482ab lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb7d expref: 11 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.285960:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeae00/0x48868a4e439482ab lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb7d expref: 11 pid: 14315 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746129744.285970:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053221888:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129744.286019:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.292011:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053221888:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129744.292029:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e439482c0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129744.293397:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.293619:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052003456 00000100:00100000:0.0:1746129744.293625:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052003456 00010000:00010000:0.0:1746129744.293650:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeae00/0x48868a4e439482ab lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb7d expref: 12 pid: 14315 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746129744.293684:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4995 00000100:00100000:0.0:1746129744.293691:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949052003456:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129744.293701:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129744.293706:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeae00/0x48868a4e439482ab lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb7d expref: 12 pid: 14315 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.293715:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeae00/0x48868a4e439482ab lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb7d expref: 12 pid: 14315 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.293732:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeae00/0x48868a4e439482ab lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb7d expref: 12 pid: 14315 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.293744:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129744.293748:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e439482c0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.293756:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e439482c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.293762:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e439482c0 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.293785:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129744.293818:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052003456:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 127us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.293824:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4995 00010000:00010000:0.0:1746129744.293841:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e439482c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.293861:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e439482c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:0.0:1746129744.293894:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:0.0:1746129744.293898:0:14315:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129744.293910:0:14315:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e439482c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:3.0:1746129744.293966:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129744.294018:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c5800/0x48868a4e439482b9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb84 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.294037:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e439482c0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb84 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.294043:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129744.294045:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129744.294047:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b22c4000, rc 0) 00000100:00100000:0.0:1746129744.294067:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+10:28399:x1830949052003328:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 8277us (8360us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.294072:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9762 00000100:00100000:0.0:1746129744.294086:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052003712 00000100:00100000:0.0:1746129744.294089:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052003712 00000100:00100000:0.0:1746129744.294111:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9763 00000100:00100000:0.0:1746129744.294116:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:28404:x1830949052003712:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129744.294129:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.294138:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faebe00/0x48868a4e439482c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eb8b expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.294207:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb800/0x48868a4e439482ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.294215:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb800/0x48868a4e439482ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.294221:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb800/0x48868a4e439482ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.294236:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea000/0x48868a4e439482d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.294245:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea000/0x48868a4e439482d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.294250:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea000/0x48868a4e439482d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:3.0:1746129744.296272:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.296312:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052003840 00000100:00100000:2.0:1746129744.296317:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052003840 00000100:00100000:2.0:1746129744.296342:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10377 00000100:00100000:2.0:1746129744.296348:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+12:1963:x1830949052003840:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129744.296357:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129744.296393:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a4c800/0x48868a4e439482dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eb92 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129744.296433:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053222016:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129744.296482:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeaa00/0x48868a4e439482e3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.296491:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeaa00/0x48868a4e439482e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.296498:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeaa00/0x48868a4e439482e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:0.0:1746129744.296507:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000100:00100000:2.0:1746129744.296555:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4efdf00 going to sleep for 11 seconds 00010000:00010000:0.0:1746129744.296584:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb800/0x48868a4e439482ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.296589:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb800/0x48868a4e439482ce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.296595:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb800/0x48868a4e439482ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.296599:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faeb800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129744.296602:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb800/0x48868a4e439482ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.296608:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb800/0x48868a4e439482ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00000100:00100000:1.0:1746129744.296609:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129744.296616:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:0.0:1746129744.296619:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129744.296622:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb800/0x48868a4e439482ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.296626:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb800/0x48868a4e439482ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.296634:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea000/0x48868a4e439482d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.296638:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea000/0x48868a4e439482d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.296642:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea000/0x48868a4e439482d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.296646:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faea000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129744.296647:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea000/0x48868a4e439482d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.296651:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea000/0x48868a4e439482d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.296656:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e8c7a00) 00010000:00010000:0.0:1746129744.296658:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129744.296660:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea000/0x48868a4e439482d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.296664:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea000/0x48868a4e439482d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00000100:00100000:1.0:1746129744.296678:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129744.296696:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faebe00/0x48868a4e439482c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb8b expref: 293 pid: 14315 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.296699:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129744.296709:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeaa00/0x48868a4e439482e3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb8b expref: 292 pid: 14315 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.296712:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052003968 00000100:00100000:1.0:1746129744.296714:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052003968 00010000:00010000:0.0:1746129744.296715:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129744.296716:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129744.296718:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faeaa00, rc 0) 00000100:00100000:1.0:1746129744.296728:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052004096 00000100:00100000:1.0:1746129744.296729:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052004096 00000100:00100000:1.0:1746129744.296737:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052004224 00000100:00100000:1.0:1746129744.296739:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052004224 00000100:00100000:0.0:1746129744.296739:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:28404:x1830949052003712:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2623us (2773us total) trans 8589943531 rc 0/0 00000100:00100000:0.0:1746129744.296745:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9763 00000100:00100000:1.0:1746129744.296748:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10378 00000100:00100000:1.0:1746129744.296751:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+15:1964:x1830949052003968:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129744.296757:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129744.296763:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8695400/0x48868a4e439482f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eb99 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.296784:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053222144:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129744.296805:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129744.296820:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10379 00000100:00100000:1.0:1746129744.296826:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+8:1964:x1830949052004096:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129744.296832:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129744.296870:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10380 00000100:00100000:2.0:1746129744.296876:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+16:1963:x1830949052004224:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129744.296882:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129744.296888:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a4cc00/0x48868a4e439482ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eba7 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129744.296907:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053222272:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129744.296933:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa48c180 going to sleep for 11 seconds 00010000:00010000:1.0:1746129744.296983:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8695a00/0x48868a4e439482f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eba0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.297001:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8695a00/0x48868a4e439482f8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eba0 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.297008:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8695a00/0x48868a4e439482f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eba0 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.297015:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8695a00, rc 0) 00000100:00100000:1.0:1746129744.297031:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+8:1964:x1830949052004096:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 206us (352us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129744.297037:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10379 00000100:00100000:1.0:1746129744.299436:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.299482:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052004480 00000100:00100000:0.0:1746129744.299488:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052004480 00000100:00100000:1.0:1746129744.299552:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053222016:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129744.299560:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3810 00000100:00100000:0.0:1746129744.299566:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:28404:x1830949052004480:12345-192.168.204.31@tcp:35:cat.0 00010000:00010000:1.0:1746129744.299575:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a4c800/0x48868a4e439482dc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb92 expref: 17 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.299585:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a4c800/0x48868a4e439482dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb92 expref: 17 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.299592:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a4c800, rc 0) 00000100:00100000:1.0:1746129744.299791:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+16:1963:x1830949052003840:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3442us (3520us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129744.299797:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10377 00000100:00100000:1.0:1746129744.299832:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053222272:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129744.299844:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a4cc00/0x48868a4e439482ff lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eba7 expref: 15 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.299868:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a4cc00/0x48868a4e439482ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eba7 expref: 15 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.299875:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a4cc00, rc 0) 00000100:00100000:1.0:1746129744.299901:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+14:1963:x1830949052004224:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3025us (3201us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129744.299906:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10380 00000100:00100000:0.0:1746129744.299988:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:28404:x1830949052004480:12345-192.168.204.31@tcp:35:cat.0 Request processed in 421us (557us total) trans 8589943532 rc 0/0 00000100:00100000:0.0:1746129744.299993:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3810 00000100:00100000:1.0:1746129744.300077:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053222144:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129744.300091:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8695400/0x48868a4e439482f1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb99 expref: 13 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.300099:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8695400/0x48868a4e439482f1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb99 expref: 13 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.300105:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8695400, rc 0) 00000100:00100000:1.0:1746129744.300136:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+12:1964:x1830949052003968:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3383us (3526us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129744.300141:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10378 00000100:00100000:0.0:1746129744.302431:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.302456:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.302475:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052004608 00000100:00100000:0.0:1746129744.302481:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052004608 00000100:00100000:0.0:1746129744.302504:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052004736 00000100:00100000:0.0:1746129744.302506:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052004736 00000100:00100000:0.0:1746129744.302517:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10381 00000100:00100000:0.0:1746129744.302523:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1962:x1830949052004608:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129744.302546:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.302559:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009faeac00/0x48868a4e43948306 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ebae expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.302598:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053222400:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129744.302646:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aba600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.302661:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10382 00000100:00100000:0.0:1746129744.302666:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1962:x1830949052004736:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129744.302672:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.302678:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009faea200/0x48868a4e4394830d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ebb5 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.302697:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053222528:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129744.302714:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1abae40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129744.304899:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.304899:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053222400:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129744.304923:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009faeac00/0x48868a4e43948306 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebae expref: 38 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.304935:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009faeac00/0x48868a4e43948306 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebae expref: 38 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.304943:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faeac00, rc 0) 00000100:00100000:0.0:1746129744.305404:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1962:x1830949052004608:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2879us (2976us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129744.305411:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10381 00000100:00100000:0.0:1746129744.305437:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052004992 00000100:00100000:0.0:1746129744.305441:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052004992 00000100:00100000:1.0:1746129744.305447:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.305468:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9764 00000100:00100000:0.0:1746129744.305473:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+10:28399:x1830949052004992:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129744.305484:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129744.305485:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052005120 00000100:00100000:1.0:1746129744.305488:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052005120 00010000:00010000:0.0:1746129744.305495:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e56400/0x48868a4e43948314 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ebbc expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.305573:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e56600/0x48868a4e4394831b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.305584:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e56600/0x48868a4e4394831b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129744.305592:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e56600/0x48868a4e4394831b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:0.0:1746129744.305602:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129744.305681:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e56400/0x48868a4e43948314 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebbc expref: 13 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.305692:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e56600/0x48868a4e4394831b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebbc expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.305699:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129744.305702:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129744.305704:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e56600, rc 0) 00000100:00100000:0.0:1746129744.305726:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+12:28399:x1830949052004992:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 252us (831us total) trans 8589943533 rc 0/0 00000100:00100000:0.0:1746129744.305731:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9764 00000100:00100000:0.0:1746129744.305762:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053222528:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129744.305777:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009faea200/0x48868a4e4394830d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebb5 expref: 36 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.305784:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009faea200/0x48868a4e4394830d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebb5 expref: 36 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.305790:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faea200, rc 0) 00000100:00100000:0.0:1746129744.305809:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949052004736:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3142us (3351us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129744.305813:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10382 00000100:00100000:0.0:1746129744.305824:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10383 00000100:00100000:0.0:1746129744.305829:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052005120:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129744.305837:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.305875:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8e56200/0x48868a4e43948329 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ebc3 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.305891:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e56200/0x48868a4e43948329 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebc3 expref: 23 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.305899:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e56200/0x48868a4e43948329 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebc3 expref: 23 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.305905:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e56200, rc 0) 00000100:00100000:0.0:1746129744.305920:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052005120:12345-192.168.204.31@tcp:101:cat.0 Request processed in 91us (473us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129744.305924:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10383 00000100:00100000:1.0:1746129744.311417:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.311449:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.311473:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.311485:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.311491:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052005248 00000100:00100000:1.0:1746129744.311496:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.311499:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052005248 00000100:00100000:1.0:1746129744.311517:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.311576:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052005376 00000100:00100000:0.0:1746129744.311578:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052005376 00000100:00100000:0.0:1746129744.311590:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052005504 00000100:00100000:0.0:1746129744.311592:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052005504 00000100:00100000:0.0:1746129744.311599:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052005632 00000100:00100000:0.0:1746129744.311601:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052005632 00000100:00100000:0.0:1746129744.311608:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052005760 00000100:00100000:0.0:1746129744.311609:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052005760 00000100:00100000:0.0:1746129744.311616:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052005888 00000100:00100000:0.0:1746129744.311618:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052005888 00000100:00100000:0.0:1746129744.311630:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10384 00000100:00100000:0.0:1746129744.311636:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949052005248:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:0.0:1746129744.311667:0:4589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e57400/0x48868a4e43948330 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.311681:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fadb600/0x48868a4e43947ede lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e92a expref: 10 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.311688:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fada000/0x48868a4e43947fb7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e977 expref: 9 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.311694:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013585bc00/0x48868a4e43947fb0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e970 expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.311700:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.311701:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.311704:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e57400/0x48868a4e43948330 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.311732:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013585bc00/0x48868a4e43947fb0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e970 expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.311743:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013585bc00/0x48868a4e43947fb0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e970 expref: 21 pid: 4589 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746129744.311754:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053222656:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129744.311756:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10385 00000100:00100000:1.0:1746129744.311762:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+14:1961:x1830949052005376:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:1.0:1746129744.311777:0:3624:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e43948337 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.311786:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093d57a00/0x48868a4e43948265 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->1888255) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb53 expref: 18 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.311791:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129744.311792:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129744.311794:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e43948337 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.311807:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093d57a00/0x48868a4e43948265 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->1888255) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb53 expref: 18 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.311814:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fada000/0x48868a4e43947fb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e977 expref: 9 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.311815:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093d57a00/0x48868a4e43948265 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->1888255) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb53 expref: 18 pid: 3623 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.311821:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fada000/0x48868a4e43947fb7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e977 expref: 9 pid: 20441 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746129744.311828:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053222784:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129744.311828:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053222912:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129744.311845:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738b780 going to sleep for 11 seconds 00010000:00010000:0.0:1746129744.311862:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fadb600/0x48868a4e43947ede lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e92a expref: 10 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.311868:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fadb600/0x48868a4e43947ede lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e92a expref: 10 pid: 20441 timeout: 790 lvb_type: 1 00000100:00100000:1.0:1746129744.311874:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10386 00000100:00100000:0.0:1746129744.311875:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053223040:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129744.311879:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+14:1961:x1830949052005504:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:1.0:1746129744.311892:0:1140:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8695000/0x48868a4e4394833e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.311899:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aba600 going to sleep for 11 seconds 00010000:00010000:1.0:1746129744.311900:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135677800/0x48868a4e439481e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaff expref: 18 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.311906:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129744.311907:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129744.311909:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8695000/0x48868a4e4394833e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.311911:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10387 00000100:00100000:0.0:1746129744.311915:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949052005632:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:1.0:1746129744.311922:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135677800/0x48868a4e439481e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaff expref: 18 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.311929:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135677800/0x48868a4e439481e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaff expref: 18 pid: 3624 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.311929:0:8435:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4a00/0x48868a4e43948345 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.311936:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053223168:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129744.311937:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ffbce00/0x48868a4e43948035 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d9 expref: 21 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.311943:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e103800/0x48868a4e439480ac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea42 expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.311949:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e102400/0x48868a4e43948097 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea2d expref: 9 pid: 8435 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129744.311951:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b7b0ca80 going to sleep for 11 seconds 00010000:00010000:0.0:1746129744.311954:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.311955:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.311957:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4a00/0x48868a4e43948345 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.311962:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10388 00000100:00100000:1.0:1746129744.311967:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949052005760:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:0.0:1746129744.311968:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e102400/0x48868a4e43948097 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea2d expref: 9 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.311974:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e102400/0x48868a4e43948097 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea2d expref: 9 pid: 8435 timeout: 790 lvb_type: 1 00010000:00010000:1.0:1746129744.311979:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e4394834c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.311981:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053223296:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129744.311987:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b101600/0x48868a4e4394821f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3698688->4960255] (req 3698688->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb29 expref: 21 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.311994:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f08ee00/0x48868a4e4394818c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eac0 expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.311999:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e103800/0x48868a4e439480ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea42 expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.312000:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b100000/0x48868a4e43948138 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4960256->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea96 expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.312007:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093d57000/0x48868a4e4394822d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4960256->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb3e expref: 9 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.312010:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e103800/0x48868a4e439480ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea42 expref: 10 pid: 3624 timeout: 790 lvb_type: 1 00010000:00010000:1.0:1746129744.312012:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 4 00010000:00010000:1.0:1746129744.312013:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 4 00010000:00010000:1.0:1746129744.312015:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e4394834c lrc: 7/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.312017:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095243800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053223424:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129744.312026:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093d57000/0x48868a4e4394822d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4960256->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb3e expref: 9 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.312030:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ffbce00/0x48868a4e43948035 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d9 expref: 21 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.312033:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093d57000/0x48868a4e4394822d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4960256->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb3e expref: 9 pid: 3624 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.312037:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ffbce00/0x48868a4e43948035 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d9 expref: 21 pid: 10930 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746129744.312039:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053223552:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129744.312043:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095240000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053223680:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129744.312051:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1abae40 going to sleep for 11 seconds 00010000:00010000:1.0:1746129744.312057:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b100000/0x48868a4e43948138 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4960256->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea96 expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.312063:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b100000/0x48868a4e43948138 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4960256->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea96 expref: 21 pid: 4589 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746129744.312063:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10389 00000100:00100000:0.0:1746129744.312067:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+14:1961:x1830949052005888:12345-192.168.204.31@tcp:1:lfs.0 00000100:00100000:1.0:1746129744.312070:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053223808:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129744.312079:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009faea400/0x48868a4e43948353 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.312085:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f08ee00/0x48868a4e4394818c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eac0 expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.312088:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b100200/0x48868a4e4394825e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb4c expref: 34 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.312091:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f08ee00/0x48868a4e4394818c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eac0 expref: 21 pid: 8436 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.312093:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129744.312094:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129744.312096:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009faea400/0x48868a4e43948353 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.312097:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053223936:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129744.312110:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b101600/0x48868a4e4394821f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3698688->4960255] (req 3698688->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb29 expref: 21 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.312111:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b100200/0x48868a4e4394825e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb4c expref: 34 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.312116:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b101600/0x48868a4e4394821f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3698688->4960255] (req 3698688->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb29 expref: 21 pid: 3624 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.312118:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b100200/0x48868a4e4394825e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb4c expref: 34 pid: 3624 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746129744.312122:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053224064:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129744.312124:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053224192:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129744.312131:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b7b0c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.312133:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa48c180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129744.314469:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.314546:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052006016 00000100:00100000:3.0:1746129744.314553:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052006016 00000100:00100000:3.0:1746129744.314583:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10390 00000100:00100000:3.0:1746129744.314590:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:28404:x1830949052006016:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129744.314601:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.314614:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e4394835a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ebca expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.314633:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129744.314636:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e43948337 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.314642:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746129744.314646:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e4394835a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebca expref: 36 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.314657:0:20441:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e43948337 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.314669:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e4394835a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebca expref: 36 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.314677:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5283e00, rc 0) 00000100:00100000:3.0:1746129744.314708:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:28404:x1830949052006016:12345-192.168.204.31@tcp:101:cat.0 Request processed in 119us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.314713:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10390 00000100:00100000:0.0:1746129744.320880:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053222784:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129744.320911:0:3624:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e43948337 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.320941:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053222656:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129744.322017:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053222912:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129744.322025:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053223040:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129744.322040:0:4589:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a8e57400/0x48868a4e43948330 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.324361:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053223296:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129744.324783:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095243800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053223424:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129744.324826:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.324845:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.324876:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.324888:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.324893:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052006144 00000100:00100000:0.0:1746129744.324899:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052006144 00000100:00100000:2.0:1746129744.324901:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.324912:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.324923:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:0.0:1746129744.324931:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e6:0x0] (1425408->1888255) req@ffff880136318700 x1830949052006144/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746129744.324934:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:0.0:1746129744.324941:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136318700 with x1830949052006144 ext(1425408->1888255) 00000100:00100000:2.0:1746129744.324946:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129744.324950:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093d57a00/0x48868a4e43948265 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1425408->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb53 expref: 19 pid: 3623 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.324957:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129744.324962:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093d57a00/0x48868a4e43948265 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1425408->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb53 expref: 19 pid: 3623 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.324967:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00010000:0.0:1746129744.324968:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136318700 00000100:00100000:2.0:1746129744.324976:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.324981:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052007424 00000100:00100000:0.0:1746129744.324983:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052007424 00002000:00100000:0.0:1746129744.324993:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3698688->4194303) req@ffff88013631a300 x1830949052007424/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746129744.324996:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:0.0:1746129744.325000:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631a300 with x1830949052007424 ext(3698688->4194303) 00010000:00010000:0.0:1746129744.325004:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b101600/0x48868a4e4394821f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3698688->4960255] (req 3698688->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb29 expref: 22 pid: 3624 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.325009:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052006656 00010000:00010000:0.0:1746129744.325011:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b101600/0x48868a4e4394821f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3698688->4960255] (req 3698688->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb29 expref: 22 pid: 3624 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.325012:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052006656 00002000:00010000:0.0:1746129744.325016:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013631a300 00000100:00100000:0.0:1746129744.325024:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052006528 00010000:00010000:2.0:1746129744.325027:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fada000/0x48868a4e43947fb7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e977 expref: 10 pid: 20441 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746129744.325027:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052006528 00002000:00100000:0.0:1746129744.325034:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->1089535) req@ffff88009f6a6300 x1830949052006528/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746129744.325037:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052006912 00000100:00100000:2.0:1746129744.325039:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052006912 00002000:00100000:0.0:1746129744.325040:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a6300 with x1830949052006528 ext(1048576->1089535) 00010000:00010000:2.0:1746129744.325045:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093d57000/0x48868a4e4394822d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4960256->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb3e expref: 11 pid: 3624 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.325045:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135677800/0x48868a4e439481e7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaff expref: 20 pid: 3624 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.325052:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052006272 00010000:00010000:0.0:1746129744.325052:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135677800/0x48868a4e439481e7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaff expref: 20 pid: 3624 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.325053:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052006272 00002000:00010000:0.0:1746129744.325057:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f6a6300 00010000:00010000:2.0:1746129744.325059:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013585bc00/0x48868a4e43947fb0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e970 expref: 23 pid: 4589 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746129744.325062:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052007680 00000100:00100000:0.0:1746129744.325063:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052007680 00000100:00100000:2.0:1746129744.325065:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052006784 00000100:00100000:2.0:1746129744.325066:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052006784 00002000:00100000:0.0:1746129744.325071:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->3432447) req@ffff88009f6a6a00 x1830949052007680/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746129744.325073:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e103800/0x48868a4e439480ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea42 expref: 11 pid: 3624 timeout: 790 lvb_type: 1 00002000:00100000:0.0:1746129744.325077:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a6a00 with x1830949052007680 ext(3145728->3432447) 00000100:00100000:2.0:1746129744.325080:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052007296 00000100:00100000:2.0:1746129744.325081:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052007296 00010000:00010000:0.0:1746129744.325081:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b100200/0x48868a4e4394825e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb4c expref: 36 pid: 3624 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.325086:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b100200/0x48868a4e4394825e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb4c expref: 36 pid: 3624 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.325087:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffbce00/0x48868a4e43948035 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d9 expref: 24 pid: 10930 timeout: 790 lvb_type: 0 00002000:00010000:0.0:1746129744.325091:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f6a6a00 00000100:00100000:2.0:1746129744.325093:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052007168 00000100:00100000:2.0:1746129744.325095:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052007168 00010000:00010000:2.0:1746129744.325100:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b100000/0x48868a4e43948138 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4960256->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea96 expref: 25 pid: 4589 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746129744.325100:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 529 00000100:00100000:0.0:1746129744.325105:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949052006144:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:2.0:1746129744.325106:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052006400 00000100:00100000:2.0:1746129744.325108:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052006400 00010000:00010000:2.0:1746129744.325113:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fadb600/0x48868a4e43947ede lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e92a expref: 12 pid: 20441 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746129744.325119:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052007040 00000100:00100000:2.0:1746129744.325121:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052007040 00010000:00010000:2.0:1746129744.325126:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e102400/0x48868a4e43948097 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea2d expref: 12 pid: 8435 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746129744.325131:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052007552 00000100:00100000:2.0:1746129744.325133:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052007552 00010000:00010000:2.0:1746129744.325138:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f08ee00/0x48868a4e4394818c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eac0 expref: 26 pid: 8436 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.325146:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4996 00000100:00100000:2.0:1746129744.325150:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1964:x1830949052006656:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129744.325158:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129744.325170:0:7108:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 1975 -> 2055 00010000:00010000:2.0:1746129744.325175:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fada000/0x48868a4e43947fb7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e977 expref: 12 pid: 20441 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.325183:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fada000/0x48868a4e43947fb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e977 expref: 12 pid: 20441 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.325199:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fada000/0x48868a4e43947fb7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e977 expref: 12 pid: 20441 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.325212:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129744.325241:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949052006656:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 90us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.325246:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4996 00000100:00100000:2.0:1746129744.325258:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4997 00000100:00100000:2.0:1746129744.325262:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949052006912:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129744.325268:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.325275:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093d57000/0x48868a4e4394822d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [4960256->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb3e expref: 10 pid: 3624 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.325282:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093d57000/0x48868a4e4394822d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [4960256->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb3e expref: 10 pid: 3624 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.325291:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129744.325302:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949052006912:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 39us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.325306:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4997 00000100:00100000:2.0:1746129744.325313:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4998 00000100:00100000:2.0:1746129744.325317:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1964:x1830949052006272:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129744.325322:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.325326:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013585bc00/0x48868a4e43947fb0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e970 expref: 26 pid: 4589 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.325333:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013585bc00/0x48868a4e43947fb0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e970 expref: 26 pid: 4589 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.325342:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013585bc00/0x48868a4e43947fb0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e970 expref: 26 pid: 4589 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.325349:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129744.325360:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1964:x1830949052006272:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 43us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.325368:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4998 00000100:00100000:2.0:1746129744.325375:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4999 00000100:00100000:2.0:1746129744.325379:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+12:1964:x1830949052006784:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129744.325383:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.325390:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e103800/0x48868a4e439480ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea42 expref: 12 pid: 3624 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746129744.325397:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e103800/0x48868a4e439480ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea42 expref: 12 pid: 3624 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746129744.325406:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e103800/0x48868a4e439480ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea42 expref: 12 pid: 3624 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746129744.325412:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129744.325421:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052006784:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 43us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.325426:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4999 00000100:00100000:2.0:1746129744.325433:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5000 00000100:00100000:2.0:1746129744.325436:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1964:x1830949052007296:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129744.325442:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.325447:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ffbce00/0x48868a4e43948035 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d9 expref: 24 pid: 10930 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746129744.325452:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5001 00010000:00010000:2.0:1746129744.325454:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ffbce00/0x48868a4e43948035 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d9 expref: 24 pid: 10930 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746129744.325457:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949052007168:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129744.325463:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.325468:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129744.325469:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b100000/0x48868a4e43948138 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [4960256->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea96 expref: 24 pid: 4589 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.325478:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1964:x1830949052007296:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 41us (554us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129744.325481:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b100000/0x48868a4e43948138 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [4960256->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea96 expref: 24 pid: 4589 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.325483:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5000 00010000:00010000:0.0:1746129744.325490:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129744.325499:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949052007168:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 43us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.325503:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5001 00000100:00100000:2.0:1746129744.325506:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5002 00000100:00100000:2.0:1746129744.325510:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949052006400:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129744.325510:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5003 00000100:00100000:0.0:1746129744.325514:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1961:x1830949052007040:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129744.325515:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129744.325518:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.325521:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fadb600/0x48868a4e43947ede lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e92a expref: 10 pid: 20441 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.325522:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e102400/0x48868a4e43948097 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea2d expref: 9 pid: 8435 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746129744.325528:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fadb600/0x48868a4e43947ede lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e92a expref: 10 pid: 20441 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.325529:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e102400/0x48868a4e43948097 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea2d expref: 9 pid: 8435 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746129744.325549:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fadb600/0x48868a4e43947ede lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e92a expref: 10 pid: 20441 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.325549:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e102400/0x48868a4e43948097 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea2d expref: 9 pid: 8435 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746129744.325556:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.325556:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.325558:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.325558:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.325561:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e57400/0x48868a4e43948330 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.325561:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4a00/0x48868a4e43948345 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.325569:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e57400/0x48868a4e43948330 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.325569:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4a00/0x48868a4e43948345 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.325581:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129744.325583:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129744.325593:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949052006400:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 82us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.325593:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1961:x1830949052007040:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 79us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.325598:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5003 00000100:00100000:2.0:1746129744.325600:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5002 00000100:00100000:0.0:1746129744.325607:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5004 00000100:00100000:0.0:1746129744.325610:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949052007552:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129744.325615:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129744.325622:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f08ee00/0x48868a4e4394818c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eac0 expref: 22 pid: 8436 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.325629:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f08ee00/0x48868a4e4394818c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eac0 expref: 22 pid: 8436 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.325637:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129744.325646:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949052007552:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 36us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.325808:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053224192:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129744.325821:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009faea400/0x48868a4e43948353 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129744.325838:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 530 00000100:00100000:3.0:1746129744.325842:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1964:x1830949052007424:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129744.326152:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 531 00000100:00100000:3.0:1746129744.326157:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1961:x1830949052006528:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:1.0:1746129744.326270:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053223168:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129744.326282:0:1140:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a8695000/0x48868a4e4394833e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.326310:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093d57000/0x48868a4e4394822d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4960256->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb3e expref: 7 pid: 3624 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746129744.326318:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053223552:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129744.326327:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b100000/0x48868a4e43948138 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4960256->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ea96 expref: 23 pid: 4589 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746129744.326334:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053223808:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129744.326341:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f08ee00/0x48868a4e4394818c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eac0 expref: 22 pid: 8436 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746129744.326348:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053223936:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129744.326355:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053224064:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129744.326367:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e4394834c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.326384:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 532 00000100:00100000:1.0:1746129744.326389:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949052007680:12345-192.168.204.31@tcp:4:cat.0 00010000:00010000:1.0:1746129744.326789:0:4589:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a8e57400/0x48868a4e43948330 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.326797:0:4589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8e57400/0x48868a4e43948330 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.326814:0:4589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e57400/0x48868a4e43948330 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.326820:0:4589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e57400/0x48868a4e43948330 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.326826:0:4589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a8e57400/0x48868a4e43948330 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.326831:0:4589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8e57400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129744.326835:0:4589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a8e57400/0x48868a4e43948330 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.326841:0:4589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a8e57400/0x48868a4e43948330 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.326880:0:4589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a8e57400/0x48868a4e43948330 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.326885:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e57400/0x48868a4e43948330 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.326917:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949052005248:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 15281us (15506us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129744.326923:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10384 00000100:00100000:0.0:1746129744.328149:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5004 00010000:00010000:0.0:1746129744.328187:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ffbce00/0x48868a4e43948035 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9d9 expref: 20 pid: 10930 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746129744.328197:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095240000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053223680:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129744.328217:0:8435:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4a00/0x48868a4e43948345 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.328224:0:8435:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4a00/0x48868a4e43948345 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.328231:0:8435:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4a00/0x48868a4e43948345 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.328246:0:8435:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4a00/0x48868a4e43948345 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.328252:0:8435:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4a00/0x48868a4e43948345 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.328257:0:8435:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4a00/0x48868a4e43948345 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.328263:0:8435:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b22c4a00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129744.328266:0:8435:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4a00/0x48868a4e43948345 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.328272:0:8435:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4a00/0x48868a4e43948345 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.328282:0:8435:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4a00/0x48868a4e43948345 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.328287:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4a00/0x48868a4e43948345 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.328321:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+7:1961:x1830949052005632:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 16405us (16834us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.328328:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10387 00000100:00100000:0.0:1746129744.329425:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.329550:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052007936 00000100:00100000:2.0:1746129744.329555:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052007936 00000100:00100000:2.0:1746129744.329584:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9765 00000100:00100000:2.0:1746129744.329590:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28407:x1830949052007936:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129744.329605:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129744.329617:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4c600/0x48868a4e43948361 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ebd1 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.330920:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4d800/0x48868a4e43948368 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.330934:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4d800/0x48868a4e43948368 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.330943:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4d800/0x48868a4e43948368 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.330955:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4da00/0x48868a4e4394836f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.330961:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4da00/0x48868a4e4394836f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.330966:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4da00/0x48868a4e4394836f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.331065:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4c800/0x48868a4e43948376 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.331074:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4c800/0x48868a4e43948376 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.331080:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4c800/0x48868a4e43948376 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:2.0:1746129744.331089:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129744.331157:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4c800/0x48868a4e43948376 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.331163:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4c800/0x48868a4e43948376 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.331168:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4c800/0x48868a4e43948376 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.331173:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a4c800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129744.331176:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4c800/0x48868a4e43948376 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.331182:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4c800/0x48868a4e43948376 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.331190:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129744.331192:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129744.331195:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4c800/0x48868a4e43948376 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.331200:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4c800/0x48868a4e43948376 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.331213:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4d800/0x48868a4e43948368 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.331217:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4d800/0x48868a4e43948368 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.331225:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4d800/0x48868a4e43948368 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.331229:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a4d800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129744.331231:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4d800/0x48868a4e43948368 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.331236:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4d800/0x48868a4e43948368 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.331241:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129744.331243:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129744.331245:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4d800/0x48868a4e43948368 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.331249:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4d800/0x48868a4e43948368 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.331725:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4da00/0x48868a4e4394836f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.331730:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4da00/0x48868a4e4394836f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.331734:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4da00/0x48868a4e4394836f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.331737:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a4da00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129744.331739:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4da00/0x48868a4e4394836f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.331743:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4da00/0x48868a4e4394836f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.331752:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800acd6ae00) 00010000:00010000:2.0:1746129744.331754:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129744.331757:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4da00/0x48868a4e4394836f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.331761:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4da00/0x48868a4e4394836f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.331795:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4c600/0x48868a4e43948361 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebd1 expref: 19 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.331802:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4c600/0x48868a4e43948361 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebd1 expref: 19 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.331809:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a4c600, rc 0) 00000100:00100000:2.0:1746129744.331864:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28407:x1830949052007936:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2254us (2421us total) trans 8589943534 rc 301/301 00000100:00100000:2.0:1746129744.331874:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9765 00000100:00100000:2.0:1746129744.333983:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.334091:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052008192 00000100:00100000:1.0:1746129744.334098:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052008192 00000100:00100000:1.0:1746129744.334138:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3811 00000100:00100000:1.0:1746129744.334145:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28407:x1830949052008192:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129744.334284:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:28407:x1830949052008192:12345-192.168.204.31@tcp:35:cat.0 Request processed in 139us (305us total) trans 8589943535 rc 0/0 00000100:00100000:1.0:1746129744.334290:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3811 00000100:00100000:0.0:1746129744.337460:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.337482:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.337494:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.337520:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.337542:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.337560:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.337576:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052008320 00000100:00100000:0.0:1746129744.337581:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052008320 00000100:00100000:1.0:1746129744.337590:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1964:x1830949052006144:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 12483us (12764us total) trans 21474840172 rc 0/0 00000100:00100000:1.0:1746129744.337598:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 529 00000100:00100000:0.0:1746129744.337603:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052008576 00000100:00100000:0.0:1746129744.337605:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052008576 00002000:00100000:1.0:1746129744.337607:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e6:0x0] (1425408->1888255) req@ffff880136318700 x1830949052006144/t21474840172(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/448 e 0 to 0 dl 1746129755 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746129744.337612:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052008832 00000100:00100000:0.0:1746129744.337613:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052008832 00002000:00100000:1.0:1746129744.337616:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136318700 with x1830949052006144 ext(1425408->1888255) 00000100:00100000:0.0:1746129744.337619:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052008448 00000100:00100000:0.0:1746129744.337620:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052008448 00010000:00010000:1.0:1746129744.337623:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093d57a00/0x48868a4e43948265 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1425408->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb53 expref: 24 pid: 3623 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746129744.337625:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052008704 00000100:00100000:0.0:1746129744.337626:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052008704 00000100:00100000:0.0:1746129744.337631:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052008960 00000100:00100000:0.0:1746129744.337632:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052008960 00010000:00010000:1.0:1746129744.337634:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093d57a00/0x48868a4e43948265 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1425408->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb53 expref: 25 pid: 3623 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746129744.337639:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10391 00002000:00010000:1.0:1746129744.337640:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136318700 00000100:00100000:0.0:1746129744.337644:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052008320:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129744.337655:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129744.337659:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10392 00000100:00100000:1.0:1746129744.337663:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:1962:x1830949052008576:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129744.337667:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009faeb200/0x48868a4e43948384 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ebd8 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.337668:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129744.337674:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a238000/0x48868a4e4394838b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ebe6 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129744.337682:0:8435:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e8:0x0] initial LVB size: 1048576, mtime: 0x6813d34f, atime: 0x6813d34f, ctime: 0x6813d34f, blocks: 0x807 00010000:00010000:0.0:1746129744.337690:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.337692:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.337698:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faeb200/0x48868a4e43948384 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebd8 expref: 10 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.337708:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009faeb200/0x48868a4e43948384 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebd8 expref: 10 pid: 8435 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129744.337711:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053224320:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129744.337716:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faeb200, rc 0) 00000100:00100000:0.0:1746129744.337730:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949052008320:12345-192.168.204.31@tcp:101:cat.0 Request processed in 86us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.337734:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10391 00000100:00100000:0.0:1746129744.337742:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10393 00000100:00100000:0.0:1746129744.337746:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052008832:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129744.337751:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129744.337754:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324240 going to sleep for 11 seconds 00010000:00010000:0.0:1746129744.337756:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009faea000/0x48868a4e43948392 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ebf4 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.337769:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009faea000/0x48868a4e43948392 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebf4 expref: 10 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.337776:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faea000/0x48868a4e43948392 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebf4 expref: 10 pid: 8435 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129744.337810:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10394 00000100:00100000:3.0:1746129744.337816:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1962:x1830949052008448:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129744.337822:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.337828:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43948399 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ebdf expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129744.337866:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053224448:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129744.337896:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129744.337910:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10395 00000100:00100000:3.0:1746129744.337915:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949052008704:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129744.337920:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.337927:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e439483a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ebed expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129744.337937:0:7976:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3ea:0x0] initial LVB size: 2097152, mtime: 0x6813d350, atime: 0x6813d34f, ctime: 0x6813d350, blocks: 0x81f 00010000:00010000:3.0:1746129744.337944:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.337946:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.337951:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e439483a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebed expref: 11 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.337959:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e439483a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebed expref: 11 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.337965:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5283400, rc 0) 00000100:00100000:3.0:1746129744.337983:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052008704:12345-192.168.204.31@tcp:101:cat.0 Request processed in 69us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.337989:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10395 00000100:00100000:3.0:1746129744.338000:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10396 00000100:00100000:3.0:1746129744.338004:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+27:1962:x1830949052008960:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129744.338009:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.338015:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5283000/0x48868a4e439483a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ebfb expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129744.338034:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053224576:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129744.338053:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803a80 going to sleep for 11 seconds 00010000:00010000:0.0:1746129744.338999:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faea000, rc 0) 00000100:00100000:0.0:1746129744.339021:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052008832:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1273us (1525us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129744.339025:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10393 00000001:00080000:2.0:1746129744.339455:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840171 is committed 00000001:00080000:2.0:1746129744.339466:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840170 is committed 00000001:00080000:2.0:1746129744.339472:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840159 is committed 00000001:00080000:2.0:1746129744.339488:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840142 is committed 00000001:00080000:2.0:1746129744.339501:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840166 is committed 00000001:00080000:2.0:1746129744.339554:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840168 is committed 00000001:00080000:2.0:1746129744.339602:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840144 is committed 00000100:00100000:1.0:1746129744.340793:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053224320:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129744.340816:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a238000/0x48868a4e4394838b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebe6 expref: 16 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.340826:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a238000/0x48868a4e4394838b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebe6 expref: 16 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.340833:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a238000, rc 0) 00000100:00100000:1.0:1746129744.340885:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949052008576:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3220us (3401us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129744.340891:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10392 00000100:00100000:2.0:1746129744.340952:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053224576:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129744.340965:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5283000/0x48868a4e439483a7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebfb expref: 14 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.340974:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5283000/0x48868a4e439483a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebfb expref: 14 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.340981:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5283000, rc 0) 00000100:00100000:2.0:1746129744.340996:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949052008960:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2991us (3435us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129744.341001:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10396 00000100:00100000:3.0:1746129744.341066:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053224448:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129744.341078:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43948399 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebdf expref: 12 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.341085:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43948399 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebdf expref: 12 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.341091:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5283600, rc 0) 00000100:00100000:3.0:1746129744.341106:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052008448:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3291us (3585us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129744.341110:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10394 00000100:00100000:2.0:1746129744.342464:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052006528:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 16303us (17525us total) trans 21474840173 rc 0/0 00000100:00100000:2.0:1746129744.342473:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 531 00002000:00100000:2.0:1746129744.342481:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->1089535) req@ffff88009f6a6300 x1830949052006528/t21474840173(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/448 e 0 to 0 dl 1746129755 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129744.342489:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a6300 with x1830949052006528 ext(1048576->1089535) 00010000:00010000:2.0:1746129744.342496:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135677800/0x48868a4e439481e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaff expref: 11 pid: 3624 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.342505:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135677800/0x48868a4e439481e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaff expref: 11 pid: 3624 timeout: 790 lvb_type: 0 00002000:00010000:2.0:1746129744.342510:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f6a6300 00000100:00100000:0.0:1746129744.345299:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1964:x1830949052007424:12345-192.168.204.31@tcp:4:cat.0 Request processed in 19448us (20400us total) trans 17179873009 rc 0/0 00000100:00100000:0.0:1746129744.345309:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 530 00002000:00100000:0.0:1746129744.345318:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3698688->4194303) req@ffff88013631a300 x1830949052007424/t17179873009(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/448 e 0 to 0 dl 1746129755 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129744.345325:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631a300 with x1830949052007424 ext(3698688->4194303) 00010000:00010000:0.0:1746129744.345333:0:21600:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b101600/0x48868a4e4394821f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3698688->4960255] (req 3698688->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb29 expref: 20 pid: 3624 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.345344:0:21600:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b101600/0x48868a4e4394821f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3698688->4960255] (req 3698688->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb29 expref: 20 pid: 3624 timeout: 790 lvb_type: 0 00002000:00010000:0.0:1746129744.345349:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013631a300 00000100:00100000:2.0:1746129744.345673:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.345874:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052009088 00000100:00100000:1.0:1746129744.345881:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052009088 00010000:00010000:1.0:1746129744.345903:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093d57a00/0x48868a4e43948265 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1425408->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb53 expref: 11 pid: 3623 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746129744.345923:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5005 00000100:00100000:1.0:1746129744.345929:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1963:x1830949052009088:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129744.345940:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129744.345954:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093d57a00/0x48868a4e43948265 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1425408->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb53 expref: 11 pid: 3623 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746129744.345969:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093d57a00/0x48868a4e43948265 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1425408->1888255) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb53 expref: 11 pid: 3623 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746129744.345987:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093d57a00/0x48868a4e43948265 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1425408->1888255) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb53 expref: 11 pid: 3623 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746129744.345999:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129744.346000:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129744.346004:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e43948337 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.346011:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e43948337 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.346030:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129744.346050:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1963:x1830949052009088:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 120us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129744.346055:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5005 00010000:00010000:1.0:1746129744.346074:0:3624:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e43948337 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.346082:0:3624:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e43948337 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.346098:0:3624:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e43948337 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.346109:0:3624:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e43948337 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.346115:0:3624:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e43948337 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.346121:0:3624:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8695a00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129744.346124:0:3624:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e43948337 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.346131:0:3624:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e43948337 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.346138:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129744.346139:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129744.346145:0:3624:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e4394835a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebca expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.346151:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e4394835a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebca expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.346174:0:3624:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e4394835a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebca expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.346186:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053224704:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129744.346230:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324240 going to sleep for 11 seconds 00000100:00100000:1.0:1746129744.352186:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.352237:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.352304:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052009216 00000100:00100000:2.0:1746129744.352311:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052009216 00010000:00010000:2.0:1746129744.352341:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135677800/0x48868a4e439481e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaff expref: 10 pid: 3624 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.352363:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052009344 00000100:00100000:2.0:1746129744.352365:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052009344 00010000:00010000:2.0:1746129744.352374:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b101600/0x48868a4e4394821f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3698688->4960255] (req 3698688->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb29 expref: 20 pid: 3624 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.352386:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5006 00000100:00100000:2.0:1746129744.352391:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052009216:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129744.352400:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.352414:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135677800/0x48868a4e439481e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaff expref: 10 pid: 3624 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.352423:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135677800/0x48868a4e439481e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaff expref: 10 pid: 3624 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.352441:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135677800/0x48868a4e439481e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eaff expref: 10 pid: 3624 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.352453:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.352455:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.352459:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8695000/0x48868a4e4394833e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.352466:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8695000/0x48868a4e4394833e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.352483:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129744.352514:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1961:x1830949052009216:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 122us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.352519:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5006 00000100:00100000:2.0:1746129744.352545:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5007 00000100:00100000:2.0:1746129744.352550:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1963:x1830949052009344:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129744.352556:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.352566:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b101600/0x48868a4e4394821f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3698688->4960255] (req 3698688->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb29 expref: 20 pid: 3624 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.352573:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b101600/0x48868a4e4394821f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3698688->4960255] (req 3698688->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb29 expref: 20 pid: 3624 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746129744.353235:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.353323:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052009600 00000100:00100000:0.0:1746129744.353327:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052009600 00002000:00100000:0.0:1746129744.353349:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009adafb80 x1830949052009600/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129744.353358:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adafb80 with x1830949052009600 ext(0->1048575) 00002000:00010000:0.0:1746129744.353361:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adafb80 00000100:00100000:0.0:1746129744.353374:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3832 00000100:00100000:0.0:1746129744.353379:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1961:x1830949052009600:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129744.355136:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949052007680:12345-192.168.204.31@tcp:4:cat.0 Request processed in 28740us (30171us total) trans 21474840174 rc 0/0 00000100:00100000:1.0:1746129744.355144:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 532 00002000:00100000:1.0:1746129744.355152:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->3432447) req@ffff88009f6a6a00 x1830949052007680/t21474840174(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/448 e 0 to 0 dl 1746129755 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129744.355160:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a6a00 with x1830949052007680 ext(3145728->3432447) 00010000:00010000:1.0:1746129744.355167:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b100200/0x48868a4e4394825e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb4c expref: 14 pid: 3624 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746129744.355180:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b100200/0x48868a4e4394825e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb4c expref: 14 pid: 3624 timeout: 790 lvb_type: 0 00002000:00010000:1.0:1746129744.355186:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f6a6a00 00010000:00010000:1.0:1746129744.355212:0:1140:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a8695000/0x48868a4e4394833e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.355219:0:1140:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8695000/0x48868a4e4394833e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.355236:0:1140:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8695000/0x48868a4e4394833e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.355242:0:1140:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8695000/0x48868a4e4394833e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.355253:0:1140:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8695000/0x48868a4e4394833e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.355258:0:1140:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8695000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129744.355261:0:1140:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8695000/0x48868a4e4394833e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.355267:0:1140:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8695000/0x48868a4e4394833e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.355280:0:1140:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8695000/0x48868a4e4394833e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.355286:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8695000/0x48868a4e4394833e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.355319:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949052005504:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 43439us (43845us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129744.355325:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10386 00010000:00010000:2.0:1746129744.355468:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b101600/0x48868a4e4394821f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3698688->4960255] (req 3698688->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb29 expref: 20 pid: 3624 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.355477:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.355479:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.355482:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e4394834c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.355488:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e4394834c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.355504:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129744.355524:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1963:x1830949052009344:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2974us (3287us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.355540:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5007 00010000:00010000:1.0:1746129744.359730:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e4394834c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.359744:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e4394834c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.359770:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e4394834c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.359777:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e4394834c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.359783:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e4394834c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.359789:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8694600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129744.359792:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e4394834c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.359797:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e4394834c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.359813:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e4394834c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.359818:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e4394834c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129744.362163:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053224704:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129744.362184:0:3624:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e43948337 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.362196:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e43948337 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.362733:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+6:1961:x1830949052005760:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 50762us (51231us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129744.362743:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10388 00000100:00100000:3.0:1746129744.363210:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+7:1961:x1830949052005376:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 51447us (51760us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.363219:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10385 00000100:00100000:0.0:1746129744.366681:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.366739:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052009856 00000100:00100000:2.0:1746129744.366747:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052009856 00002000:00100000:2.0:1746129744.366782:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009fbeea00 x1830949052009856/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129744.366792:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbeea00 with x1830949052009856 ext(1048576->2097151) 00002000:00010000:2.0:1746129744.366796:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbeea00 00000100:00100000:2.0:1746129744.366825:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3833 00000100:00100000:2.0:1746129744.366833:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1962:x1830949052009856:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129744.371933:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.372483:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052009984 00000100:00100000:2.0:1746129744.372492:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052009984 00010000:00010000:2.0:1746129744.372523:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b100200/0x48868a4e4394825e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb4c expref: 16 pid: 3624 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.372561:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5008 00000100:00100000:2.0:1746129744.372569:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1961:x1830949052009984:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129744.372579:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.372597:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b100200/0x48868a4e4394825e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb4c expref: 16 pid: 3624 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.372609:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b100200/0x48868a4e4394825e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb4c expref: 16 pid: 3624 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.372628:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b100200/0x48868a4e4394825e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb4c expref: 16 pid: 3624 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.372643:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.372644:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.372649:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009faea400/0x48868a4e43948353 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.372656:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009faea400/0x48868a4e43948353 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.372675:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129744.372723:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949052009984:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 155us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.372730:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5008 00010000:00010000:3.0:1746129744.372844:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009faea400/0x48868a4e43948353 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.372867:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009faea400/0x48868a4e43948353 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.372886:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009faea400/0x48868a4e43948353 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.372892:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009faea400/0x48868a4e43948353 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.372904:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009faea400/0x48868a4e43948353 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.372909:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faea400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129744.372913:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009faea400/0x48868a4e43948353 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.372919:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009faea400/0x48868a4e43948353 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.372930:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009faea400/0x48868a4e43948353 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.372935:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009faea400/0x48868a4e43948353 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129744.372980:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+6:1961:x1830949052005888:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 60911us (61460us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.372987:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10389 00000100:00100000:0.0:1746129744.374079:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1961:x1830949052009600:12345-192.168.204.31@tcp:3:cat.0 Request processed in 20697us (20843us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129744.374086:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3832 00002000:00100000:0.0:1746129744.374094:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009adafb80 x1830949052009600/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129744.374101:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adafb80 with x1830949052009600 ext(0->1048575) 00002000:00010000:0.0:1746129744.374105:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adafb80 00000100:00100000:2.0:1746129744.378150:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949052009856:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11308us (11467us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129744.378161:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3833 00002000:00100000:2.0:1746129744.378171:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009fbeea00 x1830949052009856/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129744.378179:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbeea00 with x1830949052009856 ext(1048576->2097151) 00002000:00010000:2.0:1746129744.378185:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbeea00 00000100:00100000:0.0:1746129744.380724:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.381170:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052010240 00000100:00100000:2.0:1746129744.381177:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052010240 00000100:00100000:2.0:1746129744.381250:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9766 00000100:00100000:2.0:1746129744.381258:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+12:28399:x1830949052010240:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:2.0:1746129744.381303:0:16808:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.381326:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e439482c0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb84 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.381479:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129744.381484:0:16808:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129744.381508:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6eaa00/0x48868a4e439483ae lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.381519:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3c00/0x48868a4e43947fef lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e993 expref: 18 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.381525:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2e00/0x48868a4e43948004 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9a8 expref: 18 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.381541:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2c00/0x48868a4e4394800b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9af expref: 292 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.381548:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100800/0x48868a4e43948177 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eab2 expref: 292 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.381554:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4200/0x48868a4e43948249 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb37 expref: 18 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.381560:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeaa00/0x48868a4e439482e3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb8b expref: 292 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.381565:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6eaa00/0x48868a4e439483ae lrc: 9/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.381590:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeaa00/0x48868a4e439482e3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb8b expref: 292 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.381600:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeaa00/0x48868a4e439482e3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb8b expref: 292 pid: 14315 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.381612:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053224832:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.382073:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4200/0x48868a4e43948249 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb37 expref: 18 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.382081:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4200/0x48868a4e43948249 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb37 expref: 18 pid: 16808 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.382088:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053224960:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.382115:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100800/0x48868a4e43948177 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eab2 expref: 292 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.382121:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100800/0x48868a4e43948177 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eab2 expref: 292 pid: 14315 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.382128:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053225088:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.382147:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2c00/0x48868a4e4394800b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9af expref: 292 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.382152:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2c00/0x48868a4e4394800b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9af expref: 292 pid: 1851 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.382159:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053225216:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.382176:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2e00/0x48868a4e43948004 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9a8 expref: 18 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.382182:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2e00/0x48868a4e43948004 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9a8 expref: 18 pid: 1851 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.382193:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053225344:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.382212:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3c00/0x48868a4e43947fef lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e993 expref: 18 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.382218:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3c00/0x48868a4e43947fef lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e993 expref: 18 pid: 16808 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.382224:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053225472:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129744.382239:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.383603:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.384023:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.384141:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052010368 00000100:00100000:2.0:1746129744.384147:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052010368 00000100:00100000:0.0:1746129744.384484:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.384506:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.384541:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052010496 00000100:00100000:2.0:1746129744.384545:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052010496 00000100:00100000:3.0:1746129744.384625:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10397 00000100:00100000:3.0:1746129744.384633:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:28404:x1830949052010368:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129744.384647:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.384660:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5600/0x48868a4e439483b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ec02 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129744.384683:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e7:0x0] initial LVB size: 2097152, mtime: 0x6813d350, atime: 0x6813d350, ctime: 0x6813d350, blocks: 0x821 00010000:00010000:3.0:1746129744.384697:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.384699:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.384704:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5600/0x48868a4e439483b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec02 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.384715:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5600/0x48868a4e439483b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec02 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.384722:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b22c5600, rc 0) 00000100:00100000:3.0:1746129744.384750:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:28404:x1830949052010368:12345-192.168.204.31@tcp:101:cat.0 Request processed in 118us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.384755:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10397 00000100:00100000:3.0:1746129744.384767:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10398 00000100:00100000:3.0:1746129744.384771:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28407:x1830949052010496:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129744.384776:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.384780:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e439483bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ec09 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.384788:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.384789:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.384793:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e439483bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec09 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.384799:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e439483bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec09 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.384809:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b22c5000, rc 0) 00000100:00100000:3.0:1746129744.384818:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28407:x1830949052010496:12345-192.168.204.31@tcp:101:cat.0 Request processed in 47us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.384822:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10398 00000100:00100000:3.0:1746129744.384836:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052010880 00000100:00100000:3.0:1746129744.384838:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052010880 00010000:00010000:3.0:1746129744.384866:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100800/0x48868a4e43948177 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eab2 expref: 293 pid: 14315 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746129744.384879:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052011136 00000100:00100000:3.0:1746129744.384880:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052011136 00010000:00010000:3.0:1746129744.384888:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2e00/0x48868a4e43948004 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9a8 expref: 19 pid: 1851 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746129744.384897:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5009 00000100:00100000:3.0:1746129744.384900:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131462300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:1963:x1830949052010880:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129744.384907:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129744.384910:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100800/0x48868a4e43948177 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eab2 expref: 293 pid: 14315 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746129744.384918:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100800/0x48868a4e43948177 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eab2 expref: 293 pid: 14315 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746129744.384929:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129744.384932:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6eaa00/0x48868a4e439483ae lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.384942:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129744.384952:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131462300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:1963:x1830949052010880:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 52us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.384956:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5009 00000100:00100000:3.0:1746129744.384969:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5010 00000100:00100000:3.0:1746129744.384972:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1963:x1830949052011136:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129744.384977:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129744.384979:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2e00/0x48868a4e43948004 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9a8 expref: 19 pid: 1851 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746129744.384985:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2e00/0x48868a4e43948004 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9a8 expref: 19 pid: 1851 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746129744.384992:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129744.384994:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6eaa00/0x48868a4e439483ae lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.384998:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129744.385005:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1963:x1830949052011136:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 32us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.385009:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5010 00000100:00100000:2.0:1746129744.385090:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053224832:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129744.385099:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053224960:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.385106:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b100800/0x48868a4e43948177 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eab2 expref: 292 pid: 14315 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.385116:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053225088:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129744.385123:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053225216:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.385129:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2e00/0x48868a4e43948004 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9a8 expref: 18 pid: 1851 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.385136:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053225344:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129744.385143:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053225472:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.385163:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6eaa00/0x48868a4e439483ae lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:0.0:1746129744.385479:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.385864:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.385892:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.385996:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.386156:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052010624 00000100:00100000:2.0:1746129744.386159:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052010624 00010000:00010000:2.0:1746129744.386174:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeaa00/0x48868a4e439482e3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb8b expref: 292 pid: 14315 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.386190:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052011008 00000100:00100000:2.0:1746129744.386192:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052011008 00010000:00010000:2.0:1746129744.386198:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2c00/0x48868a4e4394800b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9af expref: 293 pid: 1851 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.386207:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052010752 00000100:00100000:2.0:1746129744.386209:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052010752 00010000:00010000:2.0:1746129744.386215:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4200/0x48868a4e43948249 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb37 expref: 18 pid: 16808 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.386222:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052011264 00000100:00100000:2.0:1746129744.386223:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052011264 00010000:00010000:2.0:1746129744.386228:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3c00/0x48868a4e43947fef lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e993 expref: 19 pid: 16808 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.386236:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5011 00000100:00100000:2.0:1746129744.386241:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:1962:x1830949052010624:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129744.386249:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.386252:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeaa00/0x48868a4e439482e3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb8b expref: 293 pid: 14315 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.386263:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeaa00/0x48868a4e439482e3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb8b expref: 293 pid: 14315 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.386273:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeaa00/0x48868a4e439482e3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb8b expref: 293 pid: 14315 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.386282:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129744.386286:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6eaa00/0x48868a4e439483ae lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.386291:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129744.386311:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:1962:x1830949052010624:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 70us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.386316:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5011 00000100:00100000:2.0:1746129744.386328:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5012 00000100:00100000:2.0:1746129744.386333:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:1962:x1830949052011008:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129744.386339:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.386342:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2c00/0x48868a4e4394800b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9af expref: 291 pid: 1851 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.386349:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2c00/0x48868a4e4394800b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9af expref: 291 pid: 1851 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.386358:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb2c00/0x48868a4e4394800b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e9af expref: 291 pid: 1851 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.386365:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129744.386368:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6eaa00/0x48868a4e439483ae lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.386373:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129744.386386:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:1962:x1830949052011008:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 54us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.386391:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5012 00000100:00100000:2.0:1746129744.386402:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5013 00000100:00100000:2.0:1746129744.386406:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949052010752:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129744.386412:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.386415:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4200/0x48868a4e43948249 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb37 expref: 19 pid: 16808 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.386422:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4200/0x48868a4e43948249 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb37 expref: 19 pid: 16808 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.386431:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4200/0x48868a4e43948249 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eb37 expref: 19 pid: 16808 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.386438:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129744.386441:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6eaa00/0x48868a4e439483ae lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.386445:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129744.386456:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052010752:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 50us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.386461:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5013 00000100:00100000:2.0:1746129744.386471:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5014 00000100:00100000:2.0:1746129744.386475:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052011264:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129744.386482:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.386485:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3c00/0x48868a4e43947fef lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e993 expref: 17 pid: 16808 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.386492:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3c00/0x48868a4e43947fef lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e993 expref: 17 pid: 16808 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.386501:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3c00/0x48868a4e43947fef lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34e993 expref: 17 pid: 16808 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.386509:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129744.386511:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6eaa00/0x48868a4e439483ae lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.386517:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6eaa00/0x48868a4e439483ae lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.386522:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6eaa00/0x48868a4e439483ae lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.386546:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129744.386560:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052011264:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 84us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.386564:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5014 00010000:00010000:2.0:1746129744.386591:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6eaa00/0x48868a4e439483ae lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.386597:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6eaa00/0x48868a4e439483ae lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:1.0:1746129744.387161:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.387208:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052011392 00000100:00100000:0.0:1746129744.387212:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052011392 00000100:00100000:1.0:1746129744.387218:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.387327:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052011520 00000100:00100000:0.0:1746129744.387330:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052011520 00000100:00100000:3.0:1746129744.387333:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9767 00000100:00100000:3.0:1746129744.387339:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28407:x1830949052011392:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:0.0:1746129744.387344:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9768 00000100:00100000:0.0:1746129744.387347:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:28404:x1830949052011520:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129744.387351:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.387353:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.387359:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e439483c3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ec10 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.387359:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87c800/0x48868a4e439483ca lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ec17 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.387386:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6eaa00/0x48868a4e439483ae lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.387392:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87c800/0x48868a4e439483ca lrc: 4/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec17 expref: 291 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.387451:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e439483c3 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec10 expref: 17 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.387482:0:14315:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6eaa00/0x48868a4e439483ae lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.387483:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e439483c3 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec10 expref: 17 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.387490:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87c800/0x48868a4e439483ca lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec17 expref: 291 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.387492:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129744.387494:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129744.387496:0:15044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87c800/0x48868a4e439483ca lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec17 expref: 291 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.387502:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b22c4000, rc 0) 00000100:00100000:3.0:1746129744.387529:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28407:x1830949052011392:12345-192.168.204.31@tcp:101:cat.0 Request processed in 185us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.387544:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9767 00010000:00010000:0.0:1746129744.387577:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129744.387579:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129744.387583:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87c800/0x48868a4e439483ca lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec17 expref: 291 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.387589:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f87c800, rc 0) 00000100:00100000:0.0:1746129744.387604:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:28404:x1830949052011520:12345-192.168.204.31@tcp:101:cat.0 Request processed in 256us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.387608:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9768 00000040:00080000:2.0:1746129744.387968:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2714, 88 off225672 00000004:00080000:2.0:1746129744.387976:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690446127851ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129744.388025:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2660, 88 off221000 00000004:00080000:2.0:1746129744.388030:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690446181381ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129744.388040:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2661, 88 off221088 00000004:00080000:2.0:1746129744.388043:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690446195289ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129744.388050:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2715, 88 off225760 00000004:00080000:2.0:1746129744.388052:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690446204024ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129744.388059:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2716, 88 off225848 00000004:00080000:2.0:1746129744.388061:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690446212881ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129744.388421:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2663, 88 off221272 00000004:00080000:2.0:1746129744.388426:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690446578501ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129744.388704:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2664, 88 off221360 00000004:00080000:2.0:1746129744.388708:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690446860452ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129744.388720:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2665, 88 off221448 00000004:00080000:2.0:1746129744.388723:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690446875274ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129744.388731:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2717, 88 off225936 00000004:00080000:2.0:1746129744.388733:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690446885196ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129744.388747:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2666, 88 off221536 00000004:00080000:2.0:1746129744.388750:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690446902226ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129744.388756:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2718, 88 off226024 00000004:00080000:2.0:1746129744.388758:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690446910599ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129744.388764:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2667, 88 off221624 00000004:00080000:2.0:1746129744.388768:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690446919876ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129744.388774:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2719, 88 off226112 00000004:00080000:2.0:1746129744.388776:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690446928269ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129744.388784:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2720, 88 off226200 00000004:00080000:2.0:1746129744.388786:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690446938297ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129744.388793:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2721, 88 off226288 00000004:00080000:2.0:1746129744.388796:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690446947846ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129744.388803:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2722, 88 off226376 00000004:00080000:2.0:1746129744.388805:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690446957016ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129744.388811:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2668, 88 off221712 00000004:00080000:2.0:1746129744.388813:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690446965567ns, next at 641623252291ns, rc = 0 00000004:00010000:3.0:1746129744.408074:0:16808:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009fbee680 reply state ffff88009f9e5800 transno 8589943536 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6eaa00/0x48868a4e439483ae lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00000100:00100000:3.0:1746129744.408087:0:16808:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746129744.408176:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+13:28399:x1830949052010240:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 26915us (27456us total) trans 8589943536 rc 0/0 00000100:00100000:3.0:1746129744.408184:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9766 00000001:00080000:0.0:1746129744.408242:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943533 is committed 00000001:00080000:0.0:1746129744.408249:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943532 is committed 00000001:00080000:0.0:1746129744.408255:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943528 is committed 00000001:00080000:0.0:1746129744.408264:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943535 is committed 00000001:00080000:0.0:1746129744.408275:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943536 is committed 00000004:00080000:0.0:1746129744.408278:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1854 committed 00000004:00080000:0.0:1746129744.408283:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1905 committed 00000004:00080000:0.0:1746129744.408288:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1904 committed 00000004:00080000:0.0:1746129744.408289:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1903 committed 00000004:00080000:0.0:1746129744.408291:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1902 committed 00000004:00080000:0.0:1746129744.408292:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1853 committed 00000004:00080000:0.0:1746129744.408293:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1901 committed 00000004:00080000:0.0:1746129744.408295:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1852 committed 00000004:00080000:0.0:1746129744.408297:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1900 committed 00000004:00080000:0.0:1746129744.408299:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1851 committed 00000004:00080000:0.0:1746129744.408300:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1850 committed 00000004:00080000:0.0:1746129744.408301:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1849 committed 00000004:00080000:0.0:1746129744.408303:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1899 committed 00000004:00080000:0.0:1746129744.408304:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1898 committed 00000004:00080000:0.0:1746129744.408305:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1848 committed 00000004:00080000:0.0:1746129744.408307:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1847 committed 00000004:00080000:0.0:1746129744.408308:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1897 committed 00000100:00100000:0.0:1746129744.408515:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053225728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129744.408568:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129744.408588:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053226240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129744.408601:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129744.408612:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746129744.408616:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053225856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129744.408626:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129744.408633:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053226368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129744.408643:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129744.408659:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053225728 00000100:00100000:0.0:1746129744.408665:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053225728 00000100:00100000:0.0:1746129744.408684:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053226240 00000100:00100000:0.0:1746129744.408686:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053226240 00000100:00100000:0.0:1746129744.408695:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053225856 00000100:00100000:0.0:1746129744.408697:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053225856 00000100:00100000:0.0:1746129744.408705:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053226368 00000100:00100000:0.0:1746129744.408706:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053226368 00000100:00100000:0.0:1746129744.408715:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10399 00000100:00100000:0.0:1746129744.408720:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3296:x1830949053225728:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129744.408901:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129744.408904:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129744 -> 1746129744 00002000:00010000:0.0:1746129744.408906:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746129743 -> 1746129743 00002000:00010000:0.0:1746129744.408907:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129744 -> 1746129744 00002000:00010000:0.0:1746129744.408909:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746129744.408929:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3296:x1830949053225728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 209us (361us total) trans 17179873010 rc 0/0 00000100:00100000:0.0:1746129744.408934:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10399 00000100:00100000:0.0:1746129744.408944:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10400 00000100:00100000:0.0:1746129744.408947:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3296:x1830949053226240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129744.409022:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3296:x1830949053226240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (419us total) trans 17179873011 rc 0/0 00000100:00100000:0.0:1746129744.409026:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10400 00000100:00100000:0.0:1746129744.409035:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10401 00000100:00100000:0.0:1746129744.409039:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3296:x1830949053225856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129744.409105:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3296:x1830949053225856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (478us total) trans 17179873012 rc 0/0 00000100:00100000:0.0:1746129744.409109:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10401 00000100:00100000:0.0:1746129744.409116:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10402 00000100:00100000:0.0:1746129744.409120:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3296:x1830949053226368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129744.409184:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3296:x1830949053226368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (540us total) trans 17179873013 rc 0/0 00000100:00100000:0.0:1746129744.409189:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10402 00000100:00100000:0.0:1746129744.409221:0:3296:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873005 gen 2 00000004:00080000:0.0:1746129744.409224:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094d8df80, transno 17179872916 00000004:00080000:0.0:1746129744.409229:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094768000, transno 17179872917 00000004:00080000:0.0:1746129744.409232:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009476aa00, transno 17179872918 00000004:00080000:0.0:1746129744.409234:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c137b80, transno 17179872919 00000004:00080000:0.0:1746129744.409236:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284df80, transno 17179872920 00000004:00080000:0.0:1746129744.409238:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094769c00, transno 17179872921 00000004:00080000:0.0:1746129744.409239:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c135500, transno 17179872922 00000004:00080000:0.0:1746129744.409241:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009476b800, transno 17179872923 00000004:00080000:0.0:1746129744.409243:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c134380, transno 17179872924 00000004:00080000:0.0:1746129744.409245:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130505500, transno 17179872930 00000004:00080000:0.0:1746129744.409247:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba84380, transno 17179872931 00000004:00080000:0.0:1746129744.409248:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130506300, transno 17179872932 00000004:00080000:0.0:1746129744.409250:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba85c00, transno 17179872933 00000004:00080000:0.0:1746129744.409252:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba86a00, transno 17179872934 00000004:00080000:0.0:1746129744.409254:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130504380, transno 17179872935 00000004:00080000:0.0:1746129744.409256:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130504700, transno 17179872936 00000004:00080000:0.0:1746129744.409258:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c040380, transno 17179872937 00000004:00080000:0.0:1746129744.409259:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba87800, transno 17179872938 00000004:00080000:0.0:1746129744.409261:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00ea00, transno 17179872942 00000004:00080000:0.0:1746129744.409263:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00ca80, transno 17179872943 00000004:00080000:0.0:1746129744.409265:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00d880, transno 17179872944 00000004:00080000:0.0:1746129744.409267:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00f100, transno 17179872945 00000004:00080000:0.0:1746129744.409268:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00c380, transno 17179872946 00000004:00080000:0.0:1746129744.409270:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00ce00, transno 17179872947 00000004:00080000:0.0:1746129744.409271:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00e680, transno 17179872948 00000004:00080000:0.0:1746129744.409273:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00d180, transno 17179872949 00000004:00080000:0.0:1746129744.409275:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00fb80, transno 17179872950 00000004:00080000:0.0:1746129744.409277:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136886a00, transno 17179872951 00000004:00080000:0.0:1746129744.409278:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136884000, transno 17179872952 00000004:00080000:0.0:1746129744.409280:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136886680, transno 17179872953 00000004:00080000:0.0:1746129744.409282:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136885c00, transno 17179872954 00000004:00080000:0.0:1746129744.409284:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136884e00, transno 17179872955 00000004:00080000:0.0:1746129744.409286:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136887800, transno 17179872956 00000004:00080000:0.0:1746129744.409287:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136885880, transno 17179872957 00000004:00080000:0.0:1746129744.409289:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136884a80, transno 17179872958 00000004:00080000:0.0:1746129744.409291:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423dc00, transno 17179872959 00000004:00080000:0.0:1746129744.409293:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04c000, transno 17179872967 00000004:00080000:0.0:1746129744.409295:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04ca80, transno 17179872968 00000004:00080000:0.0:1746129744.409297:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04d880, transno 17179872969 00000004:00080000:0.0:1746129744.409299:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04ed80, transno 17179872970 00000004:00080000:0.0:1746129744.409301:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04c380, transno 17179872971 00000004:00080000:0.0:1746129744.409302:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04d180, transno 17179872972 00000004:00080000:0.0:1746129744.409304:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04ce00, transno 17179872973 00000004:00080000:0.0:1746129744.409306:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04ea00, transno 17179872974 00000004:00080000:0.0:1746129744.409308:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04c700, transno 17179872975 00000004:00080000:0.0:1746129744.409310:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094d8e300, transno 17179872979 00000004:00080000:0.0:1746129744.409312:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8fd2680, transno 17179872980 00000004:00080000:0.0:1746129744.409314:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8fd3100, transno 17179872981 00000004:00080000:0.0:1746129744.409315:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094d8f800, transno 17179872982 00000004:00080000:0.0:1746129744.409317:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8fd0a80, transno 17179872983 00000004:00080000:0.0:1746129744.409319:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094d8f100, transno 17179872984 00000004:00080000:0.0:1746129744.409321:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8fd3800, transno 17179872985 00000004:00080000:0.0:1746129744.409322:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8fd0700, transno 17179872986 00000004:00080000:0.0:1746129744.409324:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d8ce00, transno 17179872987 00000004:00080000:0.0:1746129744.409326:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d8f480, transno 17179872988 00000004:00080000:0.0:1746129744.409328:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d8fb80, transno 17179872989 00000004:00080000:0.0:1746129744.409329:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d8df80, transno 17179872990 00000004:00080000:0.0:1746129744.409332:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a645d180, transno 17179872991 00000004:00080000:0.0:1746129744.409333:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d8dc00, transno 17179872992 00000004:00080000:0.0:1746129744.409335:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a645dc00, transno 17179872993 00000004:00080000:0.0:1746129744.409337:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d8ca80, transno 17179872994 00000004:00080000:0.0:1746129744.409339:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d8ed80, transno 17179872995 00000004:00080000:0.0:1746129744.409341:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d637800, transno 17179872996 00000004:00080000:0.0:1746129744.409343:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adadc00, transno 17179872997 00000004:00080000:0.0:1746129744.409345:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adad180, transno 17179872998 00000004:00080000:0.0:1746129744.409347:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adac380, transno 17179872999 00000004:00080000:0.0:1746129744.409348:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adac700, transno 17179873000 00000004:00080000:0.0:1746129744.409350:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adad880, transno 17179873001 00000004:00080000:0.0:1746129744.409352:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adace00, transno 17179873002 00000004:00080000:0.0:1746129744.409354:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adad500, transno 17179873003 00000004:00080000:0.0:1746129744.409355:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adaed80, transno 17179873004 00000004:00080000:0.0:1746129744.409357:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c137100, transno 17179873005 00000100:00100000:0.0:1746129744.409362:0:3296:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880131461500 x1830949053225856/t17179873012(17179873012) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746129760 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746129744.409370:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131461500/2, rc 0, transno 17179873012 00000100:00100000:0.0:1746129744.409374:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053225856:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129744.409384:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131461f80/2, rc 0, transno 17179873013 00000100:00100000:0.0:1746129744.409387:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053226368:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129744.409392:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131461880/2, rc 0, transno 17179873010 00000100:00100000:0.0:1746129744.409394:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053225728:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129744.409399:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131460000/2, rc 0, transno 17179873011 00000100:00100000:0.0:1746129744.409401:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053226240:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129744.409712:0:14359:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 4 in flight, 72 done 00010000:00010000:2.0:1746129744.409879:0:3283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6eaa00/0x48868a4e439483ae lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.409887:0:3283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6eaa00/0x48868a4e439483ae lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.409893:0:3283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6eaa00/0x48868a4e439483ae lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.409898:0:3283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6eaa00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129744.409902:0:3283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6eaa00/0x48868a4e439483ae lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.409907:0:3283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6eaa00/0x48868a4e439483ae lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.409919:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129744.409922:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129744.409927:0:3283:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87c800/0x48868a4e439483ca lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec17 expref: 281 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.409937:0:3283:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87c800/0x48868a4e439483ca lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec17 expref: 281 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.409944:0:3283:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87c800/0x48868a4e439483ca lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec17 expref: 281 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.409953:0:3283:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e439483c3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec10 expref: 7 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.409958:0:3283:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e439483c3 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec10 expref: 7 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.409963:0:3283:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e439483c3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec10 expref: 7 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.409985:0:3283:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e439483c3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec10 expref: 7 pid: 15044 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129744.409994:0:3283:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631b100 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3283:1830949053226752:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129744.410036:0:3283:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87c800/0x48868a4e439483ca lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec17 expref: 281 pid: 14315 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129744.410043:0:3283:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136318a80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3283:1830949053227776:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129744.410052:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053225984:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129744.410056:0:3283:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6a600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129744.410066:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053225600:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129744.410071:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129744.410079:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129744.410082:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053226496:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129744.410088:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053226112:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129744.410094:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129744.410102:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053227008:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129744.410105:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053227136:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129744.410116:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129744.410116:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129744.410125:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053227520:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129744.410126:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053227648:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129744.410137:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129744.410142:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053225984 00000100:00100000:2.0:1746129744.410145:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053225984 00000100:00100000:3.0:1746129744.410154:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053225600 00000100:00100000:3.0:1746129744.410155:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053225600 00000100:00100000:2.0:1746129744.410160:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053226496 00000100:00100000:2.0:1746129744.410162:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053226496 00000100:00100000:3.0:1746129744.410167:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053227008 00000100:00100000:3.0:1746129744.410168:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053227008 00000100:00100000:2.0:1746129744.410169:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053227136 00000100:00100000:2.0:1746129744.410170:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053227136 00000100:00100000:2.0:1746129744.410176:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053227648 00000100:00100000:2.0:1746129744.410178:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053227648 00000100:00100000:3.0:1746129744.410180:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10403 00000100:00100000:3.0:1746129744.410184:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3298:x1830949053225984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129744.410185:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10404 00000100:00100000:2.0:1746129744.410188:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3299:x1830949053225600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129744.410208:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10405 00000100:00100000:2.0:1746129744.410211:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3298:x1830949053226496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129744.410263:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129744.410266:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746129744.410268:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746129744.410269:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746129744.410271:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746129744.410288:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3298:x1830949053226496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (192us total) trans 17179873015 rc 0/0 00000100:00100000:2.0:1746129744.410292:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10405 00000100:00100000:2.0:1746129744.410302:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10406 00000100:00100000:2.0:1746129744.410306:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3297:x1830949053227008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129744.410370:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053226880:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129744.410386:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129744.410388:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129744 -> 1746129744 00002000:00010000:2.0:1746129744.410390:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129744 -> 1746129744 00002000:00010000:2.0:1746129744.410391:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129744 -> 1746129744 00000100:00100000:1.0:1746129744.410391:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746129744.410393:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129744.410399:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053227392:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129744.410407:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3297:x1830949053227008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 101us (290us total) trans 21474840175 rc 0/0 00000100:00100000:1.0:1746129744.410410:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129744.410412:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10406 00000100:00100000:2.0:1746129744.410424:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053226880 00000100:00100000:2.0:1746129744.410426:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053226880 00000100:00100000:2.0:1746129744.410433:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053227392 00000100:00100000:2.0:1746129744.410435:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053227392 00000100:00100000:2.0:1746129744.410440:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10407 00000100:00100000:2.0:1746129744.410443:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3298:x1830949053227136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129744.410573:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3298:x1830949053225984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 388us (500us total) trans 17179873014 rc 0/0 00000100:00100000:3.0:1746129744.410578:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10403 00000100:00100000:3.0:1746129744.410591:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10408 00000100:00100000:3.0:1746129744.410595:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3298:x1830949053227648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129744.410680:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3298:x1830949053227648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (541us total) trans 21474840177 rc 0/0 00000100:00100000:3.0:1746129744.410685:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10408 00000100:00100000:3.0:1746129744.410694:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10409 00000100:00100000:3.0:1746129744.410698:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3296:x1830949053226880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129744.410759:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129744.410761:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129744 -> 1746129744 00002000:00010000:3.0:1746129744.410763:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129744 -> 1746129744 00002000:00010000:3.0:1746129744.410765:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129744 -> 1746129744 00002000:00010000:3.0:1746129744.410766:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2081 -> 2079 00000100:00100000:3.0:1746129744.410786:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3296:x1830949053226880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (394us total) trans 21474840178 rc 0/0 00000100:00100000:3.0:1746129744.410790:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10409 00000100:00100000:3.0:1746129744.410800:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10410 00000100:00100000:3.0:1746129744.410804:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3296:x1830949053227392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129744.410839:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3298:x1830949053227136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 393us (720us total) trans 21474840176 rc 0/0 00000100:00100000:2.0:1746129744.410843:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10407 00000100:00100000:2.0:1746129744.410878:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746129744.410880:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129744.410883:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746129744.410884:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746129744.410886:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746129744.410887:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746129744.410890:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053226624:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129744.410904:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3296:x1830949053227392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (493us total) trans 21474840179 rc 0/0 00000100:00100000:2.0:1746129744.410904:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129744.410909:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10410 00000100:00100000:2.0:1746129744.410911:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053227264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129744.410917:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053226112 00000100:00100000:3.0:1746129744.410919:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053226112 00000100:00100000:2.0:1746129744.410922:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129744.410927:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053226624 00000100:00100000:3.0:1746129744.410928:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053226624 00000100:00100000:2.0:1746129744.410928:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053227904:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129744.410934:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053227264 00000100:00100000:3.0:1746129744.410936:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053227264 00000100:00100000:2.0:1746129744.410939:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129744.410941:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053227904 00000100:00100000:3.0:1746129744.410942:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053227904 00000100:00100000:3.0:1746129744.410948:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10411 00000100:00100000:3.0:1746129744.410952:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3299:x1830949053226112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129744.410953:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10412 00000100:00100000:2.0:1746129744.410956:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3299:x1830949053226624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129744.410982:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129744.411000:0:3297:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840168 gen 2 00000004:00080000:2.0:1746129744.411003:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d7800, transno 21474840084 00000004:00080000:2.0:1746129744.411008:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d636a00, transno 21474840085 00000004:00080000:2.0:1746129744.411011:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd47b80, transno 21474840086 00000004:00080000:2.0:1746129744.411013:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d634700, transno 21474840087 00000004:00080000:2.0:1746129744.411015:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d4a80, transno 21474840088 00000004:00080000:2.0:1746129744.411017:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d636300, transno 21474840089 00000004:00080000:2.0:1746129744.411019:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d6d80, transno 21474840090 00000004:00080000:2.0:1746129744.411021:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d637100, transno 21474840091 00000004:00080000:2.0:1746129744.411023:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130505880, transno 21474840097 00000004:00080000:2.0:1746129744.411025:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130506a00, transno 21474840098 00000004:00080000:2.0:1746129744.411027:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130506d80, transno 21474840099 00000004:00080000:2.0:1746129744.411029:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130504000, transno 21474840100 00000004:00080000:2.0:1746129744.411031:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130505f80, transno 21474840101 00000004:00080000:2.0:1746129744.411033:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130507800, transno 21474840102 00000100:00100000:3.0:1746129744.411034:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3299:x1830949053226112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (156us total) trans 17179873016 rc 0/0 00000004:00080000:2.0:1746129744.411035:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130507b80, transno 21474840103 00000004:00080000:2.0:1746129744.411036:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130506680, transno 21474840104 00000004:00080000:2.0:1746129744.411038:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8790380, transno 21474840108 00000100:00100000:3.0:1746129744.411039:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10411 00000004:00080000:2.0:1746129744.411040:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8791880, transno 21474840109 00000004:00080000:2.0:1746129744.411042:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8791c00, transno 21474840110 00000004:00080000:2.0:1746129744.411044:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8793b80, transno 21474840111 00000004:00080000:2.0:1746129744.411046:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8792680, transno 21474840112 00000100:00100000:3.0:1746129744.411047:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053227520 00000004:00080000:2.0:1746129744.411048:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8792a00, transno 21474840113 00000100:00100000:3.0:1746129744.411049:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053227520 00000004:00080000:2.0:1746129744.411050:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8793480, transno 21474840114 00000004:00080000:2.0:1746129744.411052:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8790a80, transno 21474840115 00000004:00080000:2.0:1746129744.411054:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c040000, transno 21474840116 00000100:00100000:3.0:1746129744.411056:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10413 00000004:00080000:2.0:1746129744.411056:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423ed80, transno 21474840117 00000004:00080000:2.0:1746129744.411058:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423d500, transno 21474840118 00000100:00100000:3.0:1746129744.411060:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3299:x1830949053227264:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129744.411060:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423f480, transno 21474840119 00000004:00080000:2.0:1746129744.411062:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423c380, transno 21474840120 00000004:00080000:2.0:1746129744.411064:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423d180, transno 21474840121 00000004:00080000:2.0:1746129744.411066:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423c700, transno 21474840122 00000004:00080000:2.0:1746129744.411067:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423d880, transno 21474840123 00000004:00080000:2.0:1746129744.411069:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284ce00, transno 21474840134 00000004:00080000:2.0:1746129744.411071:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284c000, transno 21474840135 00000004:00080000:2.0:1746129744.411073:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284dc00, transno 21474840136 00000004:00080000:2.0:1746129744.411075:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284f800, transno 21474840137 00000004:00080000:2.0:1746129744.411077:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284e680, transno 21474840138 00000004:00080000:2.0:1746129744.411079:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284f480, transno 21474840139 00000004:00080000:2.0:1746129744.411081:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284d500, transno 21474840140 00000004:00080000:2.0:1746129744.411084:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284f100, transno 21474840141 00000004:00080000:2.0:1746129744.411085:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284e300, transno 21474840145 00000004:00080000:2.0:1746129744.411087:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284fb80, transno 21474840146 00000004:00080000:2.0:1746129744.411089:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04f800, transno 21474840147 00000004:00080000:2.0:1746129744.411091:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284d180, transno 21474840148 00000004:00080000:2.0:1746129744.411093:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284d880, transno 21474840149 00000004:00080000:2.0:1746129744.411095:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284c380, transno 21474840150 00000004:00080000:2.0:1746129744.411096:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284c700, transno 21474840151 00000004:00080000:2.0:1746129744.411098:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284ca80, transno 21474840152 00000004:00080000:2.0:1746129744.411100:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55a6d80, transno 21474840153 00000004:00080000:2.0:1746129744.411103:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55a4700, transno 21474840154 00000004:00080000:2.0:1746129744.411105:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55a6300, transno 21474840155 00000004:00080000:2.0:1746129744.411107:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55a4380, transno 21474840156 00000004:00080000:2.0:1746129744.411109:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55a7800, transno 21474840157 00000004:00080000:2.0:1746129744.411110:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55a4e00, transno 21474840158 00000004:00080000:2.0:1746129744.411112:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55a7480, transno 21474840159 00000004:00080000:2.0:1746129744.411114:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55a5f80, transno 21474840160 00000004:00080000:2.0:1746129744.411116:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb4e00, transno 21474840161 00000004:00080000:2.0:1746129744.411118:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fad3100, transno 21474840162 00000004:00080000:2.0:1746129744.411121:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb4000, transno 21474840163 00000100:00100000:3.0:1746129744.411123:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3299:x1830949053227264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (200us total) trans 21474840180 rc 0/0 00000004:00080000:2.0:1746129744.411123:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04f480, transno 21474840164 00000004:00080000:2.0:1746129744.411125:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fad0e00, transno 21474840165 00000100:00100000:3.0:1746129744.411127:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10413 00000004:00080000:2.0:1746129744.411127:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb7480, transno 21474840166 00000004:00080000:2.0:1746129744.411129:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb5f80, transno 21474840167 00000004:00080000:2.0:1746129744.411131:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fad2d80, transno 21474840168 00000100:00100000:2.0:1746129744.411135:0:3297:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009adad180 x1830949053227008/t21474840175(21474840175) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746129760 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000100:00100000:3.0:1746129744.411136:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10414 00000100:00100000:3.0:1746129744.411139:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3299:x1830949053227904:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129744.411142:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adad180/2, rc 0, transno 21474840175 00000100:00100000:2.0:1746129744.411145:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053227008:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129744.411203:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3299:x1830949053227904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (263us total) trans 21474840181 rc 0/0 00000100:00100000:2.0:1746129744.411203:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3299:x1830949053226624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 246us (298us total) trans 17179873017 rc 0/0 00000100:00100000:3.0:1746129744.411208:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10414 00000100:00100000:2.0:1746129744.411216:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10412 00000004:00080000:1.0:1746129744.411256:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adadc00/2, rc 0, transno 21474840178 00000100:00100000:1.0:1746129744.411260:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053226880:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129744.411265:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adad880/2, rc 0, transno 21474840179 00000100:00100000:1.0:1746129744.411268:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053227392:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129744.411323:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10415 00000100:00100000:3.0:1746129744.411329:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3297:x1830949053227520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129744.411411:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3297:x1830949053227520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (427us total) trans 21474840182 rc 0/0 00000100:00100000:3.0:1746129744.411416:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10415 00000004:00080000:3.0:1746129744.411448:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131462300/2, rc 0, transno 17179873014 00000100:00100000:3.0:1746129744.411451:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053225984:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129744.411457:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131460700/2, rc 0, transno 17179873015 00000100:00100000:3.0:1746129744.411459:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053226496:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129744.411464:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adac380/2, rc 0, transno 21474840176 00000100:00100000:3.0:1746129744.411466:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053227136:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129744.411471:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adad500/2, rc 0, transno 21474840177 00000100:00100000:3.0:1746129744.411473:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053227648:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129744.412009:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746129744.412012:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129743 -> 1746129743 00002000:00010000:2.0:1746129744.412014:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129743 -> 1746129743 00002000:00010000:2.0:1746129744.412015:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129743 -> 1746129743 00002000:00010000:2.0:1746129744.412017:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:2.0:1746129744.412035:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3299:x1830949053225600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1846us (1955us total) trans 17179873018 rc 0/0 00000100:00100000:2.0:1746129744.412041:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10404 00000004:00080000:2.0:1746129744.412152:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131463b80/2, rc 0, transno 17179873018 00000100:00100000:2.0:1746129744.412155:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053225600:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129744.412161:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131461c00/2, rc 0, transno 17179873016 00000100:00100000:2.0:1746129744.412164:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053226112:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129744.412168:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f6d8e00/2, rc 0, transno 17179873017 00000100:00100000:2.0:1746129744.412170:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053226624:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129744.412176:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adac700/2, rc 0, transno 21474840180 00000100:00100000:2.0:1746129744.412178:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053227264:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129744.412184:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adaed80/2, rc 0, transno 21474840181 00000100:00100000:2.0:1746129744.412187:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053227904:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129744.412199:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adace00/2, rc 0, transno 21474840182 00000100:00100000:2.0:1746129744.412202:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053227520:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129744.413183:0:14357:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 0 in flight, 64 done 00000100:00100000:2.0:1746129744.413206:0:3283:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631b100 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3283:1830949053226752:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129744.414059:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.414136:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.414157:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.414187:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052011648 00000100:00100000:3.0:1746129744.414192:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052011648 00000100:00100000:3.0:1746129744.414215:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052011776 00000100:00100000:3.0:1746129744.414217:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052011776 00000100:00100000:3.0:1746129744.414228:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3812 00000100:00100000:3.0:1746129744.414233:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28407:x1830949052011648:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:3.0:1746129744.414309:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28407:x1830949052011648:12345-192.168.204.31@tcp:49:cat.0 Request processed in 75us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.414314:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3812 00000100:00100000:3.0:1746129744.414326:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3813 00000100:00100000:3.0:1746129744.414329:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:28404:x1830949052011776:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:3.0:1746129744.414359:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:28404:x1830949052011776:12345-192.168.204.31@tcp:49:cat.0 Request processed in 29us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.414363:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3813 00000100:00100000:2.0:1746129744.414693:0:3283:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136318a80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3283:1830949053227776:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129744.414714:0:3283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6eaa00/0x48868a4e439483ae lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.414722:0:3283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6eaa00/0x48868a4e439483ae lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 16808 initiator: MDT0 00000100:00100000:2.0:1746129744.414925:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052011904 00000100:00100000:2.0:1746129744.414929:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052011904 00000100:00100000:2.0:1746129744.414949:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9769 00000100:00100000:2.0:1746129744.414953:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+7:28399:x1830949052011904:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129744.414964:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129744.414974:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5357800/0x48868a4e439483d1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ec1e expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.415006:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5357800/0x48868a4e439483d1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec1e expref: 8 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.415015:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5357800/0x48868a4e439483d1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec1e expref: 8 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.415027:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129744.415029:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129744.415243:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5357800, rc 0) 00000100:00100000:2.0:1746129744.415350:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:28399:x1830949052011904:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 394us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.415355:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9769 00000100:00100000:2.0:1746129744.421764:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.421838:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052012032 00000100:00100000:0.0:1746129744.422398:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052012032 00000100:00100000:0.0:1746129744.422446:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9770 00000100:00100000:0.0:1746129744.422454:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6141239f-0c60-480d-830c-e22ba61457b0+8:28399:x1830949052012032:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129744.423169:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.423185:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4c400/0x48868a4e439483d8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ec25 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.423247:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc6d400/0x48868a4e439483df lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.423257:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc6d400/0x48868a4e439483df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.423266:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc6d400/0x48868a4e439483df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:0.0:1746129744.423283:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:0.0:1746129744.423286:0:14314:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129744.423296:0:14314:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc6d400/0x48868a4e439483df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.423315:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4c400/0x48868a4e439483d8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec25 expref: 10 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.423330:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc6d400/0x48868a4e439483df lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec25 expref: 9 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.423337:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129744.423339:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129744.423342:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bc6d400, rc 0) 00000100:00100000:0.0:1746129744.423379:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:28399:x1830949052012032:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 925us (1620us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.423385:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9770 00000100:00100000:3.0:1746129744.423452:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.423525:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.423978:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052012288 00000100:00100000:2.0:1746129744.423983:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052012288 00002000:00100000:2.0:1746129744.424006:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012c041c00 x1830949052012288/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129744.424013:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c041c00 with x1830949052012288 ext(1048576->2097151) 00002000:00010000:2.0:1746129744.424016:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c041c00 00000100:00100000:2.0:1746129744.424037:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052012544 00000100:00100000:2.0:1746129744.424039:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052012544 00002000:00100000:2.0:1746129744.424050:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012c040700 x1830949052012544/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129744.424056:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c040700 with x1830949052012544 ext(1048576->2097151) 00002000:00010000:2.0:1746129744.424059:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c040700 00000100:00100000:2.0:1746129744.424068:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3834 00000100:00100000:2.0:1746129744.424073:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052012288:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129744.424266:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3835 00000100:00100000:0.0:1746129744.424273:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1962:x1830949052012544:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129744.427237:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.427257:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.427270:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.427280:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.427290:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.427331:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.427347:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052012800 00000100:00100000:3.0:1746129744.427353:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052012800 00000100:00100000:3.0:1746129744.427379:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052013056 00000100:00100000:3.0:1746129744.427380:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052013056 00000100:00100000:3.0:1746129744.427388:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052013312 00000100:00100000:3.0:1746129744.427389:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052013312 00000100:00100000:3.0:1746129744.427395:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052012672 00000100:00100000:3.0:1746129744.427397:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052012672 00000100:00100000:3.0:1746129744.427402:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052012928 00000100:00100000:3.0:1746129744.427403:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052012928 00000100:00100000:3.0:1746129744.427409:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052013184 00000100:00100000:3.0:1746129744.427410:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052013184 00000100:00100000:3.0:1746129744.427419:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10416 00000100:00100000:3.0:1746129744.427424:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949052012800:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129744.427436:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.427448:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acd83000/0x48868a4e439483e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ec33 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.427464:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.427466:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.427473:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd83000/0x48868a4e439483e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec33 expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.427484:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acd83000/0x48868a4e439483e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec33 expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.427492:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd83000, rc 0) 00000100:00100000:3.0:1746129744.427518:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949052012800:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 94us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.427523:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10416 00000100:00100000:3.0:1746129744.427550:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10417 00000100:00100000:3.0:1746129744.427554:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949052013056:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129744.427560:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.427567:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acd83200/0x48868a4e439483ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ec41 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.427575:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.427576:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.427579:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd83200/0x48868a4e439483ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec41 expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.427587:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acd83200/0x48868a4e439483ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec41 expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.427593:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd83200, rc 0) 00000100:00100000:3.0:1746129744.427604:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949052013056:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 49us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.427607:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10417 00000100:00100000:3.0:1746129744.427614:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10418 00000100:00100000:3.0:1746129744.427617:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949052013312:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129744.427621:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.427627:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acd83400/0x48868a4e439483f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ec4f expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129744.427641:0:3624:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e8:0x0] initial LVB size: 4194304, mtime: 0x6813d350, atime: 0x6813d34f, ctime: 0x6813d350, blocks: 0x1029 00010000:00010000:3.0:1746129744.427647:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.427648:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.427651:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd83400/0x48868a4e439483f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec4f expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.427658:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acd83400/0x48868a4e439483f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec4f expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.427664:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd83400, rc 0) 00000100:00100000:3.0:1746129744.427672:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949052013312:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 55us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.427676:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10418 00000100:00100000:3.0:1746129744.427682:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10419 00000100:00100000:3.0:1746129744.427684:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949052012672:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129744.427688:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.427692:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acd83600/0x48868a4e439483fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ec2c expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.427699:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.427699:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.427703:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd83600/0x48868a4e439483fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec2c expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.427711:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acd83600/0x48868a4e439483fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec2c expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.427717:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd83600, rc 0) 00000100:00100000:3.0:1746129744.427729:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949052012672:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 44us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.427733:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10419 00000100:00100000:3.0:1746129744.427742:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10420 00000100:00100000:3.0:1746129744.427746:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949052012928:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129744.427751:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.427756:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acd83800/0x48868a4e43948402 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ec3a expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.427759:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10421 00010000:00010000:3.0:1746129744.427765:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.427766:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746129744.427767:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949052013184:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129744.427770:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd83800/0x48868a4e43948402 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec3a expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.427774:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.427777:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acd83800/0x48868a4e43948402 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec3a expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.427782:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a1efe00/0x48868a4e43948409 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ec48 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.427783:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd83800, rc 0) 00002000:00010000:0.0:1746129744.427795:0:4589:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3eb:0x0] initial LVB size: 4960928, mtime: 0x6813d350, atime: 0x6813d34f, ctime: 0x6813d34f, blocks: 0x1629 00000100:00100000:3.0:1746129744.427796:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949052012928:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 49us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.427799:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10420 00010000:00010000:0.0:1746129744.427803:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.427805:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.427809:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a1efe00/0x48868a4e43948409 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec48 expref: 9 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.427825:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a1efe00/0x48868a4e43948409 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec48 expref: 9 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.427831:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a1efe00, rc 0) 00000100:00100000:0.0:1746129744.429583:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949052013184:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1811us (2244us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.429592:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10421 00000100:00100000:3.0:1746129744.434630:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052012288:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10548us (11170us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129744.434641:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3834 00002000:00100000:3.0:1746129744.434651:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012c041c00 x1830949052012288/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129744.434660:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c041c00 with x1830949052012288 ext(1048576->2097151) 00002000:00010000:3.0:1746129744.434665:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c041c00 00000100:00100000:0.0:1746129744.441899:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1962:x1830949052012544:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17616us (18363us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129744.441911:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3835 00002000:00100000:0.0:1746129744.441922:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012c040700 x1830949052012544/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129744.441929:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c040700 with x1830949052012544 ext(1048576->2097151) 00002000:00010000:0.0:1746129744.441935:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c040700 00000100:00100000:2.0:1746129744.442147:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.443111:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052013440 00000100:00100000:0.0:1746129744.443119:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052013440 00000100:00100000:3.0:1746129744.443149:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.444556:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052013824 00000100:00100000:2.0:1746129744.444561:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052013824 00000100:00100000:2.0:1746129744.444812:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3836 00000100:00100000:2.0:1746129744.444820:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052013824:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:2.0:1746129744.444865:0:21600:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f87d400/0x48868a4e43948410 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.444881:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.444883:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.444886:0:21600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87d400/0x48868a4e43948410 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.444897:0:21600:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f87d400/0x48868a4e43948410 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.445197:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10422 00000100:00100000:1.0:1746129744.445205:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28407:x1830949052013440:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129744.445214:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129744.445224:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b534da00/0x48868a4e43948417 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ec56 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.445235:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129744.445236:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129744.445241:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b534da00/0x48868a4e43948417 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec56 expref: 11 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.445250:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b534da00/0x48868a4e43948417 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec56 expref: 11 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.445258:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b534da00, rc 0) 00000100:00100000:1.0:1746129744.445760:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28407:x1830949052013440:12345-192.168.204.31@tcp:101:cat.0 Request processed in 554us (3612us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129744.445765:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10422 00000100:00100000:3.0:1746129744.445914:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.446000:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.446013:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.446025:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.446047:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.446060:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052013952 00000100:00100000:3.0:1746129744.446065:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052013952 00000100:00100000:3.0:1746129744.446086:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052014336 00000100:00100000:3.0:1746129744.446087:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052014336 00000100:00100000:3.0:1746129744.446097:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052014208 00000100:00100000:3.0:1746129744.446098:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052014208 00000100:00100000:3.0:1746129744.446106:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052014848 00000100:00100000:3.0:1746129744.446107:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052014848 00000100:00100000:3.0:1746129744.446118:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3837 00000100:00100000:3.0:1746129744.446122:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949052013952:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129744.446138:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e4394841e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.446145:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.446146:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.446149:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e4394841e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.446157:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e4394841e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.446621:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3838 00000100:00100000:1.0:1746129744.446629:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052014336:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:1.0:1746129744.446643:0:21599:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b534d000/0x48868a4e43948425 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.446650:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129744.446651:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129744.446653:0:21599:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b534d000/0x48868a4e43948425 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.446660:0:21599:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b534d000/0x48868a4e43948425 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.447808:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3839 00000100:00100000:1.0:1746129744.447814:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052014208:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:1.0:1746129744.447833:0:21605:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e4394842c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.447841:0:21605:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129744.447842:0:21605:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129744.447845:0:21605:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e4394842c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.447869:0:21605:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e4394842c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.448758:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3840 00000100:00100000:1.0:1746129744.448766:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949052014848:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:1.0:1746129744.448787:0:25617:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e43948433 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.448795:0:25617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129744.448796:0:25617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129744.448799:0:25617:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e43948433 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.448807:0:25617:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e43948433 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.458981:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052014720 00000100:00100000:0.0:1746129744.458990:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052014720 00000100:00100000:0.0:1746129744.459026:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10423 00000100:00100000:0.0:1746129744.459033:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:28404:x1830949052014720:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129744.459047:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.459060:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f70c00/0x48868a4e4394843a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ec5d expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.459078:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.459079:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.459086:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f70c00/0x48868a4e4394843a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec5d expref: 20 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.459099:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f70c00/0x48868a4e4394843a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec5d expref: 20 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.459107:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f70c00, rc 0) 00000100:00100000:0.0:1746129744.459146:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:28404:x1830949052014720:12345-192.168.204.31@tcp:101:cat.0 Request processed in 113us (13119us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.459151:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10423 00000100:00100000:3.0:1746129744.459624:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.459695:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.459711:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052015104 00000100:00100000:3.0:1746129744.459715:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052015104 00000100:00100000:3.0:1746129744.459743:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052015488 00000100:00100000:3.0:1746129744.459745:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052015488 00000100:00100000:3.0:1746129744.459760:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3841 00000100:00100000:3.0:1746129744.459765:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6141239f-0c60-480d-830c-e22ba61457b0+13:1961:x1830949052015104:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129744.459785:0:21601:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800acd82600/0x48868a4e43948441 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.459793:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.459795:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.459797:0:21601:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd82600/0x48868a4e43948441 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.459807:0:21601:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acd82600/0x48868a4e43948441 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.460893:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3842 00000100:00100000:1.0:1746129744.460902:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052015488:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:1.0:1746129744.460923:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880129e78e00/0x48868a4e43948448 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.460933:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129744.460934:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129744.460937:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e78e00/0x48868a4e43948448 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.460947:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e78e00/0x48868a4e43948448 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129744.461038:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.461052:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052015616 00000100:00100000:3.0:1746129744.461056:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052015616 00000100:00100000:3.0:1746129744.461079:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3843 00000100:00100000:3.0:1746129744.461084:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052015616:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129744.461097:0:21603:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800acd82e00/0x48868a4e4394844f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.461104:0:21603:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.461105:0:21603:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.461107:0:21603:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd82e00/0x48868a4e4394844f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.461114:0:21603:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acd82e00/0x48868a4e4394844f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129744.463252:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.465068:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052015872 00000100:00100000:0.0:1746129744.465078:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052015872 00002000:00100000:0.0:1746129744.465113:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800a8792680 x1830949052015872/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129744.465122:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8792680 with x1830949052015872 ext(1048576->2097151) 00002000:00010000:0.0:1746129744.465127:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8792680 00000100:00100000:0.0:1746129744.465147:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3844 00000100:00100000:0.0:1746129744.465152:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052015872:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129744.468376:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.468398:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052016128 00000100:00100000:0.0:1746129744.468404:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052016128 00000100:00100000:0.0:1746129744.468436:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9771 00000100:00100000:0.0:1746129744.468443:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:28409:x1830949052016128:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129744.468458:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.468473:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71000/0x48868a4e43948456 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ec64 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.468566:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71200/0x48868a4e4394845d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.468577:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71200/0x48868a4e4394845d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.468586:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71200/0x48868a4e4394845d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.468595:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f70400/0x48868a4e43948464 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.468601:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f70400/0x48868a4e43948464 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.468605:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f70400/0x48868a4e43948464 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.468690:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71600/0x48868a4e4394846b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.468700:0:14314:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e56600/0x48868a4e4394831b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebbc expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.468706:0:14314:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71600/0x48868a4e4394846b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.468728:0:14314:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e56600/0x48868a4e4394831b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebbc expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.468737:0:14314:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e56600/0x48868a4e4394831b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebbc expref: 8 pid: 14315 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746129744.468747:0:14314:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6d9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053228032:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129744.468798:0:14314:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa48c540 going to sleep for 11 seconds 00010000:00010000:3.0:1746129744.471148:0:21600:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f87d400/0x48868a4e43948410 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.471162:0:21600:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87d400/0x48868a4e43948410 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.471170:0:21600:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f87d400/0x48868a4e43948410 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.471176:0:21600:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f87d400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129744.471179:0:21600:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f87d400/0x48868a4e43948410 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.471186:0:21600:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f87d400/0x48868a4e43948410 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.471202:0:21600:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f87d400/0x48868a4e43948410 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.471208:0:21600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f87d400/0x48868a4e43948410 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129744.471302:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052013824:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 26479us (28150us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129744.471312:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3836 00010000:00010000:1.0:1746129744.471571:0:21599:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b534d000/0x48868a4e43948425 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.471578:0:21599:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b534d000/0x48868a4e43948425 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.471583:0:21599:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b534d000/0x48868a4e43948425 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.471588:0:21599:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b534d000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129744.471590:0:21599:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b534d000/0x48868a4e43948425 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.471594:0:21599:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b534d000/0x48868a4e43948425 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.471603:0:21599:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b534d000/0x48868a4e43948425 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.471608:0:21599:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b534d000/0x48868a4e43948425 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.471640:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052014336:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 25012us (25639us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129744.471645:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3838 00000100:00100000:0.0:1746129744.473551:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.476248:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052016384 00000100:00100000:2.0:1746129744.476258:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052016384 00002000:00100000:2.0:1746129744.476295:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009f6d9880 x1830949052016384/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129744.476304:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6d9880 with x1830949052016384 ext(1048576->2097151) 00002000:00010000:2.0:1746129744.476308:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6d9880 00000100:00100000:2.0:1746129744.476325:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3845 00000100:00100000:2.0:1746129744.476330:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949052016384:12345-192.168.204.31@tcp:3:cat.0 00010000:00010000:1.0:1746129744.477693:0:21605:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e4394842c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.477705:0:21605:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e4394842c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.477711:0:21605:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e4394842c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.477718:0:21605:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b534d600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129744.477723:0:21605:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e4394842c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.477730:0:21605:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e4394842c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.477745:0:21605:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e4394842c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.477751:0:21605:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e4394842c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.477800:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949052014208:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 29983us (31783us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129744.477807:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3839 00000100:00100000:0.0:1746129744.479138:0:14314:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6d9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053228032:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129744.479156:0:14314:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71600/0x48868a4e4394846b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000100:00100000:1.0:1746129744.486175:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.486219:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.486415:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052016768 00000100:00100000:3.0:1746129744.486427:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052016768 00000100:00100000:3.0:1746129744.486463:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9772 00000100:00100000:3.0:1746129744.486470:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28411:x1830949052016768:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129744.486487:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.486501:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd83c00/0x48868a4e43948472 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ec6b expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.486596:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82000/0x48868a4e43948479 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.486607:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82000/0x48868a4e43948479 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.486616:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82000/0x48868a4e43948479 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.486624:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c35400/0x48868a4e43948480 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.486630:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c35400/0x48868a4e43948480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.486635:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c35400/0x48868a4e43948480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.486716:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x48868a4e43948487 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.486724:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x48868a4e43948487 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.486731:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x48868a4e43948487 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.487675:0:25617:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e43948433 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.487685:0:25617:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e43948433 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.487690:0:25617:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e43948433 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.487701:0:25617:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b534c200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129744.487704:0:25617:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e43948433 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.487711:0:25617:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e43948433 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.487724:0:25617:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e43948433 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.487731:0:25617:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e43948433 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.488470:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052016512 00000100:00100000:1.0:1746129744.488476:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052016512 00010000:00010000:1.0:1746129744.488501:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e56600/0x48868a4e4394831b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebbc expref: 9 pid: 14315 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746129744.488523:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5015 00000100:00100000:1.0:1746129744.488528:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+9:1963:x1830949052016512:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129744.488548:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129744.488552:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e56600/0x48868a4e4394831b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebbc expref: 9 pid: 14315 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746129744.488565:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e56600/0x48868a4e4394831b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebbc expref: 9 pid: 14315 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746129744.488577:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e56600/0x48868a4e4394831b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebbc expref: 9 pid: 14315 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746129744.488590:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129744.488594:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71600/0x48868a4e4394846b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129744.488599:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71600/0x48868a4e4394846b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129744.488604:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71600/0x48868a4e4394846b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129744.488609:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x48868a4e43948487 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129744.488613:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x48868a4e43948487 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129744.488618:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x48868a4e43948487 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00000100:00100000:0.0:1746129744.489101:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949052014848:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 40335us (43051us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129744.489109:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3840 00010000:00010000:1.0:1746129744.489372:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129744.489391:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+8:1963:x1830949052016512:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 863us (3171us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129744.489396:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5015 00010000:00010000:0.0:1746129744.489601:0:14314:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71600/0x48868a4e4394846b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.489607:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71600/0x48868a4e4394846b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:0.0:1746129744.489619:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129744.489722:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71600/0x48868a4e4394846b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.489728:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71600/0x48868a4e4394846b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.489735:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71600/0x48868a4e4394846b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.489739:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4f71600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129744.489742:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71600/0x48868a4e4394846b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.489747:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71600/0x48868a4e4394846b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.489755:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129744.489757:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129744.489759:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71600/0x48868a4e4394846b lrc: 2/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.489762:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71600/0x48868a4e4394846b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.489774:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71200/0x48868a4e4394845d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.489779:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71200/0x48868a4e4394845d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.489783:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71200/0x48868a4e4394845d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.489787:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4f71200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129744.489789:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71200/0x48868a4e4394845d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.489793:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71200/0x48868a4e4394845d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.489802:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:0.0:1746129744.489804:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129744.489806:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71200/0x48868a4e4394845d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.489810:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71200/0x48868a4e4394845d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.489816:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f70400/0x48868a4e43948464 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.489819:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f70400/0x48868a4e43948464 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.489823:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f70400/0x48868a4e43948464 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.489827:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4f70400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129744.489828:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f70400/0x48868a4e43948464 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.489832:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f70400/0x48868a4e43948464 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.489836:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012bfca000) 00010000:00010000:0.0:1746129744.489837:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129744.489839:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f70400/0x48868a4e43948464 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.489842:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f70400/0x48868a4e43948464 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129744.489896:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71000/0x48868a4e43948456 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec64 expref: 284 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.490294:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f71000/0x48868a4e43948456 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec64 expref: 284 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.490302:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f71000, rc 0) 00000100:00100000:0.0:1746129744.490323:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28409:x1830949052016128:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 21881us (21955us total) trans 8589943537 rc 301/301 00000100:00100000:0.0:1746129744.490329:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9771 00010000:00010000:3.0:1746129744.490751:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e4394841e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.490760:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e4394841e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.490766:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e4394841e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.490771:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800acd82800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129744.490774:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e4394841e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.490779:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e4394841e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.490791:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e4394841e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.490796:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e4394841e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129744.490835:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052013952:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 44711us (44920us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129744.490842:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3837 00010000:00010000:3.0:1746129744.490883:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x48868a4e43948487 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.490889:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x48868a4e43948487 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:3.0:1746129744.490901:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129744.490954:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x48868a4e43948487 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.490978:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x48868a4e43948487 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.490982:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x48868a4e43948487 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.490986:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c34200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129744.490989:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x48868a4e43948487 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.490993:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x48868a4e43948487 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.491000:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129744.491002:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129744.491005:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x48868a4e43948487 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.491022:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x48868a4e43948487 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.491032:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82000/0x48868a4e43948479 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.491036:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82000/0x48868a4e43948479 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.491040:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82000/0x48868a4e43948479 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.491046:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800acd82000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129744.491048:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82000/0x48868a4e43948479 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.491052:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82000/0x48868a4e43948479 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.491058:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129744.491060:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129744.491062:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82000/0x48868a4e43948479 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.491066:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82000/0x48868a4e43948479 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.491073:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c35400/0x48868a4e43948480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.491077:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c35400/0x48868a4e43948480 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.491081:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094c35400/0x48868a4e43948480 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.491084:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c35400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129744.491085:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c35400/0x48868a4e43948480 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.491089:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c35400/0x48868a4e43948480 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.491094:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012bfca000) 00010000:00010000:3.0:1746129744.491096:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129744.491099:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094c35400/0x48868a4e43948480 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.491103:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c35400/0x48868a4e43948480 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.491134:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd83c00/0x48868a4e43948472 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec6b expref: 10 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.491140:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd83c00/0x48868a4e43948472 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec6b expref: 10 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.491146:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd83c00, rc 0) 00000100:00100000:3.0:1746129744.491162:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28411:x1830949052016768:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4693us (4999us total) trans 8589943538 rc 301/301 00000100:00100000:3.0:1746129744.491167:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9772 00010000:00010000:2.0:1746129744.493208:0:21601:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800acd82600/0x48868a4e43948441 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.493222:0:21601:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd82600/0x48868a4e43948441 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.493229:0:21601:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800acd82600/0x48868a4e43948441 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.493239:0:21601:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800acd82600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129744.493242:0:21601:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800acd82600/0x48868a4e43948441 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.493248:0:21601:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800acd82600/0x48868a4e43948441 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.493261:0:21601:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800acd82600/0x48868a4e43948441 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.493266:0:21601:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acd82600/0x48868a4e43948441 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129744.494014:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052015104:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 34244us (34386us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129744.494024:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3841 00010000:00010000:1.0:1746129744.498973:0:8441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880129e78e00/0x48868a4e43948448 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.498993:0:8441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129e78e00/0x48868a4e43948448 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.499001:0:8441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129e78e00/0x48868a4e43948448 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.499008:0:8441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e78e00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129744.499011:0:8441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129e78e00/0x48868a4e43948448 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.499017:0:8441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129e78e00/0x48868a4e43948448 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.499033:0:8441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129e78e00/0x48868a4e43948448 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.499038:0:8441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e78e00/0x48868a4e43948448 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.499095:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052015488:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 38191us (39396us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129744.499103:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3842 00000100:00100000:2.0:1746129744.506812:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052015872:12345-192.168.204.31@tcp:3:cat.0 Request processed in 41652us (43559us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129744.506822:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3844 00002000:00100000:2.0:1746129744.506833:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800a8792680 x1830949052015872/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129744.506842:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8792680 with x1830949052015872 ext(1048576->2097151) 00002000:00010000:2.0:1746129744.506864:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8792680 00010000:00010000:3.0:1746129744.513952:0:21603:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800acd82e00/0x48868a4e4394844f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.513967:0:21603:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd82e00/0x48868a4e4394844f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.513974:0:21603:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800acd82e00/0x48868a4e4394844f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.513980:0:21603:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800acd82e00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129744.513984:0:21603:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800acd82e00/0x48868a4e4394844f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.513992:0:21603:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800acd82e00/0x48868a4e4394844f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.514009:0:21603:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800acd82e00/0x48868a4e4394844f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.514016:0:21603:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acd82e00/0x48868a4e4394844f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129744.514622:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052015616:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 53533us (53579us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129744.514631:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3843 00000100:00100000:0.0:1746129744.514793:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949052016384:12345-192.168.204.31@tcp:3:cat.0 Request processed in 38458us (41243us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129744.514801:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3845 00002000:00100000:0.0:1746129744.514812:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009f6d9880 x1830949052016384/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129744.514822:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6d9880 with x1830949052016384 ext(1048576->2097151) 00002000:00010000:0.0:1746129744.514828:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6d9880 00000100:00100000:0.0:1746129744.524123:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.525200:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052017024 00000100:00100000:2.0:1746129744.525209:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052017024 00002000:00100000:2.0:1746129744.525248:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009f6d9500 x1830949052017024/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129744.525257:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6d9500 with x1830949052017024 ext(1048576->2097151) 00002000:00010000:2.0:1746129744.525262:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6d9500 00000100:00100000:2.0:1746129744.525292:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3846 00000100:00100000:2.0:1746129744.525299:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1961:x1830949052017024:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129744.533806:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.537749:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052017280 00000100:00100000:3.0:1746129744.537761:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052017280 00000100:00100000:3.0:1746129744.537826:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9773 00000100:00100000:3.0:1746129744.537834:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:28399:x1830949052017280:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:3.0:1746129744.537897:0:16808:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129744.537918:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc6d400/0x48868a4e439483df lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec25 expref: 8 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.537936:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129744.537940:0:16808:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129744.537972:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x48868a4e4394849c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.537983:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x48868a4e4394849c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.537991:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x48868a4e4394849c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00010000:3.0:1746129744.538126:0:16808:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f6d9c00 reply state ffff88009ff7e000 transno 8589943539 ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x48868a4e4394849c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:3.0:1746129744.538133:0:16808:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746129744.538200:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+9:28399:x1830949052017280:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 367us (4400us total) trans 8589943539 rc 0/0 00000100:00100000:3.0:1746129744.538206:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9773 00000100:00100000:0.0:1746129744.582356:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.582397:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.582412:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052017536 00000100:00100000:1.0:1746129744.582419:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052017536 00000100:00100000:0.0:1746129744.582422:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.582461:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052017408 00000100:00100000:1.0:1746129744.582463:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052017408 00000100:00100000:1.0:1746129744.582473:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052017664 00000100:00100000:1.0:1746129744.582475:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052017664 00000100:00100000:1.0:1746129744.582488:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10424 00000100:00100000:1.0:1746129744.582493:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052017536:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:0.0:1746129744.582496:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10425 00000100:00100000:0.0:1746129744.582503:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052017408:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129744.582507:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.582511:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129744.582519:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8fa5800/0x48868a4e439484a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ec79 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.582519:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fb66200/0x48868a4e439484aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ec72 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.582546:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.582546:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129744.582548:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.582548:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129744.582556:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8fa5800/0x48868a4e439484a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec79 expref: 23 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.582556:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fb66200/0x48868a4e439484aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec72 expref: 23 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.582569:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8fa5800/0x48868a4e439484a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec79 expref: 23 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.582569:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fb66200/0x48868a4e439484aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec72 expref: 23 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.582577:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fa5800, rc 0) 00010000:00010000:0.0:1746129744.582577:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fb66200, rc 0) 00000100:00100000:0.0:1746129744.582612:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949052017408:12345-192.168.204.31@tcp:101:cat.0 Request processed in 110us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.582618:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10425 00000100:00100000:0.0:1746129744.582631:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10426 00000100:00100000:0.0:1746129744.582636:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949052017664:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129744.582642:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.582650:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fb67e00/0x48868a4e439484b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ec80 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.582660:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.582662:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.582666:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb67e00/0x48868a4e439484b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec80 expref: 15 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.582673:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x48868a4e4394849c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.582675:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fb67e00/0x48868a4e439484b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec80 expref: 15 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.582681:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x48868a4e4394849c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.582685:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fb67e00, rc 0) 00010000:00010000:2.0:1746129744.582686:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x48868a4e4394849c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.582691:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c34200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129744.582694:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x48868a4e4394849c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.582699:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x48868a4e4394849c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.582710:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129744.582712:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129744.582715:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x48868a4e4394849c lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.582719:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x48868a4e4394849c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00000100:00100000:1.0:1746129744.582817:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949052017536:12345-192.168.204.31@tcp:101:cat.0 Request processed in 322us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129744.582822:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10424 00000100:00100000:0.0:1746129744.583371:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949052017664:12345-192.168.204.31@tcp:101:cat.0 Request processed in 733us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.583376:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10426 00000100:00100000:0.0:1746129744.583832:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1961:x1830949052017024:12345-192.168.204.31@tcp:3:cat.0 Request processed in 58532us (59716us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129744.583840:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3846 00002000:00100000:0.0:1746129744.583864:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009f6d9500 x1830949052017024/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129744.583872:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6d9500 with x1830949052017024 ext(1048576->2097151) 00002000:00010000:0.0:1746129744.583876:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6d9500 00000100:00100000:0.0:1746129744.601345:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.601425:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052017792 00000100:00100000:2.0:1746129744.601434:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052017792 00000100:00100000:2.0:1746129744.601486:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10427 00000100:00100000:2.0:1746129744.601493:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+9:28399:x1830949052017792:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129744.601509:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129744.601524:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136920800/0x48868a4e439484b8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ec87 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.601564:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009faeb200/0x48868a4e43948384 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebd8 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.601572:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fb66200/0x48868a4e439484aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec72 expref: 21 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.601577:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acd83600/0x48868a4e439483fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec2c expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.601582:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.601584:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.601587:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136920800/0x48868a4e439484b8 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec87 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.601613:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800acd83600/0x48868a4e439483fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec2c expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.601623:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800acd83600/0x48868a4e439483fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec2c expref: 10 pid: 3624 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746129744.601633:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8792a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053228160:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.601729:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fb66200/0x48868a4e439484aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec72 expref: 21 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.601737:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fb66200/0x48868a4e439484aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec72 expref: 21 pid: 8435 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746129744.601745:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8793480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053228288:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.601773:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009faeb200/0x48868a4e43948384 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebd8 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.601780:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009faeb200/0x48868a4e43948384 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebd8 expref: 8 pid: 8435 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746129744.601787:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8790a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053228416:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129744.601802:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6a600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.606155:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.606183:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.606203:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052017920 00000100:00100000:0.0:1746129744.606209:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052017920 00010000:00010000:0.0:1746129744.606238:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd83600/0x48868a4e439483fb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec2c expref: 11 pid: 3624 timeout: 790 lvb_type: 1 00000100:00100000:0.0:1746129744.606257:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052018048 00000100:00100000:0.0:1746129744.606259:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052018048 00010000:00010000:0.0:1746129744.606266:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fb66200/0x48868a4e439484aa lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec72 expref: 22 pid: 8435 timeout: 790 lvb_type: 1 00000100:00100000:0.0:1746129744.606294:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5016 00000100:00100000:0.0:1746129744.606301:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052017920:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129744.606311:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129744.606330:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800acd83600/0x48868a4e439483fb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec2c expref: 11 pid: 3624 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.606339:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800acd83600/0x48868a4e439483fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec2c expref: 11 pid: 3624 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.606361:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129744.606392:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052017920:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 92us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.606398:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5016 00000100:00100000:0.0:1746129744.606411:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5017 00000100:00100000:0.0:1746129744.606415:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949052018048:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129744.606421:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129744.606426:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fb66200/0x48868a4e439484aa lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec72 expref: 22 pid: 8435 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.606433:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fb66200/0x48868a4e439484aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec72 expref: 22 pid: 8435 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.606442:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129744.606455:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949052018048:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 39us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.606460:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5017 00000100:00100000:0.0:1746129744.606516:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.606566:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.606591:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.606603:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052018304 00000100:00100000:0.0:1746129744.606606:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052018304 00010000:00010000:0.0:1746129744.606616:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009faeb200/0x48868a4e43948384 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebd8 expref: 9 pid: 8435 timeout: 790 lvb_type: 1 00000100:00100000:0.0:1746129744.606627:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5018 00000100:00100000:0.0:1746129744.606631:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1964:x1830949052018304:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129744.606637:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129744.606643:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009faeb200/0x48868a4e43948384 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebd8 expref: 9 pid: 8435 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.606650:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009faeb200/0x48868a4e43948384 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebd8 expref: 9 pid: 8435 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.606660:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.606662:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.606668:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136920800/0x48868a4e439484b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec87 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.606674:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136920800/0x48868a4e439484b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec87 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.606699:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136920800/0x48868a4e439484b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec87 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.606709:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6d8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053228544:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129744.606759:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aba840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.606824:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052018176 00000100:00100000:0.0:1746129744.606827:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052018176 00000100:00100000:0.0:1746129744.606840:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052018432 00000100:00100000:0.0:1746129744.606842:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052018432 00000100:00100000:0.0:1746129744.606881:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10428 00000100:00100000:0.0:1746129744.606885:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052018176:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129744.606896:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.606906:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fb66400/0x48868a4e439484bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ec8e expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.606918:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.606919:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.606923:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fb66400/0x48868a4e439484bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec8e expref: 11 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.606932:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fb66400/0x48868a4e439484bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec8e expref: 11 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.606939:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fb66400, rc 0) 00000100:00100000:0.0:1746129744.606955:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052018176:12345-192.168.204.31@tcp:101:cat.0 Request processed in 69us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.606959:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10428 00000100:00100000:0.0:1746129744.606967:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10429 00000100:00100000:0.0:1746129744.606972:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052018432:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129744.606977:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.606984:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fb67600/0x48868a4e439484c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ec95 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.606994:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.606996:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.606999:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb67600/0x48868a4e439484c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec95 expref: 12 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.607007:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fb67600/0x48868a4e439484c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec95 expref: 12 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.607013:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fb67600, rc 0) 00000100:00100000:0.0:1746129744.607024:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949052018432:12345-192.168.204.31@tcp:101:cat.0 Request processed in 53us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.607029:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10429 00010000:00010000:2.0:1746129744.607153:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acd83600/0x48868a4e439483fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec2c expref: 10 pid: 3624 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746129744.607174:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8792a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053228160:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.607183:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fb66200/0x48868a4e439484aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec72 expref: 21 pid: 8435 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746129744.607190:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8793480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053228288:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.607198:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faeb200/0x48868a4e43948384 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebd8 expref: 10 pid: 8435 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746129744.607209:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8790a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053228416:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.607227:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136920800/0x48868a4e439484b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec87 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.607233:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136920800, rc 0) 00000100:00100000:2.0:1746129744.607250:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+9:28399:x1830949052017792:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5758us (5916us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.607255:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10427 00000100:00100000:0.0:1746129744.609914:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.610116:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052018944 00000100:00100000:2.0:1746129744.610125:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052018944 00002000:00100000:2.0:1746129744.610165:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009f6d8380 x1830949052018944/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129744.610175:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6d8380 with x1830949052018944 ext(3145728->4194303) 00002000:00010000:2.0:1746129744.610180:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6d8380 00000100:00100000:2.0:1746129744.610224:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3847 00000100:00100000:2.0:1746129744.610234:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949052018944:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129744.629538:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.629573:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.629599:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.629663:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6d8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053228544:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129744.629677:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129744.629709:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1964:x1830949052018304:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 23076us (23192us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.629718:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5018 00000100:00100000:0.0:1746129744.629770:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.629834:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052019584 00000100:00100000:0.0:1746129744.629839:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052019584 00000100:00100000:0.0:1746129744.629881:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10430 00000100:00100000:0.0:1746129744.629886:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+9:28399:x1830949052019584:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129744.629900:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.629913:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fb67a00/0x48868a4e439484cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ec9c expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.629933:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e4394835a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebca expref: 16 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.629940:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acd83000/0x48868a4e439483e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec33 expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.629946:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e439483bc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec09 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.629951:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.629952:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.629955:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb67a00/0x48868a4e439484cd lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec9c expref: 10 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.629976:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e439483bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec09 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.629985:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e439483bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec09 expref: 11 pid: 8437 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746129744.629994:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053228672:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129744.630048:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acd83000/0x48868a4e439483e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec33 expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.630060:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acd83000/0x48868a4e439483e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec33 expref: 10 pid: 3624 timeout: 790 lvb_type: 1 00000100:00100000:0.0:1746129744.630068:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053228800:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129744.630087:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e4394835a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebca expref: 16 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.630094:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e4394835a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebca expref: 16 pid: 20441 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746129744.630100:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053228928:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129744.630114:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aba840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129744.630443:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052018816 00000100:00100000:3.0:1746129744.630448:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052018816 00002000:00100000:3.0:1746129744.630473:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f6d8700 x1830949052018816/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129744.630482:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6d8700 with x1830949052018816 ext(2097152->3145727) 00002000:00010000:3.0:1746129744.630485:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6d8700 00000100:00100000:3.0:1746129744.630495:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052019200 00000100:00100000:3.0:1746129744.630497:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052019200 00002000:00100000:3.0:1746129744.630508:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009f6d8a80 x1830949052019200/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129744.630514:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6d8a80 with x1830949052019200 ext(2097152->3145727) 00002000:00010000:3.0:1746129744.630517:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6d8a80 00000100:00100000:3.0:1746129744.630542:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052019328 00000100:00100000:3.0:1746129744.630544:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052019328 00002000:00100000:3.0:1746129744.630555:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009284ce00 x1830949052019328/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129744.630561:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284ce00 with x1830949052019328 ext(3145728->4194303) 00002000:00010000:3.0:1746129744.630564:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284ce00 00000100:00100000:3.0:1746129744.630589:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3848 00000100:00100000:3.0:1746129744.630595:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949052018816:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129744.632328:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3849 00000100:00100000:3.0:1746129744.632339:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052019200:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129744.633758:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3850 00000100:00100000:3.0:1746129744.633766:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949052019328:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129744.641555:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.641587:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052019840 00000100:00100000:0.0:1746129744.641596:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052019840 00002000:00100000:0.0:1746129744.641635:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009284f480 x1830949052019840/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129744.641645:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284f480 with x1830949052019840 ext(2097152->3145727) 00002000:00010000:0.0:1746129744.641650:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284f480 00000100:00100000:0.0:1746129744.641705:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3851 00000100:00100000:0.0:1746129744.641715:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1964:x1830949052019840:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129744.642645:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.642675:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.642698:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.642774:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052020096 00000100:00100000:1.0:1746129744.642780:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052020096 00002000:00100000:1.0:1746129744.642802:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012ba18a80 x1830949052020096/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129744.642810:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba18a80 with x1830949052020096 ext(3145728->4194303) 00002000:00010000:1.0:1746129744.642813:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba18a80 00000100:00100000:1.0:1746129744.642830:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052020352 00000100:00100000:1.0:1746129744.642834:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052020352 00002000:00100000:1.0:1746129744.642881:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012ba18380 x1830949052020352/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129744.642888:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba18380 with x1830949052020352 ext(2097152->3145727) 00002000:00010000:1.0:1746129744.642891:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba18380 00000100:00100000:1.0:1746129744.642904:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052020608 00000100:00100000:1.0:1746129744.642908:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052020608 00002000:00100000:1.0:1746129744.642923:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012ba19f80 x1830949052020608/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129744.642929:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba19f80 with x1830949052020608 ext(3145728->4194303) 00002000:00010000:1.0:1746129744.642932:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba19f80 00000100:00100000:1.0:1746129744.642943:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3852 00000100:00100000:1.0:1746129744.642950:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949052020096:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129744.644108:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3853 00000100:00100000:0.0:1746129744.644116:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1964:x1830949052020352:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129744.644212:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3854 00000100:00100000:1.0:1746129744.644220:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1964:x1830949052020608:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129744.645130:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053228672:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129744.645142:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053228928:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129744.648309:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949052018944:12345-192.168.204.31@tcp:3:cat.0 Request processed in 38066us (38462us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129744.648322:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3847 00002000:00100000:2.0:1746129744.648333:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009f6d8380 x1830949052018944/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129744.648341:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6d8380 with x1830949052018944 ext(3145728->4194303) 00002000:00010000:2.0:1746129744.648348:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6d8380 00000100:00100000:3.0:1746129744.648613:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053229056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746129744.648668:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129744.648730:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053229056 00000100:00100000:3.0:1746129744.648738:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053229056 00000100:00100000:3.0:1746129744.648775:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1746129744.648783:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949053229056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746129744.648806:0:8438:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 277413888 pending 5111808 free 3853516800 avail 3832545280 00000100:00100000:3.0:1746129744.648845:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949053229056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.648881:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1746129744.648934:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053229056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746129744.650806:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.650906:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.651023:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053228800:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.651056:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fb67a00/0x48868a4e439484cd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec9c expref: 10 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.651074:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fb67a00, rc 0) 00000100:00100000:2.0:1746129744.651118:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+10:28399:x1830949052019584:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 21228us (21343us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.651125:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10430 00000100:00100000:0.0:1746129744.652392:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.652724:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052020864 00000100:00100000:3.0:1746129744.652730:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052020864 00010000:00010000:3.0:1746129744.652756:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd83000/0x48868a4e439483e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec33 expref: 10 pid: 3624 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746129744.652787:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052020736 00000100:00100000:3.0:1746129744.652789:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052020736 00010000:00010000:3.0:1746129744.652797:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e4394835a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebca expref: 17 pid: 20441 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746129744.652812:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052020992 00000100:00100000:3.0:1746129744.652814:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052020992 00010000:00010000:3.0:1746129744.652821:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e439483bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec09 expref: 16 pid: 8437 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746129744.652831:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5019 00000100:00100000:3.0:1746129744.652837:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052020864:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129744.652860:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129744.652879:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acd83000/0x48868a4e439483e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec33 expref: 10 pid: 3624 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746129744.652887:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acd83000/0x48868a4e439483e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec33 expref: 10 pid: 3624 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746129744.652904:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acd83000/0x48868a4e439483e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec33 expref: 10 pid: 3624 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746129744.652918:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129744.652943:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052020864:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 106us (2143us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.652948:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5019 00000100:00100000:3.0:1746129744.652961:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5020 00000100:00100000:3.0:1746129744.652965:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949052020736:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129744.652971:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129744.652977:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e4394835a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebca expref: 17 pid: 20441 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746129744.652983:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e4394835a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebca expref: 17 pid: 20441 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746129744.652992:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e4394835a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebca expref: 17 pid: 20441 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746129744.652999:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129744.653009:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1962:x1830949052020736:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 44us (2106us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.653013:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5020 00000100:00100000:3.0:1746129744.653020:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5021 00000100:00100000:3.0:1746129744.653023:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052020992:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129744.653028:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129744.653033:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e439483bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec09 expref: 16 pid: 8437 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746129744.653040:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e439483bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec09 expref: 16 pid: 8437 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746129744.653048:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e439483bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec09 expref: 16 pid: 8437 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746129744.653057:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.653058:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.653063:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fb67a00/0x48868a4e439484cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec9c expref: 8 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.653070:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb67a00/0x48868a4e439484cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec9c expref: 8 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.653092:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fb67a00/0x48868a4e439484cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec9c expref: 8 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129744.653101:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053229184:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129744.653142:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129744.656121:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1962:x1830949052018816:12345-192.168.204.31@tcp:3:cat.0 Request processed in 25516us (26590us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129744.656131:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3848 00002000:00100000:3.0:1746129744.656140:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f6d8700 x1830949052018816/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129744.656150:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6d8700 with x1830949052018816 ext(2097152->3145727) 00002000:00010000:3.0:1746129744.656611:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6d8700 00000100:00100000:3.0:1746129744.661057:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746129744.661071:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053229312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746129744.661119:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129744.661196:0:4345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053229312 00000100:00100000:0.0:1746129744.661202:0:4345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053229312 00000100:00100000:0.0:1746129744.661232:0:4345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1746129744.661237:0:4345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3296:x1830949053229312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746129744.661254:0:4345:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 289210368 pending 3407872 free 3852468224 avail 3835691008 00000100:00100000:0.0:1746129744.661286:0:4345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3296:x1830949053229312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.661291:0:4345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1746129744.661377:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053229312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746129744.664945:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053229184:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129744.664964:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129744.665020:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949052020992:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 11995us (12631us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.665029:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5021 00000100:00100000:2.0:1746129744.665189:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.665213:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052021120 00000100:00100000:2.0:1746129744.665221:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052021120 00000100:00100000:2.0:1746129744.665257:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10431 00000100:00100000:2.0:1746129744.665265:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+9:28399:x1830949052021120:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129744.665281:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129744.665298:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949052019200:12345-192.168.204.31@tcp:3:cat.0 Request processed in 32961us (35723us total) trans 0 rc 1048576/1048576 00010000:00010000:2.0:1746129744.665298:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8fec000/0x48868a4e439484d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eca3 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129744.665304:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3849 00002000:00100000:3.0:1746129744.665312:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009f6d8a80 x1830949052019200/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129744.665321:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6d8a80 with x1830949052019200 ext(2097152->3145727) 00002000:00010000:3.0:1746129744.665325:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6d8a80 00010000:00010000:2.0:1746129744.665325:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5600/0x48868a4e439483b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec02 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.665333:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b534da00/0x48868a4e43948417 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec56 expref: 14 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.665339:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acd83800/0x48868a4e43948402 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec3a expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.665350:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.665352:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.665355:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fec000/0x48868a4e439484d4 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eca3 expref: 10 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129744.665366:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.665381:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052021376 00000100:00100000:3.0:1746129744.665383:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052021376 00010000:00010000:2.0:1746129744.665383:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acd83800/0x48868a4e43948402 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec3a expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.665395:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acd83800/0x48868a4e43948402 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec3a expref: 10 pid: 3624 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746129744.665407:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9774 00000100:00100000:2.0:1746129744.665409:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8793480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053229440:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129744.665411:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28409:x1830949052021376:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129744.665422:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.665424:0:16808:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746129744.665440:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87c800/0x48868a4e439483ca lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec17 expref: 283 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.665453:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129744.665457:0:16808:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129744.665463:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82c00/0x48868a4e439484db lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ecaa expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.665473:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b534da00/0x48868a4e43948417 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec56 expref: 14 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.665483:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b534da00/0x48868a4e43948417 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec56 expref: 14 pid: 4589 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.665491:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8792a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053229568:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129744.665494:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd83e00/0x48868a4e439484e2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.665505:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e439483c3 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec10 expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.665510:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5357800/0x48868a4e439483d1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec1e expref: 7 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.665514:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd83e00/0x48868a4e439484e2 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129744.665540:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5600/0x48868a4e439483b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec02 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.665542:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5357800/0x48868a4e439483d1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec1e expref: 7 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.665549:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5600/0x48868a4e439483b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec02 expref: 13 pid: 8437 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746129744.665550:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5357800/0x48868a4e439483d1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec1e expref: 7 pid: 16808 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746129744.665558:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053229824:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129744.665562:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053229696:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129744.665589:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e439483c3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec10 expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129744.665591:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6a600 going to sleep for 11 seconds 00010000:00010000:3.0:1746129744.665596:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e439483c3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec10 expref: 8 pid: 15044 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746129744.665601:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053229952:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129744.665615:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129744.671805:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052019328:12345-192.168.204.31@tcp:3:cat.0 Request processed in 38032us (42197us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129744.671814:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3850 00002000:00100000:2.0:1746129744.671822:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009284ce00 x1830949052019328/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129744.671831:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284ce00 with x1830949052019328 ext(3145728->4194303) 00002000:00010000:2.0:1746129744.671835:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284ce00 00000100:00100000:3.0:1746129744.676090:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.676148:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.676172:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052021632 00000100:00100000:3.0:1746129744.676178:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052021632 00000100:00100000:3.0:1746129744.676223:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9775 00000100:00100000:3.0:1746129744.676229:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28404:x1830949052021632:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129744.676244:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.676258:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82400/0x48868a4e439484e9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ecb1 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.676299:0:14314:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd83e00/0x48868a4e439484e2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.676306:0:14314:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82400/0x48868a4e439484e9 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb1 expref: 285 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.676321:0:14314:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd83e00/0x48868a4e439484e2 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.676331:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82400/0x48868a4e439484e9 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb1 expref: 285 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.676339:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129744.676342:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129744.676344:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd83e00/0x48868a4e439484e2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.676348:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd82400, rc 0) 00000100:00100000:3.0:1746129744.676379:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28404:x1830949052021632:12345-192.168.204.31@tcp:101:cat.0 Request processed in 150us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.676384:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9775 00000100:00100000:0.0:1746129744.676474:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052021504 00000100:00100000:0.0:1746129744.676477:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052021504 00010000:00010000:0.0:1746129744.676493:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd83800/0x48868a4e43948402 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec3a expref: 11 pid: 3624 timeout: 790 lvb_type: 1 00000100:00100000:0.0:1746129744.676508:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5022 00000100:00100000:0.0:1746129744.676513:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052021504:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129744.676521:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129744.676545:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acd83800/0x48868a4e43948402 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec3a expref: 11 pid: 3624 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.676553:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acd83800/0x48868a4e43948402 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec3a expref: 11 pid: 3624 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.676569:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129744.676586:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052021504:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 73us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.676590:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5022 00010000:00010000:2.0:1746129744.676814:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acd83800/0x48868a4e43948402 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec3a expref: 10 pid: 3624 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746129744.676828:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8793480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053229440:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129744.677071:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ea7f7eb-2f74-477e-bfed-16dc08365411:3298:1830949053230080:0@lo:400:kworker.0 00000100:00100000:2.0:1746129744.677102:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129744.679652:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746129744.679664:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3298:1830949053230208:0@lo:400:kworker.0 00000100:00100000:2.0:1746129744.679701:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129744.679727:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3297:1830949053230464:0@lo:400:kworker.0 00000100:00100000:2.0:1746129744.679741:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129744.679753:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746129744.679757:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3297:1830949053230336:0@lo:400:kworker.0 00000100:00100000:2.0:1746129744.679774:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129744.679797:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053230208 00000100:00100000:2.0:1746129744.679801:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053230208 00000100:00100000:2.0:1746129744.679831:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053230464 00000100:00100000:2.0:1746129744.679833:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053230464 00000100:00100000:2.0:1746129744.679841:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053230336 00000100:00100000:2.0:1746129744.679842:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053230336 00000100:00100000:2.0:1746129744.679870:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1746129744.679875:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1830949053230208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746129744.679907:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1830949053230208:12345-0@lo:400:kworker.0 Request processed in 32us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.679911:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1746129744.679922:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1746129744.679925:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1830949053230464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746129744.679940:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1830949053230464:12345-0@lo:400:kworker.0 Request processed in 15us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.679943:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1746129744.679949:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1746129744.679952:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1830949053230336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746129744.679964:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1830949053230336:12345-0@lo:400:kworker.0 Request processed in 12us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.679967:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1746129744.679976:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746129744.679992:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3298:1830949053230208:0@lo:400:kworker.0 00000100:00100000:2.0:1746129744.680005:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3297:1830949053230336:0@lo:400:kworker.0 00000100:00100000:2.0:1746129744.680010:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3297:1830949053230464:0@lo:400:kworker.0 00000100:00100000:1.0:1746129744.680649:0:14312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053230080 00000100:00100000:1.0:1746129744.680655:0:14312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053230080 00000100:00100000:1.0:1746129744.680686:0:14312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1746129744.680690:0:14312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ea7f7eb-2f74-477e-bfed-16dc08365411+18:3298:x1830949053230080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746129744.680719:0:14312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ea7f7eb-2f74-477e-bfed-16dc08365411+18:3298:x1830949053230080:12345-0@lo:400:kworker.0 Request processed in 29us (3617us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129744.680724:0:14312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1746129744.680827:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ea7f7eb-2f74-477e-bfed-16dc08365411:3298:1830949053230080:0@lo:400:kworker.0 00000100:00100000:2.0:1746129744.684196:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8792a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053229568:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129744.684665:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.684693:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.684716:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052022016 00000100:00100000:0.0:1746129744.684723:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052022016 00010000:00010000:0.0:1746129744.684754:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e439483c3 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec10 expref: 9 pid: 15044 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746129744.684780:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052021888 00000100:00100000:0.0:1746129744.684784:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052021888 00010000:00010000:0.0:1746129744.684795:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5357800/0x48868a4e439483d1 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec1e expref: 8 pid: 16808 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746129744.684814:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5023 00000100:00100000:0.0:1746129744.684823:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1961:x1830949052022016:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129744.684836:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129744.684843:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e439483c3 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec10 expref: 9 pid: 15044 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.684878:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e439483c3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec10 expref: 9 pid: 15044 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.684901:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129744.684905:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd83e00/0x48868a4e439484e2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.684913:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd83e00/0x48868a4e439484e2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.684917:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129744.684963:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1961:x1830949052022016:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 139us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.684968:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5023 00000100:00100000:0.0:1746129744.684986:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5024 00000100:00100000:0.0:1746129744.684992:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:1964:x1830949052021888:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129744.685000:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129744.685005:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5357800/0x48868a4e439483d1 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec1e expref: 8 pid: 16808 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.685012:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5357800/0x48868a4e439483d1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec1e expref: 8 pid: 16808 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.685023:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129744.685026:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd83e00/0x48868a4e439484e2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.685033:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd83e00/0x48868a4e439484e2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.685038:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd83e00/0x48868a4e439484e2 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.685046:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82400/0x48868a4e439484e9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb1 expref: 284 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.685064:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129744.685085:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:1964:x1830949052021888:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 92us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.685090:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5024 00000100:00100000:0.0:1746129744.685127:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.685149:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052021760 00000100:00100000:0.0:1746129744.685154:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052021760 00010000:00010000:0.0:1746129744.685169:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b534da00/0x48868a4e43948417 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec56 expref: 15 pid: 4589 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746129744.685189:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5025 00000100:00100000:0.0:1746129744.685195:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1964:x1830949052021760:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129744.685204:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129744.685224:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b534da00/0x48868a4e43948417 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec56 expref: 15 pid: 4589 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.685233:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b534da00/0x48868a4e43948417 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec56 expref: 15 pid: 4589 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.685246:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b534da00/0x48868a4e43948417 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec56 expref: 15 pid: 4589 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.685264:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129744.685287:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1964:x1830949052021760:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 91us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.685296:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5025 00000100:00100000:0.0:1746129744.685380:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.685400:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052022144 00000100:00100000:0.0:1746129744.685405:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052022144 00010000:00010000:0.0:1746129744.685419:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5600/0x48868a4e439483b5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec02 expref: 14 pid: 8437 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746129744.685441:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5026 00000100:00100000:0.0:1746129744.685446:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1964:x1830949052022144:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129744.685454:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129744.685464:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5600/0x48868a4e439483b5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec02 expref: 14 pid: 8437 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.685473:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5600/0x48868a4e439483b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec02 expref: 14 pid: 8437 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746129744.685486:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.685488:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.685494:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fec000/0x48868a4e439484d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eca3 expref: 9 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.685501:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fec000/0x48868a4e439484d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eca3 expref: 9 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.685540:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8fec000/0x48868a4e439484d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eca3 expref: 9 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.685555:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053230592:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129744.685597:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aba240 going to sleep for 11 seconds 00000100:00100000:1.0:1746129744.686168:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949052019840:12345-192.168.204.31@tcp:3:cat.0 Request processed in 44455us (44623us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129744.686179:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3851 00002000:00100000:1.0:1746129744.686186:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009284f480 x1830949052019840/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129744.686194:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284f480 with x1830949052019840 ext(2097152->3145727) 00002000:00010000:1.0:1746129744.686197:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284f480 00010000:00010000:2.0:1746129744.686282:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5600/0x48868a4e439483b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec02 expref: 14 pid: 8437 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.686300:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053229696:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.686319:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fec000/0x48868a4e439484d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eca3 expref: 9 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.686327:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fec000, rc 0) 00000100:00100000:2.0:1746129744.686344:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8790a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+9:28399:x1830949052021120:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 21081us (21159us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.686350:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10431 00010000:00010000:3.0:1746129744.686559:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5357800/0x48868a4e439483d1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec1e expref: 7 pid: 16808 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746129744.686589:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053229824:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129744.686602:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b22c4000/0x48868a4e439483c3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec10 expref: 8 pid: 15044 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746129744.686610:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053229952:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129744.686657:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd83e00/0x48868a4e439484e2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.686665:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd83e00/0x48868a4e439484e2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129744.686670:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd83e00/0x48868a4e439484e2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00000040:00080000:3.0:1746129744.687195:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2723, 88 off226464 00000004:00080000:3.0:1746129744.687324:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690745475756ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129744.687357:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2669, 88 off221800 00000004:00080000:3.0:1746129744.687361:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690745512962ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129744.687384:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2670, 88 off221888 00000004:00080000:3.0:1746129744.687387:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690745538836ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129744.687394:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2724, 88 off226552 00000004:00080000:3.0:1746129744.687397:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690745548776ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129744.687402:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2725, 88 off226640 00000004:00080000:3.0:1746129744.687404:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690745556569ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129744.687434:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2671, 88 off221976 00000004:00080000:3.0:1746129744.687437:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690745589279ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129744.687455:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2672, 88 off222064 00000004:00080000:3.0:1746129744.687458:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690745610252ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129744.687465:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2673, 88 off222152 00000004:00080000:3.0:1746129744.687468:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690745619801ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129744.687475:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2726, 88 off226728 00000004:00080000:3.0:1746129744.687478:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690745629824ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129744.687483:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2674, 88 off222240 00000004:00080000:3.0:1746129744.687485:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690745636929ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129744.687492:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2727, 88 off226816 00000004:00080000:3.0:1746129744.687494:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690745646026ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129744.687499:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2675, 88 off222328 00000004:00080000:3.0:1746129744.687502:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690745654079ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129744.687509:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2728, 88 off226904 00000004:00080000:3.0:1746129744.687512:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690745664057ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129744.687517:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2729, 88 off226992 00000004:00080000:3.0:1746129744.687519:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690745671591ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129744.687536:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2730, 88 off227080 00000004:00080000:3.0:1746129744.687539:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690745690681ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129744.687545:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2731, 88 off227168 00000004:00080000:3.0:1746129744.687547:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690745699294ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129744.687553:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2676, 88 off222416 00000004:00080000:3.0:1746129744.687556:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690745707852ns, next at 641623252291ns, rc = 0 00000100:00100000:0.0:1746129744.690419:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053230592:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129744.690434:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129744.690468:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1964:x1830949052022144:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5021us (5089us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.690477:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5026 00000100:00100000:1.0:1746129744.691739:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1964:x1830949052020096:12345-192.168.204.31@tcp:3:cat.0 Request processed in 48787us (49093us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129744.691746:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3852 00002000:00100000:1.0:1746129744.691754:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012ba18a80 x1830949052020096/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129744.691762:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba18a80 with x1830949052020096 ext(3145728->4194303) 00002000:00010000:1.0:1746129744.691766:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba18a80 00000100:00100000:2.0:1746129744.697878:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.697906:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052022272 00000100:00100000:2.0:1746129744.697915:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052022272 00000100:00100000:2.0:1746129744.697957:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10432 00000100:00100000:2.0:1746129744.697966:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+9:28399:x1830949052022272:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129744.697982:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129744.697998:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363ce000/0x48868a4e439484f0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ecb8 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.698025:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e439483a0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebed expref: 8 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.698034:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f70c00/0x48868a4e4394843a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec5d expref: 20 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.698041:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acd83200/0x48868a4e439483ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec41 expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.698046:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.698048:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.698051:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363ce000/0x48868a4e439484f0 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb8 expref: 10 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.698079:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800acd83200/0x48868a4e439483ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec41 expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.698092:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800acd83200/0x48868a4e439483ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec41 expref: 10 pid: 3624 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746129744.698103:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053230720:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.698194:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f70c00/0x48868a4e4394843a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec5d expref: 20 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.698202:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f70c00/0x48868a4e4394843a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec5d expref: 20 pid: 7976 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.698209:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053230848:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.698232:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e439483a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebed expref: 8 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.698244:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e439483a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebed expref: 8 pid: 7976 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746129744.698250:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053230976:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129744.698921:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1964:x1830949052020352:12345-192.168.204.31@tcp:3:cat.0 Request processed in 54804us (56244us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129744.698929:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3853 00002000:00100000:0.0:1746129744.698942:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012ba18380 x1830949052020352/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129744.698949:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba18380 with x1830949052020352 ext(2097152->3145727) 00002000:00010000:0.0:1746129744.698954:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba18380 00000100:00100000:2.0:1746129744.700106:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129744.704844:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.704946:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052022400 00000100:00100000:2.0:1746129744.704953:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052022400 00000100:00100000:2.0:1746129744.704987:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9776 00000100:00100000:2.0:1746129744.704994:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28407:x1830949052022400:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129744.705012:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129744.705027:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a1ee000/0x48868a4e439484f7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ecbf expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.705070:0:14314:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a1ee000/0x48868a4e439484f7 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecbf expref: 9 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.705080:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a1ee000/0x48868a4e439484f7 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecbf expref: 9 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.705088:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129744.705091:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129744.705094:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82400/0x48868a4e439484e9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb1 expref: 285 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.705099:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a1ee000, rc 0) 00000100:00100000:2.0:1746129744.705132:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28407:x1830949052022400:12345-192.168.204.31@tcp:101:cat.0 Request processed in 139us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.705138:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9776 00000100:00100000:2.0:1746129744.709516:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053230720:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129744.709543:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053230848:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129744.710749:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.710767:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.710878:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052022528 00000100:00100000:2.0:1746129744.710883:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052022528 00010000:00010000:2.0:1746129744.710910:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd83200/0x48868a4e439483ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec41 expref: 11 pid: 3624 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746129744.710929:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052022656 00000100:00100000:2.0:1746129744.710931:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052022656 00010000:00010000:2.0:1746129744.710941:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f70c00/0x48868a4e4394843a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec5d expref: 21 pid: 7976 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.710955:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5027 00000100:00100000:2.0:1746129744.710961:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052022528:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129744.710972:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.710989:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800acd83200/0x48868a4e439483ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec41 expref: 11 pid: 3624 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746129744.710997:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800acd83200/0x48868a4e439483ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec41 expref: 11 pid: 3624 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746129744.711012:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acd83200/0x48868a4e439483ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec41 expref: 11 pid: 3624 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746129744.711023:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129744.711052:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052022528:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 91us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.711057:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5027 00000100:00100000:2.0:1746129744.711070:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5028 00000100:00100000:2.0:1746129744.711073:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052022656:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129744.711079:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.711084:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f70c00/0x48868a4e4394843a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec5d expref: 21 pid: 7976 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.711090:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4f70c00/0x48868a4e4394843a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec5d expref: 21 pid: 7976 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.711099:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f70c00/0x48868a4e4394843a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec5d expref: 21 pid: 7976 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.711106:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129744.711116:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949052022656:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 42us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.711119:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5028 00000100:00100000:2.0:1746129744.711154:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053230976:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.711171:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801363ce000/0x48868a4e439484f0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb8 expref: 9 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.711181:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801363ce000, rc 0) 00000100:00100000:2.0:1746129744.711194:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+9:28399:x1830949052022272:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 13231us (13355us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.711201:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10432 00000100:00100000:0.0:1746129744.711220:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949052020608:12345-192.168.204.31@tcp:3:cat.0 Request processed in 67001us (68522us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129744.711227:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3854 00002000:00100000:0.0:1746129744.711234:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012ba19f80 x1830949052020608/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129744.711242:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba19f80 with x1830949052020608 ext(3145728->4194303) 00002000:00010000:0.0:1746129744.711246:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba19f80 00000100:00100000:0.0:1746129744.715696:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.715726:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052022784 00000100:00100000:0.0:1746129744.715735:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052022784 00010000:00010000:0.0:1746129744.715764:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e439483a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebed expref: 9 pid: 7976 timeout: 790 lvb_type: 1 00000100:00100000:0.0:1746129744.715795:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5029 00000100:00100000:0.0:1746129744.715805:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052022784:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129744.715818:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129744.715839:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e439483a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebed expref: 9 pid: 7976 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.715877:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e439483a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebed expref: 9 pid: 7976 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.715898:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e439483a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ebed expref: 9 pid: 7976 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.715915:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.715917:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.715924:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363ce000/0x48868a4e439484f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb8 expref: 8 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.715932:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363ce000/0x48868a4e439484f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb8 expref: 8 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.715962:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801363ce000/0x48868a4e439484f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb8 expref: 8 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.715979:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053231104:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129744.716059:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738b180 going to sleep for 11 seconds 00000100:00100000:3.0:1746129744.719197:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053231104:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129744.719221:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129744.719946:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1962:x1830949052022784:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4138us (4253us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.719955:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5029 00000100:00100000:2.0:1746129744.720801:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.720825:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052022912 00000100:00100000:2.0:1746129744.720830:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052022912 00000100:00100000:2.0:1746129744.720878:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10433 00000100:00100000:2.0:1746129744.720885:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+9:28399:x1830949052022912:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129744.720899:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129744.720913:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363cfe00/0x48868a4e439484fe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ecc6 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.720936:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a1efe00/0x48868a4e43948409 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec48 expref: 10 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.720942:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fb66400/0x48868a4e439484bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec8e expref: 7 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.720949:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fa5800/0x48868a4e439484a3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec79 expref: 19 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.720953:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.720955:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.720958:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363cfe00/0x48868a4e439484fe lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecc6 expref: 10 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.720979:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8fa5800/0x48868a4e439484a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec79 expref: 19 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.720993:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8fa5800/0x48868a4e439484a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec79 expref: 19 pid: 4589 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746129744.721003:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053231232:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.721054:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fb66400/0x48868a4e439484bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec8e expref: 7 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.721061:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fb66400/0x48868a4e439484bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec8e expref: 7 pid: 1140 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746129744.721068:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053231360:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.721089:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a1efe00/0x48868a4e43948409 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec48 expref: 10 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.721096:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a1efe00/0x48868a4e43948409 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec48 expref: 10 pid: 4589 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746129744.721101:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053231488:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129744.721114:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129744.726961:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053231232:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129744.726974:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053231360:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129744.726981:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053231488:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.727007:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801363cfe00/0x48868a4e439484fe lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecc6 expref: 10 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.727021:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801363cfe00, rc 0) 00000100:00100000:2.0:1746129744.727067:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+10:28399:x1830949052022912:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 6181us (6265us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.727074:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10433 00000100:00100000:0.0:1746129744.727805:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.727826:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.727863:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052023168 00000100:00100000:0.0:1746129744.727868:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052023168 00010000:00010000:0.0:1746129744.727892:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a1efe00/0x48868a4e43948409 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec48 expref: 10 pid: 4589 timeout: 790 lvb_type: 1 00000100:00100000:0.0:1746129744.727910:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052023040 00000100:00100000:0.0:1746129744.727912:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052023040 00010000:00010000:0.0:1746129744.727921:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8fa5800/0x48868a4e439484a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec79 expref: 20 pid: 4589 timeout: 790 lvb_type: 1 00000100:00100000:0.0:1746129744.727936:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5030 00000100:00100000:0.0:1746129744.727942:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+10:1963:x1830949052023168:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129744.727952:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129744.727970:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a1efe00/0x48868a4e43948409 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec48 expref: 10 pid: 4589 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.727979:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a1efe00/0x48868a4e43948409 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec48 expref: 10 pid: 4589 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.727996:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a1efe00/0x48868a4e43948409 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec48 expref: 10 pid: 4589 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.728011:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129744.728033:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:1963:x1830949052023168:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 91us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.728038:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5030 00000100:00100000:0.0:1746129744.728049:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5031 00000100:00100000:0.0:1746129744.728054:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1963:x1830949052023040:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129744.728060:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129744.728067:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8fa5800/0x48868a4e439484a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec79 expref: 20 pid: 4589 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.728074:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8fa5800/0x48868a4e439484a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec79 expref: 20 pid: 4589 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.728085:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fa5800/0x48868a4e439484a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec79 expref: 20 pid: 4589 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.728092:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129744.728106:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1963:x1830949052023040:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 52us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.728111:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5031 00000100:00100000:0.0:1746129744.728148:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.728215:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052023296 00000100:00100000:0.0:1746129744.728218:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052023296 00010000:00010000:0.0:1746129744.728227:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fb66400/0x48868a4e439484bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec8e expref: 8 pid: 1140 timeout: 790 lvb_type: 1 00000100:00100000:0.0:1746129744.728246:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5032 00000100:00100000:0.0:1746129744.728250:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1962:x1830949052023296:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129744.728256:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129744.728263:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fb66400/0x48868a4e439484bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec8e expref: 8 pid: 1140 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.728270:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fb66400/0x48868a4e439484bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec8e expref: 8 pid: 1140 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.728280:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fb66400/0x48868a4e439484bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec8e expref: 8 pid: 1140 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746129744.728287:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.728289:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129744.728294:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363cfe00/0x48868a4e439484fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecc6 expref: 8 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.728301:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363cfe00/0x48868a4e439484fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecc6 expref: 8 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.728323:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801363cfe00/0x48868a4e439484fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecc6 expref: 8 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.728333:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053231616:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129744.728372:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.733933:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.735034:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053231616:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129744.735050:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129744.735085:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1962:x1830949052023296:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6833us (6936us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.735098:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5032 00000100:00100000:2.0:1746129744.735373:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052023424 00000100:00100000:2.0:1746129744.735379:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052023424 00000100:00100000:3.0:1746129744.735978:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10434 00000100:00100000:3.0:1746129744.735986:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+9:28399:x1830949052023424:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129744.736000:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.736013:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acd82600/0x48868a4e43948505 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eccd expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.736036:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acd83400/0x48868a4e439483f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec4f expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.736043:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fb67600/0x48868a4e439484c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec95 expref: 9 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.736050:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fb67e00/0x48868a4e439484b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec80 expref: 12 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.736055:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.736057:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.736061:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd82600/0x48868a4e43948505 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eccd expref: 10 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.736089:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fb67e00/0x48868a4e439484b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec80 expref: 12 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.736103:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fb67e00/0x48868a4e439484b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec80 expref: 12 pid: 8435 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746129744.736113:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053231744:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129744.736169:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fb67600/0x48868a4e439484c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec95 expref: 9 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.736177:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fb67600/0x48868a4e439484c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec95 expref: 9 pid: 1140 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746129744.736184:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053231872:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129744.736207:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acd83400/0x48868a4e439483f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec4f expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.736213:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acd83400/0x48868a4e439483f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec4f expref: 10 pid: 3624 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746129744.736219:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053232000:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129744.736229:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2e40 going to sleep for 11 seconds 00000001:00080000:1.0:1746129744.738022:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943537 is committed 00000001:00080000:1.0:1746129744.738038:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943540 is committed 00000004:00080000:1.0:1746129744.738042:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1862 committed 00000004:00080000:1.0:1746129744.738048:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1914 committed 00000004:00080000:1.0:1746129744.738054:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1913 committed 00000004:00080000:1.0:1746129744.738055:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1912 committed 00000004:00080000:1.0:1746129744.738057:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1911 committed 00000004:00080000:1.0:1746129744.738058:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1861 committed 00000004:00080000:1.0:1746129744.738060:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1910 committed 00000004:00080000:1.0:1746129744.738061:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1860 committed 00000004:00080000:1.0:1746129744.738062:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1909 committed 00000004:00080000:1.0:1746129744.738064:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1859 committed 00000004:00080000:1.0:1746129744.738065:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1858 committed 00000004:00080000:1.0:1746129744.738067:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1857 committed 00000004:00080000:1.0:1746129744.738069:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1908 committed 00000004:00080000:1.0:1746129744.738070:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1907 committed 00000004:00080000:1.0:1746129744.738071:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1856 committed 00000004:00080000:1.0:1746129744.738073:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1855 committed 00000004:00080000:1.0:1746129744.738074:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1906 committed 00000001:00080000:1.0:1746129744.738078:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943539 is committed 00000001:00080000:1.0:1746129744.738081:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943538 is committed 00000100:00100000:1.0:1746129744.738161:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053232384:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746129744.738174:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd83e00/0x48868a4e439484e2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecaa expref: 284 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.738182:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129744.738184:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746129744.738188:0:16808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82400/0x48868a4e439484e9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb1 expref: 284 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.738196:0:16808:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82400/0x48868a4e439484e9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb1 expref: 284 pid: 14314 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.738198:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746129744.738202:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82400/0x48868a4e439484e9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb1 expref: 284 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.738208:0:16808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a1ee000/0x48868a4e439484f7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecbf expref: 7 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.738213:0:16808:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a1ee000/0x48868a4e439484f7 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecbf expref: 7 pid: 14314 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.738216:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053232896:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746129744.738219:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a1ee000/0x48868a4e439484f7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecbf expref: 7 pid: 14314 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.738227:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746129744.738237:0:16808:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a1ee000/0x48868a4e439484f7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecbf expref: 7 pid: 14314 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.738240:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746129744.738243:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053232512:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129744.738245:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd45f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053233152:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129744.738255:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129744.738265:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053233024:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129744.738278:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746129744.738283:0:16808:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82400/0x48868a4e439484e9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb1 expref: 284 pid: 14314 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129744.738294:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053233280:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129744.738294:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053232384 00000100:00100000:1.0:1746129744.738298:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053232384 00000100:00100000:3.0:1746129744.738308:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129744.738317:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053232128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129744.738318:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053232896 00000100:00100000:1.0:1746129744.738319:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053232896 00000100:00100000:1.0:1746129744.738328:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053232512 00000100:00100000:1.0:1746129744.738329:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053232512 00000100:00100000:3.0:1746129744.738330:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129744.738338:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053233024 00000100:00100000:1.0:1746129744.738339:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053233024 00000100:00100000:3.0:1746129744.738341:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053232640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129744.738347:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053232128 00000100:00100000:1.0:1746129744.738348:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053232128 00000100:00100000:3.0:1746129744.738352:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129744.738356:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053232640 00000100:00100000:1.0:1746129744.738358:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053232640 00000100:00100000:3.0:1746129744.738362:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746129744.738365:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053232256:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129744.738366:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10435 00000100:00100000:1.0:1746129744.738371:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3296:x1830949053232384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129744.738376:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129744.738381:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053232768:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129744.738391:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129744.738493:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053233536:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129744.738507:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:1.0:1746129744.738509:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129744 -> 1746129744 00002000:00010000:1.0:1746129744.738511:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129743 -> 1746129743 00000100:00100000:2.0:1746129744.738513:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746129744.738513:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129743 -> 1746129743 00002000:00010000:1.0:1746129744.738515:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5673 -> 5673 00000100:00100000:2.0:1746129744.738521:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053234048:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129744.738544:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129744.738546:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3296:x1830949053232384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 175us (348us total) trans 17179873019 rc 0/0 00000100:00100000:1.0:1746129744.738551:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10435 00000100:00100000:2.0:1746129744.738552:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746129744.738555:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053233408:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129744.738562:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053232256 00000100:00100000:1.0:1746129744.738564:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053232256 00000100:00100000:2.0:1746129744.738565:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129744.738571:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053233920:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129744.738571:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053232768 00000100:00100000:1.0:1746129744.738572:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053232768 00000100:00100000:1.0:1746129744.738577:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053233536 00000100:00100000:1.0:1746129744.738578:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053233536 00000100:00100000:2.0:1746129744.738581:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129744.738584:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053234048 00000100:00100000:1.0:1746129744.738585:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053234048 00000100:00100000:1.0:1746129744.738590:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053233408 00000100:00100000:2.0:1746129744.738592:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053233792:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129744.738592:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053233408 00000100:00100000:1.0:1746129744.738597:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053233920 00000100:00100000:1.0:1746129744.738598:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053233920 00000100:00100000:1.0:1746129744.738604:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10436 00000100:00100000:2.0:1746129744.738605:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129744.738608:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3296:x1830949053232896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129744.738611:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053234304:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129744.738623:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129744.738636:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746129744.738640:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053233664:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129744.738653:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129744.738660:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053234176:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129744.738671:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129744.738674:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3296:x1830949053232896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (446us total) trans 17179873020 rc 0/0 00000100:00100000:1.0:1746129744.738679:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10436 00000100:00100000:1.0:1746129744.738686:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053233792 00000100:00100000:1.0:1746129744.738688:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053233792 00000100:00100000:1.0:1746129744.738699:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053234304 00000100:00100000:1.0:1746129744.738701:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053234304 00000100:00100000:1.0:1746129744.738706:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053233664 00000100:00100000:1.0:1746129744.738708:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053233664 00000100:00100000:1.0:1746129744.738713:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10437 00000100:00100000:1.0:1746129744.738716:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3296:x1830949053232512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129744.738775:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746129744.738778:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746129744.738780:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746129744.738781:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746129744.738783:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129744.738800:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3296:x1830949053232512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (543us total) trans 17179873021 rc 0/0 00000100:00100000:1.0:1746129744.738804:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10437 00000100:00100000:1.0:1746129744.738812:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053234176 00000100:00100000:1.0:1746129744.738814:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053234176 00000100:00100000:1.0:1746129744.738822:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10438 00000100:00100000:1.0:1746129744.738825:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3296:x1830949053233024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129744.738916:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3296:x1830949053233024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (637us total) trans 17179873022 rc 0/0 00000100:00100000:1.0:1746129744.738921:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10438 00000100:00100000:1.0:1746129744.738929:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10439 00000100:00100000:1.0:1746129744.738933:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949053232128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129744.738992:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746129744.738994:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129743 -> 1746129743 00002000:00010000:1.0:1746129744.738996:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129743 -> 1746129743 00002000:00010000:1.0:1746129744.738998:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129743 -> 1746129743 00002000:00010000:1.0:1746129744.739000:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:1.0:1746129744.739016:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3298:x1830949053232128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (685us total) trans 17179873023 rc 0/0 00000100:00100000:1.0:1746129744.739021:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10439 00000100:00100000:1.0:1746129744.739029:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10440 00000100:00100000:1.0:1746129744.739033:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949053232640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129744.739101:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3298:x1830949053232640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (747us total) trans 17179873024 rc 0/0 00000100:00100000:1.0:1746129744.739105:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10440 00000100:00100000:1.0:1746129744.739114:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10441 00000100:00100000:1.0:1746129744.739118:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949053232256:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129744.739179:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129744.739181:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129744 -> 1746129744 00002000:00010000:1.0:1746129744.739183:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746129743 -> 1746129743 00002000:00010000:1.0:1746129744.739184:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129744 -> 1746129744 00002000:00010000:1.0:1746129744.739186:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746129744.739202:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3298:x1830949053232256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (825us total) trans 17179873025 rc 0/0 00000100:00100000:1.0:1746129744.739207:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10441 00000100:00100000:1.0:1746129744.739216:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10442 00000100:00100000:1.0:1746129744.739220:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949053232768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129744.739284:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3298:x1830949053232768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (891us total) trans 17179873026 rc 0/0 00000100:00100000:1.0:1746129744.739289:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10442 00000100:00100000:1.0:1746129744.739297:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10443 00000100:00100000:1.0:1746129744.739301:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3299:x1830949053233536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129744.739377:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10444 00002000:00010000:1.0:1746129744.739378:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129744.739380:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129744 -> 1746129744 00002000:00010000:1.0:1746129744.739382:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129744 -> 1746129744 00000100:00100000:2.0:1746129744.739383:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3299:x1830949053234048:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129744.739384:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129744 -> 1746129744 00002000:00010000:1.0:1746129744.739385:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129744.739404:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3299:x1830949053233536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (891us total) trans 21474840183 rc 0/0 00000100:00100000:1.0:1746129744.739409:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10443 00000100:00100000:1.0:1746129744.739417:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10445 00000100:00100000:1.0:1746129744.739420:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3299:x1830949053233408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129744.739461:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3299:x1830949053234048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (916us total) trans 21474840184 rc 0/0 00000100:00100000:2.0:1746129744.739466:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10444 00002000:00010000:1.0:1746129744.739473:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:2.0:1746129744.739474:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10446 00002000:00010000:1.0:1746129744.739475:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129744 -> 1746129744 00002000:00010000:1.0:1746129744.739477:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129744 -> 1746129744 00000100:00100000:2.0:1746129744.739478:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3299:x1830949053233920:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129744.739479:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129744 -> 1746129744 00002000:00010000:1.0:1746129744.739480:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746129744.739495:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3299:x1830949053233408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (928us total) trans 21474840185 rc 0/0 00000100:00100000:1.0:1746129744.739500:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10445 00000100:00100000:1.0:1746129744.739508:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10447 00000100:00100000:1.0:1746129744.739511:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a344450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3297:x1830949053233792:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129744.739546:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746129744.739549:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746129744.739550:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746129744.739552:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746129744.739553:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746129744.739569:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3299:x1830949053233920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (987us total) trans 21474840186 rc 0/0 00000100:00100000:2.0:1746129744.739574:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10446 00000100:00100000:2.0:1746129744.739583:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10448 00000100:00100000:1.0:1746129744.739586:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a344450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3297:x1830949053233792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (980us total) trans 21474840187 rc 0/0 00000100:00100000:2.0:1746129744.739587:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3297:x1830949053234304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129744.739590:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10447 00000100:00100000:1.0:1746129744.739597:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10449 00000100:00100000:1.0:1746129744.739600:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3297:x1830949053233664:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129744.739646:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746129744.739649:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129744 -> 1746129744 00000100:00100000:2.0:1746129744.739650:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3297:x1830949053234304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (1026us total) trans 21474840188 rc 0/0 00002000:00010000:1.0:1746129744.739651:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129743 -> 1746129743 00002000:00010000:1.0:1746129744.739652:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129744 -> 1746129744 00000100:00100000:2.0:1746129744.739654:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10448 00002000:00010000:1.0:1746129744.739654:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746129744.739662:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10450 00000100:00100000:1.0:1746129744.739666:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3297:x1830949053233664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (1013us total) trans 21474840189 rc 0/0 00000100:00100000:2.0:1746129744.739667:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3297:x1830949053234176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129744.739671:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10449 00000004:00080000:1.0:1746129744.739704:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135d8dc00/2, rc 0, transno 17179873021 00000100:00100000:1.0:1746129744.739711:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053232512:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129744.739718:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135d8ea00/2, rc 0, transno 17179873022 00000100:00100000:1.0:1746129744.739721:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053233024:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129744.739727:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3297:x1830949053234176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (1055us total) trans 21474840190 rc 0/0 00000004:00080000:1.0:1746129744.739727:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135d8df80/2, rc 0, transno 17179873019 00000100:00100000:1.0:1746129744.739730:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053232384:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129744.739732:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10450 00000004:00080000:1.0:1746129744.739735:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135d8e300/2, rc 0, transno 17179873020 00000100:00100000:1.0:1746129744.739737:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053232896:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129744.740876:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a4e00/2, rc 0, transno 21474840189 00000100:00100000:2.0:1746129744.740882:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053233664:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129744.740888:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009be67100/2, rc 0, transno 21474840190 00000100:00100000:2.0:1746129744.740890:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053234176:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129744.740896:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8792a00/2, rc 0, transno 21474840187 00000100:00100000:2.0:1746129744.740898:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053233792:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129744.740903:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009be64000/2, rc 0, transno 21474840188 00000100:00100000:2.0:1746129744.740905:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053234304:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129744.740920:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a5f80/2, rc 0, transno 21474840185 00000100:00100000:2.0:1746129744.740923:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053233408:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129744.740929:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8793480/2, rc 0, transno 21474840186 00000100:00100000:2.0:1746129744.740932:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053233920:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129744.740938:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a7800/2, rc 0, transno 21474840183 00000100:00100000:2.0:1746129744.740941:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053233536:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129744.740947:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009be65500/2, rc 0, transno 21474840184 00000100:00100000:2.0:1746129744.740950:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053234048:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129744.740959:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053234432:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129744.740982:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746129744.741002:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135d8fb80/2, rc 0, transno 17179873025 00000100:00100000:2.0:1746129744.741005:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053232256:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129744.741011:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135d8ed80/2, rc 0, transno 17179873026 00000100:00100000:2.0:1746129744.741014:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053232768:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129744.741258:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053234432 00000100:00100000:3.0:1746129744.741264:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053234432 00000100:00100000:3.0:1746129744.741291:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10451 00000100:00100000:3.0:1746129744.741296:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3298:x1830949053234432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129744.741428:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3298:x1830949053234432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 131us (444us total) trans 17179873027 rc 0/0 00000100:00100000:3.0:1746129744.741434:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10451 00000004:00080000:2.0:1746129744.741638:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135d8f480/2, rc 0, transno 17179873023 00000100:00100000:2.0:1746129744.741642:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053232128:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129744.741663:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135d8ca80/2, rc 0, transno 17179873024 00000100:00100000:2.0:1746129744.741665:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053232640:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129744.741673:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04c000/2, rc 0, transno 17179873027 00000100:00100000:2.0:1746129744.741675:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053234432:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129744.741882:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053231744:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129744.741891:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053231872:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129744.741897:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd47b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053232000:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129744.741919:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acd82600/0x48868a4e43948505 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eccd expref: 10 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.741932:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd82600, rc 0) 00000100:00100000:3.0:1746129744.741970:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+10:28399:x1830949052023424:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5985us (8043us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.741975:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10434 00000100:00100000:0.0:1746129744.742452:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.742649:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052023552 00000100:00100000:3.0:1746129744.742654:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052023552 00010000:00010000:3.0:1746129744.742672:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd83400/0x48868a4e439483f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec4f expref: 10 pid: 3624 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746129744.742701:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5033 00000100:00100000:3.0:1746129744.742708:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+10:1963:x1830949052023552:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129744.742716:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129744.742730:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acd83400/0x48868a4e439483f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec4f expref: 10 pid: 3624 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746129744.742739:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acd83400/0x48868a4e439483f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec4f expref: 10 pid: 3624 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746129744.742755:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acd83400/0x48868a4e439483f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec4f expref: 10 pid: 3624 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746129744.742764:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129744.742781:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:1963:x1830949052023552:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 74us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.742786:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5033 00000100:00100000:0.0:1746129744.744381:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.744399:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd45f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053233152:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129744.744409:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053233280:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129744.744415:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.744484:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052023808 00000100:00100000:1.0:1746129744.744489:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052023808 00000100:00100000:1.0:1746129744.744517:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3814 00000100:00100000:1.0:1746129744.744523:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c560050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28407:x1830949052023808:12345-192.168.204.31@tcp:49:cat.0 00010000:00010000:3.0:1746129744.744576:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82c00/0x48868a4e439484db lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecaa expref: 284 pid: 16808 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746129744.744591:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd83e00/0x48868a4e439484e2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecaa expref: 283 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.744608:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd83e00, rc 0) 00000100:00100000:1.0:1746129744.744619:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c560050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28407:x1830949052023808:12345-192.168.204.31@tcp:49:cat.0 Request processed in 95us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129744.744624:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3814 00000100:00100000:3.0:1746129744.744628:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28409:x1830949052021376:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 79216us (79262us total) trans 8589943540 rc 0/0 00000100:00100000:3.0:1746129744.744634:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9774 00000100:00100000:0.0:1746129744.744670:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.744687:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.744702:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052023680 00000100:00100000:2.0:1746129744.744705:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052023680 00010000:00010000:2.0:1746129744.744719:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb67e00/0x48868a4e439484b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec80 expref: 13 pid: 8435 timeout: 790 lvb_type: 1 00000100:00100000:0.0:1746129744.744726:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.744728:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052024064 00000100:00100000:3.0:1746129744.744731:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052024064 00000100:00100000:2.0:1746129744.744735:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5034 00000100:00100000:2.0:1746129744.744740:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1961:x1830949052023680:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129744.744744:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb67600/0x48868a4e439484c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec95 expref: 10 pid: 1140 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746129744.744747:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129744.744760:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5035 00000100:00100000:3.0:1746129744.744764:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052024064:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129744.744764:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fb67e00/0x48868a4e439484b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec80 expref: 13 pid: 8435 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746129744.744771:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.744772:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fb67e00/0x48868a4e439484b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec80 expref: 13 pid: 8435 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746129744.744780:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fb67600/0x48868a4e439484c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec95 expref: 10 pid: 1140 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746129744.744787:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fb67e00/0x48868a4e439484b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec80 expref: 13 pid: 8435 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746129744.744788:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fb67600/0x48868a4e439484c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec95 expref: 10 pid: 1140 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746129744.744801:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129744.744807:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fb67600/0x48868a4e439484c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec95 expref: 10 pid: 1140 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746129744.744820:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.744821:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746129744.744821:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+12:1961:x1830949052023680:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 81us (405us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129744.744827:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acd82600/0x48868a4e43948505 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eccd expref: 8 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129744.744827:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5034 00010000:00010000:3.0:1746129744.744834:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd82600/0x48868a4e43948505 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eccd expref: 8 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.744889:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800acd82600/0x48868a4e43948505 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eccd expref: 8 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129744.744899:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053234560:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129744.744933:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129744.744944:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052024192 00000100:00100000:3.0:1746129744.744946:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052024192 00000100:00100000:3.0:1746129744.744964:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9777 00000100:00100000:3.0:1746129744.744968:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28411:x1830949052024192:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129744.744975:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.744985:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed000/0x48868a4e4394850c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ecd4 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.745001:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052023936 00000100:00100000:1.0:1746129744.745005:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052023936 00010000:00010000:3.0:1746129744.745010:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed000/0x48868a4e4394850c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecd4 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.745020:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3815 00010000:00010000:3.0:1746129744.745024:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed000/0x48868a4e4394850c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecd4 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.745025:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28404:x1830949052023936:12345-192.168.204.31@tcp:49:cat.0 00010000:00010000:3.0:1746129744.745034:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129744.745036:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129744.745038:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310ed000, rc 0) 00000100:00100000:3.0:1746129744.745057:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28411:x1830949052024192:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 88us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.745061:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9777 00000100:00100000:1.0:1746129744.745061:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28404:x1830949052023936:12345-192.168.204.31@tcp:49:cat.0 Request processed in 35us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129744.745066:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3815 00000100:00100000:0.0:1746129744.746835:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.747012:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052024320 00000100:00100000:3.0:1746129744.747017:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052024320 00000100:00100000:3.0:1746129744.747054:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10452 00000100:00100000:3.0:1746129744.747059:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28407:x1830949052024320:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129744.747070:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.747081:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e43948513 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ecdb expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.747100:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acd82600/0x48868a4e43948505 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eccd expref: 8 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.747105:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129744.747107:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129744.747109:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e43948513 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecdb expref: 11 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.747128:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acd82600/0x48868a4e43948505 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eccd expref: 8 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.747138:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acd82600/0x48868a4e43948505 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eccd expref: 8 pid: 4589 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746129744.747147:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053234688:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129744.747212:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.748092:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.748114:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.748125:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.748134:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.748145:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.748155:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.748164:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.748174:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.748188:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.748247:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052025344 00000100:00100000:1.0:1746129744.748251:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052025344 00000100:00100000:1.0:1746129744.748271:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052024448 00000100:00100000:1.0:1746129744.748273:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052024448 00000100:00100000:1.0:1746129744.748283:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052024704 00000100:00100000:1.0:1746129744.748429:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052024704 00000100:00100000:1.0:1746129744.748443:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052024960 00000100:00100000:1.0:1746129744.748445:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052024960 00000100:00100000:1.0:1746129744.748451:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052024576 00000100:00100000:1.0:1746129744.748452:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052024576 00000100:00100000:1.0:1746129744.748457:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052024832 00000100:00100000:1.0:1746129744.748459:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052024832 00000100:00100000:1.0:1746129744.748463:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052025088 00000100:00100000:1.0:1746129744.748465:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052025088 00000100:00100000:1.0:1746129744.748469:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052025472 00000100:00100000:1.0:1746129744.748471:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052025472 00000100:00100000:1.0:1746129744.748479:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10453 00000100:00100000:1.0:1746129744.748484:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:28404:x1830949052025344:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:3.0:1746129744.748491:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053234560:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129744.748493:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129744.748502:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094fd8c00/0x48868a4e4394851a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ece9 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.748517:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129744.748521:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fd8c00/0x48868a4e4394851a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece9 expref: 14 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.748535:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129744.748545:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094fd8c00/0x48868a4e4394851a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece9 expref: 14 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.748552:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fd8c00, rc 0) 00000100:00100000:3.0:1746129744.748561:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052024064:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3796us (3872us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.748570:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5035 00000100:00100000:1.0:1746129744.748571:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:28404:x1830949052025344:12345-192.168.204.31@tcp:101:cat.0 Request processed in 86us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129744.748576:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10453 00000100:00100000:1.0:1746129744.748587:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10454 00000100:00100000:1.0:1746129744.748592:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052024448:12345-192.168.204.31@tcp:2:lfs.0 00000100:00100000:3.0:1746129744.748603:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052025216 00000100:00100000:3.0:1746129744.748606:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052025216 00000100:00100000:3.0:1746129744.748622:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 555 00000100:00100000:3.0:1746129744.748626:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052025216:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129744.748633:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129744.748646:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed000/0x48868a4e4394850c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecd4 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.748656:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129744.748658:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129744.748671:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1962:x1830949052025216:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 45us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.748675:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 555 00000100:00100000:3.0:1746129744.748691:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10455 00000100:00100000:3.0:1746129744.748696:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052024704:12345-192.168.204.31@tcp:2:lfs.0 00000100:00100000:2.0:1746129744.748705:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10456 00000100:00100000:2.0:1746129744.748712:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052024960:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:3.0:1746129744.748804:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129744.748807:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129744 -> 1746129744 00002000:00010000:3.0:1746129744.748808:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129744 -> 1746129744 00002000:00010000:3.0:1746129744.748810:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129744 -> 1746129745 00002000:00010000:3.0:1746129744.748812:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746129744.748828:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949052024704:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 131us (702us total) trans 21474840191 rc 0/0 00000100:00100000:3.0:1746129744.748833:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10455 00000100:00100000:3.0:1746129744.748843:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10457 00000100:00100000:3.0:1746129744.748863:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052024576:12345-192.168.204.31@tcp:2:lfs.0 00000100:00100000:0.0:1746129744.748903:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10458 00000100:00100000:0.0:1746129744.748909:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052024832:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:3.0:1746129744.748921:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129744.748923:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129744 -> 1746129744 00002000:00010000:3.0:1746129744.748925:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129744 -> 1746129744 00002000:00010000:3.0:1746129744.748926:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129744 -> 1746129745 00002000:00010000:3.0:1746129744.748927:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746129744.748943:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949052024576:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 80us (786us total) trans 21474840192 rc 0/0 00000100:00100000:3.0:1746129744.748948:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10457 00000100:00100000:3.0:1746129744.748957:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10459 00000100:00100000:3.0:1746129744.748962:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052025088:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:3.0:1746129744.749017:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746129744.749020:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129744 -> 1746129744 00002000:00010000:3.0:1746129744.749021:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129743 -> 1746129744 00002000:00010000:3.0:1746129744.749023:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129744 -> 1746129745 00002000:00010000:3.0:1746129744.749025:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746129744.749027:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10460 00000100:00100000:1.0:1746129744.749032:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:28409:x1830949052025472:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129744.749038:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1746129744.749041:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00010000:00010000:1.0:1746129744.749043:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094fd9a00/0x48868a4e43948521 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ecf0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129744.749044:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129744 -> 1746129744 00002000:00010000:2.0:1746129744.749046:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129743 -> 1746129744 00002000:00010000:2.0:1746129744.749048:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129743 -> 1746129745 00002000:00010000:2.0:1746129744.749049:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5673 -> 5673 00010000:00010000:1.0:1746129744.749055:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fec000/0x48868a4e439484d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eca3 expref: 12 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.749061:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129744.749062:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129744.749064:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fd9a00/0x48868a4e43948521 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1056768->1982463] (req 1056768->1982463) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecf0 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129744.749065:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949052024960:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 354us (930us total) trans 17179873029 rc 0/0 00000100:00100000:2.0:1746129744.749070:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10456 00010000:00010000:1.0:1746129744.749080:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8fec000/0x48868a4e439484d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eca3 expref: 12 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.749087:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fec000/0x48868a4e439484d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eca3 expref: 12 pid: 4589 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746129744.749095:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053234816:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129744.749124:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324480 going to sleep for 11 seconds 00002000:00010000:1.0:1746129744.749156:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746129744.749158:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129743 -> 1746129744 00002000:00010000:1.0:1746129744.749160:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129743 -> 1746129744 00002000:00010000:1.0:1746129744.749162:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129743 -> 1746129745 00002000:00010000:1.0:1746129744.749163:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:1.0:1746129744.749177:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949052024448:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 584us (1061us total) trans 17179873028 rc 0/0 00000100:00100000:1.0:1746129744.749182:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10454 00000100:00100000:2.0:1746129744.749216:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00010000:0.0:1746129744.749279:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129744.749282:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129744 -> 1746129744 00002000:00010000:0.0:1746129744.749283:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746129743 -> 1746129744 00002000:00010000:0.0:1746129744.749285:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129744 -> 1746129745 00002000:00010000:0.0:1746129744.749287:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746129744.749301:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949052024832:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 393us (1135us total) trans 17179873030 rc 0/0 00000100:00100000:0.0:1746129744.749306:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10458 00000100:00100000:0.0:1746129744.749314:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052025600 00000100:00100000:0.0:1746129744.749316:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052025600 00000100:00100000:0.0:1746129744.749330:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10461 00000100:00100000:0.0:1746129744.749334:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:28411:x1830949052025600:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129744.749339:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129744.749341:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053234688:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129744.749345:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fb66400/0x48868a4e43948528 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ece2 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.749357:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136920800/0x48868a4e439484b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec87 expref: 11 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.749362:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129744.749363:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129744.749365:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fb66400/0x48868a4e43948528 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [544768->1048575] (req 544768->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece2 expref: 8 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.749366:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e43948513 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecdb expref: 10 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.749373:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310ed600, rc 0) 00010000:00010000:0.0:1746129744.749377:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136920800/0x48868a4e439484b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec87 expref: 11 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.749384:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136920800/0x48868a4e439484b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec87 expref: 11 pid: 8435 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.749388:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28407:x1830949052024320:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2329us (2558us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.749392:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053234944:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129744.749393:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10452 00000100:00100000:0.0:1746129744.749408:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738b780 going to sleep for 11 seconds 00000100:00100000:1.0:1746129744.751361:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053234816:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129744.751370:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129744.751385:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094fd9a00/0x48868a4e43948521 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1056768->1982463] (req 1056768->1982463) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecf0 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.751385:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129744.751396:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fd9a00, rc 0) 00000100:00100000:0.0:1746129744.751409:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.751434:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:28409:x1830949052025472:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2391us (3234us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129744.751440:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10460 00000100:00100000:0.0:1746129744.751463:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.751484:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053234944:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129744.751498:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fb66400/0x48868a4e43948528 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [544768->1048575] (req 544768->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece2 expref: 8 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.751506:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fb66400, rc 0) 00000100:00100000:0.0:1746129744.751541:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28411:x1830949052025600:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2207us (2325us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.751546:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10461 00000100:00100000:0.0:1746129744.751580:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052025728 00000100:00100000:0.0:1746129744.751584:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052025728 00000100:00100000:0.0:1746129744.751605:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9778 00000100:00100000:0.0:1746129744.751611:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+6:28399:x1830949052025728:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129744.751625:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.751635:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66c00/0x48868a4e4394852f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ecf7 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129744.751678:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052025984 00000100:00100000:2.0:1746129744.751681:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052025984 00010000:00010000:2.0:1746129744.751700:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd82600/0x48868a4e43948505 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eccd expref: 13 pid: 4589 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.751719:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052025856 00000100:00100000:2.0:1746129744.751720:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052025856 00010000:00010000:2.0:1746129744.751727:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fec000/0x48868a4e439484d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eca3 expref: 14 pid: 4589 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.751736:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052026112 00000100:00100000:2.0:1746129744.751738:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052026112 00010000:00010000:2.0:1746129744.751745:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136920800/0x48868a4e439484b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec87 expref: 12 pid: 8435 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.751757:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5036 00000100:00100000:2.0:1746129744.751761:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+14:1962:x1830949052025984:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129744.751769:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.751783:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acd82600/0x48868a4e43948505 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eccd expref: 14 pid: 4589 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746129744.751788:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5037 00010000:00010000:2.0:1746129744.751791:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acd82600/0x48868a4e43948505 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eccd expref: 14 pid: 4589 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746129744.751793:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+14:1963:x1830949052025856:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129744.751801:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.751806:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acd82600/0x48868a4e43948505 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eccd expref: 14 pid: 4589 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746129744.751808:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8fec000/0x48868a4e439484d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eca3 expref: 14 pid: 4589 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746129744.751815:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8fec000/0x48868a4e439484d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eca3 expref: 13 pid: 4589 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.751816:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.751818:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129744.751823:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fec000/0x48868a4e439484d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eca3 expref: 13 pid: 4589 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.751824:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e43948513 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecdb expref: 9 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.751833:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129744.751834:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.751835:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e43948513 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecdb expref: 9 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.751838:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094fd9a00/0x48868a4e43948521 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1982463) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecf0 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.751841:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.751842:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129744.751843:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fd9a00/0x48868a4e43948521 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1982463) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecf0 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.751845:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094fd8c00/0x48868a4e4394851a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece9 expref: 13 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.751871:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fd8c00/0x48868a4e4394851a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece9 expref: 13 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.751881:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094fd9a00/0x48868a4e43948521 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1982463) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecf0 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.751884:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094fd8c00/0x48868a4e4394851a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece9 expref: 13 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.751889:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053235072:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129744.751890:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053235200:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129744.751920:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324480 going to sleep for 11 seconds 00010000:00010000:0.0:1746129744.752145:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66c00/0x48868a4e4394852f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecf7 expref: 7 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.752155:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66c00/0x48868a4e4394852f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecf7 expref: 7 pid: 16808 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129744.752157:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949052025088:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 78us (865us total) trans 21474840193 rc 0/0 00000100:00100000:3.0:1746129744.752165:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10459 00010000:00010000:0.0:1746129744.752169:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129744.752172:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129744.752174:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fb66c00, rc 0) 00010000:00010000:2.0:1746129744.752210:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e43948513 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecdb expref: 9 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129744.752218:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ada680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053235328:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129744.752234:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6a600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129744.752248:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5038 00000100:00100000:2.0:1746129744.752253:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+12:1963:x1830949052026112:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129744.752260:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.752270:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136920800/0x48868a4e439484b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec87 expref: 12 pid: 8435 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.752279:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136920800/0x48868a4e439484b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec87 expref: 12 pid: 8435 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.752290:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136920800/0x48868a4e439484b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec87 expref: 12 pid: 8435 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.752297:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.752415:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.752420:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fb66400/0x48868a4e43948528 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece2 expref: 7 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.752426:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fb66400/0x48868a4e43948528 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece2 expref: 7 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.752442:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fb66400/0x48868a4e43948528 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece2 expref: 7 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129744.752449:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ada300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053235456:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129744.752468:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.752720:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+7:28399:x1830949052025728:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1108us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.752728:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9778 00000100:00100000:1.0:1746129744.754161:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053235072:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129744.754176:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129744.754196:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949052025856:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2403us (2786us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129744.754203:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5037 00000100:00100000:0.0:1746129744.756341:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.756380:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ada300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053235456:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129744.756400:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129744.756445:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949052026112:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4190us (4980us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.756455:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5038 00000100:00100000:2.0:1746129744.757065:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053235200:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129744.757072:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ada680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053235328:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129744.757087:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129744.757115:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052026368 00000100:00100000:1.0:1746129744.757121:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052026368 00002000:00100000:1.0:1746129744.757153:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1056768->1060863) req@ffff88009f6dbb80 x1830949052026368/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746129744.757160:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052025984:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5397us (5772us total) trans 0 rc 0/0 00002000:00100000:1.0:1746129744.757162:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6dbb80 with x1830949052026368 ext(1056768->1060863) 00000100:00100000:3.0:1746129744.757165:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5036 00002000:00010000:1.0:1746129744.757166:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6dbb80 00000100:00100000:1.0:1746129744.757177:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3855 00000100:00100000:1.0:1746129744.757182:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1964:x1830949052026368:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129744.757296:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1964:x1830949052026368:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 113us (960us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129744.757301:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3855 00002000:00100000:1.0:1746129744.757306:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1056768->1060863) req@ffff88009f6dbb80 x1830949052026368/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/4536 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129744.757313:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6dbb80 with x1830949052026368 ext(1056768->1060863) 00002000:00010000:1.0:1746129744.757315:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6dbb80 00000100:00100000:0.0:1746129744.757659:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.757686:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.757697:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052026624 00000100:00100000:0.0:1746129744.757700:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052026624 00002000:00100000:0.0:1746129744.757717:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f6d8000 x1830949052026624/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129744.757724:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6d8000 with x1830949052026624 ext(2097152->3145727) 00002000:00010000:0.0:1746129744.757727:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6d8000 00000100:00100000:0.0:1746129744.757735:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052026880 00000100:00100000:0.0:1746129744.757736:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052026880 00002000:00100000:0.0:1746129744.757743:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800a645d180 x1830949052026880/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129744.757749:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645d180 with x1830949052026880 ext(2097152->3145727) 00002000:00010000:0.0:1746129744.757752:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645d180 00000100:00100000:0.0:1746129744.757758:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3856 00000100:00100000:0.0:1746129744.757762:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1962:x1830949052026624:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129744.759154:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3857 00000100:00100000:1.0:1746129744.759162:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949052026880:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129744.761651:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.762794:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.762869:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052027264 00000100:00100000:1.0:1746129744.762876:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052027264 00002000:00100000:1.0:1746129744.762910:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e8:0x0] (544768->548863) req@ffff88009fbee300 x1830949052027264/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129744.762919:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbee300 with x1830949052027264 ext(544768->548863) 00002000:00010000:1.0:1746129744.762924:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbee300 00000100:00100000:1.0:1746129744.762939:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3858 00000100:00100000:1.0:1746129744.762946:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1961:x1830949052027264:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129744.763076:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1961:x1830949052027264:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 130us (284us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129744.763082:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3858 00002000:00100000:1.0:1746129744.763087:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e8:0x0] (544768->548863) req@ffff88009fbee300 x1830949052027264/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/4536 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129744.763094:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbee300 with x1830949052027264 ext(544768->548863) 00002000:00010000:1.0:1746129744.763097:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbee300 00000100:00100000:3.0:1746129744.763195:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052027008 00000100:00100000:3.0:1746129744.763199:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052027008 00000100:00100000:3.0:1746129744.763220:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10462 00000100:00100000:3.0:1746129744.763224:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:28399:x1830949052027008:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129744.763232:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.763246:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acd83000/0x48868a4e43948536 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ecfe expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.763268:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fb66400/0x48868a4e43948528 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece2 expref: 7 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.763275:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129744.763277:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129744.763281:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd83000/0x48868a4e43948536 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecfe expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.763302:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fb66400/0x48868a4e43948528 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece2 expref: 7 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.763313:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fb66400/0x48868a4e43948528 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece2 expref: 7 pid: 1140 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746129744.763322:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053235584:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129744.763379:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.767180:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.767762:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052027520 00000100:00100000:2.0:1746129744.767769:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052027520 00002000:00100000:2.0:1746129744.767805:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1978368->1982463) req@ffff88009fbed880 x1830949052027520/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129744.767813:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbed880 with x1830949052027520 ext(1978368->1982463) 00002000:00010000:2.0:1746129744.767818:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbed880 00000100:00100000:3.0:1746129744.769127:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053235584:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129744.769169:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acd83000/0x48868a4e43948536 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecfe expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.769182:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd83000, rc 0) 00000100:00100000:3.0:1746129744.769220:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+12:28399:x1830949052027008:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5995us (7575us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.769228:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10462 00000100:00100000:2.0:1746129744.769433:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3859 00000100:00100000:2.0:1746129744.769441:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1962:x1830949052027520:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129744.770267:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1962:x1830949052027520:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 824us (3093us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129744.770274:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3859 00002000:00100000:2.0:1746129744.770282:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1978368->1982463) req@ffff88009fbed880 x1830949052027520/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/4536 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129744.770290:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbed880 with x1830949052027520 ext(1978368->1982463) 00002000:00010000:2.0:1746129744.770294:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbed880 00000100:00100000:1.0:1746129744.771011:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1962:x1830949052026624:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 13245us (13351us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129744.771018:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3856 00002000:00100000:1.0:1746129744.771023:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f6d8000 x1830949052026624/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129744.771030:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6d8000 with x1830949052026624 ext(2097152->3145727) 00002000:00010000:1.0:1746129744.771033:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6d8000 00000100:00100000:1.0:1746129744.774299:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949052026880:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 15131us (16604us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129744.774309:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3857 00002000:00100000:1.0:1746129744.774318:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800a645d180 x1830949052026880/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129744.774326:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645d180 with x1830949052026880 ext(2097152->3145727) 00002000:00010000:1.0:1746129744.774331:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645d180 00000100:00100000:0.0:1746129744.776510:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.776561:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.776641:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052027648 00000100:00100000:3.0:1746129744.776649:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052027648 00000100:00100000:3.0:1746129744.776681:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10463 00000100:00100000:3.0:1746129744.776688:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:28404:x1830949052027648:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129744.776703:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.776717:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8a00/0x48868a4e4394853d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ed05 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.776744:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363cfe00/0x48868a4e439484fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecc6 expref: 11 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.776751:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129744.776753:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129744.776756:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8a00/0x48868a4e4394853d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed05 expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.776781:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801363cfe00/0x48868a4e439484fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecc6 expref: 11 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.776790:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801363cfe00/0x48868a4e439484fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecc6 expref: 11 pid: 4589 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746129744.776800:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053235712:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129744.776888:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129744.777288:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052027904 00000100:00100000:2.0:1746129744.777292:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052027904 00000100:00100000:2.0:1746129744.777323:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3816 00000100:00100000:2.0:1746129744.777328:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28409:x1830949052027904:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129744.777570:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28409:x1830949052027904:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 240us (1007us total) trans 8589943541 rc 0/0 00000100:00100000:2.0:1746129744.777576:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3816 00000100:00100000:0.0:1746129744.779461:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.779513:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052028160 00000100:00100000:2.0:1746129744.779519:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052028160 00000100:00100000:2.0:1746129744.779555:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10464 00000100:00100000:2.0:1746129744.779560:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28411:x1830949052028160:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129744.779573:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129744.779574:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129744.779586:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e43948544 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ed0c expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.779605:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fb67a00/0x48868a4e439484cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec9c expref: 9 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.779612:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129744.779613:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129744.779616:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e43948544 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->1568767] (req 1048576->1568767) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed0c expref: 11 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.779638:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fb67a00/0x48868a4e439484cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec9c expref: 9 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.779647:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fb67a00/0x48868a4e439484cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec9c expref: 9 pid: 4589 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.779657:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ada680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053235840:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129744.779659:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053235712:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129744.779698:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8a00/0x48868a4e4394853d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed05 expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129744.779705:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6a3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746129744.779708:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d7f8a00, rc 0) 00000100:00100000:3.0:1746129744.779725:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:28404:x1830949052027648:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3037us (3221us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129744.780003:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052028288 00000100:00100000:1.0:1746129744.780007:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052028288 00002000:00100000:1.0:1746129744.780028:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (544768->1048575) req@ffff88009fbed500 x1830949052028288/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129744.780035:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbed500 with x1830949052028288 ext(544768->1048575) 00010000:00010000:1.0:1746129744.780040:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fb66400/0x48868a4e43948528 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece2 expref: 8 pid: 1140 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746129744.780048:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fb66400/0x48868a4e43948528 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece2 expref: 8 pid: 1140 timeout: 790 lvb_type: 0 00002000:00010000:1.0:1746129744.780054:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbed500 00000100:00100000:1.0:1746129744.780065:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 533 00000100:00100000:1.0:1746129744.780069:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1962:x1830949052028288:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:3.0:1746129744.780129:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10463 00000100:00100000:0.0:1746129744.781977:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.782227:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052028416 00000100:00100000:2.0:1746129744.782232:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052028416 00010000:00010000:2.0:1746129744.782254:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801363cfe00/0x48868a4e439484fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecc6 expref: 12 pid: 4589 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.782283:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5039 00000100:00100000:2.0:1746129744.782289:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949052028416:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129744.782296:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129744.782298:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.782313:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801363cfe00/0x48868a4e439484fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecc6 expref: 12 pid: 4589 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.782323:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801363cfe00/0x48868a4e439484fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecc6 expref: 12 pid: 4589 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.782341:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363cfe00/0x48868a4e439484fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecc6 expref: 12 pid: 4589 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746129744.782344:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052028544 00000100:00100000:3.0:1746129744.782347:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052028544 00010000:00010000:2.0:1746129744.782351:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.782353:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.782358:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8a00/0x48868a4e4394853d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed05 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129744.782363:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10465 00010000:00010000:2.0:1746129744.782365:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8a00/0x48868a4e4394853d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed05 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129744.782367:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28407:x1830949052028544:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129744.782378:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.782385:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9800/0x48868a4e4394854b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ed13 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.782390:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8a00/0x48868a4e4394853d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed05 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.782394:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.782396:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.782399:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9800/0x48868a4e4394854b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed13 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.782407:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9800/0x48868a4e4394854b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed13 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129744.782409:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053235968:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129744.782413:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d7f9800, rc 0) 00000100:00100000:3.0:1746129744.782449:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28407:x1830949052028544:12345-192.168.204.31@tcp:101:cat.0 Request processed in 81us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.782454:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10465 00000100:00100000:2.0:1746129744.783712:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6a600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129744.783744:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ada680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053235840:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.783763:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e43948544 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->1568767] (req 1048576->1568767) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed0c expref: 11 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.783775:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8e9a00, rc 0) 00000100:00100000:2.0:1746129744.783809:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28411:x1830949052028160:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4248us (4354us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.783815:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10464 00000100:00100000:1.0:1746129744.784044:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.786688:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053235968:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129744.786708:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129744.786748:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052028416:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4458us (4776us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.786757:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5039 00000100:00100000:3.0:1746129744.786770:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052028672 00000100:00100000:3.0:1746129744.786776:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052028672 00010000:00010000:3.0:1746129744.786796:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb67a00/0x48868a4e439484cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec9c expref: 10 pid: 4589 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746129744.786821:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5040 00000100:00100000:3.0:1746129744.786827:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949052028672:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129744.786837:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129744.786881:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fb67a00/0x48868a4e439484cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec9c expref: 10 pid: 4589 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746129744.786890:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fb67a00/0x48868a4e439484cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec9c expref: 10 pid: 4589 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746129744.786906:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fb67a00/0x48868a4e439484cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ec9c expref: 10 pid: 4589 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746129744.786930:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.786932:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.786937:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e43948544 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed0c expref: 10 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.786945:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e43948544 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed0c expref: 10 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.786973:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e43948544 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed0c expref: 10 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129744.786982:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053236096:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129744.787037:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129744.792587:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.792994:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.793012:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052028928 00000100:00100000:2.0:1746129744.793018:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052028928 00000100:00100000:3.0:1746129744.793582:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053236096:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129744.793655:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129744.793709:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949052028672:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6881us (9664us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.793727:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5040 00002000:00100000:2.0:1746129744.795452:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880092ad9c00 x1830949052028928/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129744.795463:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad9c00 with x1830949052028928 ext(3145728->4194303) 00002000:00010000:2.0:1746129744.795468:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ad9c00 00000100:00100000:2.0:1746129744.795499:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3860 00000100:00100000:2.0:1746129744.795508:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949052028928:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129744.797314:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052029184 00000100:00100000:3.0:1746129744.797323:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052029184 00002000:00100000:3.0:1746129744.797352:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880092ada680 x1830949052029184/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129744.797361:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ada680 with x1830949052029184 ext(3145728->4194303) 00002000:00010000:3.0:1746129744.797365:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ada680 00000100:00100000:3.0:1746129744.797381:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3861 00000100:00100000:3.0:1746129744.797387:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949052029184:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129744.799058:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949052028288:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 18982us (19477us total) trans 17179873031 rc 0/0 00000100:00100000:1.0:1746129744.799068:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 533 00002000:00100000:1.0:1746129744.799075:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (544768->1048575) req@ffff88009fbed500 x1830949052028288/t17179873031(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/448 e 0 to 0 dl 1746129755 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129744.799083:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbed500 with x1830949052028288 ext(544768->1048575) 00010000:00010000:1.0:1746129744.799090:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fb66400/0x48868a4e43948528 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece2 expref: 13 pid: 1140 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746129744.799107:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fb66400/0x48868a4e43948528 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece2 expref: 13 pid: 1140 timeout: 790 lvb_type: 0 00002000:00010000:1.0:1746129744.799113:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbed500 00000100:00100000:0.0:1746129744.803225:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.803252:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.803286:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.803497:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052029568 00000100:00100000:1.0:1746129744.803505:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052029568 00002000:00100000:1.0:1746129744.803548:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88008fad2d80 x1830949052029568/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129744.803556:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad2d80 with x1830949052029568 ext(3145728->4194303) 00002000:00010000:1.0:1746129744.803561:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fad2d80 00000100:00100000:1.0:1746129744.803587:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052029696 00000100:00100000:1.0:1746129744.803589:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052029696 00002000:00100000:1.0:1746129744.803601:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88008fad3b80 x1830949052029696/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129744.803607:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad3b80 with x1830949052029696 ext(3145728->4194303) 00002000:00010000:1.0:1746129744.803611:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fad3b80 00000100:00100000:1.0:1746129744.803618:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052029952 00000100:00100000:1.0:1746129744.803619:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052029952 00002000:00100000:1.0:1746129744.803627:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1564672->1568767) req@ffff88008fad0700 x1830949052029952/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129744.803632:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad0700 with x1830949052029952 ext(1564672->1568767) 00002000:00010000:1.0:1746129744.803635:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fad0700 00000100:00100000:1.0:1746129744.803643:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3862 00000100:00100000:1.0:1746129744.803649:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949052029568:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129744.804442:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3863 00000100:00100000:3.0:1746129744.804451:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949052029696:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129744.804643:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3864 00000100:00100000:1.0:1746129744.804649:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1963:x1830949052029952:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129744.804720:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1963:x1830949052029952:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 70us (1432us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129744.804725:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3864 00002000:00100000:1.0:1746129744.804731:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1564672->1568767) req@ffff88008fad0700 x1830949052029952/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/4536 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129744.804736:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad0700 with x1830949052029952 ext(1564672->1568767) 00002000:00010000:1.0:1746129744.804740:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fad0700 00000100:00100000:0.0:1746129744.806612:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.806695:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052030080 00000100:00100000:2.0:1746129744.806703:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052030080 00010000:00010000:2.0:1746129744.806730:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fb66400/0x48868a4e43948528 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece2 expref: 13 pid: 1140 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.806752:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5041 00000100:00100000:2.0:1746129744.806758:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1963:x1830949052030080:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129744.806768:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129744.806782:0:7109:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129744 -> 1746129745 00010000:00010000:2.0:1746129744.806787:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fb66400/0x48868a4e43948528 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 544768->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece2 expref: 13 pid: 1140 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.806797:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fb66400/0x48868a4e43948528 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 544768->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece2 expref: 13 pid: 1140 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.806814:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fb66400/0x48868a4e43948528 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 544768->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece2 expref: 13 pid: 1140 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.806835:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.806837:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.806844:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acd83000/0x48868a4e43948536 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecfe expref: 10 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.806865:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd83000/0x48868a4e43948536 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecfe expref: 10 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.806892:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800acd83000/0x48868a4e43948536 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecfe expref: 10 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129744.806902:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053236224:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129744.806949:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6a600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129744.810505:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949052028928:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 14991us (17917us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129744.810516:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3860 00002000:00100000:2.0:1746129744.810535:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880092ad9c00 x1830949052028928/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129744.810546:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad9c00 with x1830949052028928 ext(3145728->4194303) 00002000:00010000:2.0:1746129744.810551:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ad9c00 00000100:00100000:2.0:1746129744.815771:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053236224:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129744.815789:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129744.815834:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1963:x1830949052030080:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 9075us (9227us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.815844:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5041 00000100:00100000:3.0:1746129744.817495:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949052029184:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 20103us (24495us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129744.817504:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3861 00002000:00100000:3.0:1746129744.817511:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880092ada680 x1830949052029184/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129744.817520:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ada680 with x1830949052029184 ext(3145728->4194303) 00002000:00010000:3.0:1746129744.817533:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ada680 00000100:00100000:0.0:1746129744.817961:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.822669:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052030208 00000100:00100000:2.0:1746129744.822679:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052030208 00000100:00100000:1.0:1746129744.823095:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949052029568:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 19441us (19871us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129744.823104:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3862 00002000:00100000:1.0:1746129744.823112:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88008fad2d80 x1830949052029568/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129744.823120:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad2d80 with x1830949052029568 ext(3145728->4194303) 00002000:00010000:1.0:1746129744.823125:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fad2d80 00000100:00100000:0.0:1746129744.823684:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10466 00000100:00100000:0.0:1746129744.823693:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+9:28399:x1830949052030208:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129744.823706:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.823721:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43948552 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ed1a expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.823744:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e43948544 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed0c expref: 10 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.823750:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129744.823752:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129744.823755:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43948552 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed1a expref: 10 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.823783:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e43948544 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed0c expref: 10 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.823792:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e43948544 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed0c expref: 10 pid: 10930 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746129744.823801:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053236352:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129744.823881:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.828311:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.829473:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.829496:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052030336 00000100:00100000:3.0:1746129744.829503:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052030336 00000100:00100000:3.0:1746129744.829558:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10467 00000100:00100000:3.0:1746129744.829565:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949052030336:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129744.829581:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.829596:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094bae000/0x48868a4e43948559 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ed21 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129744.829643:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053236480:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129744.829718:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129744.830655:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.830784:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.830957:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052030464 00000100:00100000:2.0:1746129744.830961:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052030464 00000100:00100000:2.0:1746129744.830984:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052030592 00000100:00100000:2.0:1746129744.830986:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052030592 00000100:00100000:2.0:1746129744.830999:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10468 00000100:00100000:2.0:1746129744.831005:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052030464:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129744.831016:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129744.831026:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f96ea00/0x48868a4e43948560 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ed28 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129744.831053:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053236608:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129744.831093:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129744.831108:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052030848 00000100:00100000:2.0:1746129744.831110:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052030848 00000100:00100000:2.0:1746129744.831128:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3817 00000100:00100000:2.0:1746129744.831132:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28411:x1830949052030848:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129744.831273:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28411:x1830949052030848:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 139us (487us total) trans 8589943542 rc 0/0 00000100:00100000:2.0:1746129744.831279:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3817 00000100:00100000:0.0:1746129744.831361:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053236352:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129744.831383:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43948552 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed1a expref: 10 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.831393:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5283600, rc 0) 00000100:00100000:0.0:1746129744.831408:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+10:28399:x1830949052030208:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 7717us (13449us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.831413:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10466 00000100:00100000:0.0:1746129744.831425:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10469 00000100:00100000:0.0:1746129744.831430:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052030592:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129744.831436:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.831443:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5283000/0x48868a4e43948567 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ed2f expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.831463:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053236736:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129744.831485:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738b780 going to sleep for 11 seconds 00000100:00100000:2.0:1746129744.832132:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949052029696:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 27680us (28876us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129744.832140:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3863 00002000:00100000:2.0:1746129744.832146:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88008fad3b80 x1830949052029696/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129744.832155:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad3b80 with x1830949052029696 ext(3145728->4194303) 00002000:00010000:2.0:1746129744.832159:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fad3b80 00000100:00100000:3.0:1746129744.833490:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053236480:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129744.833562:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094bae000/0x48868a4e43948559 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed21 expref: 13 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.833572:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094bae000/0x48868a4e43948559 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed21 expref: 13 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.833589:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094bae000, rc 0) 00000100:00100000:3.0:1746129744.833625:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052030336:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4059us (5320us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129744.833631:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10467 00000100:00100000:1.0:1746129744.833834:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.834041:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052030976 00000100:00100000:3.0:1746129744.834046:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052030976 00002000:00100000:3.0:1746129744.834069:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1568767) req@ffff88009a04d180 x1830949052030976/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129744.834077:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04d180 with x1830949052030976 ext(1048576->1568767) 00010000:00010000:3.0:1746129744.834083:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e43948544 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed0c expref: 13 pid: 10930 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746129744.834092:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e43948544 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed0c expref: 13 pid: 10930 timeout: 790 lvb_type: 0 00002000:00010000:3.0:1746129744.834103:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a04d180 00000100:00100000:3.0:1746129744.834115:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 534 00000100:00100000:3.0:1746129744.834121:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949052030976:12345-192.168.204.31@tcp:4:multiop.0 00002000:00010000:2.0:1746129744.836864:0:8436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime: 1746129744 -> 1746129745 00002000:00010000:2.0:1746129744.836872:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime: 1746129744 -> 1746129745 00000100:00100000:2.0:1746129744.836891:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053236608:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129744.836916:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f96ea00/0x48868a4e43948560 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed28 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.836928:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f96ea00/0x48868a4e43948560 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed28 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.836937:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f96ea00, rc 0) 00000100:00100000:2.0:1746129744.836991:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949052030464:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5984us (7519us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129744.836999:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10468 00000100:00100000:2.0:1746129744.843392:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129744.843472:0:3623:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff8801363ce000/0x48868a4e439484f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb8 expref: 10 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.843498:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053236736:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129744.843537:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5283000/0x48868a4e43948567 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed2f expref: 11 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.843549:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5283000/0x48868a4e43948567 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed2f expref: 11 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.843562:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5283000, rc 0) 00000100:00100000:1.0:1746129744.843598:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949052030592:12345-192.168.204.31@tcp:101:cat.0 Request processed in 12167us (12944us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129744.843606:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10469 00000100:00100000:1.0:1746129744.843627:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052031104 00000100:00100000:1.0:1746129744.843632:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052031104 00000100:00100000:1.0:1746129744.843659:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10470 00000100:00100000:1.0:1746129744.843664:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949052031104:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129744.843676:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129744.843686:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e4394856e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ed36 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.843720:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053236864:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129744.843756:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3243c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.845102:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.845266:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.845406:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052031360 00000100:00100000:3.0:1746129744.845412:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052031360 00000100:00100000:3.0:1746129744.845440:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052031232 00000100:00100000:3.0:1746129744.845441:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052031232 00000100:00100000:3.0:1746129744.845454:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10471 00000100:00100000:3.0:1746129744.845459:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949052031360:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129744.845470:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.845479:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094baee00/0x48868a4e43948575 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ed44 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129744.845511:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053236992:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129744.845578:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2180 going to sleep for 11 seconds 00000100:00100000:3.0:1746129744.845593:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10472 00000100:00100000:3.0:1746129744.845598:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949052031232:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129744.845603:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.845611:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094bafa00/0x48868a4e4394857c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ed3d expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129744.845629:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053237120:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129744.845644:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129744.847248:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053236864:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129744.847280:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e4394856e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed36 expref: 23 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.847291:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e4394856e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed36 expref: 23 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.847304:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801360b3400, rc 0) 00000100:00100000:1.0:1746129744.847347:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052031104:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3681us (3960us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129744.847354:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10470 00000100:00100000:0.0:1746129744.847901:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.848074:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052031616 00000100:00100000:1.0:1746129744.848081:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052031616 00002000:00100000:1.0:1746129744.848110:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88013631b100 x1830949052031616/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129744.848117:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631b100 with x1830949052031616 ext(4194304->4964351) 00002000:00010000:1.0:1746129744.848121:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013631b100 00000100:00100000:1.0:1746129744.848144:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3865 00000100:00100000:1.0:1746129744.848151:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949052031616:12345-192.168.204.31@tcp:3:cat.0 00010000:00010000:3.0:1746129744.849605:0:8436:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff8801363ce000/0x48868a4e439484f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb8 expref: 10 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129744.849629:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053236992:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129744.849669:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094baee00/0x48868a4e43948575 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed44 expref: 21 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.849679:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094baee00/0x48868a4e43948575 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed44 expref: 21 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129744.849702:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094baee00, rc 0) 00000100:00100000:3.0:1746129744.849734:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949052031360:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4273us (4636us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129744.849741:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10471 00000100:00100000:2.0:1746129744.852154:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949052030976:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 18025us (18311us total) trans 21474840194 rc 0/0 00000100:00100000:2.0:1746129744.852163:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 534 00002000:00100000:2.0:1746129744.852171:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1568767) req@ffff88009a04d180 x1830949052030976/t21474840194(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/448 e 0 to 0 dl 1746129755 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129744.852180:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04d180 with x1830949052030976 ext(1048576->1568767) 00010000:00010000:2.0:1746129744.852188:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e43948544 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed0c expref: 13 pid: 10930 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.852199:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e43948544 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed0c expref: 13 pid: 10930 timeout: 790 lvb_type: 0 00002000:00010000:2.0:1746129744.852205:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a04d180 00002000:00010000:2.0:1746129744.852727:0:20441:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime: 1746129744 -> 1746129745 00002000:00010000:2.0:1746129744.852730:0:20441:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime: 1746129744 -> 1746129745 00000100:00100000:2.0:1746129744.852741:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053237120:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129744.852773:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094bafa00/0x48868a4e4394857c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed3d expref: 15 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.852784:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094bafa00/0x48868a4e4394857c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed3d expref: 15 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.852793:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094bafa00, rc 0) 00000100:00100000:2.0:1746129744.852830:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949052031232:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7231us (7564us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129744.852836:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10472 00000100:00100000:0.0:1746129744.857987:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.859953:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949052031616:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11796us (12047us total) trans 0 rc 770048/770048 00000100:00100000:1.0:1746129744.859963:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3865 00002000:00100000:1.0:1746129744.859972:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88013631b100 x1830949052031616/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129744.859980:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631b100 with x1830949052031616 ext(4194304->4964351) 00002000:00010000:1.0:1746129744.859984:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013631b100 00000100:00100000:2.0:1746129744.861106:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052031744 00000100:00100000:2.0:1746129744.861115:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052031744 00010000:00010000:2.0:1746129744.861143:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e43948544 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed0c expref: 13 pid: 10930 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.861182:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5042 00000100:00100000:2.0:1746129744.861189:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949052031744:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129744.861202:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.861218:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e43948544 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed0c expref: 13 pid: 10930 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.861228:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e43948544 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed0c expref: 13 pid: 10930 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.861247:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e43948544 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed0c expref: 13 pid: 10930 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.861258:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.861260:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.861265:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43948552 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed1a expref: 9 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.861271:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43948552 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed1a expref: 9 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.861297:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43948552 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed1a expref: 9 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129744.861310:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053237248:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129744.861387:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.861682:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.861726:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052032000 00000100:00100000:2.0:1746129744.861731:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052032000 00002000:00100000:2.0:1746129744.861753:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88013631ad80 x1830949052032000/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129744.861761:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631ad80 with x1830949052032000 ext(4194304->4964351) 00002000:00010000:2.0:1746129744.861764:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013631ad80 00000100:00100000:2.0:1746129744.861786:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3866 00000100:00100000:2.0:1746129744.861791:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949052032000:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129744.867905:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053237248:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129744.867929:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129744.867982:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052031744:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6791us (10000us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.867991:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5042 00000100:00100000:0.0:1746129744.869299:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.870216:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052032640 00000100:00100000:2.0:1746129744.870224:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052032640 00000100:00100000:2.0:1746129744.870265:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10473 00000100:00100000:2.0:1746129744.870272:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+10:28399:x1830949052032640:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129744.870286:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129744.870302:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4f5c600/0x48868a4e43948583 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ed67 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.870330:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094fd9a00/0x48868a4e43948521 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1982463) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecf0 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.870337:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129744.870338:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129744.870341:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f5c600/0x48868a4e43948583 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed67 expref: 11 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.870364:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094fd9a00/0x48868a4e43948521 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1982463) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecf0 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.870374:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094fd9a00/0x48868a4e43948521 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1982463) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecf0 expref: 13 pid: 8437 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.870384:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053237376:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129744.870447:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.872121:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.872149:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.872161:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.872176:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052032128 00000100:00100000:0.0:1746129744.872180:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052032128 00000100:00100000:0.0:1746129744.872209:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052032384 00000100:00100000:0.0:1746129744.872211:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052032384 00000100:00100000:0.0:1746129744.872220:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052032256 00000100:00100000:0.0:1746129744.872221:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052032256 00000100:00100000:0.0:1746129744.872232:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10474 00000100:00100000:0.0:1746129744.872239:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052032128:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129744.872249:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.872260:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5283000/0x48868a4e4394858a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ed4b expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.872299:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053237504:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129744.872344:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738b480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.872360:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10475 00000100:00100000:0.0:1746129744.872366:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949052032384:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129744.872372:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.872381:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5283a00/0x48868a4e43948591 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ed59 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.872402:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053237632:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129744.872420:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.872449:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.872689:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052032512 00000100:00100000:1.0:1746129744.872693:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052032512 00000100:00100000:1.0:1746129744.872721:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10476 00000100:00100000:1.0:1746129744.872727:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949052032256:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129744.872736:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129744.872743:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bd9c000/0x48868a4e43948598 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ed52 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.872765:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053237760:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129744.872789:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3243c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129744.872803:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10477 00000100:00100000:1.0:1746129744.872809:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949052032512:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129744.872815:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129744.872821:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bd9cc00/0x48868a4e4394859f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ed60 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.872840:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053237888:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129744.872888:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3240c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129744.873329:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949052032000:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11536us (11647us total) trans 0 rc 770048/770048 00000100:00100000:3.0:1746129744.873344:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3866 00002000:00100000:3.0:1746129744.873351:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88013631ad80 x1830949052032000/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/440 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129744.873359:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631ad80 with x1830949052032000 ext(4194304->4964351) 00002000:00010000:3.0:1746129744.873363:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013631ad80 00000100:00100000:2.0:1746129744.876398:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.876565:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053237632:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129744.876597:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5283a00/0x48868a4e43948591 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed59 expref: 15 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.876615:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5283a00/0x48868a4e43948591 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed59 expref: 15 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.876626:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5283a00, rc 0) 00000100:00100000:0.0:1746129744.876654:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949052032384:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4289us (4504us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129744.876661:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10475 00000100:00100000:0.0:1746129744.876686:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053237376:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129744.876697:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f5c600/0x48868a4e43948583 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed67 expref: 11 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.876706:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f5c600, rc 0) 00000100:00100000:0.0:1746129744.876718:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+11:28399:x1830949052032640:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 6447us (7422us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129744.876722:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10473 00000100:00100000:3.0:1746129744.876785:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052032768 00000100:00100000:3.0:1746129744.876790:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052032768 00002000:00100000:3.0:1746129744.876816:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1056768->1982463) req@ffff880092adbb80 x1830949052032768/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129744.876824:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092adbb80 with x1830949052032768 ext(1056768->1982463) 00010000:00010000:3.0:1746129744.876830:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094fd9a00/0x48868a4e43948521 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecf0 expref: 14 pid: 8437 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746129744.876839:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094fd9a00/0x48868a4e43948521 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecf0 expref: 14 pid: 8437 timeout: 790 lvb_type: 0 00002000:00010000:3.0:1746129744.876844:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092adbb80 00000100:00100000:3.0:1746129744.876881:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 535 00000100:00100000:3.0:1746129744.876887:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949052032768:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129744.877613:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053237760:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129744.877633:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bd9c000/0x48868a4e43948598 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed52 expref: 13 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.877640:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bd9c000/0x48868a4e43948598 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed52 expref: 13 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.877656:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bd9c000, rc 0) 00000100:00100000:1.0:1746129744.877673:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949052032256:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4946us (5509us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129744.877678:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10476 00010000:00010000:1.0:1746129744.877702:0:7975:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff8801363ce000/0x48868a4e439484f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb8 expref: 10 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.877716:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053237888:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129744.877728:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bd9cc00/0x48868a4e4394859f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed60 expref: 13 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.877736:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bd9cc00/0x48868a4e4394859f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed60 expref: 13 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.877743:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bd9cc00, rc 0) 00000100:00100000:1.0:1746129744.877757:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949052032512:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4948us (5307us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129744.877761:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10477 00000100:00100000:1.0:1746129744.877788:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053237504:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129744.877801:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5283000/0x48868a4e4394858a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed4b expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.877808:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5283000/0x48868a4e4394858a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed4b expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.877814:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5283000, rc 0) 00000100:00100000:1.0:1746129744.877827:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052032128:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5590us (5711us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129744.877832:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10474 00000100:00100000:0.0:1746129744.883036:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.883067:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.883096:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.883218:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052032896 00000100:00100000:2.0:1746129744.883225:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052032896 00000100:00100000:2.0:1746129744.883256:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052033024 00000100:00100000:2.0:1746129744.883258:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052033024 00000100:00100000:2.0:1746129744.883268:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052033152 00000100:00100000:2.0:1746129744.883270:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052033152 00000100:00100000:2.0:1746129744.883293:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10478 00000100:00100000:2.0:1746129744.883300:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052032896:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129744.883314:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129744.883329:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a51c5800/0x48868a4e439485a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ed6e expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129744.883370:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053238016:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129744.883429:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129744.883653:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10479 00000100:00100000:1.0:1746129744.883660:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949052033024:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129744.883667:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129744.883681:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801360b3e00/0x48868a4e439485ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ed75 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.883705:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053238144:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129744.883728:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3240c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129744.883743:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10480 00000100:00100000:1.0:1746129744.883749:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949052033152:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129744.883755:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129744.883761:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801360b2e00/0x48868a4e439485b4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ed7c expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.883781:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053238272:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129744.883797:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3243c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.884532:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.884548:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052033280 00000100:00100000:0.0:1746129744.884551:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052033280 00000100:00100000:0.0:1746129744.884569:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10481 00000100:00100000:0.0:1746129744.884573:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1964:x1830949052033280:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129744.884580:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.884589:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009adbb600/0x48868a4e439485bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ed83 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.884610:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053238400:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129744.884646:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.885403:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.886226:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.886248:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052033408 00000100:00100000:3.0:1746129744.886253:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052033408 00000100:00100000:1.0:1746129744.886475:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10482 00000100:00100000:1.0:1746129744.886483:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949052033408:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129744.886496:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129744.886510:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013683ec00/0x48868a4e439485c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ed8a expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.886556:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053238528:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129744.887049:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.888597:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.888623:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.888818:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052033664 00000100:00100000:3.0:1746129744.888825:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052033664 00000100:00100000:3.0:1746129744.888866:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052033536 00000100:00100000:3.0:1746129744.888868:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052033536 00000100:00100000:3.0:1746129744.889535:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052033792 00000100:00100000:3.0:1746129744.889539:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052033792 00000100:00100000:1.0:1746129744.889661:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10483 00000100:00100000:2.0:1746129744.889668:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10484 00000100:00100000:1.0:1746129744.889671:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949052033664:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129744.889686:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129744.889698:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a14a00/0x48868a4e439485c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ed98 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129744.889712:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053238016:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129744.889733:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a51c5800/0x48868a4e439485a6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed6e expref: 13 pid: 7975 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129744.889737:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053238656:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129744.889744:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a51c5800/0x48868a4e439485a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed6e expref: 13 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.889756:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a51c5800, rc 0) 00000100:00100000:2.0:1746129744.889786:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949052032896:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6486us (6756us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129744.889791:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10478 00000100:00100000:1.0:1746129744.889794:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129744.889808:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10485 00000100:00100000:2.0:1746129744.889813:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949052033792:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129744.889820:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129744.889827:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a51c4a00/0x48868a4e439485d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ed9f expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.889833:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053238272:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129744.889862:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053238784:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129744.889869:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801360b2e00/0x48868a4e439485b4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed7c expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.889879:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801360b2e00/0x48868a4e439485b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed7c expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129744.889880:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6acc0 going to sleep for 11 seconds 00010000:00010000:1.0:1746129744.889893:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801360b2e00, rc 0) 00000100:00100000:2.0:1746129744.889901:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949052033536:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129744.889908:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129744.889913:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a51c5600/0x48868a4e439485d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ed91 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.889913:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949052033152:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6164us (6815us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129744.889918:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10480 00000100:00100000:2.0:1746129744.889931:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053238912:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129744.889947:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129744.889950:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053238144:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129744.889962:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801360b3e00/0x48868a4e439485ad lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed75 expref: 13 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.889969:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801360b3e00/0x48868a4e439485ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed75 expref: 13 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.889976:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801360b3e00, rc 0) 00000100:00100000:1.0:1746129744.889992:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949052033024:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6333us (6924us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129744.889996:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10479 00010000:00010000:0.0:1746129744.890754:0:20441:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff8801363ce000/0x48868a4e439484f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb8 expref: 10 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.890770:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053238400:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129744.890788:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009adbb600/0x48868a4e439485bb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed83 expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.890797:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009adbb600/0x48868a4e439485bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed83 expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.890815:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009adbb600, rc 0) 00000100:00100000:0.0:1746129744.890832:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949052033280:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6259us (6310us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129744.890837:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10481 00000100:00100000:1.0:1746129744.895270:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053238528:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129744.895302:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013683ec00/0x48868a4e439485c2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed8a expref: 23 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.895314:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013683ec00/0x48868a4e439485c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed8a expref: 23 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.895326:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683ec00, rc 0) 00000100:00100000:1.0:1746129744.896518:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949052033408:12345-192.168.204.31@tcp:101:cat.0 Request processed in 10029us (11110us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129744.896535:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10482 00000100:00100000:1.0:1746129744.899110:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053238656:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129744.899138:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a14a00/0x48868a4e439485c9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed98 expref: 19 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.899151:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a14a00/0x48868a4e439485c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed98 expref: 19 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.899162:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a14a00, rc 0) 00000100:00100000:1.0:1746129744.899198:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949052033664:12345-192.168.204.31@tcp:101:cat.0 Request processed in 9529us (12973us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129744.899205:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10483 00010000:00010000:2.0:1746129744.899408:0:7975:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff8801363ce000/0x48868a4e439484f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb8 expref: 10 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129744.899424:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053238784:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129744.899438:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a51c4a00/0x48868a4e439485d0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed9f expref: 21 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.899445:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a51c4a00/0x48868a4e439485d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed9f expref: 21 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.899455:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a51c4a00, rc 0) 00000100:00100000:2.0:1746129744.899472:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949052033792:12345-192.168.204.31@tcp:101:cat.0 Request processed in 9659us (10848us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129744.899476:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10485 00000100:00100000:2.0:1746129744.899512:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053238912:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129744.899537:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a51c5600/0x48868a4e439485d7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed91 expref: 17 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.899545:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a51c5600/0x48868a4e439485d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed91 expref: 17 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.899551:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a51c5600, rc 0) 00000100:00100000:2.0:1746129744.899569:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1961:x1830949052033536:12345-192.168.204.31@tcp:101:cat.0 Request processed in 9895us (10978us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129744.899573:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10484 00000100:00100000:0.0:1746129744.907012:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.907048:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.907061:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.907094:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.907123:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052033920 00000100:00100000:0.0:1746129744.907130:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052033920 00000100:00100000:0.0:1746129744.907159:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052034176 00000100:00100000:0.0:1746129744.907161:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052034176 00000100:00100000:0.0:1746129744.907170:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052034048 00000100:00100000:0.0:1746129744.907171:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052034048 00000100:00100000:0.0:1746129744.907180:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052034304 00000100:00100000:0.0:1746129744.907181:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052034304 00000100:00100000:0.0:1746129744.907192:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10486 00000100:00100000:0.0:1746129744.907198:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052033920:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129744.907212:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.907225:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e439485de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eda6 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.907265:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053239040:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129744.907321:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.907338:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10487 00000100:00100000:0.0:1746129744.907343:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949052034176:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129744.907350:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.907358:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e439485e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34edb4 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.907379:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053239168:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129744.907397:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.907415:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10488 00000100:00100000:0.0:1746129744.907419:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949052034048:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129744.907425:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.907431:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801360b3e00/0x48868a4e439485ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34edad expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.907451:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053239296:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129744.907467:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.907482:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10489 00000100:00100000:0.0:1746129744.907486:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949052034304:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129744.907491:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.907497:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801360b3800/0x48868a4e439485f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34edbb expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129744.907514:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053239424:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129744.907540:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738b480 going to sleep for 11 seconds 00000100:00100000:3.0:1746129744.911150:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949052032768:12345-192.168.204.31@tcp:4:cat.0 Request processed in 34253us (34748us total) trans 21474840195 rc 0/0 00000100:00100000:3.0:1746129744.911162:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 535 00002000:00100000:3.0:1746129744.911173:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e7:0x0] (1056768->1982463) req@ffff880092adbb80 x1830949052032768/t21474840195(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/448 e 0 to 0 dl 1746129755 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129744.911181:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092adbb80 with x1830949052032768 ext(1056768->1982463) 00010000:00010000:3.0:1746129744.911190:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094fd9a00/0x48868a4e43948521 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1056768->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecf0 expref: 20 pid: 8437 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746129744.911203:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094fd9a00/0x48868a4e43948521 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1056768->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecf0 expref: 20 pid: 8437 timeout: 790 lvb_type: 0 00002000:00010000:3.0:1746129744.911210:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092adbb80 00000100:00100000:2.0:1746129744.913603:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053239040:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129744.913637:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e439485de lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eda6 expref: 23 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.913649:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e439485de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eda6 expref: 23 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129744.913659:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5283400, rc 0) 00000100:00100000:2.0:1746129744.913708:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949052033920:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6508us (6701us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129744.913715:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10486 00000100:00100000:1.0:1746129744.914801:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053239168:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129744.914824:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e439485e5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edb4 expref: 19 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.914833:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e439485e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edb4 expref: 19 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.914844:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5283e00, rc 0) 00000100:00100000:1.0:1746129744.914885:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949052034176:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7541us (7836us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129744.914892:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10487 00010000:00010000:1.0:1746129744.915586:0:8437:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff8801363ce000/0x48868a4e439484f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb8 expref: 10 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.915604:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053239424:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129744.915618:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801360b3800/0x48868a4e439485f3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edbb expref: 21 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.915627:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801360b3800/0x48868a4e439485f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edbb expref: 21 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129744.915634:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801360b3800, rc 0) 00000100:00100000:0.0:1746129744.915710:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053239296:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129744.915723:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801360b3e00/0x48868a4e439485ec lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edad expref: 17 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.915731:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801360b3e00/0x48868a4e439485ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edad expref: 17 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129744.915750:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801360b3e00, rc 0) 00000100:00100000:1.0:1746129744.915794:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949052034304:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8306us (8698us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129744.915799:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10489 00000100:00100000:0.0:1746129744.915838:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1961:x1830949052034048:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8417us (8775us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129744.915843:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10488 00000100:00100000:1.0:1746129744.916404:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.916566:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052034432 00000100:00100000:3.0:1746129744.916571:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052034432 00010000:00010000:3.0:1746129744.916591:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094fd9a00/0x48868a4e43948521 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecf0 expref: 16 pid: 8437 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746129744.916608:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5043 00000100:00100000:3.0:1746129744.916613:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1962:x1830949052034432:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129744.916624:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129744.916633:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094fd9a00/0x48868a4e43948521 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1056768->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecf0 expref: 16 pid: 8437 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746129744.916642:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094fd9a00/0x48868a4e43948521 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1056768->1982463) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecf0 expref: 16 pid: 8437 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746129744.916657:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094fd9a00/0x48868a4e43948521 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1056768->1982463) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecf0 expref: 16 pid: 8437 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746129744.916679:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.916681:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.916686:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f5c600/0x48868a4e43948583 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed67 expref: 10 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.916692:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f5c600/0x48868a4e43948583 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed67 expref: 10 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.916721:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4f5c600/0x48868a4e43948583 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed67 expref: 10 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129744.916731:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053239552:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129744.917231:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.918742:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.919086:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053239552:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129744.919120:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129744.919161:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949052034432:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2547us (2757us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.919168:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5043 00000100:00100000:1.0:1746129744.919321:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052034560 00000100:00100000:1.0:1746129744.919327:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052034560 00000100:00100000:1.0:1746129744.919354:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10490 00000100:00100000:1.0:1746129744.919359:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:28399:x1830949052034560:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129744.919373:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129744.919385:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a15800/0x48868a4e439485fa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34edc2 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.919406:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8a00/0x48868a4e4394853d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed05 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.919413:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9800/0x48868a4e4394854b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed13 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.919419:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129744.919420:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129744.919424:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a15800/0x48868a4e439485fa lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edc2 expref: 12 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.919446:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9800/0x48868a4e4394854b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed13 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.919456:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9800/0x48868a4e4394854b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed13 expref: 9 pid: 8436 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746129744.919465:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053239680:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129744.919531:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8a00/0x48868a4e4394853d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed05 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.919542:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8a00/0x48868a4e4394853d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed05 expref: 19 pid: 8436 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746129744.919549:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053239808:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129744.919566:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129744.920200:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.920247:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052034816 00000100:00100000:0.0:1746129744.920251:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052034816 00000100:00100000:0.0:1746129744.920320:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9779 00000100:00100000:0.0:1746129744.920325:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28417:x1830949052034816:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129744.920337:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129744.920347:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2a00/0x48868a4e43948601 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34edc9 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.920423:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3600/0x48868a4e43948608 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920431:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3600/0x48868a4e43948608 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920439:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3600/0x48868a4e43948608 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920448:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2400/0x48868a4e4394860f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920452:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2400/0x48868a4e4394860f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920456:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2400/0x48868a4e4394860f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920538:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3400/0x48868a4e43948616 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920544:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3400/0x48868a4e43948616 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920548:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3400/0x48868a4e43948616 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:0.0:1746129744.920557:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129744.920614:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3400/0x48868a4e43948616 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920618:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3400/0x48868a4e43948616 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920623:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3400/0x48868a4e43948616 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920627:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801360b3400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129744.920630:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3400/0x48868a4e43948616 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920634:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3400/0x48868a4e43948616 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920641:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129744.920643:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129744.920646:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3400/0x48868a4e43948616 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920649:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3400/0x48868a4e43948616 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920658:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3600/0x48868a4e43948608 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920662:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3600/0x48868a4e43948608 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920666:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3600/0x48868a4e43948608 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920673:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801360b3600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129744.920675:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3600/0x48868a4e43948608 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920679:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3600/0x48868a4e43948608 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920685:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:0.0:1746129744.920687:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129744.920689:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3600/0x48868a4e43948608 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920693:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3600/0x48868a4e43948608 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920699:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2400/0x48868a4e4394860f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920703:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2400/0x48868a4e4394860f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920707:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2400/0x48868a4e4394860f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920711:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801360b2400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129744.920713:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2400/0x48868a4e4394860f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920717:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2400/0x48868a4e4394860f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920722:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012bfca000) 00010000:00010000:0.0:1746129744.920724:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129744.920726:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2400/0x48868a4e4394860f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920730:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2400/0x48868a4e4394860f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129744.920756:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2a00/0x48868a4e43948601 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edc9 expref: 286 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.920761:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2a00/0x48868a4e43948601 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edc9 expref: 286 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129744.920767:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801360b2a00, rc 0) 00000100:00100000:0.0:1746129744.920802:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28417:x1830949052034816:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 476us (602us total) trans 8589943543 rc 301/301 00000100:00100000:0.0:1746129744.920808:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9779 00000100:00100000:0.0:1746129744.928510:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.928667:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052035072 00000100:00100000:2.0:1746129744.928674:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052035072 00000100:00100000:2.0:1746129744.928706:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3818 00000100:00100000:2.0:1746129744.928714:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28404:x1830949052035072:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129744.929600:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:28404:x1830949052035072:12345-192.168.204.31@tcp:35:cat.0 Request processed in 884us (1093us total) trans 8589943544 rc 0/0 00000100:00100000:2.0:1746129744.929675:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3818 00000100:00100000:0.0:1746129744.930350:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.930510:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053239680:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129744.930520:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053239808:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129744.930556:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a15800/0x48868a4e439485fa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edc2 expref: 12 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.930571:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a15800, rc 0) 00000100:00100000:1.0:1746129744.930597:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+12:28399:x1830949052034560:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 11238us (11861us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129744.930604:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10490 00000100:00100000:2.0:1746129744.930663:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052035200 00000100:00100000:2.0:1746129744.930667:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052035200 00010000:00010000:2.0:1746129744.930685:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9800/0x48868a4e4394854b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed13 expref: 10 pid: 8436 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.930713:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5044 00000100:00100000:2.0:1746129744.930718:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949052035200:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129744.930727:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.930742:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9800/0x48868a4e4394854b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed13 expref: 10 pid: 8436 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.930751:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9800/0x48868a4e4394854b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed13 expref: 10 pid: 8436 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.930767:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9800/0x48868a4e4394854b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed13 expref: 10 pid: 8436 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.930776:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129744.930790:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1964:x1830949052035200:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 73us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.930794:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5044 00000100:00100000:0.0:1746129744.932372:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.932496:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052035328 00000100:00100000:1.0:1746129744.932503:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052035328 00010000:00010000:1.0:1746129744.932535:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8a00/0x48868a4e4394853d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed05 expref: 20 pid: 8436 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746129744.932625:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5045 00000100:00100000:1.0:1746129744.932633:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949052035328:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129744.932643:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129744.932659:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8a00/0x48868a4e4394853d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed05 expref: 20 pid: 8436 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746129744.932668:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8a00/0x48868a4e4394853d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed05 expref: 20 pid: 8436 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746129744.932684:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8a00/0x48868a4e4394853d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed05 expref: 20 pid: 8436 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746129744.932967:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129744.932969:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129744.932976:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a15800/0x48868a4e439485fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edc2 expref: 11 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.932983:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a15800/0x48868a4e439485fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edc2 expref: 11 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129744.933009:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130a15800/0x48868a4e439485fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edc2 expref: 11 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129744.933020:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053239936:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129744.933340:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129744.936972:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053239936:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129744.936993:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129744.937029:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949052035328:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4396us (4661us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.937038:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5045 00000100:00100000:1.0:1746129744.937621:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.937653:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052035456 00000100:00100000:2.0:1746129744.937659:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052035456 00000100:00100000:2.0:1746129744.937690:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10491 00000100:00100000:2.0:1746129744.937701:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:28399:x1830949052035456:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129744.937714:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129744.937732:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4400/0x48868a4e43948624 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34edd0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.937758:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e43948513 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecdb expref: 11 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.937766:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094fd8c00/0x48868a4e4394851a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece9 expref: 14 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.937772:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.937774:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.937780:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4400/0x48868a4e43948624 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd0 expref: 12 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.937805:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094fd8c00/0x48868a4e4394851a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece9 expref: 14 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.937814:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094fd8c00/0x48868a4e4394851a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece9 expref: 14 pid: 1877 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.937825:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053240064:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.938987:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e43948513 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecdb expref: 11 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.938998:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e43948513 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecdb expref: 11 pid: 4589 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.939008:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053240192:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129744.940152:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129744.940739:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053240064:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129744.940748:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053240192:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129744.940771:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4400/0x48868a4e43948624 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd0 expref: 12 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.940785:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a51c4400, rc 0) 00000100:00100000:2.0:1746129744.940812:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+12:28399:x1830949052035456:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3111us (3192us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.940819:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10491 00000100:00100000:0.0:1746129744.943991:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.944354:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052035584 00000100:00100000:2.0:1746129744.944363:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052035584 00010000:00010000:2.0:1746129744.944396:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094fd8c00/0x48868a4e4394851a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece9 expref: 15 pid: 1877 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.944425:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5046 00000100:00100000:2.0:1746129744.944433:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949052035584:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129744.944446:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.944467:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880094fd8c00/0x48868a4e4394851a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece9 expref: 15 pid: 1877 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.944480:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094fd8c00/0x48868a4e4394851a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece9 expref: 15 pid: 1877 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.944502:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094fd8c00/0x48868a4e4394851a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ece9 expref: 15 pid: 1877 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.944515:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129744.944767:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949052035584:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 332us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.944773:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5046 00000100:00100000:0.0:1746129744.950558:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.950650:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052035712 00000100:00100000:2.0:1746129744.950658:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052035712 00010000:00010000:2.0:1746129744.950686:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e43948513 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecdb expref: 12 pid: 4589 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746129744.950710:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5047 00000100:00100000:2.0:1746129744.950717:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949052035712:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129744.950728:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129744.950745:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e43948513 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecdb expref: 12 pid: 4589 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.950755:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e43948513 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecdb expref: 12 pid: 4589 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.950777:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e43948513 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecdb expref: 12 pid: 4589 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746129744.950789:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.950791:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129744.950798:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4400/0x48868a4e43948624 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd0 expref: 11 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.950805:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4400/0x48868a4e43948624 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd0 expref: 11 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129744.950831:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4400/0x48868a4e43948624 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd0 expref: 11 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129744.950841:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053240320:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129744.953206:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129744.955614:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053240320:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129744.955631:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129744.955665:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052035712:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4948us (5114us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129744.955673:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5047 00000100:00100000:0.0:1746129744.958090:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.958120:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.959339:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.959672:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052035968 00000100:00100000:1.0:1746129744.959680:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052035968 00000100:00100000:1.0:1746129744.959727:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052036224 00000100:00100000:1.0:1746129744.959729:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052036224 00000100:00100000:1.0:1746129744.959741:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052036480 00000100:00100000:1.0:1746129744.959743:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052036480 00000100:00100000:1.0:1746129744.959755:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10492 00000100:00100000:3.0:1746129744.959762:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10493 00000100:00100000:1.0:1746129744.959762:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949052035968:12345-192.168.204.31@tcp:2:lfs.0 00000100:00100000:3.0:1746129744.959767:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949052036224:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:3.0:1746129744.959910:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129744.959910:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129744.959913:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129744 -> 1746129744 00002000:00010000:1.0:1746129744.959913:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129745 -> 1746129744 00002000:00010000:3.0:1746129744.959915:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746129744 -> 1746129744 00002000:00010000:1.0:1746129744.959915:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129745 -> 1746129744 00002000:00010000:3.0:1746129744.959917:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129745 -> 1746129745 00002000:00010000:1.0:1746129744.959917:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129745 -> 1746129745 00002000:00010000:3.0:1746129744.959919:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2079 -> 2079 00002000:00010000:1.0:1746129744.959919:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746129744.959955:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+14:1962:x1830949052035968:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 193us (1871us total) trans 21474840196 rc 0/0 00000100:00100000:1.0:1746129744.959960:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10492 00000100:00100000:1.0:1746129744.959972:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10494 00000100:00100000:1.0:1746129744.959976:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949052036480:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:1.0:1746129744.960027:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746129744.960029:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129744 -> 1746129744 00002000:00010000:1.0:1746129744.960031:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129744 -> 1746129744 00002000:00010000:1.0:1746129744.960032:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129745 -> 1746129745 00002000:00010000:1.0:1746129744.960034:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746129744.960216:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949052036224:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 448us (2094us total) trans 17179873032 rc 0/0 00000100:00100000:3.0:1746129744.960221:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10493 00000100:00100000:0.0:1746129744.960290:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.960478:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129744.960636:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.960647:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052035840 00000100:00100000:2.0:1746129744.960651:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052035840 00000100:00100000:2.0:1746129744.960666:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052036096 00000100:00100000:2.0:1746129744.960668:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052036096 00000100:00100000:2.0:1746129744.960678:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10495 00000100:00100000:2.0:1746129744.960682:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949052035840:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:2.0:1746129744.960754:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746129744.960756:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129745 -> 1746129744 00002000:00010000:2.0:1746129744.960758:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129744 -> 1746129744 00002000:00010000:2.0:1746129744.960759:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129745 -> 1746129745 00002000:00010000:2.0:1746129744.960761:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:2.0:1746129744.960777:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+14:1962:x1830949052035840:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 94us (486us total) trans 17179873033 rc 0/0 00000100:00100000:2.0:1746129744.960781:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10495 00000100:00100000:2.0:1746129744.960791:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10496 00000100:00100000:2.0:1746129744.960795:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052036096:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:2.0:1746129744.960858:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129744.960860:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129745 -> 1746129744 00002000:00010000:2.0:1746129744.960861:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129745 -> 1746129744 00002000:00010000:2.0:1746129744.960863:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129745 -> 1746129745 00002000:00010000:2.0:1746129744.960864:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746129744.960877:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+16:1962:x1830949052036096:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 81us (398us total) trans 21474840198 rc 0/0 00000100:00100000:2.0:1746129744.960881:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10496 00000100:00100000:1.0:1746129744.963177:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052036480:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 3191us (3834us total) trans 21474840197 rc 0/0 00000100:00100000:1.0:1746129744.963188:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10494 00000100:00100000:1.0:1746129744.963206:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052036352 00000100:00100000:1.0:1746129744.963212:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052036352 00000100:00100000:1.0:1746129744.963235:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10497 00000100:00100000:1.0:1746129744.963240:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+14:1962:x1830949052036352:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:1.0:1746129744.963367:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:1.0:1746129744.963371:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129744 -> 1746129744 00002000:00010000:1.0:1746129744.963372:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129744 -> 1746129744 00002000:00010000:1.0:1746129744.963374:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129745 -> 1746129745 00002000:00010000:1.0:1746129744.963375:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5673 -> 5673 00000100:00100000:1.0:1746129744.963405:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052036352:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 163us (2767us total) trans 17179873034 rc 0/0 00000100:00100000:1.0:1746129744.963412:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10497 00000100:00100000:0.0:1746129744.968936:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.970774:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052036608 00000100:00100000:2.0:1746129744.970785:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052036608 00000100:00100000:3.0:1746129744.970915:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10498 00000100:00100000:3.0:1746129744.970923:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:28417:x1830949052036608:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129744.970945:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129744.970962:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a38800/0x48868a4e4394862b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34edd7 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.970985:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4400/0x48868a4e43948624 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd0 expref: 14 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.970992:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129744.970994:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129744.970997:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a38800/0x48868a4e4394862b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2514944->2920447] (req 2514944->2920447) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd7 expref: 15 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.971021:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4400/0x48868a4e43948624 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd0 expref: 14 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.971032:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4400/0x48868a4e43948624 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd0 expref: 14 pid: 3624 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746129744.971042:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053240448:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129744.971113:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.973513:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.975353:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052036864 00000100:00100000:2.0:1746129744.975362:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052036864 00000100:00100000:2.0:1746129744.975416:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3819 00000100:00100000:2.0:1746129744.975423:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+7:28399:x1830949052036864:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:2.0:1746129744.975611:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+8:28399:x1830949052036864:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 187us (2103us total) trans 8589943545 rc 0/0 00000100:00100000:2.0:1746129744.975616:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3819 00000100:00100000:3.0:1746129744.975972:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053240448:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129744.976015:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a38800/0x48868a4e4394862b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2514944->2920447] (req 2514944->2920447) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd7 expref: 15 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.976029:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a38800, rc 0) 00000100:00100000:3.0:1746129744.976061:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:28417:x1830949052036608:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5139us (7133us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.976068:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10498 00000100:00100000:0.0:1746129744.976362:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.976409:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052036992 00000100:00100000:3.0:1746129744.976413:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052036992 00010000:00010000:3.0:1746129744.976427:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4400/0x48868a4e43948624 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd0 expref: 15 pid: 3624 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746129744.976443:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5048 00000100:00100000:3.0:1746129744.976448:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052036992:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129744.976455:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129744.976470:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4400/0x48868a4e43948624 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd0 expref: 15 pid: 3624 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746129744.976479:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4400/0x48868a4e43948624 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd0 expref: 15 pid: 3624 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746129744.976495:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4400/0x48868a4e43948624 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd0 expref: 15 pid: 3624 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746129744.976517:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.976519:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129744.976533:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a38800/0x48868a4e4394862b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->2920447) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd7 expref: 14 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.976541:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a38800/0x48868a4e4394862b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->2920447) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd7 expref: 14 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129744.977331:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130a38800/0x48868a4e4394862b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->2920447) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd7 expref: 14 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129744.977344:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053240576:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129744.977673:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129744.978156:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129744.979449:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052037248 00000100:00100000:1.0:1746129744.979457:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052037248 00000100:00100000:1.0:1746129744.979498:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3820 00000100:00100000:1.0:1746129744.979504:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c561c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28399:x1830949052037248:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:1.0:1746129744.979695:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c561c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:28399:x1830949052037248:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 190us (1539us total) trans 8589943546 rc 0/0 00000100:00100000:1.0:1746129744.979701:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3820 00000100:00100000:0.0:1746129744.981495:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.981585:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053240576:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129744.981628:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129744.981659:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+14:1962:x1830949052036992:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5210us (5297us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129744.981668:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5048 00000100:00100000:2.0:1746129744.981759:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052037504 00000100:00100000:2.0:1746129744.981764:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052037504 00002000:00100000:2.0:1746129744.981795:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2514944->2519039) req@ffff88009ba87800 x1830949052037504/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129744.981804:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba87800 with x1830949052037504 ext(2514944->2519039) 00002000:00010000:2.0:1746129744.981808:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba87800 00000100:00100000:2.0:1746129744.981821:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3867 00000100:00100000:2.0:1746129744.981827:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949052037504:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129744.981980:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949052037504:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 153us (490us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129744.981984:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3867 00002000:00100000:2.0:1746129744.981989:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2514944->2519039) req@ffff88009ba87800 x1830949052037504/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/4536 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129744.981995:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba87800 with x1830949052037504 ext(2514944->2519039) 00002000:00010000:2.0:1746129744.981997:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba87800 00000100:00100000:0.0:1746129744.992713:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129744.992841:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052037760 00000100:00100000:3.0:1746129744.992885:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052037760 00002000:00100000:3.0:1746129744.992920:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2916352->2920447) req@ffff88009ba85880 x1830949052037760/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/0 e 0 to 0 dl 1746129755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129744.992928:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85880 with x1830949052037760 ext(2916352->2920447) 00002000:00010000:3.0:1746129744.992932:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba85880 00000100:00100000:3.0:1746129744.992961:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3868 00000100:00100000:3.0:1746129744.992968:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949052037760:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129744.993113:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949052037760:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 144us (407us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129744.993119:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3868 00002000:00100000:3.0:1746129744.993124:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2916352->2920447) req@ffff88009ba85880 x1830949052037760/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:485/0 lens 488/4536 e 0 to 0 dl 1746129755 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129744.993131:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85880 with x1830949052037760 ext(2916352->2920447) 00002000:00010000:3.0:1746129744.993133:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba85880 00000100:00100000:1.0:1746129744.999537:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129744.999620:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052038016 00000100:00100000:2.0:1746129744.999627:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052038016 00000100:00100000:2.0:1746129744.999662:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3821 00000100:00100000:2.0:1746129744.999669:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:28417:x1830949052038016:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129744.999968:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:28417:x1830949052038016:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 298us (445us total) trans 8589943547 rc 0/0 00000100:00100000:2.0:1746129744.999974:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3821 00010000:00010000:2.0:1746129745.016454:0:20054:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129745.016774:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.016829:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052038272 00000100:00100000:2.0:1746129745.016836:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052038272 00000100:00080000:0.0:1746129745.030361:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746129745.031134:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9780 00000100:00100000:3.0:1746129745.031242:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28424:x1830949052038272:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129745.031260:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129745.031276:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38000/0x48868a4e43948632 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34edde expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.031362:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39800/0x48868a4e43948639 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129745.031372:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39800/0x48868a4e43948639 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129745.031381:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39800/0x48868a4e43948639 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129745.031393:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39c00/0x48868a4e43948640 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129745.031398:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39c00/0x48868a4e43948640 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129745.031403:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39c00/0x48868a4e43948640 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129745.031947:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43948647 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129745.031954:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43948647 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129745.031960:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43948647 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129745.031968:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129745.032036:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39800/0x48868a4e43948639 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129745.032042:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39800/0x48868a4e43948639 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129745.032046:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39800/0x48868a4e43948639 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129745.032051:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a39800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129745.032053:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39800/0x48868a4e43948639 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129745.032058:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39800/0x48868a4e43948639 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129745.032066:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129745.032068:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129745.032071:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39800/0x48868a4e43948639 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129745.032075:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39800/0x48868a4e43948639 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129745.032098:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39c00/0x48868a4e43948640 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129745.032103:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39c00/0x48868a4e43948640 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129745.032107:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39c00/0x48868a4e43948640 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129745.032110:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a39c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129745.032111:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39c00/0x48868a4e43948640 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129745.032116:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39c00/0x48868a4e43948640 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129745.032121:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009cae5400) 00010000:00010000:3.0:1746129745.032123:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129745.032124:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39c00/0x48868a4e43948640 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129745.032128:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39c00/0x48868a4e43948640 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129745.032156:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38000/0x48868a4e43948632 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edde expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.032164:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43948647 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edde expref: 11 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.032169:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129745.032171:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129745.032173:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a38a00, rc 0) 00000100:00100000:3.0:1746129745.032223:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28424:x1830949052038272:12345-192.168.204.31@tcp:101:cat.0 Request processed in 986us (15453us total) trans 8589943548 rc 0/0 00000100:00100000:3.0:1746129745.032228:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9780 00000100:00100000:0.0:1746129745.037209:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.037349:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052038528 00000100:00100000:2.0:1746129745.037357:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052038528 00000100:00100000:2.0:1746129745.037406:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3822 00000100:00100000:2.0:1746129745.037414:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28424:x1830949052038528:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129745.037631:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28424:x1830949052038528:12345-192.168.204.31@tcp:35:cat.0 Request processed in 217us (429us total) trans 8589943549 rc 0/0 00000100:00100000:2.0:1746129745.037637:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3822 00000100:00100000:0.0:1746129745.044499:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.045133:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.045170:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.045200:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052038656 00000100:00100000:0.0:1746129745.045207:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052038656 00000100:00100000:0.0:1746129745.045241:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052038784 00000100:00100000:0.0:1746129745.045243:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052038784 00000100:00100000:1.0:1746129745.045638:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052038912 00000100:00100000:1.0:1746129745.045642:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052038912 00000100:00100000:3.0:1746129745.045778:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10499 00000100:00100000:3.0:1746129745.045788:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052038656:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129745.045803:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129745.045817:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a39400/0x48868a4e43948655 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ede5 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129745.045879:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053240704:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129745.045961:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129745.046098:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10500 00000100:00100000:0.0:1746129745.046160:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949052038784:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129745.046167:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129745.046172:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10501 00000100:00100000:1.0:1746129745.046177:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052038912:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129745.046177:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801360b3e00/0x48868a4e4394865c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34edec expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.046182:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129745.046187:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136365400/0x48868a4e43948663 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34edf3 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129745.046205:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053240832:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129745.046205:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053240960:192.168.204.31@tcp:106: 00000100:00080000:0.0:1746129745.046231:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746129745.046233:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129745.046239:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3243c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129745.046245:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738b180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129745.046277:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.046290:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052039040 00000100:00100000:0.0:1746129745.046297:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052039040 00000100:00100000:0.0:1746129745.046316:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10502 00000100:00100000:0.0:1746129745.046326:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052039040:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129745.046335:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129745.046342:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801360b3800/0x48868a4e4394866a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34edfa expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129745.046368:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053241088:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129745.046392:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738b540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129745.046779:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.046814:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.047725:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052039168 00000100:00100000:2.0:1746129745.047730:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052039168 00000100:00100000:2.0:1746129745.047763:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052039296 00000100:00100000:2.0:1746129745.047766:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052039296 00000100:00100000:2.0:1746129745.047786:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10503 00000100:00100000:2.0:1746129745.047792:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949052039168:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129745.047801:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129745.047809:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a51c5600/0x48868a4e43948671 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ee01 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129745.047834:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053241216:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129745.047911:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129745.047922:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10504 00000100:00100000:2.0:1746129745.047927:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1961:x1830949052039296:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129745.047933:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129745.047940:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4400/0x48868a4e43948678 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ee08 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129745.047962:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053241344:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129745.047981:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129745.051687:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053241088:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129745.051716:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801360b3800/0x48868a4e4394866a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edfa expref: 14 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129745.051728:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801360b3800/0x48868a4e4394866a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edfa expref: 14 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129745.051740:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801360b3800, rc 0) 00000100:00100000:0.0:1746129745.051771:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949052039040:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5449us (5492us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129745.051777:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10502 00000100:00100000:0.0:1746129745.051878:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053240960:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129745.051896:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801360b3e00/0x48868a4e4394865c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edec expref: 16 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129745.051904:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801360b3e00/0x48868a4e4394865c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edec expref: 16 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129745.051910:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801360b3e00, rc 0) 00000100:00100000:0.0:1746129745.051925:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1961:x1830949052038784:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5822us (6792us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129745.051929:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10500 00000100:00100000:3.0:1746129745.052127:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053240704:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129745.052161:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a39400/0x48868a4e43948655 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ede5 expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129745.052168:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a39400/0x48868a4e43948655 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ede5 expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129745.052178:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a39400, rc 0) 00000100:00100000:3.0:1746129745.052198:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052038656:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6413us (7706us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129745.052202:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10499 00002000:00010000:3.0:1746129745.052231:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime: 1746129744 -> 1746129745 00002000:00010000:3.0:1746129745.052233:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746129744 -> 1746129745 00000100:00100000:3.0:1746129745.052243:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053241344:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129745.052256:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4400/0x48868a4e43948678 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee08 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129745.052263:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4400/0x48868a4e43948678 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee08 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129745.052269:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a51c4400, rc 0) 00000100:00100000:3.0:1746129745.052284:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949052039296:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4357us (5470us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129745.052288:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10504 00000100:00100000:1.0:1746129745.052511:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053240832:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129745.052538:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136365400/0x48868a4e43948663 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edf3 expref: 12 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129745.052547:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136365400/0x48868a4e43948663 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edf3 expref: 12 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129745.052567:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136365400, rc 0) 00000100:00100000:1.0:1746129745.052587:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052038912:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6410us (7417us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129745.052592:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10501 00000100:00100000:2.0:1746129745.052671:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053241216:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129745.052686:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a51c5600/0x48868a4e43948671 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee01 expref: 10 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129745.052694:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a51c5600/0x48868a4e43948671 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee01 expref: 10 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129745.052702:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a51c5600, rc 0) 00000100:00100000:2.0:1746129745.052718:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052039168:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4926us (5939us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129745.052722:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10503 00000100:00100000:2.0:1746129745.060673:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.060971:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.061493:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052039424 00000100:00100000:3.0:1746129745.061505:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052039424 00000100:00100000:1.0:1746129745.061506:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.061545:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10505 00000100:00100000:3.0:1746129745.061553:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28424:x1830949052039424:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129745.061568:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129745.061581:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a39800/0x48868a4e4394867f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ee0f expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.061606:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acd83000/0x48868a4e43948536 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecfe expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.061613:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129745.061615:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129745.061618:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a39800/0x48868a4e4394867f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee0f expref: 10 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.061643:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800acd83000/0x48868a4e43948536 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecfe expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.061652:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800acd83000/0x48868a4e43948536 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecfe expref: 14 pid: 8436 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746129745.061662:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053241472:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129745.061767:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052039680 00000100:00100000:0.0:1746129745.061771:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052039680 00000100:00100000:0.0:1746129745.061806:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052039936 00000100:00100000:0.0:1746129745.061808:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052039936 00000100:00100000:3.0:1746129745.063282:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129745.063500:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9781 00000100:00100000:0.0:1746129745.063510:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:28428:x1830949052039680:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129745.063535:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129745.063548:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d600/0x48868a4e43948686 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ee16 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.063635:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9c400/0x48868a4e4394868d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.063645:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9c400/0x48868a4e4394868d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.063654:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9c400/0x48868a4e4394868d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.063663:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9da00/0x48868a4e43948694 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.063668:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9da00/0x48868a4e43948694 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.063672:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9da00/0x48868a4e43948694 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.063757:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9c800/0x48868a4e4394869b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.063765:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9c800/0x48868a4e4394869b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.063771:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9c800/0x48868a4e4394869b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:0.0:1746129745.063777:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129745.063866:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9c400/0x48868a4e4394868d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.063872:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9c400/0x48868a4e4394868d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.063877:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9c400/0x48868a4e4394868d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.063883:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bd9c400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129745.063886:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9c400/0x48868a4e4394868d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.063892:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9c400/0x48868a4e4394868d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.063901:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:0.0:1746129745.063904:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129745.063907:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9c400/0x48868a4e4394868d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.063912:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9c400/0x48868a4e4394868d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.063921:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9da00/0x48868a4e43948694 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.063930:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9da00/0x48868a4e43948694 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.063934:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9da00/0x48868a4e43948694 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.063938:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bd9da00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129745.063940:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9da00/0x48868a4e43948694 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.063944:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9da00/0x48868a4e43948694 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.063949:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012bfca500) 00010000:00010000:0.0:1746129745.063951:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129745.063953:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9da00/0x48868a4e43948694 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.063957:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9da00/0x48868a4e43948694 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.063985:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d600/0x48868a4e43948686 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee16 expref: 290 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.063995:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9c800/0x48868a4e4394869b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee16 expref: 289 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.064000:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129745.064002:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129745.064004:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bd9c800, rc 0) 00000100:00100000:0.0:1746129745.064043:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:28428:x1830949052039680:12345-192.168.204.31@tcp:101:cat.0 Request processed in 535us (3071us total) trans 8589943550 rc 0/0 00000100:00100000:0.0:1746129745.064050:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9781 00000100:00100000:0.0:1746129745.064064:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9782 00000100:00100000:0.0:1746129745.064070:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28429:x1830949052039936:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129745.064079:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129745.064084:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9cc00/0x48868a4e439486a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ee1d expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.064115:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d400/0x48868a4e439486b0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.064123:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43948647 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edde expref: 13 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.064129:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9c800/0x48868a4e4394869b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee16 expref: 288 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.064134:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d400/0x48868a4e439486b0 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.064156:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9c800/0x48868a4e4394869b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee16 expref: 288 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.064164:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9c800/0x48868a4e4394869b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee16 expref: 288 pid: 16808 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746129745.064172:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053241600:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129745.064212:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43948647 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edde expref: 13 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.064223:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43948647 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edde expref: 13 pid: 14315 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746129745.064230:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053241728:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129745.064246:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738b180 going to sleep for 11 seconds 00000100:00080000:0.0:1746129745.064259:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746129745.071993:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.072023:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.072088:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.072106:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052040064 00000100:00100000:1.0:1746129745.072112:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052040064 00010000:00010000:1.0:1746129745.072146:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd83000/0x48868a4e43948536 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecfe expref: 15 pid: 8436 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746129745.072178:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052040320 00000100:00100000:1.0:1746129745.072180:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052040320 00010000:00010000:1.0:1746129745.072190:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43948647 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edde expref: 14 pid: 14315 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746129745.072204:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052040192 00000100:00100000:1.0:1746129745.072206:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052040192 00010000:00010000:1.0:1746129745.072213:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9c800/0x48868a4e4394869b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee16 expref: 289 pid: 16808 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746129745.072224:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5049 00000100:00100000:1.0:1746129745.072230:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052040064:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129745.072239:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129745.072256:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800acd83000/0x48868a4e43948536 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecfe expref: 15 pid: 8436 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.072266:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800acd83000/0x48868a4e43948536 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecfe expref: 15 pid: 8436 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.072286:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.072288:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.072294:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a39800/0x48868a4e4394867f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee0f expref: 10 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.072300:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a39800/0x48868a4e4394867f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee0f expref: 10 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.072323:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130a39800/0x48868a4e4394867f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee0f expref: 10 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129745.072334:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053241856:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129745.072395:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3243c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129745.072412:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5050 00000100:00100000:1.0:1746129745.072417:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052040320:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129745.072424:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129745.072429:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43948647 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edde expref: 14 pid: 14315 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.072435:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43948647 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edde expref: 14 pid: 14315 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.072447:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129745.072451:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d400/0x48868a4e439486b0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.072457:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d400/0x48868a4e439486b0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.072461:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129745.072479:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052040320:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 61us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.072483:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5050 00000100:00100000:1.0:1746129745.072497:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5051 00000100:00100000:1.0:1746129745.072501:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:1962:x1830949052040192:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129745.072507:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129745.072511:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9c800/0x48868a4e4394869b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee16 expref: 289 pid: 16808 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.072516:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9c800/0x48868a4e4394869b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee16 expref: 289 pid: 16808 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.072536:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129745.072538:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d400/0x48868a4e439486b0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.072543:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d400/0x48868a4e439486b0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.072547:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d400/0x48868a4e439486b0 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.072555:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129745.072567:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:1962:x1830949052040192:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 66us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.072572:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5051 00010000:00010000:3.0:1746129745.072694:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acd83000/0x48868a4e43948536 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecfe expref: 15 pid: 8436 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746129745.072713:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053241472:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129745.072748:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a39800/0x48868a4e4394867f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee0f expref: 10 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.072755:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a39800, rc 0) 00000100:00100000:3.0:1746129745.072774:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28424:x1830949052039424:12345-192.168.204.31@tcp:101:cat.0 Request processed in 11223us (12110us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129745.072779:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10505 00000100:00080000:3.0:1746129745.072837:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1746129745.073257:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9c800/0x48868a4e4394869b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee16 expref: 288 pid: 16808 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746129745.073268:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053241600:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129745.073277:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43948647 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edde expref: 13 pid: 14315 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746129745.073284:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053241728:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129745.073298:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d400/0x48868a4e439486b0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.073303:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d400/0x48868a4e439486b0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.073307:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d400/0x48868a4e439486b0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:0.0:1746129745.073320:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129745.073420:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9cc00/0x48868a4e439486a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee1d expref: 14 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.073429:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d400/0x48868a4e439486b0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee1d expref: 13 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.073435:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129745.073438:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129745.073439:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bd9d400, rc 0) 00000100:00100000:0.0:1746129745.073459:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28429:x1830949052039936:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 9389us (11954us total) trans 8589943551 rc 0/0 00000100:00100000:0.0:1746129745.073465:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9782 00000100:00100000:3.0:1746129745.073644:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.073721:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052040448 00000100:00100000:2.0:1746129745.073725:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052040448 00000100:00100000:2.0:1746129745.073747:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10506 00000100:00100000:2.0:1746129745.073751:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949052040448:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129745.073762:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129745.073769:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5283c00/0x48868a4e439486be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ee24 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.073780:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129745.073781:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129745.073786:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5283c00/0x48868a4e439486be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee24 expref: 20 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129745.073794:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5283c00/0x48868a4e439486be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee24 expref: 20 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129745.073804:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5283c00, rc 0) 00000100:00100000:2.0:1746129745.073820:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949052040448:12345-192.168.204.31@tcp:101:cat.0 Request processed in 69us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129745.073824:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10506 00000100:00080000:3.0:1746129745.073987:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746129745.074731:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.074751:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.074766:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.074777:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052040576 00000100:00100000:3.0:1746129745.074780:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052040576 00000100:00080000:3.0:1746129745.074790:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746129745.074802:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052040704 00000100:00100000:3.0:1746129745.074803:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052040704 00000100:00100000:3.0:1746129745.074810:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052040832 00000100:00100000:3.0:1746129745.074812:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052040832 00000100:00100000:3.0:1746129745.074820:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10507 00000100:00100000:3.0:1746129745.074824:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1961:x1830949052040576:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129745.074832:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129745.074839:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a51c5600/0x48868a4e439486c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ee2b expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129745.074888:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053241984:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129745.074930:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129745.074953:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.074994:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052040960 00000100:00100000:3.0:1746129745.074996:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052040960 00000100:00100000:3.0:1746129745.075012:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10508 00000100:00100000:3.0:1746129745.075016:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949052040704:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129745.075021:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129745.075027:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b154000/0x48868a4e439486cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ee32 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129745.075044:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053242112:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129745.075061:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129745.075084:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10509 00000100:00100000:3.0:1746129745.075088:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052040832:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129745.075093:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129745.075099:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801305a6400/0x48868a4e439486d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ee39 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129745.075116:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd45500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053242240:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129745.075131:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129745.075183:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10510 00000100:00100000:2.0:1746129745.075187:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949052040960:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129745.075192:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129745.075198:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5283000/0x48868a4e439486da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ee40 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129745.075213:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053242368:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129745.075231:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129745.080447:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053241856:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129745.080464:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129745.080506:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+14:1962:x1830949052040064:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8277us (8522us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.080515:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5049 00000100:00100000:0.0:1746129745.083299:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.083504:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052041088 00000100:00100000:2.0:1746129745.083511:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052041088 00000100:00100000:2.0:1746129745.083561:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10511 00000100:00100000:2.0:1746129745.083567:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28429:x1830949052041088:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129745.083581:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129745.083595:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e439486e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ee47 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.083618:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a38800/0x48868a4e4394862b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->2920447) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd7 expref: 18 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.083625:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129745.083627:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129745.083630:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e439486e1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3444736->3506175] (req 3444736->3506175) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee47 expref: 12 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.083652:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130a38800/0x48868a4e4394862b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->2920447) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd7 expref: 18 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.083661:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130a38800/0x48868a4e4394862b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->2920447) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd7 expref: 18 pid: 10930 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746129745.083670:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053242496:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129745.083727:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8300 going to sleep for 11 seconds 00000100:00100000:3.0:1746129745.083841:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053242112:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129745.083893:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b154000/0x48868a4e439486cc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee32 expref: 18 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129745.083907:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b154000/0x48868a4e439486cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee32 expref: 18 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129745.083918:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b154000, rc 0) 00000100:00100000:3.0:1746129745.083937:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949052040704:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8920us (9185us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129745.083942:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10508 00000100:00100000:3.0:1746129745.083974:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd47b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053241984:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129745.083984:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a51c5600/0x48868a4e439486c5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee2b expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129745.083991:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a51c5600/0x48868a4e439486c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee2b expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129745.083996:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a51c5600, rc 0) 00000100:00100000:3.0:1746129745.084008:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949052040576:12345-192.168.204.31@tcp:101:cat.0 Request processed in 9184us (9279us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129745.084012:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10507 00000100:00100000:0.0:1746129745.084616:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.086080:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053242368:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129745.086112:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5283000/0x48868a4e439486da lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee40 expref: 23 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129745.086125:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5283000/0x48868a4e439486da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee40 expref: 23 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129745.086138:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5283000, rc 0) 00000100:00100000:3.0:1746129745.086184:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949052040960:12345-192.168.204.31@tcp:101:cat.0 Request processed in 10995us (11229us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129745.086192:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10510 00000100:00100000:3.0:1746129745.086235:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd45500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053242240:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129745.086260:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801305a6400/0x48868a4e439486d3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee39 expref: 21 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129745.086268:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801305a6400/0x48868a4e439486d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee39 expref: 21 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129745.086273:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801305a6400, rc 0) 00000100:00100000:3.0:1746129745.086288:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949052040832:12345-192.168.204.31@tcp:101:cat.0 Request processed in 11200us (11521us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129745.086292:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10509 00000100:00100000:2.0:1746129745.086885:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052041344 00000100:00100000:2.0:1746129745.086892:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052041344 00002000:00100000:2.0:1746129745.086922:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009423d500 x1830949052041344/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.086930:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423d500 with x1830949052041344 ext(0->1048575) 00002000:00010000:2.0:1746129745.086934:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009423d500 00000100:00100000:2.0:1746129745.086948:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3869 00000100:00100000:2.0:1746129745.086953:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052041344:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129745.089276:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.089349:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053242496:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129745.089375:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e439486e1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3444736->3506175] (req 3444736->3506175) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee47 expref: 12 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.089388:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5282200, rc 0) 00000100:00100000:3.0:1746129745.089527:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28429:x1830949052041088:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5951us (6225us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129745.089534:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10511 00000100:00100000:3.0:1746129745.089562:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052041472 00000100:00100000:3.0:1746129745.089566:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052041472 00002000:00100000:3.0:1746129745.089590:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2514944->2920447) req@ffff88009423c380 x1830949052041472/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.089597:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423c380 with x1830949052041472 ext(2514944->2920447) 00010000:00010000:3.0:1746129745.089603:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130a38800/0x48868a4e4394862b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->2920447) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd7 expref: 15 pid: 10930 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746129745.089612:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130a38800/0x48868a4e4394862b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->2920447) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd7 expref: 15 pid: 10930 timeout: 791 lvb_type: 0 00002000:00010000:3.0:1746129745.089617:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009423c380 00000100:00100000:3.0:1746129745.089634:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 536 00000100:00100000:3.0:1746129745.089640:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949052041472:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:0.0:1746129745.092923:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.093754:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052041728 00000100:00100000:3.0:1746129745.093762:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052041728 00002000:00100000:3.0:1746129745.093796:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009423d180 x1830949052041728/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.093805:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423d180 with x1830949052041728 ext(0->1048575) 00002000:00010000:3.0:1746129745.093809:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009423d180 00000100:00100000:3.0:1746129745.093840:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3870 00000100:00100000:3.0:1746129745.093866:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949052041728:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129745.109022:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052041344:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 22060us (24398us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129745.109033:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3869 00002000:00100000:2.0:1746129745.109043:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009423d500 x1830949052041344/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/440 e 0 to 0 dl 1746129756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.109051:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423d500 with x1830949052041344 ext(0->1048575) 00002000:00010000:2.0:1746129745.109057:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009423d500 00000100:00100000:3.0:1746129745.112933:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949052041472:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 23285us (23657us total) trans 21474840199 rc 0/0 00000100:00100000:3.0:1746129745.112944:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 536 00002000:00100000:3.0:1746129745.112967:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2514944->2920447) req@ffff88009423c380 x1830949052041472/t21474840199(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/448 e 0 to 0 dl 1746129756 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.112976:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423c380 with x1830949052041472 ext(2514944->2920447) 00010000:00010000:3.0:1746129745.112984:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130a38800/0x48868a4e4394862b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->2920447) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd7 expref: 17 pid: 10930 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746129745.112996:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130a38800/0x48868a4e4394862b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->2920447) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd7 expref: 17 pid: 10930 timeout: 791 lvb_type: 0 00002000:00010000:3.0:1746129745.113002:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009423c380 00000100:00100000:3.0:1746129745.113369:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949052041728:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19521us (20452us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129745.113375:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3870 00002000:00100000:3.0:1746129745.113380:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009423d180 x1830949052041728/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/440 e 0 to 0 dl 1746129756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.113386:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423d180 with x1830949052041728 ext(0->1048575) 00002000:00010000:3.0:1746129745.113389:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009423d180 00000100:00100000:0.0:1746129745.130279:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.130324:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.130343:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052041856 00000100:00100000:3.0:1746129745.130351:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052041856 00000100:00100000:3.0:1746129745.130401:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10512 00000100:00100000:3.0:1746129745.130409:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28424:x1830949052041856:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129745.130424:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129745.130439:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a507fe00/0x48868a4e439486e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ee4e expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.130463:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43948552 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed1a expref: 13 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.130470:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129745.130471:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129745.130474:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a507fe00/0x48868a4e439486e8 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee4e expref: 13 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.130498:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43948552 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed1a expref: 13 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.130507:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43948552 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed1a expref: 13 pid: 3623 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746129745.130528:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd45500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053242624:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129745.131832:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.132115:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052041984 00000100:00100000:1.0:1746129745.132121:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052041984 00010000:00010000:1.0:1746129745.132143:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a38800/0x48868a4e4394862b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->2920447) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd7 expref: 17 pid: 10930 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746129745.132781:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052042112 00000100:00100000:2.0:1746129745.132785:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052042112 00000100:00100000:3.0:1746129745.132791:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129745.132812:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10513 00000100:00100000:2.0:1746129745.132817:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:28428:x1830949052042112:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129745.132828:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129745.132844:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e439486ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ee55 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.132878:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129745.132883:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e439486ef lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee55 expref: 19 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.132892:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e439486ef lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee55 expref: 19 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.132900:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5283e00, rc 0) 00000100:00100000:1.0:1746129745.133109:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5052 00000100:00100000:1.0:1746129745.133116:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949052041984:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129745.133125:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129745.133142:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a38800/0x48868a4e4394862b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2514944->2920447) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd7 expref: 19 pid: 10930 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.133151:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a38800/0x48868a4e4394862b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2514944->2920447) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd7 expref: 19 pid: 10930 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.133164:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a38800/0x48868a4e4394862b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2514944->2920447) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edd7 expref: 19 pid: 10930 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.133183:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.133185:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.133190:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e439486e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3506175) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee47 expref: 13 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.133196:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e439486e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3506175) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee47 expref: 13 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129745.133230:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:28428:x1830949052042112:12345-192.168.204.31@tcp:101:cat.0 Request processed in 412us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129745.133237:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10513 00010000:00010000:1.0:1746129745.133636:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e439486e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3506175) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee47 expref: 13 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129745.133647:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053242752:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129745.134085:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3243c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129745.136751:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd45500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053242624:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129745.136787:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a507fe00/0x48868a4e439486e8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee4e expref: 13 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.136801:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a507fe00, rc 0) 00000100:00100000:1.0:1746129745.136813:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053242752:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129745.136823:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129745.136834:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28424:x1830949052041856:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6425us (6563us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129745.136841:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10512 00000100:00100000:1.0:1746129745.136843:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949052041984:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3727us (6516us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.136866:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5052 00000100:00100000:0.0:1746129745.137798:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.138570:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.138657:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052042368 00000100:00100000:1.0:1746129745.138664:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052042368 00010000:00010000:1.0:1746129745.138707:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43948552 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed1a expref: 14 pid: 3623 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746129745.138727:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5053 00000100:00100000:1.0:1746129745.138734:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+14:1962:x1830949052042368:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129745.138744:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129745.138745:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052042496 00000100:00100000:3.0:1746129745.138749:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052042496 00010000:00010000:1.0:1746129745.138760:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43948552 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed1a expref: 14 pid: 3623 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.138769:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43948552 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed1a expref: 14 pid: 3623 timeout: 791 lvb_type: 0 00002000:00100000:3.0:1746129745.138772:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3444736->3448831) req@ffff88009423f100 x1830949052042496/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.138785:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423f100 with x1830949052042496 ext(3444736->3448831) 00010000:00010000:1.0:1746129745.138786:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43948552 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed1a expref: 14 pid: 3623 timeout: 791 lvb_type: 0 00002000:00010000:3.0:1746129745.138789:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009423f100 00010000:00010000:1.0:1746129745.138800:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.138802:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746129745.138805:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3871 00010000:00010000:1.0:1746129745.138808:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a507fe00/0x48868a4e439486e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee4e expref: 13 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129745.138811:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1963:x1830949052042496:12345-192.168.204.31@tcp:3:multiop.0 00010000:00010000:1.0:1746129745.138815:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a507fe00/0x48868a4e439486e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee4e expref: 13 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.138822:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.138823:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.138825:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e439486ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee55 expref: 16 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.138831:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e439486ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee55 expref: 16 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.138871:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e439486ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee55 expref: 16 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129745.138882:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053242880:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129745.138939:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a507fe00/0x48868a4e439486e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee4e expref: 13 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129745.138942:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1963:x1830949052042496:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 130us (372us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129745.138946:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053243008:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129745.138948:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3871 00002000:00100000:3.0:1746129745.138953:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3444736->3448831) req@ffff88009423f100 x1830949052042496/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/4536 e 0 to 0 dl 1746129756 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.138959:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423f100 with x1830949052042496 ext(3444736->3448831) 00002000:00010000:3.0:1746129745.138961:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009423f100 00000100:00100000:1.0:1746129745.138963:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3243c0 going to sleep for 11 seconds 00000100:00080000:2.0:1746129745.139169:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129745.147550:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.147588:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.147619:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052042752 00000100:00100000:3.0:1746129745.147627:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052042752 00002000:00100000:3.0:1746129745.147663:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009423f800 x1830949052042752/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.147671:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423f800 with x1830949052042752 ext(1048576->2097151) 00002000:00010000:3.0:1746129745.147675:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009423f800 00000100:00100000:2.0:1746129745.147676:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053242880:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129745.147686:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053243008:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129745.147690:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052043008 00000100:00100000:3.0:1746129745.147693:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052043008 00002000:00100000:3.0:1746129745.147703:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009423ea00 x1830949052043008/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746129745.147703:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746129745.147709:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423ea00 with x1830949052043008 ext(1048576->2097151) 00002000:00010000:3.0:1746129745.147712:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009423ea00 00000100:00100000:3.0:1746129745.147734:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3872 00000100:00100000:2.0:1746129745.147740:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3873 00000100:00100000:3.0:1746129745.147741:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1964:x1830949052042752:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129745.147748:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1964:x1830949052043008:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129745.147804:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949052042368:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 9070us (10009us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129745.147811:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5053 00000100:00100000:0.0:1746129745.159200:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.162341:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052043264 00000100:00100000:2.0:1746129745.162352:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052043264 00002000:00100000:2.0:1746129745.162395:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3502080->3506175) req@ffff88009423c000 x1830949052043264/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.162405:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423c000 with x1830949052043264 ext(3502080->3506175) 00002000:00010000:2.0:1746129745.162409:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009423c000 00000100:00100000:2.0:1746129745.162443:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3874 00000100:00100000:2.0:1746129745.162450:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1963:x1830949052043264:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129745.163625:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1963:x1830949052043264:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 1170us (4428us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129745.163633:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3874 00002000:00100000:2.0:1746129745.163639:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3502080->3506175) req@ffff88009423c000 x1830949052043264/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/4536 e 0 to 0 dl 1746129756 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.163645:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423c000 with x1830949052043264 ext(3502080->3506175) 00002000:00010000:2.0:1746129745.163649:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009423c000 00000100:00100000:0.0:1746129745.168084:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.169260:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1964:x1830949052043008:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21508us (21664us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129745.169272:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3873 00002000:00100000:3.0:1746129745.169282:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009423ea00 x1830949052043008/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/440 e 0 to 0 dl 1746129756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.169293:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423ea00 with x1830949052043008 ext(1048576->2097151) 00002000:00010000:3.0:1746129745.169298:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009423ea00 00000100:00100000:1.0:1746129745.170603:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052043520 00000100:00100000:1.0:1746129745.170612:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052043520 00000100:00100000:1.0:1746129745.170657:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9783 00000100:00100000:1.0:1746129745.170664:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:28431:x1830949052043520:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129745.170683:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129745.170696:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091f56600/0x48868a4e439486f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ee5c expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.170778:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091f56800/0x48868a4e439486fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.170789:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091f56800/0x48868a4e439486fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.170800:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091f56800/0x48868a4e439486fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.170810:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57400/0x48868a4e43948704 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.170814:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57400/0x48868a4e43948704 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.170818:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57400/0x48868a4e43948704 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.170915:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57800/0x48868a4e4394870b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.170922:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57800/0x48868a4e4394870b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.170927:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57800/0x48868a4e4394870b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:1.0:1746129745.170934:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129745.170992:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091f56800/0x48868a4e439486fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.170997:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091f56800/0x48868a4e439486fd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.171001:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091f56800/0x48868a4e439486fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.171006:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091f56800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129745.171009:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091f56800/0x48868a4e439486fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.171014:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091f56800/0x48868a4e439486fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.171023:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129745.171025:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129745.171028:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091f56800/0x48868a4e439486fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.171032:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091f56800/0x48868a4e439486fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.171057:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57400/0x48868a4e43948704 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.171062:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57400/0x48868a4e43948704 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.171066:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57400/0x48868a4e43948704 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.171070:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091f57400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129745.171071:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57400/0x48868a4e43948704 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.171076:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57400/0x48868a4e43948704 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.171081:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f99bf00) 00010000:00010000:1.0:1746129745.171083:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129745.171085:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57400/0x48868a4e43948704 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.171088:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57400/0x48868a4e43948704 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.171117:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091f56600/0x48868a4e439486f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee5c expref: 291 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.171126:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57800/0x48868a4e4394870b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee5c expref: 290 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.172996:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129745.172998:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129745.173002:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091f57800, rc 0) 00000100:00100000:1.0:1746129745.173056:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:28431:x1830949052043520:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2389us (4978us total) trans 8589943552 rc 0/0 00000100:00100000:1.0:1746129745.173063:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9783 00000100:00100000:3.0:1746129745.173410:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1964:x1830949052042752:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 25668us (25866us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129745.173417:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3872 00002000:00100000:3.0:1746129745.173424:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009423f800 x1830949052042752/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/440 e 0 to 0 dl 1746129756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.173433:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423f800 with x1830949052042752 ext(1048576->2097151) 00002000:00010000:3.0:1746129745.173437:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009423f800 00000100:00100000:3.0:1746129745.178060:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.178471:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052043648 00000100:00100000:0.0:1746129745.178479:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052043648 00000100:00100000:0.0:1746129745.178511:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10514 00000100:00100000:0.0:1746129745.178528:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:28428:x1830949052043648:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129745.178543:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129745.178557:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bd9c800/0x48868a4e43948719 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ee63 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.178581:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f5c600/0x48868a4e43948583 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed67 expref: 12 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.178587:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129745.178589:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129745.178592:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bd9c800/0x48868a4e43948719 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee63 expref: 18 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.178615:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4f5c600/0x48868a4e43948583 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed67 expref: 12 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.178624:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f5c600/0x48868a4e43948583 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed67 expref: 12 pid: 20441 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746129745.178634:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053243136:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129745.178792:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129745.181577:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.181641:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052043904 00000100:00100000:3.0:1746129745.181647:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052043904 00000100:00100000:3.0:1746129745.181691:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10515 00000100:00100000:3.0:1746129745.181699:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:28431:x1830949052043904:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129745.181714:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129745.181730:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a507f800/0x48868a4e43948720 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ee71 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.181755:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129745.181759:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bd9c800/0x48868a4e43948719 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee63 expref: 20 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.181765:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746129745.181768:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a507f800/0x48868a4e43948720 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1306624->1351679] (req 1306624->1351679) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee71 expref: 20 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.181801:0:10930:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bd9c800/0x48868a4e43948719 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee63 expref: 20 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.181811:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a507f800/0x48868a4e43948720 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1306624->1351679] (req 1306624->1351679) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee71 expref: 20 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.181819:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a507f800, rc 0) 00000100:00100000:3.0:1746129745.181889:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:28431:x1830949052043904:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 190us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129745.181894:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10515 00000100:00100000:0.0:1746129745.184200:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.184296:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.184387:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053243136:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129745.184417:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bd9c800/0x48868a4e43948719 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee63 expref: 19 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.184430:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bd9c800, rc 0) 00000100:00100000:1.0:1746129745.184462:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:28428:x1830949052043648:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5945us (6410us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.184470:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10514 00000100:00100000:1.0:1746129745.184489:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052043776 00000100:00100000:1.0:1746129745.184494:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052043776 00000100:00100000:1.0:1746129745.184529:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10516 00000100:00100000:1.0:1746129745.184536:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28424:x1830949052043776:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129745.184547:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129745.184558:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091f56600/0x48868a4e43948727 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ee6a expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.184574:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129745.184578:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a507f800/0x48868a4e43948720 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1306624->1351679] (req 1306624->1351679) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee71 expref: 18 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.184584:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746129745.184586:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091f56600/0x48868a4e43948727 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee6a expref: 14 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.184608:0:3623:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a507f800/0x48868a4e43948720 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1306624->1351679] (req 1306624->1351679) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee71 expref: 18 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.184617:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091f56600/0x48868a4e43948727 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee6a expref: 14 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.184623:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091f56600, rc 0) 00000100:00100000:1.0:1746129745.184637:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28424:x1830949052043776:12345-192.168.204.31@tcp:101:cat.0 Request processed in 102us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.184641:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10516 00000100:00100000:3.0:1746129745.184774:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052044032 00000100:00100000:3.0:1746129745.184777:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052044032 00010000:00010000:3.0:1746129745.184794:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f5c600/0x48868a4e43948583 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed67 expref: 13 pid: 20441 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746129745.184812:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5054 00000100:00100000:3.0:1746129745.184816:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+13:1961:x1830949052044032:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129745.184823:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129745.184876:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4f5c600/0x48868a4e43948583 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed67 expref: 13 pid: 20441 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746129745.184890:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4f5c600/0x48868a4e43948583 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed67 expref: 13 pid: 20441 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746129745.184904:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f5c600/0x48868a4e43948583 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ed67 expref: 13 pid: 20441 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746129745.184920:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129745.184922:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129745.184927:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bd9c800/0x48868a4e43948719 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee63 expref: 18 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.184933:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bd9c800/0x48868a4e43948719 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee63 expref: 18 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.184952:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bd9c800/0x48868a4e43948719 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee63 expref: 18 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.184961:0:16449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bd9c800/0x48868a4e43948719 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee63 expref: 18 pid: 3623 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746129745.184970:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053243520:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129745.185306:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803540 going to sleep for 11 seconds 00000100:00100000:3.0:1746129745.187190:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd47b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053243520:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129745.187206:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129745.187230:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949052044032:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2413us (2934us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129745.187238:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5054 00000100:00100000:0.0:1746129745.192008:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.192110:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052044288 00000100:00100000:3.0:1746129745.192116:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052044288 00002000:00100000:3.0:1746129745.192150:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880130506d80 x1830949052044288/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.192159:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130506d80 with x1830949052044288 ext(1048576->2097151) 00010000:00010000:3.0:1746129745.192166:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bd9c800/0x48868a4e43948719 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee63 expref: 19 pid: 3623 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746129745.192178:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bd9c800/0x48868a4e43948719 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee63 expref: 19 pid: 3623 timeout: 791 lvb_type: 0 00002000:00010000:3.0:1746129745.192185:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130506d80 00000100:00100000:3.0:1746129745.192326:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 537 00000100:00100000:3.0:1746129745.192333:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949052044288:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129745.205439:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949052044288:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 13098us (13584us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129745.205449:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 537 00002000:00100000:3.0:1746129745.205459:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880130506d80 x1830949052044288/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/440 e 0 to 0 dl 1746129756 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.205467:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130506d80 with x1830949052044288 ext(1048576->2097151) 00010000:00010000:3.0:1746129745.205476:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bd9c800/0x48868a4e43948719 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee63 expref: 19 pid: 3623 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746129745.205492:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bd9c800/0x48868a4e43948719 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee63 expref: 19 pid: 3623 timeout: 791 lvb_type: 0 00002000:00010000:3.0:1746129745.205498:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130506d80 00000100:00100000:0.0:1746129745.210644:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.213279:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052044416 00000100:00100000:2.0:1746129745.213290:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052044416 00000100:00100000:2.0:1746129745.213336:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10517 00000100:00100000:2.0:1746129745.213344:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:28428:x1830949052044416:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129745.213359:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129745.213374:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5283a00/0x48868a4e4394872e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ee78 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.213399:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363ce000/0x48868a4e439484f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb8 expref: 13 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.213405:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129745.213406:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129745.213409:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5283a00/0x48868a4e4394872e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee78 expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.213433:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801363ce000/0x48868a4e439484f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb8 expref: 13 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.213443:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801363ce000/0x48868a4e439484f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb8 expref: 13 pid: 4589 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746129745.213453:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053243648:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129745.214583:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129745.215081:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.215205:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052044544 00000100:00100000:3.0:1746129745.215210:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052044544 00010000:00010000:3.0:1746129745.215232:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bd9c800/0x48868a4e43948719 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee63 expref: 19 pid: 3623 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746129745.215249:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5055 00000100:00100000:3.0:1746129745.215254:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949052044544:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129745.215263:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129745.215277:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bd9c800/0x48868a4e43948719 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee63 expref: 19 pid: 3623 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746129745.215286:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bd9c800/0x48868a4e43948719 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee63 expref: 19 pid: 3623 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746129745.215302:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bd9c800/0x48868a4e43948719 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee63 expref: 19 pid: 3623 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746129745.215322:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129745.215324:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129745.215329:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a507f800/0x48868a4e43948720 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1306624->1351679) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee71 expref: 18 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.215340:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a507f800/0x48868a4e43948720 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1306624->1351679) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee71 expref: 18 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.215360:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a507f800/0x48868a4e43948720 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1306624->1351679) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee71 expref: 18 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.215367:0:16449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a507f800/0x48868a4e43948720 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1306624->1351679) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee71 expref: 18 pid: 10930 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746129745.215374:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053243776:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129745.216391:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129745.220913:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.221138:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052044672 00000100:00100000:1.0:1746129745.221144:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052044672 00010000:00010000:1.0:1746129745.221171:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801363ce000/0x48868a4e439484f0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb8 expref: 14 pid: 4589 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746129745.221196:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5056 00000100:00100000:1.0:1746129745.221203:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+14:1962:x1830949052044672:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129745.221217:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129745.221235:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801363ce000/0x48868a4e439484f0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb8 expref: 14 pid: 4589 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746129745.221305:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053243648:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129745.221327:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5283a00/0x48868a4e4394872e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee78 expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.221339:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5283a00, rc 0) 00000100:00100000:3.0:1746129745.221375:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:28428:x1830949052044416:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8032us (10738us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129745.221381:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10517 00000100:00100000:2.0:1746129745.221464:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd47b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053243776:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129745.221478:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129745.221495:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1962:x1830949052044544:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6240us (6417us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129745.221501:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5055 00010000:00010000:1.0:1746129745.221712:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801363ce000/0x48868a4e439484f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb8 expref: 14 pid: 4589 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.221729:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363ce000/0x48868a4e439484f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb8 expref: 14 pid: 4589 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.221741:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.221743:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.221748:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5283a00/0x48868a4e4394872e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee78 expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.221755:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5283a00/0x48868a4e4394872e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee78 expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.221779:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5283a00/0x48868a4e4394872e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee78 expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129745.221790:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053243904:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129745.221825:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129745.222065:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.222164:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052044928 00000100:00100000:3.0:1746129745.222168:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052044928 00002000:00100000:3.0:1746129745.222191:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1306624->1310719) req@ffff880130507800 x1830949052044928/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.222199:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130507800 with x1830949052044928 ext(1306624->1310719) 00010000:00010000:3.0:1746129745.222205:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a507f800/0x48868a4e43948720 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1351679) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee71 expref: 18 pid: 10930 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746129745.222214:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a507f800/0x48868a4e43948720 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1351679) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee71 expref: 18 pid: 10930 timeout: 791 lvb_type: 0 00002000:00010000:3.0:1746129745.222220:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130507800 00000100:00100000:3.0:1746129745.222238:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 538 00000100:00100000:3.0:1746129745.222244:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1963:x1830949052044928:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129745.222360:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1963:x1830949052044928:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 115us (295us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129745.222366:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 538 00002000:00100000:3.0:1746129745.222371:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1306624->1310719) req@ffff880130507800 x1830949052044928/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/4536 e 0 to 0 dl 1746129756 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.222377:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130507800 with x1830949052044928 ext(1306624->1310719) 00010000:00010000:3.0:1746129745.222381:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a507f800/0x48868a4e43948720 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1351679) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee71 expref: 18 pid: 10930 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746129745.222389:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a507f800/0x48868a4e43948720 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1351679) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee71 expref: 18 pid: 10930 timeout: 791 lvb_type: 0 00002000:00010000:3.0:1746129745.222394:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130507800 00000100:00100000:0.0:1746129745.228352:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.229633:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053243904:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129745.229649:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129745.229698:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949052044672:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8494us (8792us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.229708:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5056 00000100:00100000:2.0:1746129745.230044:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052045184 00000100:00100000:2.0:1746129745.230049:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052045184 00002000:00100000:2.0:1746129745.230077:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1347584->1351679) req@ffff880130507b80 x1830949052045184/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.230091:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130507b80 with x1830949052045184 ext(1347584->1351679) 00010000:00010000:2.0:1746129745.230098:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a507f800/0x48868a4e43948720 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1351679) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee71 expref: 18 pid: 10930 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746129745.230108:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a507f800/0x48868a4e43948720 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1351679) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee71 expref: 18 pid: 10930 timeout: 791 lvb_type: 0 00002000:00010000:2.0:1746129745.230114:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130507b80 00000100:00100000:2.0:1746129745.230253:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 539 00000100:00100000:2.0:1746129745.230260:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1963:x1830949052045184:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129745.230381:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1963:x1830949052045184:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 121us (2037us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129745.230387:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 539 00002000:00100000:2.0:1746129745.230392:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1347584->1351679) req@ffff880130507b80 x1830949052045184/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/4536 e 0 to 0 dl 1746129756 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.230399:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130507b80 with x1830949052045184 ext(1347584->1351679) 00010000:00010000:2.0:1746129745.230403:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a507f800/0x48868a4e43948720 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1351679) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee71 expref: 18 pid: 10930 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746129745.230412:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a507f800/0x48868a4e43948720 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1351679) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee71 expref: 18 pid: 10930 timeout: 791 lvb_type: 0 00002000:00010000:2.0:1746129745.230418:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130507b80 00000100:00100000:0.0:1746129745.232265:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.232332:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052045440 00000100:00100000:3.0:1746129745.232337:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052045440 00002000:00100000:3.0:1746129745.232363:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880130506680 x1830949052045440/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.232375:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130506680 with x1830949052045440 ext(1048576->2097151) 00002000:00010000:3.0:1746129745.232378:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130506680 00000100:00100000:3.0:1746129745.232694:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3875 00000100:00100000:3.0:1746129745.232701:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052045440:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129745.233907:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.234174:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052045696 00000100:00100000:2.0:1746129745.234180:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052045696 00002000:00100000:2.0:1746129745.234205:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1306624->1351679) req@ffff880130505500 x1830949052045696/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.234213:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130505500 with x1830949052045696 ext(1306624->1351679) 00010000:00010000:2.0:1746129745.234219:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a507f800/0x48868a4e43948720 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1351679) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee71 expref: 18 pid: 10930 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746129745.234230:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a507f800/0x48868a4e43948720 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1351679) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee71 expref: 18 pid: 10930 timeout: 791 lvb_type: 0 00002000:00010000:2.0:1746129745.234235:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130505500 00000100:00100000:2.0:1746129745.234249:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 540 00000100:00100000:2.0:1746129745.234256:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949052045696:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:0.0:1746129745.235593:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.236665:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052045952 00000100:00100000:2.0:1746129745.236673:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052045952 00000100:00100000:2.0:1746129745.236716:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3823 00000100:00100000:2.0:1746129745.236722:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:28431:x1830949052045952:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129745.236912:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:28431:x1830949052045952:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 188us (1320us total) trans 8589943553 rc 0/0 00000100:00100000:2.0:1746129745.236918:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3823 00000100:00100000:3.0:1746129745.245746:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052045440:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 13036us (13477us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129745.245757:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3875 00002000:00100000:3.0:1746129745.245766:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880130506680 x1830949052045440/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/440 e 0 to 0 dl 1746129756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.245775:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130506680 with x1830949052045440 ext(1048576->2097151) 00002000:00010000:3.0:1746129745.245780:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130506680 00000100:00100000:2.0:1746129745.246476:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949052045696:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 12220us (12570us total) trans 21474840200 rc 0/0 00000100:00100000:2.0:1746129745.246484:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 540 00002000:00100000:2.0:1746129745.246489:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1306624->1351679) req@ffff880130505500 x1830949052045696/t21474840200(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/448 e 0 to 0 dl 1746129756 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.246501:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130505500 with x1830949052045696 ext(1306624->1351679) 00010000:00010000:2.0:1746129745.246507:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a507f800/0x48868a4e43948720 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1351679) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee71 expref: 20 pid: 10930 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746129745.246528:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a507f800/0x48868a4e43948720 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1351679) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee71 expref: 20 pid: 10930 timeout: 791 lvb_type: 0 00002000:00010000:2.0:1746129745.246534:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130505500 00000100:00100000:0.0:1746129745.252148:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.252326:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052046080 00000100:00100000:1.0:1746129745.252334:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052046080 00010000:00010000:1.0:1746129745.252363:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a507f800/0x48868a4e43948720 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1351679) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee71 expref: 20 pid: 10930 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746129745.252400:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5057 00000100:00100000:1.0:1746129745.252407:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949052046080:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129745.252420:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746129745.252436:0:7107:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129744 -> 1746129745 00010000:00010000:1.0:1746129745.252496:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a507f800/0x48868a4e43948720 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1306624->1351679) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee71 expref: 20 pid: 10930 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.252507:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a507f800/0x48868a4e43948720 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1306624->1351679) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee71 expref: 20 pid: 10930 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.252534:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a507f800/0x48868a4e43948720 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1306624->1351679) gid 0 flags: 0x44801000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee71 expref: 20 pid: 10930 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.252561:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.252563:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.252569:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091f56600/0x48868a4e43948727 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee6a expref: 13 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.252575:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091f56600/0x48868a4e43948727 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee6a expref: 13 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.252607:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091f56600/0x48868a4e43948727 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee6a expref: 13 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129745.252618:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053244032:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129745.252690:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129745.255837:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.256415:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.256615:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.256647:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052046208 00000100:00100000:0.0:1746129745.256654:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052046208 00000100:00100000:0.0:1746129745.256696:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052046336 00000100:00100000:0.0:1746129745.256698:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052046336 00000100:00100000:1.0:1746129745.256874:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053244032:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129745.256890:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129745.256925:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949052046080:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4518us (4785us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.256932:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5057 00000100:00100000:0.0:1746129745.257215:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052046464 00000100:00100000:0.0:1746129745.257219:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052046464 00000100:00100000:2.0:1746129745.257299:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10518 00000100:00100000:2.0:1746129745.257307:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1963:x1830949052046208:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129745.257321:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129745.257335:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43948735 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ee7f expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.257353:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129745.257355:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129745.257373:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43948735 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee7f expref: 21 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129745.257387:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43948735 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee7f expref: 21 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129745.257395:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5283600, rc 0) 00000100:00100000:2.0:1746129745.257414:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949052046208:12345-192.168.204.31@tcp:101:cat.0 Request processed in 109us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129745.257419:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10518 00000100:00100000:2.0:1746129745.257431:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10519 00000100:00100000:2.0:1746129745.257435:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949052046336:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129745.257441:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129745.257448:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5282a00/0x48868a4e4394873c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ee86 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129745.257480:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053244160:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129745.257526:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129745.257547:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10520 00000100:00100000:2.0:1746129745.257553:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1963:x1830949052046464:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129745.257559:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129745.257565:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5283200/0x48868a4e43948743 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ee8d expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129745.257585:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053244288:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129745.257606:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129745.258433:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.259255:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052046720 00000100:00100000:2.0:1746129745.259260:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052046720 00002000:00100000:2.0:1746129745.259287:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880130505180 x1830949052046720/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.259295:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130505180 with x1830949052046720 ext(1048576->2097151) 00002000:00010000:2.0:1746129745.259298:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130505180 00000100:00100000:2.0:1746129745.259982:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3876 00000100:00100000:2.0:1746129745.259989:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949052046720:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129745.268998:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053244288:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129745.269028:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5283200/0x48868a4e43948743 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee8d expref: 21 pid: 1140 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129745.269036:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053244160:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129745.269040:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5283200/0x48868a4e43948743 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee8d expref: 21 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129745.269051:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5282a00/0x48868a4e4394873c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee86 expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129745.269053:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5283200, rc 0) 00010000:00010000:2.0:1746129745.269059:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5282a00/0x48868a4e4394873c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee86 expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129745.269067:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5282a00, rc 0) 00000100:00100000:3.0:1746129745.269102:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1963:x1830949052046464:12345-192.168.204.31@tcp:101:cat.0 Request processed in 11548us (12486us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129745.269102:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949052046336:12345-192.168.204.31@tcp:101:cat.0 Request processed in 11665us (12686us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129745.269109:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10520 00000100:00100000:2.0:1746129745.269111:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10519 00000100:00100000:2.0:1746129745.269814:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949052046720:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 9825us (11381us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129745.269821:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3876 00002000:00100000:2.0:1746129745.269828:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880130505180 x1830949052046720/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/440 e 0 to 0 dl 1746129756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.269836:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130505180 with x1830949052046720 ext(1048576->2097151) 00002000:00010000:2.0:1746129745.269839:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130505180 00000100:00100000:0.0:1746129745.271487:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.271647:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052046848 00000100:00100000:3.0:1746129745.271654:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052046848 00000100:00100000:3.0:1746129745.271701:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10521 00000100:00100000:3.0:1746129745.271708:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:28428:x1830949052046848:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129745.271723:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129745.271737:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a507fa00/0x48868a4e4394874a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ee94 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.271760:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a15800/0x48868a4e439485fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edc2 expref: 12 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.271767:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129745.271769:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129745.271773:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a507fa00/0x48868a4e4394874a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee94 expref: 22 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.271797:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a15800/0x48868a4e439485fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edc2 expref: 12 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.271807:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a15800/0x48868a4e439485fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edc2 expref: 12 pid: 3624 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746129745.271819:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053244416:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129745.271915:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129745.273101:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053244416:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129745.273133:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a507fa00/0x48868a4e4394874a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee94 expref: 22 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.273147:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a507fa00, rc 0) 00000100:00100000:3.0:1746129745.273174:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:28428:x1830949052046848:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1466us (1691us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129745.273180:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10521 00000100:00100000:0.0:1746129745.274308:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.274446:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.274522:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052046976 00000100:00100000:1.0:1746129745.274527:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052046976 00010000:00010000:1.0:1746129745.274552:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a15800/0x48868a4e439485fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edc2 expref: 13 pid: 3624 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746129745.275294:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052047104 00000100:00100000:3.0:1746129745.275299:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052047104 00000100:00100000:3.0:1746129745.275321:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10522 00000100:00100000:3.0:1746129745.275328:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28424:x1830949052047104:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129745.275340:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129745.275352:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e43948751 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ee9b expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.275370:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129745.275371:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129745.275377:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e43948751 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee9b expref: 11 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.275389:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e43948751 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee9b expref: 11 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.275396:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5283400, rc 0) 00000100:00100000:3.0:1746129745.275432:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28424:x1830949052047104:12345-192.168.204.31@tcp:101:cat.0 Request processed in 105us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129745.275437:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10522 00000100:00100000:1.0:1746129745.275731:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5058 00000100:00100000:1.0:1746129745.275738:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+13:1961:x1830949052046976:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129745.275746:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129745.275764:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a15800/0x48868a4e439485fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edc2 expref: 13 pid: 3624 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.275773:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a15800/0x48868a4e439485fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edc2 expref: 13 pid: 3624 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.275790:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a15800/0x48868a4e439485fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34edc2 expref: 13 pid: 3624 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.275802:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.275804:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.275808:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a507fa00/0x48868a4e4394874a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee94 expref: 21 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.275815:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a507fa00/0x48868a4e4394874a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee94 expref: 21 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.275837:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a507fa00/0x48868a4e4394874a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee94 expref: 21 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129745.275861:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053244544:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129745.275902:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129745.280443:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.280533:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053244544:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129745.280549:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129745.281161:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949052046976:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5421us (6853us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.281169:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5058 00000100:00100000:0.0:1746129745.281350:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.281685:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052047360 00000100:00100000:2.0:1746129745.281691:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052047360 00002000:00100000:2.0:1746129745.281722:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880092adad80 x1830949052047360/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.281731:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092adad80 with x1830949052047360 ext(2097152->3145727) 00002000:00010000:2.0:1746129745.281735:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092adad80 00000100:00100000:2.0:1746129745.281747:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052047616 00000100:00100000:2.0:1746129745.281749:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052047616 00002000:00100000:2.0:1746129745.281760:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880093288700 x1830949052047616/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.281766:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288700 with x1830949052047616 ext(1048576->2097151) 00002000:00010000:2.0:1746129745.281769:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093288700 00000100:00100000:0.0:1746129745.281773:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3877 00000100:00100000:0.0:1746129745.281781:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949052047360:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129745.281789:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3878 00000100:00100000:2.0:1746129745.281793:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052047616:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129745.305595:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.305633:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052047872 00000100:00100000:0.0:1746129745.305639:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052047872 00000100:00100000:0.0:1746129745.305683:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9784 00000100:00100000:0.0:1746129745.305689:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28435:x1830949052047872:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129745.305707:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129745.305719:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d600/0x48868a4e43948758 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eea2 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.305799:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0ca00/0x48868a4e4394875f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.305809:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0ca00/0x48868a4e4394875f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.305817:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0ca00/0x48868a4e4394875f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.305826:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d000/0x48868a4e43948766 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.305831:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d000/0x48868a4e43948766 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.305835:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d000/0x48868a4e43948766 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.305931:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859a00/0x48868a4e4394876d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.305937:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859a00/0x48868a4e4394876d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.305942:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859a00/0x48868a4e4394876d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:0.0:1746129745.305948:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129745.306008:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0ca00/0x48868a4e4394875f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.306013:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0ca00/0x48868a4e4394875f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.306020:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0ca00/0x48868a4e4394875f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.306025:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a0ca00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129745.306028:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0ca00/0x48868a4e4394875f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.306033:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0ca00/0x48868a4e4394875f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.306041:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:0.0:1746129745.306043:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746129745.306045:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052047616:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 24251us (24695us total) trans 0 rc 1048576/1048576 00010000:00010000:0.0:1746129745.306046:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0ca00/0x48868a4e4394875f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.306050:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0ca00/0x48868a4e4394875f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00000100:00100000:2.0:1746129745.306053:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3878 00002000:00100000:2.0:1746129745.306061:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880093288700 x1830949052047616/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/440 e 0 to 0 dl 1746129756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00010000:00010000:0.0:1746129745.306062:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d000/0x48868a4e43948766 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.306067:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d000/0x48868a4e43948766 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00002000:00100000:2.0:1746129745.306069:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288700 with x1830949052047616 ext(1048576->2097151) 00010000:00010000:0.0:1746129745.306071:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d000/0x48868a4e43948766 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00002000:00010000:2.0:1746129745.306072:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093288700 00010000:00010000:0.0:1746129745.306074:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a0d000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129745.306076:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d000/0x48868a4e43948766 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.306079:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d000/0x48868a4e43948766 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.306088:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012bfca000) 00010000:00010000:0.0:1746129745.306090:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129745.306091:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d000/0x48868a4e43948766 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.306095:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d000/0x48868a4e43948766 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129745.306120:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d600/0x48868a4e43948758 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eea2 expref: 16 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.306129:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859a00/0x48868a4e4394876d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eea2 expref: 15 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.306135:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129745.306137:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746129745.306139:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f859a00, rc 0) 00000100:00100000:0.0:1746129745.306156:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28435:x1830949052047872:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 467us (568us total) trans 8589943554 rc 0/0 00000100:00100000:0.0:1746129745.306160:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9784 00000100:00100000:2.0:1746129745.309665:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.309763:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052048128 00000100:00100000:1.0:1746129745.309770:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052048128 00000100:00100000:1.0:1746129745.309803:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3824 00000100:00100000:1.0:1746129745.309809:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28435:x1830949052048128:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129745.310002:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28435:x1830949052048128:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 192us (342us total) trans 8589943555 rc 0/0 00000100:00100000:1.0:1746129745.310008:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3824 00000100:00100000:1.0:1746129745.312019:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949052047360:12345-192.168.204.31@tcp:3:cat.0 Request processed in 30233us (31577us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129745.312027:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3877 00002000:00100000:1.0:1746129745.312035:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880092adad80 x1830949052047360/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/440 e 0 to 0 dl 1746129756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129745.312043:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092adad80 with x1830949052047360 ext(2097152->3145727) 00002000:00010000:1.0:1746129745.312047:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092adad80 00000100:00100000:0.0:1746129745.314693:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.314782:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052048256 00000100:00100000:3.0:1746129745.314789:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052048256 00000100:00100000:3.0:1746129745.314820:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10523 00000100:00100000:3.0:1746129745.314825:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28424:x1830949052048256:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129745.314840:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129745.314872:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800932d1600/0x48868a4e4394877b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eea9 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.314899:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129745.314900:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129745.314906:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d1600/0x48868a4e4394877b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eea9 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.314917:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800932d1600/0x48868a4e4394877b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eea9 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.314930:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d1600, rc 0) 00000100:00100000:3.0:1746129745.314975:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28424:x1830949052048256:12345-192.168.204.31@tcp:101:cat.0 Request processed in 149us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129745.314980:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10523 00000100:00100000:3.0:1746129745.323675:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.329571:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052048384 00000100:00100000:1.0:1746129745.329582:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052048384 00000100:00100000:1.0:1746129745.329629:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10524 00000100:00100000:1.0:1746129745.329636:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:28428:x1830949052048384:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129745.329650:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129745.329665:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091f56c00/0x48868a4e43948782 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eeb0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.329690:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e439486e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3506175) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee47 expref: 13 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.329696:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129745.329697:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129745.329700:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091f56c00/0x48868a4e43948782 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeb0 expref: 21 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.329734:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e439486e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3506175) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee47 expref: 13 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.329744:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e439486e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3506175) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee47 expref: 13 pid: 3623 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746129745.329755:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053244672:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129745.329829:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129745.330294:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.330332:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.330388:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052048640 00000100:00100000:1.0:1746129745.330391:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052048640 00002000:00100000:1.0:1746129745.330416:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009328a300 x1830949052048640/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129745.330423:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328a300 with x1830949052048640 ext(2097152->3145727) 00002000:00010000:1.0:1746129745.330427:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009328a300 00000100:00100000:3.0:1746129745.332029:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052049024 00000100:00100000:3.0:1746129745.332036:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052049024 00002000:00100000:3.0:1746129745.332065:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009328bb80 x1830949052049024/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.332073:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328bb80 with x1830949052049024 ext(3145728->4194303) 00002000:00010000:3.0:1746129745.332077:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009328bb80 00000100:00100000:3.0:1746129745.332095:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3879 00000100:00100000:3.0:1746129745.332102:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949052048640:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129745.334032:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3880 00000100:00100000:3.0:1746129745.334041:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052049024:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129745.334764:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.334824:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.334885:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053244672:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129745.334906:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091f56c00/0x48868a4e43948782 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeb0 expref: 21 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.334922:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091f56c00, rc 0) 00000100:00100000:0.0:1746129745.334954:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:28428:x1830949052048384:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5319us (11288us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129745.334964:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10524 00000100:00100000:2.0:1746129745.335698:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052049152 00000100:00100000:2.0:1746129745.335705:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052049152 00002000:00100000:2.0:1746129745.335731:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880093289c00 x1830949052049152/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.335738:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289c00 with x1830949052049152 ext(2097152->3145727) 00010000:00010000:2.0:1746129745.335744:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e439486e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee47 expref: 14 pid: 3623 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746129745.335755:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e439486e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee47 expref: 14 pid: 3623 timeout: 791 lvb_type: 0 00002000:00010000:2.0:1746129745.335764:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093289c00 00000100:00100000:2.0:1746129745.335775:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052049408 00000100:00100000:2.0:1746129745.335777:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052049408 00002000:00100000:2.0:1746129745.335784:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880093288380 x1830949052049408/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 504/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.335790:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288380 with x1830949052049408 ext(3145728->4194303) 00010000:00010000:2.0:1746129745.335793:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e439486e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee47 expref: 15 pid: 3623 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746129745.335799:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e439486e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee47 expref: 15 pid: 3623 timeout: 791 lvb_type: 0 00002000:00010000:2.0:1746129745.335803:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093288380 00000100:00100000:2.0:1746129745.335810:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 541 00000100:00100000:2.0:1746129745.335821:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 542 00000100:00100000:2.0:1746129745.335825:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949052049408:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129745.336897:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052049152:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129745.341430:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.341991:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052049536 00000100:00100000:1.0:1746129745.341998:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052049536 00002000:00100000:1.0:1746129745.342026:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3444736->3506175) req@ffff88009328ad80 x1830949052049536/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129745.342035:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328ad80 with x1830949052049536 ext(3444736->3506175) 00010000:00010000:1.0:1746129745.342042:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e439486e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee47 expref: 18 pid: 3623 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.342054:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e439486e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee47 expref: 18 pid: 3623 timeout: 791 lvb_type: 0 00002000:00010000:1.0:1746129745.342065:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009328ad80 00000100:00100000:1.0:1746129745.342095:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 543 00000100:00100000:1.0:1746129745.342102:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949052049536:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129745.351076:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949052049536:12345-192.168.204.31@tcp:4:cat.0 Request processed in 8965us (9645us total) trans 21474840201 rc 0/0 00000100:00100000:1.0:1746129745.351086:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 543 00002000:00100000:1.0:1746129745.351095:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3444736->3506175) req@ffff88009328ad80 x1830949052049536/t21474840201(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/448 e 0 to 0 dl 1746129756 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129745.351104:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328ad80 with x1830949052049536 ext(3444736->3506175) 00010000:00010000:1.0:1746129745.351113:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e439486e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee47 expref: 20 pid: 3623 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.351127:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e439486e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee47 expref: 20 pid: 3623 timeout: 791 lvb_type: 0 00002000:00010000:1.0:1746129745.351133:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009328ad80 00000100:00100000:3.0:1746129745.351719:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949052048640:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19614us (21423us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129745.351727:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3879 00002000:00100000:3.0:1746129745.351732:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009328a300 x1830949052048640/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/440 e 0 to 0 dl 1746129756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.351739:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328a300 with x1830949052048640 ext(2097152->3145727) 00002000:00010000:3.0:1746129745.351743:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009328a300 00000100:00100000:2.0:1746129745.358467:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052049408:12345-192.168.204.31@tcp:3:cat.0 Request processed in 22630us (23631us total) trans 0 rc 987136/987136 00000100:00100000:2.0:1746129745.358479:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 542 00002000:00100000:2.0:1746129745.358490:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880093288380 x1830949052049408/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 504/440 e 0 to 0 dl 1746129756 ref 1 fl Complete:H/200/0 rc 987136/987136 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.358498:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288380 with x1830949052049408 ext(3145728->4194303) 00010000:00010000:2.0:1746129745.358508:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e439486e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee47 expref: 18 pid: 3623 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746129745.358529:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e439486e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee47 expref: 18 pid: 3623 timeout: 791 lvb_type: 0 00002000:00010000:2.0:1746129745.358535:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093288380 00000100:00100000:2.0:1746129745.362101:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052049152:12345-192.168.204.31@tcp:3:cat.0 Request processed in 26274us (27327us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129745.362112:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 541 00002000:00100000:2.0:1746129745.362121:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880093289c00 x1830949052049152/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/440 e 0 to 0 dl 1746129756 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.362129:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289c00 with x1830949052049152 ext(2097152->3145727) 00010000:00010000:2.0:1746129745.362138:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e439486e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee47 expref: 16 pid: 3623 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746129745.362150:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e439486e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee47 expref: 16 pid: 3623 timeout: 791 lvb_type: 0 00002000:00010000:2.0:1746129745.362156:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093289c00 00000100:00100000:0.0:1746129745.365623:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.366818:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052049664 00000100:00100000:2.0:1746129745.366827:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052049664 00000100:00100000:2.0:1746129745.366983:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10525 00000100:00100000:2.0:1746129745.366990:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28424:x1830949052049664:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129745.367005:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129745.367052:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801356e3400/0x48868a4e43948789 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eeb7 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.367076:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129745.367081:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801356e3400/0x48868a4e43948789 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeb7 expref: 17 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.367091:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801356e3400/0x48868a4e43948789 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeb7 expref: 17 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.367100:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356e3400, rc 0) 00000100:00100000:3.0:1746129745.367151:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28424:x1830949052049664:12345-192.168.204.31@tcp:101:cat.0 Request processed in 161us (1535us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129745.367156:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10525 00000100:00100000:2.0:1746129745.372533:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052049024:12345-192.168.204.31@tcp:3:cat.0 Request processed in 38475us (42181us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129745.372544:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3880 00002000:00100000:2.0:1746129745.372552:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009328bb80 x1830949052049024/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/440 e 0 to 0 dl 1746129756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.372561:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328bb80 with x1830949052049024 ext(3145728->4194303) 00002000:00010000:2.0:1746129745.372565:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009328bb80 00000100:00100000:0.0:1746129745.378897:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.379034:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052049792 00000100:00100000:1.0:1746129745.379042:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052049792 00010000:00010000:1.0:1746129745.379073:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e439486e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3444736->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee47 expref: 17 pid: 3623 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746129745.379113:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5059 00000100:00100000:1.0:1746129745.379121:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1963:x1830949052049792:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129745.379134:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129745.379152:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e439486e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3444736->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee47 expref: 17 pid: 3623 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.379163:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e439486e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3444736->3506175) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee47 expref: 17 pid: 3623 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.379180:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e439486e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3444736->3506175) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee47 expref: 17 pid: 3623 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.379196:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.379198:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.379203:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091f56c00/0x48868a4e43948782 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeb0 expref: 20 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.379209:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091f56c00/0x48868a4e43948782 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeb0 expref: 20 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.379216:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.379217:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.379219:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801356e3400/0x48868a4e43948789 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeb7 expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.379225:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801356e3400/0x48868a4e43948789 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeb7 expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.379250:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801356e3400/0x48868a4e43948789 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeb7 expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129745.379264:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053244800:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129745.379351:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091f56c00/0x48868a4e43948782 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeb0 expref: 20 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129745.379358:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053244928:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129745.379378:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129745.388415:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053244800:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129745.388427:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053244928:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129745.388444:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129745.388491:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1963:x1830949052049792:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 9370us (9601us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.388500:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5059 00000100:00100000:2.0:1746129745.396407:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.396439:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.396451:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.396466:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.396468:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052050560 00000100:00100000:2.0:1746129745.396475:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052050560 00002000:00100000:2.0:1746129745.396511:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880092ada300 x1830949052050560/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.396532:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ada300 with x1830949052050560 ext(2097152->3145727) 00000100:00100000:0.0:1746129745.396532:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00010000:2.0:1746129745.396537:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ada300 00000100:00100000:2.0:1746129745.396550:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052050688 00000100:00100000:2.0:1746129745.396552:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052050688 00002000:00100000:2.0:1746129745.396561:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880092adb800 x1830949052050688/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.396567:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092adb800 with x1830949052050688 ext(3145728->4194303) 00002000:00010000:2.0:1746129745.396569:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092adb800 00000100:00100000:0.0:1746129745.396569:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.396701:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052050176 00000100:00100000:1.0:1746129745.396708:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052050176 00000100:00100000:1.0:1746129745.396745:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9785 00000100:00100000:1.0:1746129745.396754:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:28438:x1830949052050176:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129745.396775:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129745.396792:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5357000/0x48868a4e43948790 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eebe expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.396935:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5356400/0x48868a4e43948797 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.396948:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5356400/0x48868a4e43948797 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.396959:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5356400/0x48868a4e43948797 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.396971:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5357400/0x48868a4e4394879e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.396978:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5357400/0x48868a4e4394879e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.396984:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5357400/0x48868a4e4394879e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.397094:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5356600/0x48868a4e439487a5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.397104:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5356600/0x48868a4e439487a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.397111:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5356600/0x48868a4e439487a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:1.0:1746129745.397120:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129745.397204:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5356400/0x48868a4e43948797 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.397210:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5356400/0x48868a4e43948797 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.397215:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5356400/0x48868a4e43948797 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.397220:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5356400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129745.397223:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5356400/0x48868a4e43948797 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.397228:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5356400/0x48868a4e43948797 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.397238:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129745.397240:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129745.397244:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5356400/0x48868a4e43948797 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.397248:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5356400/0x48868a4e43948797 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.397267:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5357400/0x48868a4e4394879e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.397271:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5357400/0x48868a4e4394879e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.397275:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5357400/0x48868a4e4394879e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.397278:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5357400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129745.397279:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5357400/0x48868a4e4394879e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.397283:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5357400/0x48868a4e4394879e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.397288:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f99bd00) 00010000:00010000:1.0:1746129745.397290:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129745.397292:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5357400/0x48868a4e4394879e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.397295:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5357400/0x48868a4e4394879e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.397328:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5357000/0x48868a4e43948790 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eebe expref: 294 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.397338:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5356600/0x48868a4e439487a5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eebe expref: 293 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.397343:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129745.397344:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129745.397346:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5356600, rc 0) 00000100:00100000:1.0:1746129745.397380:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:28438:x1830949052050176:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 628us (917us total) trans 8589943556 rc 0/0 00000100:00100000:1.0:1746129745.397386:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9785 00000100:00100000:2.0:1746129745.397600:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052051072 00000100:00100000:2.0:1746129745.397604:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052051072 00002000:00100000:2.0:1746129745.397620:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880092ad8000 x1830949052051072/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.397627:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad8000 with x1830949052051072 ext(3145728->4194303) 00002000:00010000:2.0:1746129745.397631:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad8000 00000100:00100000:2.0:1746129745.397646:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052051200 00000100:00100000:2.0:1746129745.397648:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052051200 00002000:00100000:2.0:1746129745.397660:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880093289f80 x1830949052051200/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.397666:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289f80 with x1830949052051200 ext(3145728->4194303) 00002000:00010000:2.0:1746129745.397668:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093289f80 00000100:00100000:2.0:1746129745.397676:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052050944 00000100:00100000:2.0:1746129745.397678:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052050944 00002000:00100000:2.0:1746129745.397685:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009328a680 x1830949052050944/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.397691:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328a680 with x1830949052050944 ext(2097152->3145727) 00002000:00010000:2.0:1746129745.397693:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009328a680 00000100:00100000:2.0:1746129745.397702:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3881 00000100:00100000:2.0:1746129745.397706:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1964:x1830949052050560:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129745.398775:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3882 00000100:00100000:3.0:1746129745.398784:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949052050688:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129745.401511:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3883 00000100:00100000:3.0:1746129745.401537:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052051072:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129745.404296:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3884 00000100:00100000:2.0:1746129745.404308:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1964:x1830949052051200:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129745.404393:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3885 00000100:00100000:3.0:1746129745.404401:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052050944:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129745.406772:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.415662:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052051456 00000100:00100000:1.0:1746129745.415673:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052051456 00000100:00100000:1.0:1746129745.415733:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 556 00000100:00100000:1.0:1746129745.415740:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:1961:x1830949052051456:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129745.415753:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129745.415772:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5356600/0x48868a4e439487a5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eebe expref: 293 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.415788:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129745.415792:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129745.415838:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:1961:x1830949052051456:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 99us (9071us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.415844:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 556 00000100:00100000:3.0:1746129745.421433:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949052050688:12345-192.168.204.31@tcp:3:cat.0 Request processed in 22640us (24982us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129745.421445:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3882 00002000:00100000:3.0:1746129745.421456:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880092adb800 x1830949052050688/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/440 e 0 to 0 dl 1746129756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.421465:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092adb800 with x1830949052050688 ext(3145728->4194303) 00002000:00010000:3.0:1746129745.421470:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092adb800 00000100:00100000:2.0:1746129745.433254:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1964:x1830949052050560:12345-192.168.204.31@tcp:3:cat.0 Request processed in 35539us (36847us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129745.433264:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3881 00002000:00100000:2.0:1746129745.433274:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880092ada300 x1830949052050560/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/440 e 0 to 0 dl 1746129756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.433282:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ada300 with x1830949052050560 ext(2097152->3145727) 00002000:00010000:2.0:1746129745.433288:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ada300 00000100:00100000:3.0:1746129745.440248:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052051072:12345-192.168.204.31@tcp:3:cat.0 Request processed in 38707us (43787us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129745.440258:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3883 00002000:00100000:3.0:1746129745.440266:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880092ad8000 x1830949052051072/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/440 e 0 to 0 dl 1746129756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.440275:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad8000 with x1830949052051072 ext(3145728->4194303) 00002000:00010000:3.0:1746129745.440280:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad8000 00000100:00100000:3.0:1746129745.452815:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052050944:12345-192.168.204.31@tcp:3:cat.0 Request processed in 48408us (56241us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129745.452825:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3885 00002000:00100000:3.0:1746129745.452835:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009328a680 x1830949052050944/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/440 e 0 to 0 dl 1746129756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.452843:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328a680 with x1830949052050944 ext(2097152->3145727) 00002000:00010000:3.0:1746129745.452861:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009328a680 00000100:00100000:2.0:1746129745.454498:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1964:x1830949052051200:12345-192.168.204.31@tcp:3:cat.0 Request processed in 50188us (57961us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129745.454506:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3884 00002000:00100000:2.0:1746129745.454524:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880093289f80 x1830949052051200/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/440 e 0 to 0 dl 1746129756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.454532:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289f80 with x1830949052051200 ext(3145728->4194303) 00002000:00010000:2.0:1746129745.454536:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093289f80 00000100:00100000:0.0:1746129745.462616:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.462664:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.464382:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052051712 00000100:00100000:3.0:1746129745.464391:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052051712 00002000:00100000:3.0:1746129745.464429:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880093288a80 x1830949052051712/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.464438:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288a80 with x1830949052051712 ext(4194304->4964351) 00002000:00010000:3.0:1746129745.464443:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093288a80 00000100:00100000:3.0:1746129745.464461:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052051968 00000100:00100000:3.0:1746129745.464463:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052051968 00002000:00100000:3.0:1746129745.464473:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009328b480 x1830949052051968/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.464479:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328b480 with x1830949052051968 ext(4194304->4964351) 00002000:00010000:3.0:1746129745.464481:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009328b480 00000100:00100000:3.0:1746129745.464490:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3886 00000100:00100000:3.0:1746129745.464495:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052051712:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129745.465911:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3887 00000100:00100000:2.0:1746129745.465920:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949052051968:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129745.485923:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052051712:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21410us (23297us total) trans 0 rc 770048/770048 00000100:00100000:3.0:1746129745.485936:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3886 00002000:00100000:3.0:1746129745.485952:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880093288a80 x1830949052051712/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/440 e 0 to 0 dl 1746129756 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.485961:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288a80 with x1830949052051712 ext(4194304->4964351) 00002000:00010000:3.0:1746129745.485968:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093288a80 00000100:00100000:0.0:1746129745.489376:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.491654:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052052096 00000100:00100000:3.0:1746129745.491668:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052052096 00000100:00100000:3.0:1746129745.491740:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10526 00000100:00100000:3.0:1746129745.491750:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28435:x1830949052052096:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129745.491783:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129745.491806:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b814400/0x48868a4e439487b3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eec5 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.491835:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a39800/0x48868a4e4394867f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee0f expref: 13 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.491844:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5283c00/0x48868a4e439486be lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee24 expref: 23 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129745.491873:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129745.491875:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129745.491879:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b814400/0x48868a4e439487b3 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [925696->1048575] (req 925696->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eec5 expref: 13 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.491911:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5283c00/0x48868a4e439486be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee24 expref: 23 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129745.491923:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5283c00/0x48868a4e439486be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee24 expref: 23 pid: 4589 timeout: 791 lvb_type: 1 00000100:00100000:3.0:1746129745.491935:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053245056:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129745.492072:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a39800/0x48868a4e4394867f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee0f expref: 13 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.492082:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a39800/0x48868a4e4394867f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee0f expref: 13 pid: 4589 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746129745.492090:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053245184:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129745.492116:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129745.494272:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949052051968:12345-192.168.204.31@tcp:3:cat.0 Request processed in 28346us (31599us total) trans 0 rc 770048/770048 00000100:00100000:2.0:1746129745.494284:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3887 00002000:00100000:2.0:1746129745.494295:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009328b480 x1830949052051968/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/440 e 0 to 0 dl 1746129756 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.494303:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328b480 with x1830949052051968 ext(4194304->4964351) 00002000:00010000:2.0:1746129745.494308:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009328b480 00000100:00100000:1.0:1746129745.503990:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.504036:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.504068:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052052480 00000100:00100000:1.0:1746129745.504074:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052052480 00010000:00010000:1.0:1746129745.504104:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a39800/0x48868a4e4394867f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee0f expref: 14 pid: 4589 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746129745.504125:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5060 00000100:00100000:1.0:1746129745.504130:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949052052480:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129745.504141:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129745.504157:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a39800/0x48868a4e4394867f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee0f expref: 14 pid: 4589 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.504165:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a39800/0x48868a4e4394867f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee0f expref: 14 pid: 4589 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.504184:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129745.504215:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949052052480:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 85us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.504220:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5060 00000100:00100000:2.0:1746129745.504324:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052052352 00000100:00100000:2.0:1746129745.504328:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052052352 00000100:00100000:2.0:1746129745.504350:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3825 00000100:00100000:2.0:1746129745.504354:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:28428:x1830949052052352:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129745.504493:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:28428:x1830949052052352:12345-192.168.204.31@tcp:35:cat.0 Request processed in 138us (511us total) trans 8589943557 rc 0/0 00000100:00100000:2.0:1746129745.504499:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3825 00010000:00010000:3.0:1746129745.504844:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a39800/0x48868a4e4394867f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee0f expref: 13 pid: 4589 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746129745.505008:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053245184:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129745.505022:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd47b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053245056:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129745.505053:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b814400/0x48868a4e439487b3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [925696->1048575] (req 925696->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eec5 expref: 12 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.505061:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b814400, rc 0) 00000100:00100000:3.0:1746129745.505629:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28435:x1830949052052096:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 13881us (16258us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129745.505635:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10526 00000100:00100000:1.0:1746129745.507138:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.507598:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052052608 00000100:00100000:2.0:1746129745.507605:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052052608 00010000:00010000:2.0:1746129745.507630:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5283c00/0x48868a4e439486be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee24 expref: 22 pid: 4589 timeout: 791 lvb_type: 1 00000100:00100000:2.0:1746129745.507651:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5061 00000100:00100000:2.0:1746129745.508001:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052052608:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129745.508014:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129745.508035:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5283c00/0x48868a4e439486be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee24 expref: 22 pid: 4589 timeout: 791 lvb_type: 1 00010000:00010000:2.0:1746129745.508046:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5283c00/0x48868a4e439486be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee24 expref: 22 pid: 4589 timeout: 791 lvb_type: 1 00010000:00010000:2.0:1746129745.508066:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5283c00/0x48868a4e439486be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee24 expref: 22 pid: 4589 timeout: 791 lvb_type: 1 00010000:00010000:2.0:1746129745.508083:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129745.508085:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129745.508092:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b814400/0x48868a4e439487b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 925696->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eec5 expref: 11 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.508100:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b814400/0x48868a4e439487b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 925696->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eec5 expref: 11 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.508127:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b814400/0x48868a4e439487b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 925696->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eec5 expref: 11 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129745.508142:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053245312:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129745.508204:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129745.516399:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053245312:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129745.516419:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129745.516465:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052052608:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8467us (9331us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129745.516474:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5061 00000100:00100000:0.0:1746129745.516983:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.518329:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052052864 00000100:00100000:2.0:1746129745.518337:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052052864 00002000:00100000:2.0:1746129745.518370:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e8:0x0] (925696->929791) req@ffff880093289880 x1830949052052864/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.518378:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289880 with x1830949052052864 ext(925696->929791) 00002000:00010000:2.0:1746129745.518383:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093289880 00000100:00100000:2.0:1746129745.518397:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3888 00000100:00100000:2.0:1746129745.518402:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949052052864:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129745.518531:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949052052864:12345-192.168.204.31@tcp:3:cat.0 Request processed in 128us (1548us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129745.518537:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3888 00002000:00100000:2.0:1746129745.518542:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e8:0x0] (925696->929791) req@ffff880093289880 x1830949052052864/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/4536 e 0 to 0 dl 1746129756 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.518549:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289880 with x1830949052052864 ext(925696->929791) 00002000:00010000:2.0:1746129745.518552:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093289880 00000100:00100000:0.0:1746129745.522149:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.522216:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052052992 00000100:00100000:3.0:1746129745.522223:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052052992 00000100:00100000:3.0:1746129745.522268:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10527 00000100:00100000:3.0:1746129745.522275:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:28438:x1830949052052992:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129745.522289:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129745.522303:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b814000/0x48868a4e439487ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eecc expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.522324:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091f56600/0x48868a4e43948727 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee6a expref: 15 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.522331:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43948735 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee7f expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129745.522336:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129745.522337:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129745.522340:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b814000/0x48868a4e439487ba lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1581056->2097151] (req 1581056->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eecc expref: 22 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.522364:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43948735 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee7f expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129745.522374:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43948735 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee7f expref: 22 pid: 8437 timeout: 791 lvb_type: 1 00000100:00100000:3.0:1746129745.522382:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053245440:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129745.522468:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091f56600/0x48868a4e43948727 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee6a expref: 15 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.522475:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091f56600/0x48868a4e43948727 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee6a expref: 15 pid: 3623 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746129745.522482:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053245568:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129745.522500:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129745.524879:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.524928:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.524936:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052053248 00000100:00100000:2.0:1746129745.524943:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052053248 00010000:00010000:2.0:1746129745.524970:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43948735 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee7f expref: 23 pid: 8437 timeout: 791 lvb_type: 1 00000100:00100000:2.0:1746129745.525004:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5062 00000100:00100000:2.0:1746129745.525010:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949052053248:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129745.525022:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129745.525039:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43948735 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee7f expref: 23 pid: 8437 timeout: 791 lvb_type: 1 00010000:00010000:2.0:1746129745.525049:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43948735 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee7f expref: 23 pid: 8437 timeout: 791 lvb_type: 1 00010000:00010000:2.0:1746129745.525068:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129745.525096:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949052053248:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 86us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129745.525101:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5062 00000100:00100000:2.0:1746129745.525122:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052053120 00000100:00100000:2.0:1746129745.525125:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052053120 00000100:00100000:2.0:1746129745.525140:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10528 00000100:00100000:2.0:1746129745.525145:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28435:x1830949052053120:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129745.525155:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129745.525165:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801326ff600/0x48868a4e439487c1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eed3 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.525180:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a507fe00/0x48868a4e439486e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee4e expref: 17 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.525188:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e439486ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee55 expref: 22 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.525194:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129745.525196:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129745.525199:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801326ff600/0x48868a4e439487c1 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->1781759] (req 1048576->1781759) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eed3 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.525218:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e439486ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee55 expref: 22 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.525226:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e439486ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee55 expref: 22 pid: 10930 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746129745.525235:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053245696:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129745.525287:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a507fe00/0x48868a4e439486e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee4e expref: 17 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.525296:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a507fe00/0x48868a4e439486e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee4e expref: 17 pid: 3623 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746129745.525304:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053245824:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129745.525321:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8840 going to sleep for 11 seconds 00010000:00010000:3.0:1746129745.525993:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43948735 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee7f expref: 22 pid: 8437 timeout: 791 lvb_type: 1 00000100:00100000:3.0:1746129745.526017:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd47b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053245440:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129745.526027:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053245568:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129745.526056:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b814000/0x48868a4e439487ba lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1581056->2097151] (req 1581056->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eecc expref: 21 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.526065:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b814000, rc 0) 00000100:00100000:3.0:1746129745.526097:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:28438:x1830949052052992:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3822us (3954us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129745.526104:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10527 00000100:00100000:0.0:1746129745.529278:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.529323:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.529412:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052053376 00000100:00100000:1.0:1746129745.529419:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052053376 00010000:00010000:1.0:1746129745.529446:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091f56600/0x48868a4e43948727 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee6a expref: 18 pid: 3623 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746129745.529467:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052053504 00000100:00100000:1.0:1746129745.529470:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052053504 00010000:00010000:1.0:1746129745.529481:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e439486ef lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee55 expref: 21 pid: 10930 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746129745.529496:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5063 00000100:00100000:1.0:1746129745.529503:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052053376:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129745.529524:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129745.529543:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091f56600/0x48868a4e43948727 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee6a expref: 18 pid: 3623 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.529553:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091f56600/0x48868a4e43948727 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee6a expref: 18 pid: 3623 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.529571:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091f56600/0x48868a4e43948727 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee6a expref: 18 pid: 3623 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.529586:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.529588:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.529594:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b814000/0x48868a4e439487ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eecc expref: 21 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.529600:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b814000/0x48868a4e439487ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eecc expref: 21 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.529627:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b814000/0x48868a4e439487ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eecc expref: 21 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129745.529638:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053245952:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129745.529700:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129745.529780:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053245696:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129745.529790:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053245824:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129745.529816:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801326ff600/0x48868a4e439487c1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->1781759] (req 1048576->1781759) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eed3 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.529824:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801326ff600, rc 0) 00000100:00100000:2.0:1746129745.529844:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28435:x1830949052053120:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4698us (4915us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129745.529869:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10528 00000100:00100000:2.0:1746129745.529960:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5064 00000100:00100000:2.0:1746129745.529966:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052053504:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129745.529973:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129745.529983:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e439486ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee55 expref: 21 pid: 10930 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746129745.529990:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e439486ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee55 expref: 21 pid: 10930 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746129745.530001:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e439486ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee55 expref: 21 pid: 10930 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746129745.530024:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129745.530041:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949052053504:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 75us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129745.530046:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5064 00000100:00100000:0.0:1746129745.530327:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.530339:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052053632 00000100:00100000:0.0:1746129745.530342:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052053632 00010000:00010000:0.0:1746129745.530354:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a507fe00/0x48868a4e439486e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee4e expref: 17 pid: 3623 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746129745.530366:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5065 00000100:00100000:0.0:1746129745.530371:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052053632:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129745.530376:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129745.530383:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a507fe00/0x48868a4e439486e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee4e expref: 17 pid: 3623 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746129745.530389:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a507fe00/0x48868a4e439486e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee4e expref: 17 pid: 3623 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746129745.530399:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a507fe00/0x48868a4e439486e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee4e expref: 17 pid: 3623 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746129745.530408:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129745.530410:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129745.530413:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801326ff600/0x48868a4e439487c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eed3 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.530419:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801326ff600/0x48868a4e439487c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eed3 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.530433:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801326ff600/0x48868a4e439487c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eed3 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129745.530439:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b025f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053246080:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129745.530470:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129745.533652:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b025f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053246080:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129745.533672:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129745.533707:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1961:x1830949052053632:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3334us (3380us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129745.533822:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5065 00000100:00100000:0.0:1746129745.538576:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.539026:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053245952:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129745.539041:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129745.539066:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.539787:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949052053376:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 10280us (10513us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129745.539793:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052053888 00000100:00100000:1.0:1746129745.539797:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5063 00000100:00100000:2.0:1746129745.539800:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052053888 00000100:00100000:3.0:1746129745.539870:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052054144 00000100:00100000:3.0:1746129745.539874:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052054144 00002000:00100000:3.0:1746129745.539896:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e7:0x0] (1581056->1585151) req@ffff88012b025c00 x1830949052054144/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.539905:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b025c00 with x1830949052054144 ext(1581056->1585151) 00002000:00010000:3.0:1746129745.539909:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b025c00 00000100:00100000:3.0:1746129745.539931:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3889 00000100:00100000:3.0:1746129745.539938:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949052054144:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129745.540070:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949052054144:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 133us (1005us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129745.540076:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3889 00002000:00100000:3.0:1746129745.540081:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e7:0x0] (1581056->1585151) req@ffff88012b025c00 x1830949052054144/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/4536 e 0 to 0 dl 1746129756 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.540087:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b025c00 with x1830949052054144 ext(1581056->1585151) 00002000:00010000:3.0:1746129745.540090:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b025c00 00002000:00100000:2.0:1746129745.540500:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e6:0x0] (1777664->1781759) req@ffff88012b025f80 x1830949052053888/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.540508:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b025f80 with x1830949052053888 ext(1777664->1781759) 00002000:00010000:2.0:1746129745.540538:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b025f80 00000100:00100000:2.0:1746129745.540552:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3890 00000100:00100000:2.0:1746129745.540559:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949052053888:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129745.543196:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949052053888:12345-192.168.204.31@tcp:3:cat.0 Request processed in 2629us (4618us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129745.543207:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3890 00002000:00100000:2.0:1746129745.543216:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e6:0x0] (1777664->1781759) req@ffff88012b025f80 x1830949052053888/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/4536 e 0 to 0 dl 1746129756 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.543224:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b025f80 with x1830949052053888 ext(1777664->1781759) 00002000:00010000:2.0:1746129745.543229:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b025f80 00000100:00100000:0.0:1746129745.550077:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.550145:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052054272 00000100:00100000:2.0:1746129745.550154:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052054272 00000100:00100000:2.0:1746129745.553802:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10529 00000100:00100000:2.0:1746129745.553819:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:28438:x1830949052054272:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129745.553837:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129745.553923:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e439487c8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eeda expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.553951:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5283a00/0x48868a4e4394872e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee78 expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.553961:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e43948751 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee9b expref: 11 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.553967:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129745.553969:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129745.553971:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e439487c8 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->1232895] (req 1048576->1232895) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeda expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.553997:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e43948751 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee9b expref: 11 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.554007:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e43948751 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee9b expref: 11 pid: 1140 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746129745.554017:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053246208:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129745.554111:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5283a00/0x48868a4e4394872e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee78 expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.554118:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5283a00/0x48868a4e4394872e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee78 expref: 22 pid: 4589 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746129745.554125:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053246336:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129745.554142:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129745.562347:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.562451:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052054400 00000100:00100000:1.0:1746129745.562459:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052054400 00010000:00010000:1.0:1746129745.562488:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e43948751 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee9b expref: 12 pid: 1140 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746129745.562501:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053246208:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129745.562508:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5066 00000100:00100000:2.0:1746129745.562523:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053246336:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129745.562524:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052054400:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129745.562533:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129745.562550:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e43948751 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee9b expref: 12 pid: 1140 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746129745.562551:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e439487c8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [1048576->1232895] (req 1048576->1232895) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeda expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.562558:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e43948751 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee9b expref: 12 pid: 1140 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746129745.562705:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b534c200, rc 0) 00000100:00100000:2.0:1746129745.562745:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:28438:x1830949052054272:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 8933us (12674us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129745.562751:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10529 00010000:00010000:1.0:1746129745.562963:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e43948751 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee9b expref: 12 pid: 1140 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.562988:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129745.563017:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052054400:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 493us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.563023:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5066 00000100:00100000:0.0:1746129745.565114:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.565687:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052054528 00000100:00100000:1.0:1746129745.565696:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052054528 00010000:00010000:1.0:1746129745.565722:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5283a00/0x48868a4e4394872e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee78 expref: 22 pid: 4589 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746129745.565743:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5067 00000100:00100000:1.0:1746129745.565749:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052054528:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129745.565759:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129745.565776:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5283a00/0x48868a4e4394872e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee78 expref: 22 pid: 4589 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.565785:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5283a00/0x48868a4e4394872e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee78 expref: 22 pid: 4589 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.565801:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5283a00/0x48868a4e4394872e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee78 expref: 22 pid: 4589 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.565813:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.565814:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.565819:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e439487c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeda expref: 21 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.565826:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e439487c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeda expref: 21 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.565871:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e439487c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeda expref: 21 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129745.565882:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053246464:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129745.571352:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129745.577178:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.577704:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053246464:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129745.577732:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129745.577790:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052054528:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 12039us (12682us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.577840:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5067 00000100:00100000:3.0:1746129745.578049:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052054784 00000100:00100000:3.0:1746129745.578055:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052054784 00002000:00100000:3.0:1746129745.578088:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1228800->1232895) req@ffff88009a04ca80 x1830949052054784/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.578097:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04ca80 with x1830949052054784 ext(1228800->1232895) 00002000:00010000:3.0:1746129745.578102:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04ca80 00000100:00100000:3.0:1746129745.578116:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3891 00000100:00100000:3.0:1746129745.578122:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052054784:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129745.578255:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052054784:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 132us (1083us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129745.578260:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3891 00002000:00100000:3.0:1746129745.578265:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1228800->1232895) req@ffff88009a04ca80 x1830949052054784/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/4536 e 0 to 0 dl 1746129756 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.578271:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04ca80 with x1830949052054784 ext(1228800->1232895) 00002000:00010000:3.0:1746129745.578274:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04ca80 00000100:00100000:2.0:1746129745.581153:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.581295:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052055040 00000100:00100000:1.0:1746129745.581320:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052055040 00000100:00100000:1.0:1746129745.581669:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3826 00000100:00100000:1.0:1746129745.581677:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c561050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:28438:x1830949052055040:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129745.581998:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c561050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:28438:x1830949052055040:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 315us (846us total) trans 8589943558 rc 0/0 00000100:00100000:1.0:1746129745.582004:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3826 00000100:00100000:0.0:1746129745.594796:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.594884:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052055168 00000100:00100000:1.0:1746129745.594891:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052055168 00000100:00100000:1.0:1746129745.595371:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9786 00000100:00100000:1.0:1746129745.595378:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:28443:x1830949052055168:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129745.595398:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129745.595413:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29000/0x48868a4e439487cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eee1 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.595470:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29800/0x48868a4e439487d6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129745.595479:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29800/0x48868a4e439487d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129745.595488:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29800/0x48868a4e439487d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129745.595499:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0x48868a4e439487dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129745.595503:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0x48868a4e439487dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129745.595519:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0x48868a4e439487dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129745.595606:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439487e4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129745.595614:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d400/0x48868a4e439486b0 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee1d expref: 15 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.595619:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439487e4 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129745.595643:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d400/0x48868a4e439486b0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee1d expref: 15 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.595652:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d400/0x48868a4e439486b0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee1d expref: 15 pid: 16808 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746129745.595662:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053246592:192.168.204.31@tcp:104: 00000100:00080000:2.0:1746129745.596074:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746129745.597412:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324480 going to sleep for 11 seconds 00000100:00100000:1.0:1746129745.601705:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053246592:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129745.601724:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439487e4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129745.603113:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.603406:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052055424 00000100:00100000:1.0:1746129745.603413:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052055424 00000100:00100000:1.0:1746129745.603459:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3827 00000100:00100000:1.0:1746129745.603466:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:7658:x1830949052055424:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746129745.604112:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:7658:x1830949052055424:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 644us (1267us total) trans 8589943559 rc 0/0 00000100:00100000:1.0:1746129745.604119:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3827 00000100:00100000:0.0:1746129745.605565:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.605649:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052055552 00000100:00100000:1.0:1746129745.605655:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052055552 00010000:00010000:1.0:1746129745.605677:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d400/0x48868a4e439486b0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee1d expref: 17 pid: 16808 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746129745.605706:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5068 00000100:00100000:1.0:1746129745.605712:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052055552:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129745.605722:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129745.605727:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d400/0x48868a4e439486b0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee1d expref: 17 pid: 16808 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.605735:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d400/0x48868a4e439486b0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee1d expref: 17 pid: 16808 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.605752:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9d400/0x48868a4e439486b0 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee1d expref: 17 pid: 16808 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.605763:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129745.605766:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439487e4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129745.605773:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439487e4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129745.605779:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439487e4 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129745.605808:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129745.605845:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1961:x1830949052055552:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 132us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.605871:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5068 00010000:00010000:2.0:1746129745.606134:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439487e4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129745.606141:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439487e4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129745.606387:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:2.0:1746129745.606506:0:1851:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129745.606531:0:1851:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439487e4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129745.606541:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439487e4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129745.606548:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29800/0x48868a4e439487d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129745.606553:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29800/0x48868a4e439487d6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129745.606562:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29800/0x48868a4e439487d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129745.606566:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fe29800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129745.606570:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29800/0x48868a4e439487d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129745.606575:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29800/0x48868a4e439487d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129745.606583:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129745.606586:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129745.606588:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29800/0x48868a4e439487d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129745.606592:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29800/0x48868a4e439487d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129745.607481:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0x48868a4e439487dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129745.607489:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0x48868a4e439487dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129745.607494:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0x48868a4e439487dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129745.607498:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fe29a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129745.607500:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0x48868a4e439487dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129745.607505:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0x48868a4e439487dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129745.607616:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f99bf00) 00010000:00010000:2.0:1746129745.607618:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129745.607621:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0x48868a4e439487dd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129745.607628:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0x48868a4e439487dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129745.607669:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29000/0x48868a4e439487cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eee1 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.607683:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439487e4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eee1 expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.607688:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129745.607690:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129745.607692:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe29600, rc 0) 00000100:00100000:2.0:1746129745.607743:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+10:28443:x1830949052055168:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 12364us (12952us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129745.607749:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9786 00000100:00100000:0.0:1746129745.610575:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.610607:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.610632:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.610646:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.610668:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.610703:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052055680 00000100:00100000:2.0:1746129745.610710:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052055680 00000100:00100000:0.0:1746129745.610717:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.610739:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052055936 00000100:00100000:0.0:1746129745.610739:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052056192 00000100:00100000:2.0:1746129745.610741:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052055936 00000100:00100000:0.0:1746129745.610741:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052056192 00000100:00100000:2.0:1746129745.610750:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052055808 00000100:00100000:2.0:1746129745.610752:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052055808 00000100:00100000:0.0:1746129745.610754:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052056064 00000100:00100000:0.0:1746129745.610755:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052056064 00000100:00100000:2.0:1746129745.610760:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052056320 00000100:00100000:2.0:1746129745.610762:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052056320 00000100:00100000:0.0:1746129745.610765:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10530 00000100:00100000:0.0:1746129745.610771:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+14:1962:x1830949052055680:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:2.0:1746129745.610773:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10531 00000100:00100000:2.0:1746129745.610777:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+14:1962:x1830949052055936:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129745.610785:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129745.610785:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129745.610798:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e439487f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eef6 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.610798:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f87c000/0x48868a4e439487eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eee8 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129745.610835:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053246848:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129745.610835:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b027480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053246720:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129745.610909:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10532 00000100:00100000:0.0:1746129745.610912:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738b540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129745.610915:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052056192:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129745.610922:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129745.610926:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10533 00010000:00010000:1.0:1746129745.610928:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fe29200/0x48868a4e439487f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ef04 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129745.610931:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052055808:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129745.610936:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129745.610938:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.610940:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129745.610941:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f87c200/0x48868a4e43948800 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eeef expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.610946:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe29200/0x48868a4e439487f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef04 expref: 16 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129745.610958:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fe29200/0x48868a4e439487f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef04 expref: 16 pid: 3623 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129745.610958:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b026680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053246976:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129745.610966:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe29200, rc 0) 00000100:00100000:0.0:1746129745.610975:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738b480 going to sleep for 11 seconds 00000100:00100000:1.0:1746129745.610982:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+16:1962:x1830949052056192:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 67us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129745.610987:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10534 00000100:00100000:0.0:1746129745.610991:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+16:1962:x1830949052056064:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129745.610996:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129745.611002:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f87cc00/0x48868a4e43948807 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eefd expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129745.611021:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b027b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053247104:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129745.611037:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738b180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129745.611408:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10532 00000100:00100000:1.0:1746129745.611422:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10535 00000100:00100000:1.0:1746129745.611427:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+16:1962:x1830949052056320:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129745.611433:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129745.611438:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fe28a00/0x48868a4e4394880e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ef0b expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.611447:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.611448:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.611452:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe28a00/0x48868a4e4394880e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef0b expref: 17 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129745.611460:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fe28a00/0x48868a4e4394880e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef0b expref: 17 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129745.611467:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe28a00, rc 0) 00000100:00100000:1.0:1746129745.611480:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+17:1962:x1830949052056320:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 54us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.611484:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10535 00000100:00100000:2.0:1746129745.611546:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8840 going to sleep for 11 seconds 00002000:00010000:1.0:1746129745.614201:0:7975:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime: 1746129744 -> 1746129746 00002000:00010000:0.0:1746129745.614201:0:1877:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime: 1746129744 -> 1746129746 00002000:00010000:1.0:1746129745.614207:0:7975:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime: 1746129744 -> 1746129746 00002000:00010000:0.0:1746129745.614207:0:1877:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime: 1746129744 -> 1746129746 00002000:00010000:1.0:1746129745.614208:0:7975:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime: 1746129745 -> 1746129746 00002000:00010000:0.0:1746129745.614208:0:1877:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime: 1746129745 -> 1746129746 00000100:00100000:1.0:1746129745.614226:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b026680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053246976:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129745.614226:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b027b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053247104:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129745.614260:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f87cc00/0x48868a4e43948807 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eefd expref: 16 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129745.614271:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f87cc00/0x48868a4e43948807 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eefd expref: 16 pid: 1877 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746129745.614279:0:20441:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime: 1746129744 -> 1746129746 00002000:00010000:2.0:1746129745.614282:0:20441:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime: 1746129744 -> 1746129746 00002000:00010000:2.0:1746129745.614283:0:20441:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime: 1746129745 -> 1746129746 00010000:00010000:0.0:1746129745.614284:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f87cc00, rc 0) 00000100:00100000:2.0:1746129745.614291:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b027480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053246720:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129745.614302:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f87c000/0x48868a4e439487eb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eee8 expref: 15 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129745.614309:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f87c000/0x48868a4e439487eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eee8 expref: 15 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129745.614315:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f87c000, rc 0) 00000100:00100000:0.0:1746129745.614315:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052056064:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3323us (3645us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129745.614321:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10534 00000100:00100000:2.0:1746129745.614328:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+14:1962:x1830949052055680:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3558us (3760us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129745.614333:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10530 00010000:00010000:1.0:1746129745.614378:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f87c200/0x48868a4e43948800 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeef expref: 16 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129745.614386:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f87c200/0x48868a4e43948800 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeef expref: 16 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129745.614397:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f87c200, rc 0) 00000100:00100000:1.0:1746129745.614414:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052055808:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3483us (3767us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129745.614419:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10533 00002000:00010000:2.0:1746129745.614885:0:4589:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime: 1746129745 -> 1746129746 00002000:00010000:2.0:1746129745.614887:0:4589:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime: 1746129744 -> 1746129746 00002000:00010000:2.0:1746129745.614889:0:4589:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime: 1746129745 -> 1746129746 00000100:00100000:2.0:1746129745.614899:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053246848:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129745.614914:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e439487f2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eef6 expref: 14 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129745.614923:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e439487f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eef6 expref: 14 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129745.614930:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b534d600, rc 0) 00000100:00100000:2.0:1746129745.614949:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949052055936:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4171us (4342us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129745.614954:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10531 00000100:00100000:0.0:1746129745.619024:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.619126:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052056576 00000100:00100000:2.0:1746129745.619134:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052056576 00000100:00100000:2.0:1746129745.619170:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9787 00000100:00100000:2.0:1746129745.619178:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+10:28443:x1830949052056576:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129745.619195:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129745.619210:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4e00/0x48868a4e43948815 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ef12 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.619286:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4c00/0x48868a4e4394881c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129745.619298:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439487e4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eee1 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.619305:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4c00/0x48868a4e4394881c lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129745.619330:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439487e4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eee1 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.619344:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439487e4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eee1 expref: 11 pid: 1851 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746129745.619353:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053247232:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129745.619435:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129745.621629:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053247232:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129745.621649:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4c00/0x48868a4e4394881c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:2.0:1746129745.622944:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.622975:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052056704 00000100:00100000:0.0:1746129745.622980:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052056704 00010000:00010000:0.0:1746129745.623006:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439487e4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eee1 expref: 12 pid: 1851 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746129745.623040:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5069 00000100:00100000:0.0:1746129745.623047:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949052056704:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129745.623058:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129745.623064:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439487e4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eee1 expref: 12 pid: 1851 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746129745.623073:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439487e4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eee1 expref: 12 pid: 1851 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746129745.623090:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e439487e4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eee1 expref: 12 pid: 1851 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746129745.623115:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129745.623120:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4c00/0x48868a4e4394881c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129745.623128:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4c00/0x48868a4e4394881c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129745.623135:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4c00/0x48868a4e4394881c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129745.623167:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129745.623200:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052056704:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 153us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129745.623205:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5069 00010000:00010000:3.0:1746129745.623390:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4c00/0x48868a4e4394881c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129745.623396:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4c00/0x48868a4e4394881c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129745.623413:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129745.623546:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4e00/0x48868a4e43948815 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef12 expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.623903:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4c00/0x48868a4e4394881c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef12 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.623910:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129745.623912:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129745.623914:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094be4c00, rc 0) 00000100:00100000:3.0:1746129745.624175:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:28443:x1830949052056576:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4997us (5158us total) trans 8589943560 rc 0/0 00000100:00100000:3.0:1746129745.624181:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9787 00000100:00100000:0.0:1746129745.626591:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.626677:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052056832 00000100:00100000:3.0:1746129745.626684:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052056832 00000100:00100000:3.0:1746129745.626717:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9788 00000100:00100000:3.0:1746129745.626724:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:28443:x1830949052056832:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129745.626743:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129745.626757:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b815a00/0x48868a4e4394882a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ef19 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.626822:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b814c00/0x48868a4e43948831 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129745.626834:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4c00/0x48868a4e4394881c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef12 expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.626840:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b814c00/0x48868a4e43948831 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129745.626889:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4c00/0x48868a4e4394881c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef12 expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.626901:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4c00/0x48868a4e4394881c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef12 expref: 12 pid: 1851 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746129745.626911:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd44000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053247360:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129745.627626:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129745.630568:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd44000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053247360:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129745.630600:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b814c00/0x48868a4e43948831 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129745.630876:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.631191:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052056960 00000100:00100000:1.0:1746129745.631196:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052056960 00010000:00010000:1.0:1746129745.631219:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4c00/0x48868a4e4394881c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef12 expref: 13 pid: 1851 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746129745.631237:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5070 00000100:00100000:1.0:1746129745.631242:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+13:1961:x1830949052056960:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129745.631252:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129745.631257:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4c00/0x48868a4e4394881c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef12 expref: 13 pid: 1851 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.631265:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4c00/0x48868a4e4394881c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef12 expref: 13 pid: 1851 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.631281:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4c00/0x48868a4e4394881c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef12 expref: 13 pid: 1851 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.631305:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129745.631309:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b814c00/0x48868a4e43948831 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129745.631317:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b814c00/0x48868a4e43948831 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129745.631324:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b814c00/0x48868a4e43948831 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129745.631346:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129745.631377:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949052056960:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 134us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.631383:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5070 00010000:00010000:3.0:1746129745.631881:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b814c00/0x48868a4e43948831 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129745.631888:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b814c00/0x48868a4e43948831 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129745.631921:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:3.0:1746129745.631924:0:1851:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129745.631936:0:1851:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b814c00/0x48868a4e43948831 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129745.631962:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b815a00/0x48868a4e4394882a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef19 expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.632264:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b814c00/0x48868a4e43948831 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef19 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.632271:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129745.632273:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129745.632276:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b814c00, rc 0) 00000100:00100000:3.0:1746129745.632313:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:28443:x1830949052056832:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5590us (5729us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129745.632320:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9788 00000100:00100000:0.0:1746129745.635135:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.635168:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.635189:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.635222:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.635245:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052057216 00000100:00100000:0.0:1746129745.635252:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052057216 00000100:00100000:0.0:1746129745.635284:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052057472 00000100:00100000:0.0:1746129745.635286:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052057472 00000100:00100000:0.0:1746129745.635296:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052057088 00000100:00100000:0.0:1746129745.635297:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052057088 00000100:00100000:0.0:1746129745.635305:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052057344 00000100:00100000:0.0:1746129745.635307:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052057344 00000100:00100000:0.0:1746129745.635319:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10536 00000100:00100000:0.0:1746129745.635325:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+14:1961:x1830949052057216:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129745.635340:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129745.635354:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a12ba00/0x48868a4e43948838 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ef27 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129745.635396:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c040000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053247488:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129745.635413:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10537 00000100:00100000:2.0:1746129745.635419:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+14:1961:x1830949052057472:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129745.635427:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129745.635435:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801326fea00/0x48868a4e4394883f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ef35 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129745.635457:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053247616:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129745.635459:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129745.635475:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10538 00000100:00100000:2.0:1746129745.635476:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129745.635480:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949052057088:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129745.635486:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129745.635487:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10539 00000100:00100000:2.0:1746129745.635491:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949052057344:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129745.635492:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091f56e00/0x48868a4e43948846 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ef20 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.635496:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129745.635501:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ff98a00/0x48868a4e4394884d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ef2e expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129745.635524:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053247744:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129745.635531:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053247872:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129745.635543:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738b780 going to sleep for 11 seconds 00000100:00100000:2.0:1746129745.635545:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129745.638176:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c040000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053247488:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129745.638205:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a12ba00/0x48868a4e43948838 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef27 expref: 16 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129745.638217:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a12ba00/0x48868a4e43948838 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef27 expref: 16 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129745.638490:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a12ba00, rc 0) 00000100:00100000:3.0:1746129745.638504:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053247616:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129745.638532:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949052057216:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3206us (3403us total) trans 0 rc 301/301 00010000:00010000:3.0:1746129745.638533:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801326fea00/0x48868a4e4394883f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef35 expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129745.638539:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10536 00010000:00010000:3.0:1746129745.638541:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801326fea00/0x48868a4e4394883f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef35 expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129745.638550:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801326fea00, rc 0) 00000100:00100000:3.0:1746129745.638564:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949052057472:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3146us (3396us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129745.638569:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10537 00000100:00100000:2.0:1746129745.638689:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053247872:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129745.638702:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ff98a00/0x48868a4e4394884d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef2e expref: 14 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129745.638710:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ff98a00/0x48868a4e4394884d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef2e expref: 14 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129745.638717:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff98a00, rc 0) 00000100:00100000:1.0:1746129745.638718:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053247744:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129745.638731:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091f56e00/0x48868a4e43948846 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef20 expref: 14 pid: 8435 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129745.638735:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+13:1961:x1830949052057344:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3244us (3513us total) trans 0 rc 301/301 00010000:00010000:1.0:1746129745.638738:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091f56e00/0x48868a4e43948846 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef20 expref: 14 pid: 8435 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129745.638740:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10539 00010000:00010000:1.0:1746129745.638748:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091f56e00, rc 0) 00000100:00100000:1.0:1746129745.638762:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+13:1961:x1830949052057088:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3282us (3572us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129745.638767:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10538 00000100:00100000:0.0:1746129745.641833:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.642035:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052057728 00000100:00100000:3.0:1746129745.642042:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052057728 00000100:00100000:3.0:1746129745.642078:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9789 00000100:00100000:3.0:1746129745.642085:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:28443:x1830949052057728:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129745.642099:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129745.642113:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b815200/0x48868a4e43948854 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ef3c expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.642180:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b814800/0x48868a4e4394885b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129745.642191:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b814800/0x48868a4e4394885b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129745.642200:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b814800/0x48868a4e4394885b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129745.642209:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129745.642295:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b815200/0x48868a4e43948854 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef3c expref: 14 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.642309:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b814800/0x48868a4e4394885b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef3c expref: 13 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.642315:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129745.642317:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129745.642320:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b814800, rc 0) 00000100:00100000:3.0:1746129745.642364:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+13:28443:x1830949052057728:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 279us (536us total) trans 8589943561 rc 0/0 00000100:00100000:3.0:1746129745.642369:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9789 00000100:00100000:0.0:1746129745.644602:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.644635:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.644658:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.644684:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.644697:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.644720:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.644772:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052057984 00000100:00100000:1.0:1746129745.644778:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052057984 00000100:00100000:1.0:1746129745.644803:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052058240 00000100:00100000:1.0:1746129745.644805:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052058240 00000100:00100000:1.0:1746129745.644814:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052058496 00000100:00100000:1.0:1746129745.644816:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052058496 00000100:00100000:2.0:1746129745.644821:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052057856 00000100:00100000:2.0:1746129745.644824:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052057856 00000100:00100000:1.0:1746129745.644824:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052058112 00000100:00100000:1.0:1746129745.644826:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052058112 00000100:00100000:1.0:1746129745.644833:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052058368 00000100:00100000:1.0:1746129745.644834:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052058368 00000100:00100000:2.0:1746129745.644841:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10540 00000100:00100000:2.0:1746129745.644874:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949052057984:12345-192.168.204.31@tcp:1:lfs.0 00000100:00100000:1.0:1746129745.644896:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10541 00000100:00100000:1.0:1746129745.644902:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949052058240:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:2.0:1746129745.644908:0:4589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ff99e00/0x48868a4e43948869 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.644916:0:8435:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008fe28e00/0x48868a4e43948870 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.644921:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801326ff600/0x48868a4e439487c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eed3 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.644925:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e439487c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeda expref: 20 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.644927:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129745.644928:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129745.644930:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129745.644931:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff99e00/0x48868a4e43948869 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.644931:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129745.644933:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe28e00/0x48868a4e43948870 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.644953:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801326ff600/0x48868a4e439487c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eed3 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.644953:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e439487c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeda expref: 20 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.644962:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801326ff600/0x48868a4e439487c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eed3 expref: 14 pid: 8437 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.644962:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e439487c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeda expref: 20 pid: 8437 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746129745.644972:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053248000:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129745.644972:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053248128:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129745.645003:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10542 00000100:00100000:0.0:1746129745.645010:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949052058496:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:0.0:1746129745.645025:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9be00/0x48868a4e43948877 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.645034:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091f56c00/0x48868a4e43948782 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeb0 expref: 19 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.645040:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fe28a00/0x48868a4e4394880e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef0b expref: 15 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129745.645050:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801356e3400/0x48868a4e43948789 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeb7 expref: 14 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.645055:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129745.645056:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129745.645058:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9be00/0x48868a4e43948877 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.645071:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801356e3400/0x48868a4e43948789 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeb7 expref: 14 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.645078:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801356e3400/0x48868a4e43948789 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeb7 expref: 14 pid: 1140 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746129745.645085:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8790a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053248256:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129745.645144:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3240c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129745.645162:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10543 00000100:00100000:1.0:1746129745.645167:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949052058112:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:1.0:1746129745.645182:0:3624:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e4394887e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.645190:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b814000/0x48868a4e439487ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eecc expref: 19 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.645195:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129745.645197:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129745.645199:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e4394887e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.645211:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b814000/0x48868a4e439487ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eecc expref: 19 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.645218:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b814000/0x48868a4e439487ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eecc expref: 19 pid: 1140 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746129745.645226:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053248384:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129745.645245:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129745.645262:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10544 00000100:00100000:1.0:1746129745.645267:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949052057856:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:1.0:1746129745.645281:0:10930:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f87c000/0x48868a4e43948885 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.645289:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b814400/0x48868a4e439487b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 925696->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eec5 expref: 10 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.645294:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129745.645295:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129745.645296:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87c000/0x48868a4e43948885 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.645312:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b814400/0x48868a4e439487b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 925696->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eec5 expref: 10 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.645319:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b814400/0x48868a4e439487b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 925696->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eec5 expref: 10 pid: 1140 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746129745.645326:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053248512:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129745.645343:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129745.645366:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10545 00000100:00100000:1.0:1746129745.645370:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949052058368:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:1.0:1746129745.645382:0:3623:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f87c600/0x48868a4e4394888c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.645390:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a507fa00/0x48868a4e4394874a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee94 expref: 20 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.645397:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe29200/0x48868a4e439487f9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef04 expref: 15 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129745.645403:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800932d1600/0x48868a4e4394877b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eea9 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.645408:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.645409:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.645410:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87c600/0x48868a4e4394888c lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.645422:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800932d1600/0x48868a4e4394877b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eea9 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.645429:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800932d1600/0x48868a4e4394877b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eea9 expref: 10 pid: 8437 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746129745.645435:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053248640:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129745.645459:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fe29200/0x48868a4e439487f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef04 expref: 15 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129745.645466:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fe29200/0x48868a4e439487f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef04 expref: 15 pid: 3623 timeout: 791 lvb_type: 1 00000100:00100000:1.0:1746129745.645473:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053248768:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129745.645491:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a507fa00/0x48868a4e4394874a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee94 expref: 20 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.645497:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a507fa00/0x48868a4e4394874a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee94 expref: 20 pid: 1140 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746129745.645503:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053248896:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129745.645529:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324000 going to sleep for 11 seconds 00000100:00100000:2.0:1746129745.645681:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1746129745.647139:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fe28a00/0x48868a4e4394880e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef0b expref: 15 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129745.647154:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fe28a00/0x48868a4e4394880e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef0b expref: 15 pid: 3623 timeout: 791 lvb_type: 1 00000100:00100000:1.0:1746129745.647164:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053249024:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129745.648113:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091f56c00/0x48868a4e43948782 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeb0 expref: 19 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.648125:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091f56c00/0x48868a4e43948782 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeb0 expref: 19 pid: 1140 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746129745.648134:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053249152:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129745.650621:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738b780 going to sleep for 11 seconds 00000100:00100000:2.0:1746129745.651061:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053248384:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129745.651081:0:3624:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e4394887e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129745.651088:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053248512:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129745.651103:0:10930:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f87c000/0x48868a4e43948885 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129745.651128:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053248640:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129745.651136:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053248768:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129745.651144:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053248896:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129745.651158:0:3623:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f87c600/0x48868a4e4394888c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129745.651182:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053248128:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129745.651191:0:8435:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008fe28e00/0x48868a4e43948870 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129745.651207:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8790a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053248256:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129745.651214:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053249024:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129745.654787:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053248000:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129745.654816:0:4589:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012ff99e00/0x48868a4e43948869 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129745.656380:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053249152:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129745.656409:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9be00/0x48868a4e43948877 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129745.662989:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.663142:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.663202:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052058880 00000100:00100000:3.0:1746129745.663209:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052058880 00002000:00100000:3.0:1746129745.663244:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e8:0x0] (925696->1048575) req@ffff8800a504e680 x1830949052058880/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.663252:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504e680 with x1830949052058880 ext(925696->1048575) 00010000:00010000:3.0:1746129745.663260:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b814400/0x48868a4e439487b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 925696->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eec5 expref: 11 pid: 1140 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746129745.663271:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b814400/0x48868a4e439487b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 925696->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eec5 expref: 11 pid: 1140 timeout: 791 lvb_type: 0 00002000:00010000:3.0:1746129745.663277:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a504e680 00000100:00100000:3.0:1746129745.663303:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052058752 00000100:00100000:3.0:1746129745.663306:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052058752 00002000:00100000:3.0:1746129745.663317:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1581056->2097151) req@ffff8800a504c700 x1830949052058752/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.663323:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504c700 with x1830949052058752 ext(1581056->2097151) 00010000:00010000:3.0:1746129745.663328:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b814000/0x48868a4e439487ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eecc expref: 20 pid: 1140 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746129745.663335:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b814000/0x48868a4e439487ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eecc expref: 20 pid: 1140 timeout: 791 lvb_type: 0 00002000:00010000:3.0:1746129745.663340:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a504c700 00000100:00100000:3.0:1746129745.663351:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 544 00000100:00100000:3.0:1746129745.663357:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052058880:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129745.663384:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 545 00000100:00100000:2.0:1746129745.663392:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949052058752:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:1.0:1746129745.663688:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.663717:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.663735:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.663747:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052059648 00000100:00100000:1.0:1746129745.663750:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052059648 00000100:00100000:0.0:1746129745.663750:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052059008 00000100:00100000:0.0:1746129745.663754:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052059008 00010000:00010000:0.0:1746129745.663767:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d1600/0x48868a4e4394877b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eea9 expref: 13 pid: 8437 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746129745.663796:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5071 00000100:00100000:0.0:1746129745.663802:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949052059008:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129745.663811:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129745.663825:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800932d1600/0x48868a4e4394877b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eea9 expref: 13 pid: 8437 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746129745.663833:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800932d1600/0x48868a4e4394877b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eea9 expref: 13 pid: 8437 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746129745.663867:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932d1600/0x48868a4e4394877b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eea9 expref: 13 pid: 8437 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.663874:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a507fa00/0x48868a4e4394874a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee94 expref: 21 pid: 1140 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746129745.663888:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129745.663913:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949052059008:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 110us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129745.663918:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5071 00000100:00100000:0.0:1746129745.663936:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052058624 00000100:00100000:0.0:1746129745.663939:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052058624 00002000:00100000:0.0:1746129745.663951:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1232895) req@ffff8800a504dc00 x1830949052058624/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129745.663958:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504dc00 with x1830949052058624 ext(1048576->1232895) 00010000:00010000:0.0:1746129745.663963:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e439487c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeda expref: 22 pid: 8437 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746129745.663970:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e439487c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeda expref: 22 pid: 8437 timeout: 791 lvb_type: 0 00002000:00010000:0.0:1746129745.663975:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a504dc00 00000100:00100000:1.0:1746129745.664095:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5072 00000100:00100000:3.0:1746129745.664114:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 546 00000100:00100000:3.0:1746129745.664120:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949052058624:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:2.0:1746129745.664209:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.664227:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052059264 00000100:00100000:3.0:1746129745.664231:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052059264 00002000:00100000:3.0:1746129745.664245:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1781759) req@ffff88009a04fb80 x1830949052059264/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746129745.664246:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:3.0:1746129745.664256:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04fb80 with x1830949052059264 ext(1048576->1781759) 00010000:00010000:3.0:1746129745.664261:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801326ff600/0x48868a4e439487c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eed3 expref: 15 pid: 8437 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746129745.664267:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801326ff600/0x48868a4e439487c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eed3 expref: 15 pid: 8437 timeout: 791 lvb_type: 0 00002000:00010000:3.0:1746129745.664272:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a04fb80 00000100:00100000:3.0:1746129745.664286:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 547 00000100:00100000:3.0:1746129745.664291:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1964:x1830949052059264:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129745.664604:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949052059648:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129745.664612:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129745.664623:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a507fa00/0x48868a4e4394874a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee94 expref: 22 pid: 1140 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.664631:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a507fa00/0x48868a4e4394874a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee94 expref: 22 pid: 1140 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.664649:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a507fa00/0x48868a4e4394874a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee94 expref: 22 pid: 1140 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.664671:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129745.664951:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052059648:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 850us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.664957:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5072 00000100:00100000:1.0:1746129745.664969:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052059520 00000100:00100000:1.0:1746129745.664972:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052059520 00010000:00010000:1.0:1746129745.664981:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe28a00/0x48868a4e4394880e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef0b expref: 16 pid: 3623 timeout: 791 lvb_type: 1 00000100:00100000:1.0:1746129745.664993:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5073 00000100:00100000:1.0:1746129745.664997:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+16:1964:x1830949052059520:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129745.665003:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129745.665013:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fe28a00/0x48868a4e4394880e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef0b expref: 16 pid: 3623 timeout: 791 lvb_type: 1 00010000:00010000:1.0:1746129745.665020:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fe28a00/0x48868a4e4394880e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef0b expref: 16 pid: 3623 timeout: 791 lvb_type: 1 00010000:00010000:1.0:1746129745.665031:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fe28a00/0x48868a4e4394880e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef0b expref: 16 pid: 3623 timeout: 791 lvb_type: 1 00010000:00010000:1.0:1746129745.665040:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129745.665056:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+15:1964:x1830949052059520:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 58us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.665061:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5073 00000100:00100000:0.0:1746129745.665072:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.665088:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052059392 00000100:00100000:1.0:1746129745.665090:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052059392 00000100:00100000:0.0:1746129745.665098:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129745.665099:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801356e3400/0x48868a4e43948789 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeb7 expref: 17 pid: 1140 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746129745.665109:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052059136 00000100:00100000:0.0:1746129745.665111:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052059136 00000100:00100000:1.0:1746129745.665118:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5074 00000100:00100000:1.0:1746129745.665122:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949052059392:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129745.665123:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe29200/0x48868a4e439487f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef04 expref: 16 pid: 3623 timeout: 791 lvb_type: 1 00010000:00010000:1.0:1746129745.665128:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129745.665135:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801356e3400/0x48868a4e43948789 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeb7 expref: 17 pid: 1140 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746129745.665137:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5075 00000100:00100000:0.0:1746129745.665141:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+16:1962:x1830949052059136:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129745.665143:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801356e3400/0x48868a4e43948789 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeb7 expref: 17 pid: 1140 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746129745.665147:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129745.665153:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801356e3400/0x48868a4e43948789 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeb7 expref: 17 pid: 1140 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746129745.665155:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fe29200/0x48868a4e439487f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef04 expref: 16 pid: 3623 timeout: 791 lvb_type: 1 00010000:00010000:1.0:1746129745.665160:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129745.665163:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fe29200/0x48868a4e439487f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef04 expref: 16 pid: 3623 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746129745.665173:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe29200/0x48868a4e439487f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef04 expref: 16 pid: 3623 timeout: 791 lvb_type: 1 00000100:00100000:1.0:1746129745.665175:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8790a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949052059392:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 52us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.665180:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5074 00010000:00010000:0.0:1746129745.665180:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129745.665181:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129745.665185:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f87c600/0x48868a4e4394888c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.665191:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87c600/0x48868a4e4394888c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.665209:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129745.665214:0:3623:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f87c600/0x48868a4e4394888c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.665225:0:3623:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f87c600/0x48868a4e4394888c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129745.665226:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052059136:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 84us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129745.665230:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5075 00010000:00010000:1.0:1746129745.665240:0:3623:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f87c600/0x48868a4e4394888c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.665245:0:3623:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87c600/0x48868a4e4394888c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.665251:0:3623:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f87c600/0x48868a4e4394888c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.665257:0:3623:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f87c600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129745.665260:0:3623:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f87c600/0x48868a4e4394888c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.665266:0:3623:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f87c600/0x48868a4e4394888c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.665273:0:3623:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f87c600/0x48868a4e4394888c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.665278:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f87c600/0x48868a4e4394888c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129745.665306:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+14:1961:x1830949052058368:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 19936us (20586us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.665313:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10545 00000100:00100000:2.0:1746129745.666234:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.666268:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052059776 00000100:00100000:0.0:1746129745.666272:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052059776 00010000:00010000:0.0:1746129745.666287:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091f56c00/0x48868a4e43948782 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeb0 expref: 22 pid: 1140 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746129745.666313:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5076 00000100:00100000:0.0:1746129745.666318:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1964:x1830949052059776:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129745.666326:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129745.666335:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091f56c00/0x48868a4e43948782 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeb0 expref: 22 pid: 1140 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746129745.666343:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091f56c00/0x48868a4e43948782 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeb0 expref: 22 pid: 1140 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746129745.666356:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091f56c00/0x48868a4e43948782 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeb0 expref: 22 pid: 1140 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746129745.667868:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129745.667870:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129745.667875:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9be00/0x48868a4e43948877 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.667883:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9be00/0x48868a4e43948877 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.667914:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129745.667956:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1964:x1830949052059776:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1635us (1723us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129745.667964:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5076 00010000:00010000:1.0:1746129745.668106:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9be00/0x48868a4e43948877 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.668113:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9be00/0x48868a4e43948877 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.668135:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9be00/0x48868a4e43948877 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.668140:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9be00/0x48868a4e43948877 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.668146:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9be00/0x48868a4e43948877 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.668151:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b1a9be00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129745.668153:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9be00/0x48868a4e43948877 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.668160:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9be00/0x48868a4e43948877 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.668170:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9be00/0x48868a4e43948877 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.668175:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9be00/0x48868a4e43948877 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129745.668215:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+14:1961:x1830949052058496:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 23206us (23555us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.668221:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10542 00000100:00100000:3.0:1746129745.673707:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949052058880:12345-192.168.204.31@tcp:4:cat.0 Request processed in 10341us (10715us total) trans 17179873035 rc 0/0 00000100:00100000:3.0:1746129745.673718:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 544 00002000:00100000:3.0:1746129745.673728:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e8:0x0] (925696->1048575) req@ffff8800a504e680 x1830949052058880/t17179873035(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/448 e 0 to 0 dl 1746129756 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.673737:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504e680 with x1830949052058880 ext(925696->1048575) 00010000:00010000:3.0:1746129745.673745:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b814400/0x48868a4e439487b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 925696->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eec5 expref: 12 pid: 1140 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746129745.673757:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b814400/0x48868a4e439487b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 925696->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eec5 expref: 12 pid: 1140 timeout: 791 lvb_type: 0 00002000:00010000:3.0:1746129745.673763:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a504e680 00000100:00100000:2.0:1746129745.681794:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.683284:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052059904 00000100:00100000:2.0:1746129745.683293:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052059904 00010000:00010000:2.0:1746129745.683323:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b814400/0x48868a4e439487b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 925696->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eec5 expref: 12 pid: 1140 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746129745.683356:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5077 00000100:00100000:2.0:1746129745.683362:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052059904:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129745.683372:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129745.683392:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b814400/0x48868a4e439487b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 925696->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eec5 expref: 12 pid: 1140 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746129745.683401:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b814400/0x48868a4e439487b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 925696->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eec5 expref: 12 pid: 1140 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746129745.683418:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b814400/0x48868a4e439487b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 925696->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eec5 expref: 12 pid: 1140 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746129745.683432:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129745.683434:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129745.683437:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f87c000/0x48868a4e43948885 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.683444:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87c000/0x48868a4e43948885 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.683463:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129745.683495:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052059904:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 133us (1709us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129745.683500:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5077 00010000:00010000:1.0:1746129745.683697:0:10930:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f87c000/0x48868a4e43948885 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.683705:0:10930:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f87c000/0x48868a4e43948885 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.683722:0:10930:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f87c000/0x48868a4e43948885 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.683728:0:10930:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87c000/0x48868a4e43948885 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.683734:0:10930:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f87c000/0x48868a4e43948885 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.683739:0:10930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f87c000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129745.683741:0:10930:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f87c000/0x48868a4e43948885 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.683747:0:10930:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f87c000/0x48868a4e43948885 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.683757:0:10930:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f87c000/0x48868a4e43948885 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.683762:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f87c000/0x48868a4e43948885 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129745.683800:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+13:1961:x1830949052057856:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 38533us (39114us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.683806:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10544 00000100:00100000:3.0:1746129745.686308:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052058752:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 22910us (23159us total) trans 21474840202 rc 0/0 00000100:00100000:3.0:1746129745.686318:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 545 00002000:00100000:3.0:1746129745.686328:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e7:0x0] (1581056->2097151) req@ffff8800a504c700 x1830949052058752/t21474840202(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/448 e 0 to 0 dl 1746129756 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.686337:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504c700 with x1830949052058752 ext(1581056->2097151) 00010000:00010000:3.0:1746129745.686344:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b814000/0x48868a4e439487ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eecc expref: 21 pid: 1140 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746129745.686355:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b814000/0x48868a4e439487ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eecc expref: 21 pid: 1140 timeout: 791 lvb_type: 0 00002000:00010000:3.0:1746129745.686361:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a504c700 00000100:00100000:3.0:1746129745.692680:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.692926:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052060032 00000100:00100000:0.0:1746129745.692935:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052060032 00010000:00010000:0.0:1746129745.692962:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b814000/0x48868a4e439487ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eecc expref: 21 pid: 1140 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746129745.692987:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5078 00000100:00100000:0.0:1746129745.692994:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1964:x1830949052060032:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129745.693006:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129745.693024:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b814000/0x48868a4e439487ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eecc expref: 21 pid: 1140 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746129745.693033:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b814000/0x48868a4e439487ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eecc expref: 21 pid: 1140 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746129745.693052:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b814000/0x48868a4e439487ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eecc expref: 21 pid: 1140 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746129745.694239:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129745.694243:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129745.694247:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e4394887e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.694260:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e4394887e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.694283:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129745.694323:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1964:x1830949052060032:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1327us (1648us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129745.694330:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5078 00010000:00010000:2.0:1746129745.694392:0:3624:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e4394887e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.694399:0:3624:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e4394887e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.694420:0:3624:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e4394887e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.694426:0:3624:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e4394887e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.694432:0:3624:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e4394887e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.694437:0:3624:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b534d600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129745.694440:0:3624:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e4394887e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.694447:0:3624:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e4394887e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.694460:0:3624:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e4394887e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.694466:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e4394887e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129745.694516:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+13:1961:x1830949052058112:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 49339us (49807us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129745.694524:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10543 00000100:00100000:2.0:1746129745.700434:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949052059264:12345-192.168.204.31@tcp:4:cat.0 Request processed in 36134us (36217us total) trans 21474840203 rc 0/0 00000100:00100000:2.0:1746129745.700446:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 547 00002000:00100000:2.0:1746129745.700456:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1781759) req@ffff88009a04fb80 x1830949052059264/t21474840203(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/448 e 0 to 0 dl 1746129756 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.700464:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04fb80 with x1830949052059264 ext(1048576->1781759) 00010000:00010000:2.0:1746129745.700472:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801326ff600/0x48868a4e439487c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eed3 expref: 16 pid: 8437 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746129745.700483:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801326ff600/0x48868a4e439487c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eed3 expref: 16 pid: 8437 timeout: 791 lvb_type: 0 00002000:00010000:2.0:1746129745.700489:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a04fb80 00000100:00100000:3.0:1746129745.704946:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949052058624:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 40818us (41770us total) trans 17179873036 rc 0/0 00000100:00100000:3.0:1746129745.704956:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 546 00002000:00100000:3.0:1746129745.704964:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1232895) req@ffff8800a504dc00 x1830949052058624/t17179873036(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/448 e 0 to 0 dl 1746129756 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129745.704972:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504dc00 with x1830949052058624 ext(1048576->1232895) 00010000:00010000:3.0:1746129745.704980:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e439487c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeda expref: 22 pid: 8437 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746129745.704991:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e439487c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeda expref: 22 pid: 8437 timeout: 791 lvb_type: 0 00002000:00010000:3.0:1746129745.705002:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a504dc00 00000100:00100000:0.0:1746129745.710533:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.710875:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052060160 00000100:00100000:3.0:1746129745.710883:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052060160 00010000:00010000:3.0:1746129745.710912:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e439487c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeda expref: 22 pid: 8437 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746129745.710934:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5079 00000100:00100000:3.0:1746129745.710941:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949052060160:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129745.710951:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129745.710967:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e439487c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeda expref: 22 pid: 8437 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746129745.710977:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e439487c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeda expref: 22 pid: 8437 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746129745.710995:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e439487c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eeda expref: 22 pid: 8437 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746129745.711027:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129745.711028:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129745.711031:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe28e00/0x48868a4e43948870 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.711038:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe28e00/0x48868a4e43948870 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.711060:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129745.711262:0:8435:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008fe28e00/0x48868a4e43948870 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.711270:0:8435:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fe28e00/0x48868a4e43948870 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.711286:0:8435:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008fe28e00/0x48868a4e43948870 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.711293:0:8435:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe28e00/0x48868a4e43948870 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.711299:0:8435:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008fe28e00/0x48868a4e43948870 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.711305:0:8435:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fe28e00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129745.711307:0:8435:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fe28e00/0x48868a4e43948870 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.711314:0:8435:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fe28e00/0x48868a4e43948870 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.711324:0:8435:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008fe28e00/0x48868a4e43948870 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.711329:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe28e00/0x48868a4e43948870 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129745.711942:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8790a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052060160:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 999us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129745.711949:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5079 00000100:00100000:1.0:1746129745.712191:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949052058240:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 67268us (67533us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.712218:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10541 00000100:00100000:2.0:1746129745.712568:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.713166:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052060288 00000100:00100000:0.0:1746129745.713172:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052060288 00010000:00010000:0.0:1746129745.713193:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801326ff600/0x48868a4e439487c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eed3 expref: 16 pid: 8437 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746129745.713223:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5080 00000100:00100000:0.0:1746129745.713230:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1963:x1830949052060288:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129745.713239:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129745.713254:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801326ff600/0x48868a4e439487c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eed3 expref: 16 pid: 8437 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746129745.713263:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801326ff600/0x48868a4e439487c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eed3 expref: 16 pid: 8437 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746129745.713279:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801326ff600/0x48868a4e439487c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1781759) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eed3 expref: 16 pid: 8437 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746129745.713293:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129745.713295:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129745.713298:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ff99e00/0x48868a4e43948869 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.713304:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff99e00/0x48868a4e43948869 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.713321:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129745.713350:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1963:x1830949052060288:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 121us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129745.713355:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5080 00010000:00010000:3.0:1746129745.713777:0:4589:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012ff99e00/0x48868a4e43948869 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.713785:0:4589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ff99e00/0x48868a4e43948869 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.713800:0:4589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ff99e00/0x48868a4e43948869 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.713806:0:4589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff99e00/0x48868a4e43948869 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.713812:0:4589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ff99e00/0x48868a4e43948869 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.713818:0:4589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ff99e00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129745.713821:0:4589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ff99e00/0x48868a4e43948869 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.713826:0:4589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ff99e00/0x48868a4e43948869 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.713839:0:4589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ff99e00/0x48868a4e43948869 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.713844:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ff99e00/0x48868a4e43948869 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129745.715701:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949052057984:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 70850us (71101us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129745.715710:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10540 00000100:00100000:0.0:1746129745.719094:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.721010:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052060544 00000100:00100000:2.0:1746129745.721021:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052060544 00000100:00100000:2.0:1746129745.721068:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9790 00000100:00100000:2.0:1746129745.721075:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+13:28443:x1830949052060544:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:2.0:1746129745.721114:0:16808:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1746129745.721134:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b814c00/0x48868a4e43948831 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef19 expref: 13 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.721158:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66c00/0x48868a4e4394852f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecf7 expref: 12 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.721167:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129745.721170:0:16808:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129745.721191:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57e00/0x48868a4e43948893 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.721200:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd83e00/0x48868a4e439484e2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecaa expref: 293 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.721206:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82400/0x48868a4e439484e9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb1 expref: 293 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.721212:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a1ee000/0x48868a4e439484f7 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecbf expref: 15 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.721217:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57800/0x48868a4e4394870b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee5c expref: 293 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.721223:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859a00/0x48868a4e4394876d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eea2 expref: 15 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.721233:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57e00/0x48868a4e43948893 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.721256:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859a00/0x48868a4e4394876d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eea2 expref: 15 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.721265:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859a00/0x48868a4e4394876d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eea2 expref: 15 pid: 16808 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746129745.721275:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053249280:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129745.721353:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57800/0x48868a4e4394870b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee5c expref: 293 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.721361:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57800/0x48868a4e4394870b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee5c expref: 293 pid: 16808 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746129745.721367:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053249408:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129745.721385:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a1ee000/0x48868a4e439484f7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecbf expref: 15 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.721391:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a1ee000/0x48868a4e439484f7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecbf expref: 15 pid: 14314 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746129745.721397:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053249536:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129745.721411:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82400/0x48868a4e439484e9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb1 expref: 293 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.721422:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82400/0x48868a4e439484e9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb1 expref: 293 pid: 14314 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746129745.721428:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053249664:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129745.721441:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd83e00/0x48868a4e439484e2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecaa expref: 293 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.721447:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd83e00/0x48868a4e439484e2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecaa expref: 293 pid: 16808 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746129745.721452:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093289500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053249792:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129745.721464:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8300 going to sleep for 11 seconds 00000100:00100000:3.0:1746129745.725822:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053249280:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129745.725834:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053249408:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129745.725840:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053249536:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129745.725864:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053249664:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129745.727955:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.729023:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.729037:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.729047:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.729062:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052061056 00000100:00100000:1.0:1746129745.729068:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052061056 00010000:00010000:1.0:1746129745.729094:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82400/0x48868a4e439484e9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb1 expref: 294 pid: 14314 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746129745.729114:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052060800 00000100:00100000:1.0:1746129745.729115:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052060800 00010000:00010000:1.0:1746129745.729122:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57800/0x48868a4e4394870b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee5c expref: 295 pid: 16808 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746129745.729130:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052061184 00000100:00100000:1.0:1746129745.729132:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052061184 00010000:00010000:1.0:1746129745.729137:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd83e00/0x48868a4e439484e2 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecaa expref: 296 pid: 16808 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746129745.729142:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052060672 00000100:00100000:1.0:1746129745.729144:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052060672 00010000:00010000:1.0:1746129745.729151:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859a00/0x48868a4e4394876d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eea2 expref: 16 pid: 16808 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746129745.729160:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5081 00000100:00100000:1.0:1746129745.729165:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:1964:x1830949052061056:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129745.729175:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129745.729179:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82400/0x48868a4e439484e9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb1 expref: 296 pid: 14314 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.729187:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82400/0x48868a4e439484e9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb1 expref: 296 pid: 14314 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.729202:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82400/0x48868a4e439484e9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecb1 expref: 296 pid: 14314 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.729215:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129745.729218:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57e00/0x48868a4e43948893 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.729225:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129745.729253:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:1964:x1830949052061056:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 88us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.729258:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5081 00000100:00100000:1.0:1746129745.729269:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5082 00000100:00100000:1.0:1746129745.729273:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:1961:x1830949052060800:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129745.729277:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129745.729280:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57800/0x48868a4e4394870b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee5c expref: 294 pid: 16808 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.729286:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57800/0x48868a4e4394870b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee5c expref: 294 pid: 16808 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.729293:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57800/0x48868a4e4394870b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ee5c expref: 294 pid: 16808 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.729299:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129745.729301:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57e00/0x48868a4e43948893 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.729305:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129745.729316:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:1961:x1830949052060800:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 42us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.729320:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5082 00000100:00100000:1.0:1746129745.729358:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5083 00000100:00100000:1.0:1746129745.729362:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:1961:x1830949052061184:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129745.729367:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129745.729370:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd83e00/0x48868a4e439484e2 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecaa expref: 292 pid: 16808 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.729375:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd83e00/0x48868a4e439484e2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecaa expref: 292 pid: 16808 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.729383:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129745.729385:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57e00/0x48868a4e43948893 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.729393:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129745.729403:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:1961:x1830949052061184:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 42us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.729407:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5083 00000100:00100000:1.0:1746129745.729414:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5084 00000100:00100000:1.0:1746129745.729418:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1961:x1830949052060672:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129745.729423:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129745.729426:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859a00/0x48868a4e4394876d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eea2 expref: 16 pid: 16808 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.729433:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859a00/0x48868a4e4394876d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eea2 expref: 16 pid: 16808 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.729442:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859a00/0x48868a4e4394876d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eea2 expref: 16 pid: 16808 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.729450:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129745.729452:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57e00/0x48868a4e43948893 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.729456:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129745.729466:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1961:x1830949052060672:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 47us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.729470:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5084 00000100:00100000:1.0:1746129745.729505:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.729528:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052060928 00000100:00100000:1.0:1746129745.729530:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052060928 00010000:00010000:1.0:1746129745.729539:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a1ee000/0x48868a4e439484f7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecbf expref: 15 pid: 14314 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746129745.729554:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5085 00000100:00100000:1.0:1746129745.729558:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1961:x1830949052060928:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129745.729563:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129745.729566:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a1ee000/0x48868a4e439484f7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecbf expref: 15 pid: 14314 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.729573:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a1ee000/0x48868a4e439484f7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecbf expref: 15 pid: 14314 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.729582:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a1ee000/0x48868a4e439484f7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecbf expref: 15 pid: 14314 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746129745.729590:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129745.729593:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57e00/0x48868a4e43948893 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.729599:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57e00/0x48868a4e43948893 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.729604:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57e00/0x48868a4e43948893 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129745.729616:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129745.729627:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949052060928:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 69us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129745.729631:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5085 00010000:00010000:3.0:1746129745.730060:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd83e00/0x48868a4e439484e2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ecaa expref: 291 pid: 16808 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746129745.730072:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093289500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053249792:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129745.730099:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57e00/0x48868a4e43948893 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129745.730106:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57e00/0x48868a4e43948893 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129745.730111:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57e00/0x48868a4e43948893 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000040:00080000:3.0:1746129745.731098:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2732, 88 off227256 00000004:00080000:3.0:1746129745.731107:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691789258593ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129745.731155:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2677, 88 off222504 00000004:00080000:3.0:1746129745.731159:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691789311567ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129745.731182:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2678, 88 off222592 00000004:00080000:3.0:1746129745.731184:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691789336563ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129745.731191:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2733, 88 off227344 00000004:00080000:3.0:1746129745.731193:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691789344953ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129745.731203:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2734, 88 off227432 00000004:00080000:3.0:1746129745.731206:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691789357999ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129745.731212:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2679, 88 off222680 00000004:00080000:3.0:1746129745.731214:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691789366473ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129745.731220:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2680, 88 off222768 00000004:00080000:3.0:1746129745.731222:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691789374041ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129745.731227:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2681, 88 off222856 00000004:00080000:3.0:1746129745.731230:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691789381923ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129745.731235:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2735, 88 off227520 00000004:00080000:3.0:1746129745.731238:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691789389687ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129745.731243:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2682, 88 off222944 00000004:00080000:3.0:1746129745.731246:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691789398071ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129745.731252:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2736, 88 off227608 00000004:00080000:3.0:1746129745.731254:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691789405918ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129745.731260:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2683, 88 off223032 00000004:00080000:3.0:1746129745.731262:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691789413933ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129745.731267:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2737, 88 off227696 00000004:00080000:3.0:1746129745.731269:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691789421511ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129745.731275:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2738, 88 off227784 00000004:00080000:3.0:1746129745.731277:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691789429466ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129745.731283:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2739, 88 off227872 00000004:00080000:3.0:1746129745.731285:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691789437426ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129745.731291:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2740, 88 off227960 00000004:00080000:3.0:1746129745.731293:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691789445151ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129745.731299:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2684, 88 off223120 00000004:00080000:3.0:1746129745.731301:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691789453323ns, next at 641623252291ns, rc = 0 00000004:00010000:3.0:1746129745.757834:0:16808:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880135d8e680 reply state ffff88009a1a1400 transno 8589943562 ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57e00/0x48868a4e43948893 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:3.0:1746129745.757867:0:16808:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746129745.757963:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+13:28443:x1830949052060544:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 36884us (38872us total) trans 8589943562 rc 0/0 00000100:00100000:3.0:1746129745.757970:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9790 00000001:00080000:1.0:1746129745.758035:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943554 is committed 00000001:00080000:1.0:1746129745.758048:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943550 is committed 00000001:00080000:1.0:1746129745.758053:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943559 is committed 00000001:00080000:1.0:1746129745.758057:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943558 is committed 00000001:00080000:1.0:1746129745.758064:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943546 is committed 00000001:00080000:1.0:1746129745.758084:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943562 is committed 00000004:00080000:1.0:1746129745.758087:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1870 committed 00000004:00080000:1.0:1746129745.758092:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1923 committed 00000004:00080000:1.0:1746129745.758098:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1922 committed 00000004:00080000:1.0:1746129745.758100:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1921 committed 00000004:00080000:1.0:1746129745.758101:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1920 committed 00000004:00080000:1.0:1746129745.758102:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1869 committed 00000004:00080000:1.0:1746129745.758104:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1919 committed 00000004:00080000:1.0:1746129745.758105:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1868 committed 00000004:00080000:1.0:1746129745.758107:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1918 committed 00000004:00080000:1.0:1746129745.758108:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1867 committed 00000004:00080000:1.0:1746129745.758109:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1866 committed 00000004:00080000:1.0:1746129745.758110:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1865 committed 00000004:00080000:1.0:1746129745.758112:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1917 committed 00000004:00080000:1.0:1746129745.758113:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1916 committed 00000004:00080000:1.0:1746129745.758114:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1864 committed 00000004:00080000:1.0:1746129745.758115:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1863 committed 00000004:00080000:1.0:1746129745.758117:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1915 committed 00000100:00100000:1.0:1746129745.758205:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053249920:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129745.758577:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053250304:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746129745.758879:0:3283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57e00/0x48868a4e43948893 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129745.758887:0:3283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57e00/0x48868a4e43948893 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129745.758893:0:3283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57e00/0x48868a4e43948893 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129745.758897:0:3283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091f57e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129745.758901:0:3283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57e00/0x48868a4e43948893 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129745.758906:0:3283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57e00/0x48868a4e43948893 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129745.758922:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129745.758924:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129745.758928:0:3283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57e00/0x48868a4e43948893 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129745.758932:0:3283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091f57e00/0x48868a4e43948893 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00000100:00100000:2.0:1746129745.759100:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129745.759127:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053250816:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129745.759141:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129745.759150:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053251328:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129745.759162:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129745.759171:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053251840:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129745.759180:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129745.759192:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746129745.759195:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053250944:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129745.759206:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129745.759214:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053251456:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129745.759225:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129745.759239:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053250176:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129745.759252:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129745.759262:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053250688:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129745.759275:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129745.759284:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053251200:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129745.759296:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129745.759304:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053251712:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129745.759315:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129745.759326:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1746129745.759330:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053250048:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129745.759343:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129745.759353:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053250560:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129745.759365:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129745.759373:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053251072:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129745.759384:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129745.759390:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053251584:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129745.759400:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129745.759416:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053250304 00000100:00100000:2.0:1746129745.759421:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053250304 00000100:00100000:2.0:1746129745.759449:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053250816 00000100:00100000:2.0:1746129745.759452:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053250816 00000100:00100000:2.0:1746129745.759458:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053251328 00000100:00100000:2.0:1746129745.759460:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053251328 00000100:00100000:2.0:1746129745.759467:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053251840 00000100:00100000:2.0:1746129745.759468:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053251840 00000100:00100000:2.0:1746129745.759473:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053250944 00000100:00100000:2.0:1746129745.759475:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053250944 00000100:00100000:2.0:1746129745.759480:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053251456 00000100:00100000:2.0:1746129745.759481:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053251456 00000100:00100000:2.0:1746129745.759486:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053250176 00000100:00100000:2.0:1746129745.759487:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053250176 00000100:00100000:2.0:1746129745.759492:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053250688 00000100:00100000:2.0:1746129745.759493:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053250688 00000100:00100000:2.0:1746129745.759498:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053251200 00000100:00100000:2.0:1746129745.759499:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053251200 00000100:00100000:2.0:1746129745.759515:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053251712 00000100:00100000:2.0:1746129745.759516:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053251712 00000100:00100000:2.0:1746129745.759524:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053250048 00000100:00100000:2.0:1746129745.759525:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053250048 00000100:00100000:2.0:1746129745.759530:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053250560 00000100:00100000:2.0:1746129745.759531:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053250560 00000100:00100000:2.0:1746129745.759535:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053251072 00000100:00100000:2.0:1746129745.759536:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053251072 00000100:00100000:2.0:1746129745.759540:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053251584 00000100:00100000:2.0:1746129745.759542:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053251584 00000100:00100000:2.0:1746129745.759549:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10546 00000100:00100000:2.0:1746129745.759555:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3298:x1830949053250304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129745.759704:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746129745.759708:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746129745.759709:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746129745.759711:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746129745.759712:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746129745.759738:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3298:x1830949053250304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 183us (639us total) trans 17179873037 rc 0/0 00000100:00100000:2.0:1746129745.759744:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10546 00000100:00100000:2.0:1746129745.759756:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10547 00000100:00100000:2.0:1746129745.759760:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3298:x1830949053250816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129745.759835:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3298:x1830949053250816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (692us total) trans 17179873038 rc 0/0 00000100:00100000:2.0:1746129745.759839:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10547 00000100:00100000:2.0:1746129745.759866:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10548 00000100:00100000:2.0:1746129745.759871:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3298:x1830949053251328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129745.759960:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3298:x1830949053251328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (796us total) trans 21474840204 rc 0/0 00000100:00100000:2.0:1746129745.759965:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10548 00000100:00100000:2.0:1746129745.759974:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10549 00000100:00100000:2.0:1746129745.759977:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3298:x1830949053251840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129745.760048:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3298:x1830949053251840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (866us total) trans 21474840205 rc 0/0 00000100:00100000:2.0:1746129745.760053:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10549 00000100:00100000:2.0:1746129745.760063:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10550 00000100:00100000:2.0:1746129745.760067:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3298:x1830949053250944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129745.760145:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3298:x1830949053250944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (937us total) trans 21474840206 rc 0/0 00000100:00100000:2.0:1746129745.760150:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10550 00000100:00100000:2.0:1746129745.760160:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10551 00000100:00100000:2.0:1746129745.760164:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3298:x1830949053251456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129745.760220:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746129745.760222:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746129745.760224:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746129745.760225:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746129745.760227:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746129745.760245:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3298:x1830949053251456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (1019us total) trans 21474840207 rc 0/0 00000100:00100000:2.0:1746129745.760250:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10551 00000100:00100000:2.0:1746129745.760259:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10552 00000100:00100000:2.0:1746129745.760264:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3297:x1830949053250176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129745.760353:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3297:x1830949053250176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (1098us total) trans 17179873039 rc 0/0 00000100:00100000:2.0:1746129745.760357:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10552 00000100:00100000:2.0:1746129745.760367:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10553 00000100:00100000:2.0:1746129745.760372:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3297:x1830949053250688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129745.760444:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3297:x1830949053250688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (1168us total) trans 17179873040 rc 0/0 00000100:00100000:2.0:1746129745.760449:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10553 00000100:00100000:2.0:1746129745.760456:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10554 00000100:00100000:2.0:1746129745.760460:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3297:x1830949053251200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129745.760549:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3297:x1830949053251200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (1251us total) trans 21474840208 rc 0/0 00000100:00100000:2.0:1746129745.760554:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10554 00000100:00100000:2.0:1746129745.760563:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10555 00000100:00100000:2.0:1746129745.760567:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3297:x1830949053251712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129745.760638:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3297:x1830949053251712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (1320us total) trans 21474840209 rc 0/0 00000100:00100000:2.0:1746129745.760643:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10555 00000100:00100000:2.0:1746129745.760651:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10556 00000100:00100000:2.0:1746129745.760655:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3297:x1830949053250048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129745.760732:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3297:x1830949053250048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (1387us total) trans 17179873041 rc 0/0 00000100:00100000:2.0:1746129745.760736:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10556 00000100:00100000:2.0:1746129745.760745:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10557 00000100:00100000:2.0:1746129745.760749:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3297:x1830949053250560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129745.760817:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3297:x1830949053250560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (1450us total) trans 17179873042 rc 0/0 00000100:00100000:2.0:1746129745.760821:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10557 00000100:00100000:2.0:1746129745.760830:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10558 00000100:00100000:2.0:1746129745.760833:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3297:x1830949053251072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129745.760930:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3297:x1830949053251072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (1544us total) trans 21474840210 rc 0/0 00000100:00100000:2.0:1746129745.760934:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10558 00000100:00100000:2.0:1746129745.760942:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10559 00000100:00100000:2.0:1746129745.760946:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3297:x1830949053251584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129745.761011:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3297:x1830949053251584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (1610us total) trans 21474840211 rc 0/0 00000100:00100000:2.0:1746129745.761015:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10559 00000100:00080000:2.0:1746129745.761044:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746129745.761048:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1746129745.761072:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a504c380/2, rc 0, transno 17179873041 00000100:00100000:2.0:1746129745.761081:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053250048:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129745.761088:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04c380/2, rc 0, transno 17179873042 00000100:00100000:2.0:1746129745.761090:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053250560:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129745.761097:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093289500/2, rc 0, transno 21474840210 00000100:00100000:2.0:1746129745.761100:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053251072:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129745.761106:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b024380/2, rc 0, transno 21474840211 00000100:00100000:2.0:1746129745.761108:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053251584:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129745.761113:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a504c000/2, rc 0, transno 17179873039 00000100:00100000:2.0:1746129745.761116:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053250176:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129745.761121:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04ea00/2, rc 0, transno 17179873040 00000100:00100000:2.0:1746129745.761123:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053250688:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129745.761129:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009328b800/2, rc 0, transno 21474840208 00000100:00100000:2.0:1746129745.761131:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053251200:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129745.761136:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b024e00/2, rc 0, transno 21474840209 00000100:00100000:2.0:1746129745.761139:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053251712:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129745.761187:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009328aa00/2, rc 0, transno 21474840206 00000100:00100000:2.0:1746129745.761190:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053250944:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129745.761196:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b026a00/2, rc 0, transno 21474840207 00000100:00100000:2.0:1746129745.761198:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053251456:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129745.761204:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a504d880/2, rc 0, transno 17179873037 00000100:00100000:2.0:1746129745.761206:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053250304:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129745.761212:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04f480/2, rc 0, transno 17179873038 00000100:00100000:2.0:1746129745.761215:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053250816:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129745.761220:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b026680/2, rc 0, transno 21474840204 00000100:00100000:2.0:1746129745.761223:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053251328:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129745.761229:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b027800/2, rc 0, transno 21474840205 00000100:00100000:2.0:1746129745.761231:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053251840:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129745.761237:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746129745.761242:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053251968:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129745.761265:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129745.761285:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053251968 00000100:00100000:2.0:1746129745.761288:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053251968 00000100:00100000:2.0:1746129745.761303:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10560 00000100:00100000:2.0:1746129745.761308:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3298:x1830949053251968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129745.761385:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3298:x1830949053251968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (119us total) trans 17179873043 rc 0/0 00000100:00100000:2.0:1746129745.761390:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10560 00000004:00080000:2.0:1746129745.761407:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130505f80/2, rc 0, transno 17179873043 00000100:00100000:2.0:1746129745.761411:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053251968:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129745.762155:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129745.762179:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053250432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129745.762194:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129745.762219:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053249920 00000100:00100000:1.0:1746129745.762222:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053249920 00000100:00100000:1.0:1746129745.762236:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053250432 00000100:00100000:1.0:1746129745.762238:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053250432 00000100:00100000:1.0:1746129745.762246:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10561 00000100:00100000:1.0:1746129745.762250:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3299:x1830949053249920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129745.762347:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3299:x1830949053249920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (193us total) trans 17179873044 rc 0/0 00000100:00100000:1.0:1746129745.762352:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10561 00000100:00100000:1.0:1746129745.762361:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10562 00000100:00100000:1.0:1746129745.762364:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3299:x1830949053250432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129745.762420:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3299:x1830949053250432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (224us total) trans 17179873045 rc 0/0 00000100:00100000:1.0:1746129745.762424:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10562 00000004:00080000:1.0:1746129745.762445:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a504fb80/2, rc 0, transno 17179873044 00000100:00100000:1.0:1746129745.762448:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053249920:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129745.762453:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8790a80/2, rc 0, transno 17179873045 00000100:00100000:1.0:1746129745.762455:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053250432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129745.765040:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.765291:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052061312 00000100:00100000:3.0:1746129745.765298:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052061312 00000100:00100000:3.0:1746129745.765343:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9791 00000100:00100000:3.0:1746129745.765351:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+7:28443:x1830949052061312:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129745.765369:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129745.765384:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135cabc00/0x48868a4e4394889a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ef43 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.765430:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135cabc00/0x48868a4e4394889a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef43 expref: 8 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.765441:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135cabc00/0x48868a4e4394889a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef43 expref: 8 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.765455:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129745.765458:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129745.765461:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135cabc00, rc 0) 00000100:00100000:3.0:1746129745.765517:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:28443:x1830949052061312:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 166us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129745.765523:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9791 00000100:00100000:0.0:1746129745.770966:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.771474:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052061440 00000100:00100000:2.0:1746129745.771481:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052061440 00000100:00100000:2.0:1746129745.772099:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9792 00000100:00100000:2.0:1746129745.772107:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:28443:x1830949052061440:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129745.772123:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129745.772138:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439488a1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ef4a expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.772202:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00a00/0x48868a4e439488a8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129745.772213:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00a00/0x48868a4e439488a8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129745.772224:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00a00/0x48868a4e439488a8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129745.772243:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:2.0:1746129745.772246:0:1851:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129745.772256:0:1851:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00a00/0x48868a4e439488a8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129745.772272:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439488a1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef4a expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.772287:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00a00/0x48868a4e439488a8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef4a expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.772294:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129745.772296:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129745.772298:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa00a00, rc 0) 00000100:00100000:2.0:1746129745.774325:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:28443:x1830949052061440:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 2210us (3358us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129745.774334:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9792 00000100:00100000:1.0:1746129745.778363:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.778633:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.778657:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.778676:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.778688:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.778711:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.778798:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052061568 00000100:00100000:3.0:1746129745.778806:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052061568 00000100:00100000:3.0:1746129745.778839:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052061696 00000100:00100000:3.0:1746129745.778841:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052061696 00000100:00100000:3.0:1746129745.778870:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052061824 00000100:00100000:3.0:1746129745.778872:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052061824 00000100:00100000:3.0:1746129745.778881:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052062080 00000100:00100000:3.0:1746129745.778883:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052062080 00000100:00100000:3.0:1746129745.778890:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052061952 00000100:00100000:3.0:1746129745.778891:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052061952 00000100:00100000:3.0:1746129745.779334:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052062208 00000100:00100000:3.0:1746129745.779337:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052062208 00000100:00100000:0.0:1746129745.779374:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10563 00000100:00100000:0.0:1746129745.779382:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+14:1961:x1830949052061568:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129745.779396:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129745.779413:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fe28600/0x48868a4e439488af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ef51 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129745.779433:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e8:0x0] initial LVB size: 1048576, mtime: 0x6813d352, atime: 0x6813d350, ctime: 0x6813d352, blocks: 0x807 00010000:00010000:0.0:1746129745.779450:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129745.779451:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129745.779458:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe28600/0x48868a4e439488af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef51 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129745.779471:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fe28600/0x48868a4e439488af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef51 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129745.779481:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe28600, rc 0) 00000100:00100000:0.0:1746129745.779525:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949052061568:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 144us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129745.779530:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10563 00000100:00100000:0.0:1746129745.779548:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10564 00000100:00100000:0.0:1746129745.779552:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+14:1961:x1830949052061696:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129745.779559:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129745.779567:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fe28800/0x48868a4e439488b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ef58 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129745.779580:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e6:0x0] initial LVB size: 2097152, mtime: 0x6813d352, atime: 0x6813d350, ctime: 0x6813d352, blocks: 0x81f 00010000:00010000:0.0:1746129745.779588:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129745.779590:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129745.779593:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe28800/0x48868a4e439488b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef58 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129745.779603:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fe28800/0x48868a4e439488b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef58 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129745.779609:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe28800, rc 0) 00000100:00100000:0.0:1746129745.779622:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949052061696:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 69us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129745.779626:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10564 00000100:00100000:0.0:1746129745.779635:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10565 00000100:00100000:0.0:1746129745.779639:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+14:1962:x1830949052061824:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129745.779644:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129745.779650:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fe28c00/0x48868a4e439488bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ef5f expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129745.779658:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e7:0x0] initial LVB size: 2097152, mtime: 0x6813d352, atime: 0x6813d350, ctime: 0x6813d352, blocks: 0x821 00010000:00010000:0.0:1746129745.779664:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129745.779665:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129745.779668:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe28c00/0x48868a4e439488bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef5f expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129745.779676:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fe28c00/0x48868a4e439488bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef5f expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129745.779682:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe28c00, rc 0) 00000100:00100000:0.0:1746129745.779694:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052061824:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 55us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129745.779698:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10565 00000100:00100000:0.0:1746129745.779706:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10566 00000100:00100000:0.0:1746129745.779711:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+14:1962:x1830949052062080:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129745.779715:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129745.779721:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fe29200/0x48868a4e439488c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ef6d expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129745.779730:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3eb:0x0] initial LVB size: 4960928, mtime: 0x6813d350, atime: 0x6813d350, ctime: 0x6813d351, blocks: 0x1629 00010000:00010000:0.0:1746129745.779736:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129745.779737:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129745.779741:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe29200/0x48868a4e439488c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef6d expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129745.779748:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fe29200/0x48868a4e439488c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef6d expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129745.779754:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe29200, rc 0) 00000100:00100000:0.0:1746129745.779766:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052062080:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 55us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129745.779770:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10566 00000100:00100000:0.0:1746129745.779779:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10567 00000100:00100000:0.0:1746129745.779783:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+14:1962:x1830949052061952:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129745.779788:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129745.779795:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fe28a00/0x48868a4e439488cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ef66 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129745.779803:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3ea:0x0] initial LVB size: 2097152, mtime: 0x6813d352, atime: 0x6813d350, ctime: 0x6813d352, blocks: 0x81f 00010000:00010000:0.0:1746129745.779808:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129745.779810:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129745.779813:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe28a00/0x48868a4e439488cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef66 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129745.779821:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fe28a00/0x48868a4e439488cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef66 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129745.779827:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe28a00, rc 0) 00000100:00100000:0.0:1746129745.779838:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052061952:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 55us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129745.779843:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10567 00000100:00100000:0.0:1746129745.779872:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10568 00000100:00100000:0.0:1746129745.779877:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+14:1962:x1830949052062208:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129745.779881:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129745.779888:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fe29400/0x48868a4e439488d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ef74 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129745.779897:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e8:0x0] initial LVB size: 4194304, mtime: 0x6813d351, atime: 0x6813d351, ctime: 0x6813d351, blocks: 0x1029 00010000:00010000:0.0:1746129745.779903:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129745.779904:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129745.779907:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe29400/0x48868a4e439488d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef74 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129745.779915:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fe29400/0x48868a4e439488d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef74 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129745.779922:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe29400, rc 0) 00000100:00100000:0.0:1746129745.779934:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052062208:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 57us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129745.779938:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10568 00000100:00100000:0.0:1746129745.786814:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.786872:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052062464 00000100:00100000:3.0:1746129745.786879:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052062464 00000100:00100000:3.0:1746129745.786924:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3892 00000100:00100000:3.0:1746129745.786930:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052062464:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129745.786956:0:21603:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec400/0x48868a4e439488d9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.786968:0:21603:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129745.786969:0:21603:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129745.786973:0:21603:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec400/0x48868a4e439488d9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.786982:0:21603:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec400/0x48868a4e439488d9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129745.801504:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.801551:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.801563:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.801572:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.801581:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.801599:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.801609:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.801627:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052062976 00000100:00100000:1.0:1746129745.801634:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052062976 00000100:00100000:1.0:1746129745.801671:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052062848 00000100:00100000:1.0:1746129745.801673:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052062848 00000100:00100000:1.0:1746129745.801684:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052063104 00000100:00100000:1.0:1746129745.801685:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052063104 00000100:00100000:1.0:1746129745.801695:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052063488 00000100:00100000:1.0:1746129745.801696:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052063488 00000100:00100000:1.0:1746129745.801705:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052063744 00000100:00100000:1.0:1746129745.801706:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052063744 00000100:00100000:1.0:1746129745.801712:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052063360 00000100:00100000:1.0:1746129745.801714:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052063360 00000100:00100000:1.0:1746129745.801720:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052063616 00000100:00100000:1.0:1746129745.801722:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052063616 00000100:00100000:1.0:1746129745.801733:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3893 00000100:00100000:1.0:1746129745.801739:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6141239f-0c60-480d-830c-e22ba61457b0+19:1961:x1830949052062976:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:1.0:1746129745.801769:0:8440:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e439488e0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.801782:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.801783:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.801787:0:8440:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e439488e0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.801799:0:8440:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e439488e0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129745.802968:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3894 00000100:00100000:1.0:1746129745.802978:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6141239f-0c60-480d-830c-e22ba61457b0+20:1961:x1830949052062848:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:1.0:1746129745.803002:0:21602:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a8c26400/0x48868a4e439488e7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.803010:0:21602:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.803011:0:21602:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129745.803014:0:21602:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8c26400/0x48868a4e439488e7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.803022:0:21602:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8c26400/0x48868a4e439488e7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129745.805567:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3895 00000100:00100000:2.0:1746129745.805578:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6141239f-0c60-480d-830c-e22ba61457b0+21:1961:x1830949052063104:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:2.0:1746129745.805609:0:21600:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fa01000/0x48868a4e439488ee lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.805619:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129745.805621:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129745.805625:0:21600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa01000/0x48868a4e439488ee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.805637:0:21600:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa01000/0x48868a4e439488ee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129745.806635:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3896 00000100:00100000:2.0:1746129745.806644:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6141239f-0c60-480d-830c-e22ba61457b0+18:1961:x1830949052063488:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:2.0:1746129745.806664:0:21605:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fa01800/0x48868a4e439488f5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.806672:0:21605:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129745.806673:0:21605:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129745.806676:0:21605:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa01800/0x48868a4e439488f5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.806683:0:21605:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa01800/0x48868a4e439488f5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129745.807579:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3897 00000100:00100000:2.0:1746129745.807586:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6141239f-0c60-480d-830c-e22ba61457b0+19:1961:x1830949052063744:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:2.0:1746129745.807602:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439488fc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.807609:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129745.807610:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129745.807613:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439488fc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.807619:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439488fc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129745.808733:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3898 00000100:00100000:3.0:1746129745.808742:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6141239f-0c60-480d-830c-e22ba61457b0+20:1961:x1830949052063360:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129745.808761:0:21599:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fedc00/0x48868a4e43948903 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.808769:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129745.808770:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129745.808773:0:21599:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fedc00/0x48868a4e43948903 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.808780:0:21599:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8fedc00/0x48868a4e43948903 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129745.809668:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3899 00000100:00100000:3.0:1746129745.809676:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6141239f-0c60-480d-830c-e22ba61457b0+21:1961:x1830949052063616:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129745.809692:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fed200/0x48868a4e4394890a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.809699:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129745.809700:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129745.809703:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fed200/0x48868a4e4394890a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.809711:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8fed200/0x48868a4e4394890a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.816838:0:21603:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec400/0x48868a4e439488d9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.816870:0:21603:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec400/0x48868a4e439488d9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.816877:0:21603:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec400/0x48868a4e439488d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.816882:0:21603:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8fec400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129745.816886:0:21603:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec400/0x48868a4e439488d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.816892:0:21603:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec400/0x48868a4e439488d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.816907:0:21603:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec400/0x48868a4e439488d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.816913:0:21603:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec400/0x48868a4e439488d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129745.816975:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6141239f-0c60-480d-830c-e22ba61457b0+21:1962:x1830949052062464:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 30041us (30163us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129745.816984:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3892 00010000:00010000:1.0:1746129745.829281:0:8440:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e439488e0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.829297:0:8440:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e439488e0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.829304:0:8440:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e439488e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.829310:0:8440:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8c27200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129745.829313:0:8440:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e439488e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.829320:0:8440:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e439488e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.829335:0:8440:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e439488e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.829346:0:8440:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e439488e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129745.829409:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6141239f-0c60-480d-830c-e22ba61457b0+19:1961:x1830949052062976:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 27665us (27908us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129745.829418:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3893 00010000:00010000:1.0:1746129745.837221:0:21602:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a8c26400/0x48868a4e439488e7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.837236:0:21602:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8c26400/0x48868a4e439488e7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.837243:0:21602:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a8c26400/0x48868a4e439488e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.837250:0:21602:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8c26400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129745.837253:0:21602:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a8c26400/0x48868a4e439488e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.837260:0:21602:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a8c26400/0x48868a4e439488e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.837275:0:21602:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a8c26400/0x48868a4e439488e7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.837281:0:21602:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8c26400/0x48868a4e439488e7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129745.840266:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6141239f-0c60-480d-830c-e22ba61457b0+17:1961:x1830949052062848:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 37282us (38704us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129745.840278:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3894 00010000:00010000:3.0:1746129745.844733:0:21600:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fa01000/0x48868a4e439488ee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.844748:0:21600:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa01000/0x48868a4e439488ee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.844754:0:21600:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fa01000/0x48868a4e439488ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.844762:0:21600:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa01000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129745.844765:0:21600:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fa01000/0x48868a4e439488ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.844773:0:21600:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fa01000/0x48868a4e439488ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.844789:0:21600:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fa01000/0x48868a4e439488ee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.844794:0:21600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa01000/0x48868a4e439488ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129745.846091:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949052063104:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 40509us (44520us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129745.846102:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3895 00010000:00010000:2.0:1746129745.851673:0:21605:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fa01800/0x48868a4e439488f5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.851692:0:21605:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa01800/0x48868a4e439488f5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.851698:0:21605:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fa01800/0x48868a4e439488f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.851704:0:21605:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa01800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129745.851708:0:21605:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fa01800/0x48868a4e439488f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.851714:0:21605:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fa01800/0x48868a4e439488f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.851730:0:21605:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fa01800/0x48868a4e439488f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.851735:0:21605:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa01800/0x48868a4e439488f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129745.851831:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6141239f-0c60-480d-830c-e22ba61457b0+21:1961:x1830949052063488:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 45184us (50251us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129745.851839:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3896 00010000:00010000:3.0:1746129745.856561:0:21599:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fedc00/0x48868a4e43948903 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.856576:0:21599:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fedc00/0x48868a4e43948903 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.856582:0:21599:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8fedc00/0x48868a4e43948903 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.856588:0:21599:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8fedc00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129745.856592:0:21599:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8fedc00/0x48868a4e43948903 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.856599:0:21599:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8fedc00/0x48868a4e43948903 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.856614:0:21599:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8fedc00/0x48868a4e43948903 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.856619:0:21599:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fedc00/0x48868a4e43948903 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129745.856698:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6141239f-0c60-480d-830c-e22ba61457b0+19:1961:x1830949052063360:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 47955us (55094us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129745.856706:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3898 00010000:00010000:3.0:1746129745.866713:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fed200/0x48868a4e4394890a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.866727:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fed200/0x48868a4e4394890a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.866734:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8fed200/0x48868a4e4394890a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.866740:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8fed200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129745.866743:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8fed200/0x48868a4e4394890a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.866749:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8fed200/0x48868a4e4394890a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.866765:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8fed200/0x48868a4e4394890a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.866771:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fed200/0x48868a4e4394890a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129745.866869:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6141239f-0c60-480d-830c-e22ba61457b0+17:1961:x1830949052063616:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 57168us (65231us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129745.866878:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3899 00010000:00010000:2.0:1746129745.870681:0:8441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439488fc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.870696:0:8441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439488fc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.870707:0:8441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439488fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.870713:0:8441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa01c00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129745.870716:0:8441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439488fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.870722:0:8441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439488fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.870737:0:8441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439488fc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.870742:0:8441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439488fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129745.870824:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949052063744:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 63234us (69236us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129745.870834:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3897 00000100:00100000:2.0:1746129745.876388:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.876455:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052064128 00000100:00100000:0.0:1746129745.876463:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052064128 00000100:00100000:0.0:1746129745.876522:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9793 00000100:00100000:0.0:1746129745.876532:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:28443:x1830949052064128:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:0.0:1746129745.876573:0:1851:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129745.876594:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00a00/0x48868a4e439488a8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef4a expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129745.876624:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129745.876628:0:1851:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129745.876658:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25f800/0x48868a4e43948911 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129745.876668:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25f800/0x48868a4e43948911 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129745.876675:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25f800/0x48868a4e43948911 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00010000:0.0:1746129745.876829:0:1851:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880130507100 reply state ffff88008f2fb000 transno 8589943563 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25f800/0x48868a4e43948911 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129745.876835:0:1851:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746129745.876948:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+10:28443:x1830949052064128:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 417us (565us total) trans 8589943563 rc 0/0 00000100:00100000:3.0:1746129745.876954:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9793 00000100:00100000:0.0:1746129745.878802:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129745.878963:0:3283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25f800/0x48868a4e43948911 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129745.878972:0:3283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25f800/0x48868a4e43948911 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129745.878978:0:3283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25f800/0x48868a4e43948911 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129745.878984:0:3283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f25f800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129745.878987:0:3283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25f800/0x48868a4e43948911 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129745.878993:0:3283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25f800/0x48868a4e43948911 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129745.879004:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129745.879007:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129745.879010:0:3283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25f800/0x48868a4e43948911 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129745.879014:0:3283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25f800/0x48868a4e43948911 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129745.879107:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.879168:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052064384 00000100:00100000:2.0:1746129745.879174:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052064384 00000100:00100000:0.0:1746129745.879251:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.879255:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052064640 00000100:00100000:3.0:1746129745.879258:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052064640 00000100:00100000:0.0:1746129745.879263:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.879331:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.879394:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052064896 00000100:00100000:3.0:1746129745.879397:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052064896 00000100:00100000:3.0:1746129745.879408:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052064256 00000100:00100000:3.0:1746129745.879409:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052064256 00000100:00100000:3.0:1746129745.879416:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052064512 00000100:00100000:3.0:1746129745.879418:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052064512 00000100:00100000:3.0:1746129745.879435:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10569 00000100:00100000:3.0:1746129745.879441:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+17:1962:x1830949052064384:12345-192.168.204.31@tcp:2:lfs.0 00000100:00100000:0.0:1746129745.879455:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.879466:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052064768 00000100:00100000:0.0:1746129745.879469:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052064768 00000100:00100000:0.0:1746129745.879483:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10570 00000100:00100000:0.0:1746129745.879487:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+17:1962:x1830949052064640:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:3.0:1746129745.879591:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129745.879591:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129745.879594:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129746 -> 1746129746 00002000:00010000:0.0:1746129745.879594:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129746 -> 1746129746 00002000:00010000:3.0:1746129745.879596:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129744 -> 1746129746 00002000:00010000:0.0:1746129745.879596:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746129744 -> 1746129746 00002000:00010000:3.0:1746129745.879597:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129746 -> 1746129746 00002000:00010000:0.0:1746129745.879598:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129746 -> 1746129746 00002000:00010000:3.0:1746129745.879599:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2079 00002000:00010000:0.0:1746129745.879600:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746129745.879634:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+18:1962:x1830949052064384:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 192us (836us total) trans 21474840212 rc 0/0 00000100:00100000:3.0:1746129745.879639:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10569 00000100:00100000:3.0:1746129745.879654:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10571 00000100:00100000:3.0:1746129745.879658:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+17:1962:x1830949052064896:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:3.0:1746129745.879716:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746129745.879718:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129745 -> 1746129746 00002000:00010000:3.0:1746129745.879720:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129745 -> 1746129746 00002000:00010000:3.0:1746129745.879722:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129745 -> 1746129746 00002000:00010000:3.0:1746129745.879723:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746129745.879749:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10572 00000100:00100000:2.0:1746129745.879754:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+18:1962:x1830949052064256:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:2.0:1746129745.879810:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746129745.879812:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129746 -> 1746129746 00002000:00010000:2.0:1746129745.879814:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129744 -> 1746129746 00002000:00010000:2.0:1746129745.879815:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129746 -> 1746129746 00002000:00010000:2.0:1746129745.879817:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:1.0:1746129745.879939:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10573 00000100:00100000:1.0:1746129745.879945:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+18:1962:x1830949052064512:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:1.0:1746129745.880001:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129745.880003:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129746 -> 1746129746 00002000:00010000:1.0:1746129745.880005:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129744 -> 1746129746 00002000:00010000:1.0:1746129745.880006:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129746 -> 1746129746 00002000:00010000:1.0:1746129745.880008:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129745.881433:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+19:1962:x1830949052064640:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 1941us (2322us total) trans 17179873046 rc 0/0 00000100:00100000:0.0:1746129745.881440:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10570 00000100:00100000:0.0:1746129745.881456:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10574 00000100:00100000:0.0:1746129745.881461:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a343850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+18:1962:x1830949052064768:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129745.881556:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:0.0:1746129745.881559:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129744 -> 1746129746 00002000:00010000:0.0:1746129745.881560:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129744 -> 1746129746 00002000:00010000:0.0:1746129745.881562:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129745 -> 1746129746 00002000:00010000:0.0:1746129745.881564:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5673 -> 5673 00000100:00100000:0.0:1746129745.881578:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a343850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+19:1962:x1830949052064768:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 117us (2122us total) trans 17179873048 rc 0/0 00000100:00100000:0.0:1746129745.881582:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10574 00000100:00100000:3.0:1746129745.881871:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+19:1962:x1830949052064896:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 2211us (2619us total) trans 21474840213 rc 0/0 00000100:00100000:3.0:1746129745.881876:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10571 00000100:00100000:2.0:1746129745.884607:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+18:1962:x1830949052064256:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 4844us (5334us total) trans 17179873047 rc 0/0 00000100:00100000:2.0:1746129745.884617:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10572 00000100:00100000:1.0:1746129745.884719:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+18:1962:x1830949052064512:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 4772us (5385us total) trans 21474840214 rc 0/0 00000100:00100000:1.0:1746129745.884726:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10573 00000100:00100000:0.0:1746129745.888980:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129745.889314:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052065152 00000100:00100000:1.0:1746129745.889321:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052065152 00000100:00100000:1.0:1746129745.889368:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3828 00000100:00100000:1.0:1746129745.889375:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:28443:x1830949052065152:12345-192.168.204.31@tcp:35:lfs.0 00000004:00010000:1.0:1746129745.889422:0:14317:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x368:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b814800/0x48868a4e4394885b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef3c expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.889460:0:14317:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37a00/0x48868a4e43948918 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14317 initiator: MDT0 00010000:00010000:1.0:1746129745.889470:0:14317:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135cabc00/0x48868a4e4394889a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef43 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.889480:0:14317:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37a00/0x48868a4e43948918 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 00010000:00010000:1.0:1746129745.889513:0:14317:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135cabc00/0x48868a4e4394889a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef43 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129745.889523:0:14317:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135cabc00/0x48868a4e4394889a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef43 expref: 9 pid: 16808 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746129745.889533:0:14317:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14317:1830949053252096:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129745.889618:0:14317:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129745.892899:0:14317:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14317:1830949053252096:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129745.892927:0:14317:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37a00/0x48868a4e43948918 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 00000100:00100000:0.0:1746129745.893090:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.893155:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052065280 00000100:00100000:2.0:1746129745.893161:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052065280 00010000:00010000:2.0:1746129745.893185:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135cabc00/0x48868a4e4394889a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef43 expref: 10 pid: 16808 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746129745.893208:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5086 00000100:00100000:2.0:1746129745.893213:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136887800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052065280:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129745.893223:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129745.893228:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135cabc00/0x48868a4e4394889a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef43 expref: 10 pid: 16808 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746129745.893236:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135cabc00/0x48868a4e4394889a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef43 expref: 10 pid: 16808 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746129745.893253:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135cabc00/0x48868a4e4394889a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef43 expref: 10 pid: 16808 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746129745.893709:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129745.893715:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37a00/0x48868a4e43948918 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 00010000:00010000:2.0:1746129745.893722:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37a00/0x48868a4e43948918 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14317 initiator: MDT0 00010000:00010000:2.0:1746129745.893728:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37a00/0x48868a4e43948918 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14317 initiator: MDT0 00010000:00010000:2.0:1746129745.893754:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129745.893788:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136887800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052065280:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 574us (699us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129745.893790:0:14317:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37a00/0x48868a4e43948918 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 00000100:00100000:2.0:1746129745.893794:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5086 00010000:00010000:3.0:1746129745.893796:0:14317:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37a00/0x48868a4e43948918 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 00000040:00080000:3.0:1746129745.894325:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2741, 88 off228048 00000004:00080000:3.0:1746129745.894331:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691952482429ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129745.894379:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2685, 88 off223208 00000004:00080000:3.0:1746129745.894383:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691952534713ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129745.894583:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2686, 88 off223296 00000004:00080000:3.0:1746129745.894588:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691952739857ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129745.894595:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2742, 88 off228136 00000004:00080000:3.0:1746129745.894597:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691952748999ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129745.894605:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2743, 88 off228224 00000004:00080000:3.0:1746129745.894607:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691952759047ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129745.894612:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2687, 88 off223384 00000004:00080000:3.0:1746129745.894614:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691952766412ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129745.894619:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2688, 88 off223472 00000004:00080000:3.0:1746129745.894621:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691952773611ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129745.894626:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2689, 88 off223560 00000004:00080000:3.0:1746129745.894628:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691952780402ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129745.894634:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2744, 88 off228312 00000004:00080000:3.0:1746129745.894635:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691952787521ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129745.894641:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2690, 88 off223648 00000004:00080000:3.0:1746129745.894643:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691952794817ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129745.894647:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2745, 88 off228400 00000004:00080000:3.0:1746129745.894649:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691952801222ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129745.894654:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2691, 88 off223736 00000004:00080000:3.0:1746129745.894655:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691952807672ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129745.894660:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2746, 88 off228488 00000004:00080000:3.0:1746129745.894662:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691952813988ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129745.894667:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2747, 88 off228576 00000004:00080000:3.0:1746129745.894668:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691952820467ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129745.894673:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2748, 88 off228664 00000004:00080000:3.0:1746129745.894675:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691952826818ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129745.894680:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2749, 88 off228752 00000004:00080000:3.0:1746129745.894681:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691952833669ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129745.894686:0:14317:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2692, 88 off223824 00000004:00080000:3.0:1746129745.894688:0:14317:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691952840321ns, next at 641623252291ns, rc = 0 00000004:00010000:2.0:1746129745.913982:0:14317:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880136884e00 reply state ffff8800918ca800 transno 8589943564 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37a00/0x48868a4e43948918 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 00000001:00080000:1.0:1746129745.913990:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943563 is committed 00000100:00100000:2.0:1746129745.913995:0:14317:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1746129745.914000:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943564 is committed 00010000:00010000:2.0:1746129745.914002:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00000004:00080000:1.0:1746129745.914002:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1878 committed 00010000:00010000:2.0:1746129745.914004:0:14317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000004:00080000:1.0:1746129745.914010:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1932 committed 00010000:00010000:2.0:1746129745.914012:0:14317:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b814800/0x48868a4e4394885b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef3c expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746129745.914014:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1931 committed 00000004:00080000:1.0:1746129745.914016:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1930 committed 00000004:00080000:1.0:1746129745.914017:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1929 committed 00000004:00080000:1.0:1746129745.914018:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1877 committed 00000004:00080000:1.0:1746129745.914019:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1928 committed 00000004:00080000:1.0:1746129745.914021:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1876 committed 00000004:00080000:1.0:1746129745.914022:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1927 committed 00000004:00080000:1.0:1746129745.914023:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1875 committed 00000004:00080000:1.0:1746129745.914024:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1874 committed 00000004:00080000:1.0:1746129745.914026:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1873 committed 00000004:00080000:1.0:1746129745.914027:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1926 committed 00000004:00080000:1.0:1746129745.914028:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1925 committed 00000004:00080000:1.0:1746129745.914029:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1872 committed 00000004:00080000:1.0:1746129745.914031:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1871 committed 00000004:00080000:1.0:1746129745.914032:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1924 committed 00010000:00080000:2.0:1746129745.914091:0:14317:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746129745.914100:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+7:28443:x1830949052065152:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 24726us (25127us total) trans 8589943564 rc 0/0 00000100:00100000:2.0:1746129745.914109:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3828 00000100:00100000:1.0:1746129745.914114:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053252224:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129745.914131:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053252352:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129745.914149:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053252480:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129745.914149:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129745.914165:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129745.914170:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053252736:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129745.914175:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053252992:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129745.914183:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746129745.914190:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37a00/0x48868a4e43948918 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 00010000:00010000:2.0:1746129745.914197:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37a00/0x48868a4e43948918 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14317 initiator: MDT0 00000100:00100000:1.0:1746129745.914200:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8793b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053252608:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746129745.914203:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37a00/0x48868a4e43948918 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 00010000:00010000:2.0:1746129745.914208:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d37a00 already unused, calling callback (ffffffffa1371690) 00000100:00100000:1.0:1746129745.914211:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746129745.914212:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37a00/0x48868a4e43948918 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 00010000:00010000:2.0:1746129745.914218:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37a00/0x48868a4e43948918 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14317 initiator: MDT0 00000100:00100000:1.0:1746129745.914219:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053253120:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746129745.914229:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00000100:00100000:1.0:1746129745.914230:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746129745.914231:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129745.914234:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37a00/0x48868a4e43948918 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 00010000:00010000:2.0:1746129745.914239:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37a00/0x48868a4e43948918 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 00000100:00100000:2.0:1746129745.914250:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129745.914261:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053252864:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129745.914272:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129745.914288:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053252224 00000100:00100000:2.0:1746129745.914293:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053252224 00000100:00100000:2.0:1746129745.914314:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053252480 00000100:00100000:2.0:1746129745.914315:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053252480 00000100:00100000:1.0:1746129745.914318:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053252736 00000100:00100000:1.0:1746129745.914320:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053252736 00000100:00100000:2.0:1746129745.914323:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053252608 00000100:00100000:2.0:1746129745.914324:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053252608 00000100:00100000:1.0:1746129745.914331:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053253120 00000100:00100000:2.0:1746129745.914332:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053252352 00000100:00100000:2.0:1746129745.914333:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053252352 00000100:00100000:1.0:1746129745.914333:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053253120 00000100:00100000:2.0:1746129745.914340:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053252864 00000100:00100000:2.0:1746129745.914342:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053252864 00000100:00100000:1.0:1746129745.914344:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10575 00000100:00100000:2.0:1746129745.914349:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10576 00000100:00100000:1.0:1746129745.914349:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:3296:x1830949053252224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129745.914352:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:3298:x1830949053252480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129745.914362:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10577 00000100:00100000:2.0:1746129745.914365:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3296:x1830949053252736:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129745.914395:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10578 00000100:00100000:1.0:1746129745.914399:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:3299:x1830949053252608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129745.914441:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10579 00000100:00100000:1.0:1746129745.914445:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3299:x1830949053253120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129745.914472:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10580 00000100:00100000:1.0:1746129745.914476:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3297:x1830949053252352:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129745.914490:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746129745.914492:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746129745.914494:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746129745.914496:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746129745.914497:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746129745.914531:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3296:x1830949053252736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 164us (347us total) trans 21474840215 rc 0/0 00000100:00100000:2.0:1746129745.914536:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10577 00000100:00100000:2.0:1746129745.914545:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10581 00000100:00100000:2.0:1746129745.914549:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3297:x1830949053252864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129745.914570:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3299:x1830949053252608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 170us (357us total) trans 21474840216 rc 0/0 00000100:00100000:1.0:1746129745.914574:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10578 00000100:00100000:2.0:1746129745.914620:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3297:x1830949053252864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (347us total) trans 21474840217 rc 0/0 00000100:00100000:2.0:1746129745.914625:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10581 00002000:00010000:1.0:1746129745.914636:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129745.914638:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129746 -> 1746129746 00002000:00010000:1.0:1746129745.914640:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129746 -> 1746129746 00000100:00100000:2.0:1746129745.914642:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746129745.914642:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129746 -> 1746129746 00002000:00010000:1.0:1746129745.914644:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746129745.914658:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053252992 00000100:00100000:2.0:1746129745.914660:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053252992 00000100:00100000:1.0:1746129745.914660:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3297:x1830949053252352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 183us (409us total) trans 21474840218 rc 0/0 00000100:00100000:1.0:1746129745.914664:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10580 00000100:00100000:2.0:1746129745.914670:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10582 00000100:00100000:2.0:1746129745.914674:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3298:x1830949053252992:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129745.914690:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8793b80/2, rc 0, transno 21474840216 00000100:00100000:1.0:1746129745.914695:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8793b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053252608:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129745.914715:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009423df80/2, rc 0, transno 21474840218 00000100:00100000:2.0:1746129745.914718:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053252352:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129745.914723:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009468d880/2, rc 0, transno 21474840217 00000100:00100000:2.0:1746129745.914726:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053252864:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129745.914750:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3299:x1830949053253120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 305us (519us total) trans 21474840219 rc 0/0 00000100:00100000:1.0:1746129745.914755:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10579 00000004:00080000:1.0:1746129745.914771:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009468c000/2, rc 0, transno 21474840219 00000100:00100000:2.0:1746129745.914773:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3298:x1830949053252992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (130us total) trans 21474840220 rc 0/0 00000100:00100000:1.0:1746129745.914774:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053253120:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129745.914777:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10582 00000004:00080000:2.0:1746129745.914793:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009468e680/2, rc 0, transno 21474840220 00000100:00100000:2.0:1746129745.914796:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053252992:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129745.914830:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129745.914833:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129746 -> 1746129746 00002000:00010000:1.0:1746129745.914835:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129746 -> 1746129746 00002000:00010000:1.0:1746129745.914836:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129746 -> 1746129746 00002000:00010000:1.0:1746129745.914838:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2079 00002000:00010000:2.0:1746129745.914876:0:20441:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:1.0:1746129745.914876:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3296:x1830949053252224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 525us (725us total) trans 21474840221 rc 0/0 00002000:00010000:2.0:1746129745.914878:0:20441:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129746 -> 1746129746 00002000:00010000:2.0:1746129745.914880:0:20441:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129746 -> 1746129746 00000100:00100000:1.0:1746129745.914880:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10575 00002000:00010000:2.0:1746129745.914882:0:20441:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129746 -> 1746129746 00002000:00010000:2.0:1746129745.914884:0:20441:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000004:00080000:1.0:1746129745.914900:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009423e300/2, rc 0, transno 21474840221 00000100:00100000:2.0:1746129745.914902:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3298:x1830949053252480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 549us (735us total) trans 21474840222 rc 0/0 00000100:00100000:1.0:1746129745.914903:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053252224:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129745.914906:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10576 00000004:00080000:1.0:1746129745.914909:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8790380/2, rc 0, transno 21474840215 00000100:00100000:1.0:1746129745.914911:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053252736:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129745.914921:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009423d880/2, rc 0, transno 21474840222 00000100:00100000:2.0:1746129745.914924:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053252480:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129745.916620:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053253376:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129745.916654:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129745.916682:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053253888:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129745.916695:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053253376 00000100:00100000:2.0:1746129745.916696:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129745.916699:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053253376 00000100:00100000:2.0:1746129745.916709:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746129745.916713:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053253248:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129745.916717:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053253888 00000100:00100000:3.0:1746129745.916718:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053253888 00000100:00100000:3.0:1746129745.916728:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10583 00000100:00100000:2.0:1746129745.916728:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129745.916733:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+33:3297:x1830949053253376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129745.916736:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053253760:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129745.916746:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129745.916773:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053253504:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129745.916781:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053253248 00000100:00100000:0.0:1746129745.916784:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053253248 00000100:00100000:2.0:1746129745.916787:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129745.916796:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053254016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129745.916797:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053253760 00000100:00100000:0.0:1746129745.916799:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053253760 00000100:00100000:0.0:1746129745.916807:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053253504 00000100:00100000:0.0:1746129745.916808:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053253504 00000100:00100000:2.0:1746129745.916810:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129745.916817:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053254016 00000100:00100000:0.0:1746129745.916818:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053254016 00000100:00100000:2.0:1746129745.916819:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746129745.916823:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053253632:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129745.916826:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10584 00000100:00100000:0.0:1746129745.916830:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3297:x1830949053253888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129745.916834:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129745.916840:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053254144:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129745.916869:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129745.916884:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053253632 00000100:00100000:2.0:1746129745.916886:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053253632 00000100:00100000:2.0:1746129745.916896:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053254144 00000100:00100000:2.0:1746129745.916897:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053254144 00000100:00100000:2.0:1746129745.916903:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10585 00000100:00100000:2.0:1746129745.916906:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+39:3297:x1830949053253248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129745.916947:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10586 00000100:00100000:0.0:1746129745.916953:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3297:x1830949053253760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129745.917007:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10587 00000100:00100000:1.0:1746129745.917013:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3298:x1830949053253504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129745.917023:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10588 00000100:00100000:1.0:1746129745.917026:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3298:x1830949053254016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129745.917761:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10589 00000100:00100000:2.0:1746129745.917768:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3298:x1830949053253632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129745.917779:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10590 00000100:00100000:2.0:1746129745.917783:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3298:x1830949053254144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129745.917986:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.918037:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052065408 00000100:00100000:2.0:1746129745.918041:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052065408 00000100:00100000:2.0:1746129745.918064:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9794 00000100:00100000:2.0:1746129745.918068:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+6:28443:x1830949052065408:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129745.918081:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129745.918095:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092841200/0x48868a4e4394891f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ef7b expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.918136:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092841200/0x48868a4e4394891f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef7b expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.918148:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092841200/0x48868a4e4394891f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef7b expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129745.918210:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3297:x1830949053253888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1378us (1511us total) trans 17179873049 rc 0/0 00000100:00100000:1.0:1746129745.918215:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10584 00000004:00080000:1.0:1746129745.918254:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd46680/2, rc 0, transno 17179873049 00000100:00100000:1.0:1746129745.918270:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053253888:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746129745.918549:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129745.918551:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129745.918553:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092841200, rc 0) 00000100:00100000:2.0:1746129745.918579:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+7:28443:x1830949052065408:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 510us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129745.918584:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9794 00000100:00100000:1.0:1746129745.918757:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053254272:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129745.918780:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746129745.918994:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746129745.918997:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129746 -> 1746129746 00002000:00010000:0.0:1746129745.918999:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129746 -> 1746129746 00002000:00010000:0.0:1746129745.919001:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129746 -> 1746129746 00002000:00010000:0.0:1746129745.919002:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1746129745.919027:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3297:x1830949053253248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2120us (2298us total) trans 17179873051 rc 0/0 00000100:00100000:0.0:1746129745.919032:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10585 00000100:00100000:0.0:1746129745.919042:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053254272 00000100:00100000:0.0:1746129745.919045:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053254272 00000004:00080000:1.0:1746129745.919176:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd47b80/2, rc 0, transno 17179873051 00000100:00100000:1.0:1746129745.919181:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053253248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129745.919562:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10591 00000100:00100000:0.0:1746129745.919569:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3296:x1830949053254272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129745.920063:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+42:3296:x1830949053254272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 494us (1281us total) trans 17179873052 rc 0/0 00000100:00100000:0.0:1746129745.920068:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10591 00000004:00080000:1.0:1746129745.920199:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd45500/2, rc 0, transno 17179873052 00000100:00100000:1.0:1746129745.920203:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053254272:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129745.920252:0:3623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:2.0:1746129745.920256:0:3623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129746 -> 1746129746 00002000:00010000:2.0:1746129745.920257:0:3623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129746 -> 1746129746 00002000:00010000:2.0:1746129745.920259:0:3623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129746 -> 1746129746 00002000:00010000:2.0:1746129745.920261:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5673 -> 5673 00000100:00100000:2.0:1746129745.920286:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+43:3298:x1830949053253504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3273us (3497us total) trans 17179873053 rc 0/0 00000100:00100000:2.0:1746129745.920291:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10587 00000100:00100000:1.0:1746129745.920302:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3298:x1830949053254016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3275us (3491us total) trans 17179873054 rc 0/0 00000100:00100000:1.0:1746129745.920307:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10588 00000004:00080000:2.0:1746129745.920313:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd44000/2, rc 0, transno 17179873053 00000100:00100000:2.0:1746129745.920316:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053253504:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129745.920323:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd45180/2, rc 0, transno 17179873054 00000100:00100000:2.0:1746129745.920326:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053254016:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129745.920513:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129745.920516:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746129745.920517:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746129745.920519:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746129745.920521:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746129745.920546:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+42:3298:x1830949053253632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2778us (3710us total) trans 17179873055 rc 0/0 00000100:00100000:3.0:1746129745.920550:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10589 00000100:00100000:0.0:1746129745.920842:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+42:3297:x1830949053253760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3888us (4093us total) trans 17179873056 rc 0/0 00000100:00100000:0.0:1746129745.920864:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10586 00000004:00080000:1.0:1746129745.921306:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd45c00/2, rc 0, transno 17179873056 00000100:00100000:1.0:1746129745.921311:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053253760:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129745.921629:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+42:3298:x1830949053254144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3845us (4758us total) trans 17179873057 rc 0/0 00000100:00100000:2.0:1746129745.921634:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10590 00000004:00080000:2.0:1746129745.921663:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd44e00/2, rc 0, transno 17179873055 00000100:00100000:2.0:1746129745.921666:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053253632:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129745.921672:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd47800/2, rc 0, transno 17179873057 00000100:00100000:2.0:1746129745.921674:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053254144:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129745.921746:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129745.921749:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129746 -> 1746129746 00002000:00010000:3.0:1746129745.921750:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746129746 -> 1746129746 00002000:00010000:3.0:1746129745.921751:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129746 -> 1746129746 00002000:00010000:3.0:1746129745.921753:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746129745.921787:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3297:x1830949053253376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 5053us (5132us total) trans 17179873050 rc 0/0 00000100:00100000:3.0:1746129745.921791:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10583 00000004:00080000:1.0:1746129745.921916:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd45f80/2, rc 0, transno 17179873050 00000100:00100000:1.0:1746129745.921920:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053253376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129745.923091:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.923160:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052065664 00000100:00100000:2.0:1746129745.923165:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052065664 00000100:00100000:2.0:1746129745.923363:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3829 00000100:00100000:2.0:1746129745.923371:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+7:28443:x1830949052065664:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:2.0:1746129745.923869:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+8:28443:x1830949052065664:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 476us (757us total) trans 8589943565 rc 0/0 00000100:00100000:2.0:1746129745.923875:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3829 00000100:00100000:0.0:1746129745.953061:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129745.953113:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.953196:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052065920 00000100:00100000:2.0:1746129745.953204:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052065920 00000100:00100000:2.0:1746129745.953236:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052066176 00000100:00100000:2.0:1746129745.953238:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052066176 00000100:00100000:2.0:1746129745.953255:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9795 00000100:00100000:2.0:1746129745.953261:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+281:28451:x1830949052065920:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129745.953283:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129745.953299:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e43948926 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ef82 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.953398:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e4394892d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.953410:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e4394892d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.953420:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e4394892d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.953432:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e43948934 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.953437:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e43948934 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.953443:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e43948934 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.953572:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394893b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.953579:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394893b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.953585:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394893b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:2.0:1746129745.953592:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129745.953664:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e4394892d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.953670:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e4394892d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.953679:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e4394892d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.953683:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d7f8a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129745.953686:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e4394892d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.953691:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e4394892d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.953699:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129745.953701:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129745.953704:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e4394892d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.953708:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e4394892d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.953734:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e43948934 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.953739:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e43948934 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.953742:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e43948934 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.953746:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d7f8e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129745.953748:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e43948934 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.953752:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e43948934 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.953761:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800acd6ae00) 00010000:00010000:2.0:1746129745.953762:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129745.953764:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e43948934 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.953768:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e43948934 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.953798:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e43948926 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef82 expref: 284 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.953823:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394893b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef82 expref: 283 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.953827:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129745.953829:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129745.953831:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d7f9a00, rc 0) 00000100:00100000:2.0:1746129745.953899:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28451:x1830949052065920:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 637us (850us total) trans 8589943566 rc 0/0 00000100:00100000:2.0:1746129745.953905:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9795 00000100:00100000:2.0:1746129745.953923:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9796 00000100:00100000:2.0:1746129745.953928:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:28453:x1830949052066176:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129745.953937:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129745.953942:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092840200/0x48868a4e43948949 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ef89 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.953980:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8cc00/0x48868a4e43948950 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.953986:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8cc00/0x48868a4e43948950 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.953991:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8cc00/0x48868a4e43948950 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.953998:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8c600/0x48868a4e43948957 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.954002:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8c600/0x48868a4e43948957 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.954006:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8c600/0x48868a4e43948957 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.954049:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a10b800/0x48868a4e4394895e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.954055:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a10b800/0x48868a4e4394895e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.954060:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a10b800/0x48868a4e4394895e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:2.0:1746129745.954064:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129745.954096:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8cc00/0x48868a4e43948950 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.954101:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8cc00/0x48868a4e43948950 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.954106:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8cc00/0x48868a4e43948950 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.954113:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094b8cc00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129745.954114:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8cc00/0x48868a4e43948950 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.954118:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8cc00/0x48868a4e43948950 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.954126:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129745.954127:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129745.954129:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8cc00/0x48868a4e43948950 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.954132:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8cc00/0x48868a4e43948950 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.954138:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8c600/0x48868a4e43948957 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.954142:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8c600/0x48868a4e43948957 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.954145:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8c600/0x48868a4e43948957 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.954148:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094b8c600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129745.954150:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8c600/0x48868a4e43948957 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.954154:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8c600/0x48868a4e43948957 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.954159:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129cec900) 00010000:00010000:2.0:1746129745.954160:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129745.954162:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8c600/0x48868a4e43948957 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.954166:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8c600/0x48868a4e43948957 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129745.954185:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092840200/0x48868a4e43948949 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef89 expref: 10 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.954193:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a10b800/0x48868a4e4394895e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef89 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.954199:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129745.954200:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129745.954202:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a10b800, rc 0) 00000100:00100000:2.0:1746129745.954219:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28453:x1830949052066176:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 291us (1106us total) trans 8589943567 rc 0/0 00000100:00100000:2.0:1746129745.954225:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9796 00000100:00100000:0.0:1746129745.957540:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.957661:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052066432 00000100:00100000:2.0:1746129745.957672:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052066432 00000100:00100000:2.0:1746129745.957813:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9797 00000100:00100000:2.0:1746129745.957824:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28456:x1830949052066432:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129745.957997:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129745.958015:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8cc00/0x48868a4e4394896c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ef90 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.958107:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e43948973 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129745.958122:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e43948973 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129745.958134:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e43948973 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129745.958146:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129745.958264:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8cc00/0x48868a4e4394896c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef90 expref: 286 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.959725:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e43948973 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef90 expref: 285 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.959734:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129745.959736:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746129745.959739:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d7f9800, rc 0) 00000100:00100000:3.0:1746129745.960320:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28456:x1830949052066432:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2496us (2786us total) trans 8589943568 rc 0/0 00000100:00100000:3.0:1746129745.960328:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9797 00000100:00100000:0.0:1746129745.960753:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.960817:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052066560 00000100:00100000:3.0:1746129745.960823:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052066560 00000100:00100000:3.0:1746129745.960882:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10592 00000100:00100000:3.0:1746129745.960888:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28457:x1830949052066560:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129745.960901:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129745.960912:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094b8c600/0x48868a4e43948981 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ef97 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.960930:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129745.960931:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129745.960937:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094b8c600/0x48868a4e43948981 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef97 expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.960949:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094b8c600/0x48868a4e43948981 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef97 expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.960956:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094b8c600, rc 0) 00000100:00100000:3.0:1746129745.960975:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28457:x1830949052066560:12345-192.168.204.31@tcp:101:cat.0 Request processed in 88us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129745.960980:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10592 00000100:00100000:0.0:1746129745.966376:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.966470:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052066816 00000100:00100000:2.0:1746129745.966478:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052066816 00002000:00100000:2.0:1746129745.966530:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880136887480 x1830949052066816/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.966538:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136887480 with x1830949052066816 ext(0->1048575) 00002000:00010000:2.0:1746129745.966543:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136887480 00000100:00100000:2.0:1746129745.966569:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3900 00000100:00100000:2.0:1746129745.966576:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052066816:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129745.975088:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.975554:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052066944 00000100:00100000:2.0:1746129745.975562:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052066944 00000100:00100000:2.0:1746129745.975609:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10593 00000100:00100000:2.0:1746129745.975616:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:28456:x1830949052066944:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129745.975633:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129745.975649:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092840200/0x48868a4e43948988 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ef9e expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.975669:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129745.975670:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129745.975676:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092840200/0x48868a4e43948988 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef9e expref: 22 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.975687:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092840200/0x48868a4e43948988 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef9e expref: 22 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129745.975696:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092840200, rc 0) 00000100:00100000:2.0:1746129745.975733:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:28456:x1830949052066944:12345-192.168.204.31@tcp:101:cat.0 Request processed in 117us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129745.975738:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10593 00000100:00100000:0.0:1746129745.984340:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129745.985111:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052066816:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18530us (18737us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129745.985123:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3900 00002000:00100000:2.0:1746129745.985136:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880136887480 x1830949052066816/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:486/0 lens 488/440 e 0 to 0 dl 1746129756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.985144:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136887480 with x1830949052066816 ext(0->1048575) 00002000:00010000:2.0:1746129745.985150:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136887480 00000100:00100000:2.0:1746129745.985792:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052067200 00000100:00100000:2.0:1746129745.985801:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052067200 00002000:00100000:2.0:1746129745.985833:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880136884000 x1830949052067200/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/0 e 0 to 0 dl 1746129756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129745.985840:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136884000 with x1830949052067200 ext(0->1048575) 00002000:00010000:2.0:1746129745.985845:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136884000 00000100:00100000:2.0:1746129745.986500:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3901 00000100:00100000:2.0:1746129745.986518:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949052067200:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129745.996329:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129745.998074:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052067456 00000100:00100000:3.0:1746129745.998083:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052067456 00000100:00100000:3.0:1746129745.998552:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9798 00000100:00100000:3.0:1746129745.998560:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28453:x1830949052067456:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129745.998581:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129745.998584:0:14315:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746129745.998605:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a10b800/0x48868a4e4394895e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef89 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.998625:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129745.998629:0:14315:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129745.998639:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fedc00/0x48868a4e4394898f lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34efa5 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.999564:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43948996 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129745.999577:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092841200/0x48868a4e4394891f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef7b expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.999587:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e43948973 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef90 expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.999591:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394893b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef82 expref: 284 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.999596:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43948996 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129745.999620:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394893b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef82 expref: 284 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.999630:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394893b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef82 expref: 284 pid: 16808 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746129745.999640:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053254400:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129745.999705:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e43948973 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef90 expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.999712:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e43948973 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef90 expref: 284 pid: 14315 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746129745.999718:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053254528:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129745.999740:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092841200/0x48868a4e4394891f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef7b expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129745.999747:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092841200/0x48868a4e4394891f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef7b expref: 7 pid: 1851 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746129745.999753:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053254656:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129745.999765:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129746.001620:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.001835:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052067584 00000100:00100000:3.0:1746129746.001842:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052067584 00000100:00100000:3.0:1746129746.001898:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10594 00000100:00100000:3.0:1746129746.001904:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28457:x1830949052067584:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129746.001916:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129746.001927:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094f27c00/0x48868a4e4394899d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34efac expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.001944:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.001945:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.001950:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094f27c00/0x48868a4e4394899d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efac expref: 16 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.001962:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094f27c00/0x48868a4e4394899d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efac expref: 16 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.001970:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f27c00, rc 0) 00000100:00100000:3.0:1746129746.002015:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28457:x1830949052067584:12345-192.168.204.31@tcp:101:cat.0 Request processed in 111us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129746.002020:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10594 00000100:00100000:2.0:1746129746.003065:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949052067200:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16546us (18729us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129746.003074:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3901 00002000:00100000:2.0:1746129746.003081:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880136884000 x1830949052067200/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:486/0 lens 488/440 e 0 to 0 dl 1746129756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129746.003089:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136884000 with x1830949052067200 ext(0->1048575) 00002000:00010000:2.0:1746129746.003094:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136884000 00000100:00100000:3.0:1746129746.005211:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053254400:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129746.005220:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053254528:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129746.005227:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053254656:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129746.005264:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43948996 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129746.006155:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.006184:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.006208:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.006251:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.006279:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052067712 00000100:00100000:0.0:1746129746.006284:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052067712 00010000:00010000:0.0:1746129746.006338:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394893b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef82 expref: 285 pid: 16808 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746129746.006377:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052067840 00000100:00100000:0.0:1746129746.006379:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052067840 00010000:00010000:0.0:1746129746.006389:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e43948973 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef90 expref: 286 pid: 14315 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746129746.006399:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052067968 00000100:00100000:0.0:1746129746.006401:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052067968 00010000:00010000:0.0:1746129746.006407:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092841200/0x48868a4e4394891f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef7b expref: 8 pid: 1851 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746129746.006420:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5087 00000100:00100000:0.0:1746129746.006425:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:1963:x1830949052067712:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129746.006435:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129746.006440:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394893b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef82 expref: 286 pid: 16808 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.006453:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394893b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef82 expref: 286 pid: 16808 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.006470:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394893b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef82 expref: 286 pid: 16808 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.006482:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129746.006486:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43948996 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129746.006492:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43948996 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129746.006497:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129746.006534:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:1963:x1830949052067712:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 108us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129746.006540:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5087 00000100:00100000:0.0:1746129746.006553:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5088 00000100:00100000:0.0:1746129746.006558:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:1963:x1830949052067840:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129746.006564:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129746.006568:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e43948973 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef90 expref: 284 pid: 14315 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.006574:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e43948973 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef90 expref: 284 pid: 14315 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.006584:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e43948973 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef90 expref: 284 pid: 14315 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.006592:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129746.006595:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43948996 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129746.006599:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43948996 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129746.006604:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129746.006619:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:1963:x1830949052067840:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 60us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129746.006624:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5088 00000100:00100000:0.0:1746129746.006632:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5089 00000100:00100000:0.0:1746129746.006636:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052067968:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129746.006642:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129746.006645:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092841200/0x48868a4e4394891f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef7b expref: 8 pid: 1851 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.006653:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092841200/0x48868a4e4394891f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef7b expref: 8 pid: 1851 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.006664:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092841200/0x48868a4e4394891f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef7b expref: 8 pid: 1851 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.006682:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129746.006684:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43948996 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129746.006690:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43948996 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129746.006697:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43948996 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129746.006710:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129746.006725:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+7:1962:x1830949052067968:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 87us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129746.006730:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5089 00000100:00100000:2.0:1746129746.006919:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052068096 00000100:00100000:2.0:1746129746.006923:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052068096 00000100:00100000:2.0:1746129746.006944:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9799 00000100:00100000:2.0:1746129746.006949:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28457:x1830949052068096:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129746.006961:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129746.006972:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e439489a4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34efb3 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.007006:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43948996 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129746.007013:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e439489a4 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efb3 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.007024:0:1851:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43948996 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129746.007034:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e439489a4 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efb3 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.007043:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129746.007045:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129746.007047:0:1851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e439489a4 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efb3 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.007051:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d7f8e00, rc 0) 00000100:00100000:2.0:1746129746.007074:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28457:x1830949052068096:12345-192.168.204.31@tcp:101:cat.0 Request processed in 125us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.007079:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9799 00010000:00010000:3.0:1746129746.007136:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43948996 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.007141:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43948996 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00000004:02000000:3.0:1746129746.007169:0:14315:0:(lod_object.c:7771:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00000040:00080000:3.0:1746129746.007760:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2750, 88 off228840 00000004:00080000:3.0:1746129746.007767:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692065918238ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129746.008842:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2693, 88 off223912 00000004:00080000:3.0:1746129746.008881:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692067032193ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129746.010259:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2694, 88 off224000 00000004:00080000:3.0:1746129746.010267:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692068418608ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129746.010536:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2751, 88 off228928 00000004:00080000:3.0:1746129746.010543:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692068694591ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129746.010967:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2752, 88 off229016 00000004:00080000:3.0:1746129746.010973:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692069124541ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129746.010985:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2695, 88 off224088 00000004:00080000:3.0:1746129746.010989:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692069140887ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129746.011248:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2696, 88 off224176 00000004:00080000:3.0:1746129746.011256:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692069408296ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129746.011268:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2697, 88 off224264 00000004:00080000:3.0:1746129746.011271:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692069423329ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129746.011283:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2753, 88 off229104 00000004:00080000:3.0:1746129746.011286:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692069437776ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129746.014133:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2698, 88 off224352 00000004:00080000:3.0:1746129746.014143:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692072294547ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129746.014155:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2754, 88 off229192 00000004:00080000:3.0:1746129746.014157:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692072309322ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129746.014163:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2699, 88 off224440 00000004:00080000:3.0:1746129746.014165:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692072316913ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129746.014170:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2755, 88 off229280 00000004:00080000:3.0:1746129746.014172:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692072324122ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129746.014227:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2757, 88 off229464 00000004:00080000:3.0:1746129746.014229:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692072381198ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129746.014235:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2758, 88 off229552 00000004:00080000:3.0:1746129746.014237:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692072389317ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129746.014243:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2759, 88 off229640 00000004:00080000:3.0:1746129746.014245:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692072396697ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129746.014250:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2700, 88 off224528 00000004:00080000:3.0:1746129746.014252:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692072403996ns, next at 641623252291ns, rc = 0 00000100:00100000:2.0:1746129746.017432:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129746.018337:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746129746.019681:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052068224 00000100:00100000:1.0:1746129746.019689:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052068224 00000100:00100000:1.0:1746129746.020868:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10595 00000100:00100000:1.0:1746129746.020877:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:28456:x1830949052068224:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129746.020891:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129746.020905:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439489ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34efba expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.020924:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129746.020926:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129746.020931:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439489ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efba expref: 21 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.020942:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439489ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efba expref: 21 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.020951:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa01c00, rc 0) 00000100:00100000:1.0:1746129746.020998:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:28456:x1830949052068224:12345-192.168.204.31@tcp:101:cat.0 Request processed in 123us (3573us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129746.021003:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10595 00000100:00100000:1.0:1746129746.024873:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.024933:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052068352 00000100:00100000:0.0:1746129746.024941:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052068352 00000100:00100000:0.0:1746129746.024975:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9800 00000100:00100000:0.0:1746129746.024982:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28456:x1830949052068352:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129746.025000:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129746.025014:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08de00/0x48868a4e439489b2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34efc1 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.025059:0:14314:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08de00/0x48868a4e439489b2 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc1 expref: 284 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.025068:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08de00/0x48868a4e439489b2 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc1 expref: 284 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.025078:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129746.025080:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129746.025084:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e439489a4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efb3 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.025089:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d08de00, rc 0) 00000100:00100000:0.0:1746129746.025124:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28456:x1830949052068352:12345-192.168.204.31@tcp:101:cat.0 Request processed in 142us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129746.025129:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9800 00010000:00010000:3.0:1746129746.053766:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43948996 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efa5 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.053780:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129746.053783:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746129746.053787:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e439489a4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efb3 expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.053797:0:14315:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e439489a4 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efb3 expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.053803:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e439489a4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efb3 expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.053813:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08de00/0x48868a4e439489b2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc1 expref: 283 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.053819:0:14315:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08de00/0x48868a4e439489b2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc1 expref: 283 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.053825:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08de00/0x48868a4e439489b2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc1 expref: 283 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.053874:0:14315:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08de00/0x48868a4e439489b2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc1 expref: 283 pid: 14314 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129746.053885:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053254784:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129746.053963:0:14315:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e439489a4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efb3 expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129746.053970:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053254912:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129746.053984:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803840 going to sleep for 11 seconds 00000001:00080000:1.0:1746129746.054069:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943568 is committed 00000001:00080000:1.0:1746129746.054076:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943567 is committed 00000001:00080000:1.0:1746129746.054080:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943565 is committed 00000001:00080000:1.0:1746129746.054084:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943569 is committed 00000004:00080000:1.0:1746129746.054087:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1886 committed 00000004:00080000:1.0:1746129746.054093:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1941 committed 00000004:00080000:1.0:1746129746.054104:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1940 committed 00000004:00080000:1.0:1746129746.054105:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1939 committed 00000004:00080000:1.0:1746129746.054107:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1938 committed 00000004:00080000:1.0:1746129746.054108:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1885 committed 00000004:00080000:1.0:1746129746.054109:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1937 committed 00000004:00080000:1.0:1746129746.054111:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1884 committed 00000004:00080000:1.0:1746129746.054112:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1936 committed 00000004:00080000:1.0:1746129746.054113:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1883 committed 00000004:00080000:1.0:1746129746.054114:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1882 committed 00000004:00080000:1.0:1746129746.054115:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1881 committed 00000004:00080000:1.0:1746129746.054117:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1935 committed 00000004:00080000:1.0:1746129746.054118:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1934 committed 00000004:00080000:1.0:1746129746.054119:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1880 committed 00000004:00080000:1.0:1746129746.054120:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1879 committed 00000004:00080000:1.0:1746129746.054121:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1933 committed 00000100:00100000:2.0:1746129746.054351:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053255168:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129746.054380:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129746.054393:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053255680:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129746.054403:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129746.054416:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746129746.054420:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053255296:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129746.054433:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129746.054443:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053255808:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129746.054455:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129746.054473:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053255168 00000100:00100000:2.0:1746129746.054479:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053255168 00000100:00100000:2.0:1746129746.054512:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053255680 00000100:00100000:2.0:1746129746.054514:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053255680 00000100:00100000:2.0:1746129746.054524:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053255296 00000100:00100000:2.0:1746129746.054525:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053255296 00000100:00100000:2.0:1746129746.054532:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053255808 00000100:00100000:2.0:1746129746.054533:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053255808 00000100:00100000:2.0:1746129746.054542:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10596 00000100:00100000:2.0:1746129746.054547:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3298:x1830949053255168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129746.054685:0:20441:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129746.054688:0:20441:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129746 -> 1746129746 00002000:00010000:2.0:1746129746.054690:0:20441:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129746 -> 1746129746 00002000:00010000:2.0:1746129746.054692:0:20441:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129746 -> 1746129746 00002000:00010000:2.0:1746129746.054693:0:20441:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746129746.054719:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3298:x1830949053255168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 171us (338us total) trans 21474840223 rc 0/0 00000100:00100000:2.0:1746129746.054724:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10596 00000100:00100000:2.0:1746129746.054737:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10597 00000100:00100000:2.0:1746129746.054740:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3298:x1830949053255680:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129746.054819:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3298:x1830949053255680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (414us total) trans 21474840224 rc 0/0 00000100:00100000:2.0:1746129746.054823:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10597 00000100:00100000:2.0:1746129746.054831:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10598 00000100:00100000:2.0:1746129746.054835:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3298:x1830949053255296:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129746.054919:0:20441:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746129746.054922:0:20441:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129746 -> 1746129746 00002000:00010000:2.0:1746129746.054923:0:20441:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129746 -> 1746129746 00002000:00010000:2.0:1746129746.054925:0:20441:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129746 -> 1746129746 00002000:00010000:2.0:1746129746.054926:0:20441:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746129746.054944:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3298:x1830949053255296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 108us (511us total) trans 21474840225 rc 0/0 00000100:00100000:2.0:1746129746.054949:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10598 00000100:00100000:2.0:1746129746.054958:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10599 00000100:00100000:2.0:1746129746.054961:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3298:x1830949053255808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129746.055032:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3298:x1830949053255808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (575us total) trans 21474840226 rc 0/0 00000100:00100000:2.0:1746129746.055036:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10599 00000004:00080000:2.0:1746129746.055068:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a504f800/2, rc 0, transno 21474840225 00000100:00100000:2.0:1746129746.055072:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053255296:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129746.055080:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c1c4000/2, rc 0, transno 21474840226 00000100:00100000:2.0:1746129746.055082:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053255808:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129746.055088:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a504f100/2, rc 0, transno 21474840223 00000100:00100000:2.0:1746129746.055090:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053255168:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129746.055094:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136885c00/2, rc 0, transno 21474840224 00000100:00100000:2.0:1746129746.055097:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053255680:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129746.055858:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053255040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129746.055870:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053255424:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129746.055895:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.055910:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053255936:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129746.055921:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.055929:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053256448:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.055940:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.055961:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053256960:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.055975:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.055993:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053256320:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.056006:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.056016:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053256832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.056027:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.056036:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746129746.056040:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053256192:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.056053:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.056062:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053256704:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.056074:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.056093:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.056103:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053255552:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129746.056114:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.056123:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053256064:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.056136:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.056144:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053256576:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.056154:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129746.056241:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053255424 00000100:00100000:0.0:1746129746.056246:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053255424 00000100:00100000:0.0:1746129746.056260:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053255936 00000100:00100000:0.0:1746129746.056262:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053255936 00000100:00100000:0.0:1746129746.056272:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053256448 00000100:00100000:0.0:1746129746.056277:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053256448 00000100:00100000:0.0:1746129746.056284:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053256960 00000100:00100000:0.0:1746129746.056285:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053256960 00000100:00100000:0.0:1746129746.056291:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053256320 00000100:00100000:0.0:1746129746.056292:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053256320 00000100:00100000:0.0:1746129746.056297:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053256832 00000100:00100000:0.0:1746129746.056298:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053256832 00000100:00100000:0.0:1746129746.056307:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053256192 00000100:00100000:0.0:1746129746.056309:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053256192 00000100:00100000:0.0:1746129746.056314:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053256704 00000100:00100000:0.0:1746129746.056315:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053256704 00000100:00100000:0.0:1746129746.056320:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053255040 00000100:00100000:0.0:1746129746.056321:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053255040 00000100:00100000:0.0:1746129746.056326:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053255552 00000100:00100000:0.0:1746129746.056327:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053255552 00000100:00100000:0.0:1746129746.056331:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053256064 00000100:00100000:0.0:1746129746.056332:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053256064 00000100:00100000:0.0:1746129746.056336:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053256576 00000100:00100000:0.0:1746129746.056337:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053256576 00000100:00100000:0.0:1746129746.056344:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10600 00000100:00100000:0.0:1746129746.056349:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3296:x1830949053255424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129746.056454:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3296:x1830949053255424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (558us total) trans 21474840227 rc 0/0 00000100:00100000:0.0:1746129746.056458:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10600 00000100:00100000:0.0:1746129746.056473:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10601 00000100:00100000:0.0:1746129746.056477:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3296:x1830949053255936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129746.056560:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3296:x1830949053255936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (637us total) trans 21474840228 rc 0/0 00000100:00100000:0.0:1746129746.056565:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10601 00000100:00100000:0.0:1746129746.056574:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10602 00000100:00100000:0.0:1746129746.056578:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3296:x1830949053256448:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129746.056657:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129746.056660:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129746.056661:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129746.056663:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129746.056664:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129746.056682:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3296:x1830949053256448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 104us (741us total) trans 17179873058 rc 0/0 00000100:00100000:0.0:1746129746.056687:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10602 00000100:00100000:0.0:1746129746.056697:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10603 00000100:00100000:0.0:1746129746.056701:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3296:x1830949053256960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129746.056775:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3296:x1830949053256960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (797us total) trans 17179873059 rc 0/0 00000100:00100000:0.0:1746129746.056779:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10603 00000100:00100000:0.0:1746129746.056787:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10604 00000100:00100000:0.0:1746129746.056791:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3299:x1830949053256320:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129746.056878:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:0.0:1746129746.056880:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129746 -> 1746129746 00002000:00010000:0.0:1746129746.056882:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129746 -> 1746129746 00002000:00010000:0.0:1746129746.056885:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129746 -> 1746129746 00002000:00010000:0.0:1746129746.056886:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5673 -> 5673 00000100:00100000:0.0:1746129746.056907:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3299:x1830949053256320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 116us (900us total) trans 17179873060 rc 0/0 00000100:00100000:0.0:1746129746.056911:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10604 00000100:00100000:0.0:1746129746.056920:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10605 00000100:00100000:0.0:1746129746.056923:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3299:x1830949053256832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129746.056995:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3299:x1830949053256832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (967us total) trans 17179873061 rc 0/0 00000100:00100000:0.0:1746129746.057000:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10605 00000100:00100000:0.0:1746129746.057008:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10606 00000100:00100000:0.0:1746129746.057012:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3299:x1830949053256192:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129746.057077:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129746.057080:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129746 -> 1746129746 00002000:00010000:0.0:1746129746.057082:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746129746 -> 1746129746 00002000:00010000:0.0:1746129746.057083:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129746 -> 1746129746 00002000:00010000:0.0:1746129746.057085:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746129746.057103:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3299:x1830949053256192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (1050us total) trans 17179873062 rc 0/0 00000100:00100000:0.0:1746129746.057107:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10606 00000100:00100000:0.0:1746129746.057116:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10607 00000100:00100000:0.0:1746129746.057119:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3299:x1830949053256704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129746.057187:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3299:x1830949053256704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (1112us total) trans 17179873063 rc 0/0 00000100:00100000:0.0:1746129746.057191:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10607 00000100:00100000:0.0:1746129746.057199:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10608 00000100:00100000:0.0:1746129746.057202:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3297:x1830949053255040:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129746.057266:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129746.057269:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129746 -> 1746129746 00002000:00010000:0.0:1746129746.057270:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129746 -> 1746129746 00002000:00010000:0.0:1746129746.057272:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129746 -> 1746129746 00002000:00010000:0.0:1746129746.057273:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746129746.057294:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3297:x1830949053255040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (1199us total) trans 21474840229 rc 0/0 00000100:00100000:0.0:1746129746.057299:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10608 00000100:00100000:0.0:1746129746.057307:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10609 00000100:00100000:0.0:1746129746.057311:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3297:x1830949053255552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129746.057370:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129746.057372:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129746.057374:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129746.057375:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129746.057376:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129746.057393:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3297:x1830949053255552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (1278us total) trans 21474840230 rc 0/0 00000100:00100000:0.0:1746129746.057398:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10609 00000100:00100000:0.0:1746129746.057407:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10610 00000100:00100000:0.0:1746129746.057410:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3297:x1830949053256064:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129746.057473:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746129746.057476:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129746 -> 1746129746 00002000:00010000:0.0:1746129746.057477:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129746 -> 1746129746 00002000:00010000:0.0:1746129746.057479:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129746 -> 1746129746 00002000:00010000:0.0:1746129746.057481:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1746129746.057499:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3297:x1830949053256064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (1361us total) trans 17179873064 rc 0/0 00000100:00100000:0.0:1746129746.057514:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10610 00000100:00100000:0.0:1746129746.057591:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10611 00000100:00100000:0.0:1746129746.057595:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3297:x1830949053256576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129746.057669:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3297:x1830949053256576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (1513us total) trans 17179873065 rc 0/0 00000100:00100000:0.0:1746129746.057674:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10611 00000004:00080000:1.0:1746129746.058617:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284ca80/2, rc 0, transno 17179873062 00000100:00100000:1.0:1746129746.058639:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053256192:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129746.058650:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284e300/2, rc 0, transno 17179873063 00000100:00100000:1.0:1746129746.058652:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053256704:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129746.058658:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284c380/2, rc 0, transno 17179873060 00000100:00100000:1.0:1746129746.058661:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053256320:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129746.058667:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284d180/2, rc 0, transno 17179873061 00000100:00100000:1.0:1746129746.058670:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053256832:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129746.058688:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a504ce00/2, rc 0, transno 21474840227 00000100:00100000:1.0:1746129746.058691:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053255424:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129746.058698:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c1c4e00/2, rc 0, transno 21474840228 00000100:00100000:1.0:1746129746.058700:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053255936:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129746.058705:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284f100/2, rc 0, transno 17179873058 00000100:00100000:1.0:1746129746.058707:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053256448:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129746.058711:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284fb80/2, rc 0, transno 17179873059 00000100:00100000:1.0:1746129746.058713:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053256960:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129746.058723:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009206f100/2, rc 0, transno 21474840229 00000100:00100000:1.0:1746129746.058726:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053255040:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129746.058731:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136887800/2, rc 0, transno 21474840230 00000100:00100000:1.0:1746129746.058733:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053255552:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129746.058738:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284c700/2, rc 0, transno 17179873064 00000100:00100000:1.0:1746129746.058740:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053256064:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129746.058746:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284df80/2, rc 0, transno 17179873065 00000100:00100000:1.0:1746129746.058749:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053256576:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.058908:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746129746.058916:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053257088:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.058945:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129746.059013:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053257088 00000100:00100000:2.0:1746129746.059019:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053257088 00000100:00100000:2.0:1746129746.059567:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10612 00000100:00100000:2.0:1746129746.059574:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3296:x1830949053257088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129746.059696:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3296:x1830949053257088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 122us (749us total) trans 17179873066 rc 0/0 00000100:00100000:2.0:1746129746.059701:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10612 00000004:00080000:1.0:1746129746.059760:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284d500/2, rc 0, transno 17179873066 00000100:00100000:1.0:1746129746.059764:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053257088:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129746.061892:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053254784:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129746.063339:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.063354:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053254912:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129746.063386:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fedc00/0x48868a4e4394898f lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efa5 expref: 10 pid: 14315 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746129746.063401:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43948996 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efa5 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129746.063423:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129746.063431:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924f9600, rc 0) 00000100:00100000:3.0:1746129746.063464:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28453:x1830949052067456:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 64905us (67142us total) trans 8589943569 rc 0/0 00000100:00100000:3.0:1746129746.063471:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9798 00000100:00100000:1.0:1746129746.064509:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052068480 00000100:00100000:1.0:1746129746.064517:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052068480 00000100:00100000:1.0:1746129746.064556:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052068608 00000100:00100000:1.0:1746129746.064558:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052068608 00000100:00100000:1.0:1746129746.064574:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3830 00000100:00100000:1.0:1746129746.064581:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:28456:x1830949052068480:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:3.0:1746129746.064582:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3831 00000100:00100000:3.0:1746129746.064590:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c563450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28457:x1830949052068608:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:3.0:1746129746.064653:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c563450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28457:x1830949052068608:12345-192.168.204.31@tcp:49:cat.0 Request processed in 60us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129746.064659:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3831 00000100:00100000:1.0:1746129746.064888:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:28456:x1830949052068480:12345-192.168.204.31@tcp:49:cat.0 Request processed in 307us (1553us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129746.064893:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3830 00000100:00100000:1.0:1746129746.077785:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.077810:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.077900:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.078007:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052068992 00000100:00100000:3.0:1746129746.078016:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052068992 00002000:00100000:3.0:1746129746.078053:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ba86a00 x1830949052068992/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.078061:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba86a00 with x1830949052068992 ext(1048576->2097151) 00002000:00010000:3.0:1746129746.078066:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba86a00 00000100:00100000:3.0:1746129746.078079:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052069248 00000100:00100000:3.0:1746129746.078081:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052069248 00002000:00100000:3.0:1746129746.078092:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ba85f80 x1830949052069248/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.078098:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85f80 with x1830949052069248 ext(1048576->2097151) 00002000:00010000:3.0:1746129746.078101:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba85f80 00000100:00100000:3.0:1746129746.078111:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3902 00000100:00100000:3.0:1746129746.078122:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1961:x1830949052068992:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129746.079030:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3903 00000100:00100000:3.0:1746129746.079037:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052069248:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129746.079102:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052068736 00000100:00100000:2.0:1746129746.079106:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052068736 00000100:00100000:2.0:1746129746.079128:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3832 00000100:00100000:2.0:1746129746.079134:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28453:x1830949052068736:12345-192.168.204.31@tcp:49:multiop.0 00000100:00100000:2.0:1746129746.079203:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28453:x1830949052068736:12345-192.168.204.31@tcp:49:multiop.0 Request processed in 68us (1424us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.079208:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3832 00000100:00100000:3.0:1746129746.093288:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1961:x1830949052068992:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 15158us (15468us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129746.093298:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3902 00002000:00100000:3.0:1746129746.093307:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ba86a00 x1830949052068992/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/440 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.093315:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba86a00 with x1830949052068992 ext(1048576->2097151) 00002000:00010000:3.0:1746129746.093320:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba86a00 00000100:00100000:0.0:1746129746.096812:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.096912:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052069376 00000100:00100000:3.0:1746129746.096921:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052069376 00000100:00100000:3.0:1746129746.096969:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10613 00000100:00100000:3.0:1746129746.096976:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28453:x1830949052069376:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129746.096990:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129746.097004:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e439489b9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34efc8 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.097028:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe28a00/0x48868a4e439488cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef66 expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129746.097033:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.097035:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.097038:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e439489b9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1630208->1925119] (req 1630208->1925119) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc8 expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.097064:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fe28a00/0x48868a4e439488cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef66 expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129746.097074:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fe28a00/0x48868a4e439488cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef66 expref: 17 pid: 8437 timeout: 792 lvb_type: 1 00000100:00100000:3.0:1746129746.097084:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053257216:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129746.098351:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129746.100825:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052069248:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21780us (22916us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129746.100835:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3903 00002000:00100000:3.0:1746129746.100867:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ba85f80 x1830949052069248/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/440 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.100876:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85f80 with x1830949052069248 ext(1048576->2097151) 00002000:00010000:3.0:1746129746.100881:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba85f80 00000100:00100000:0.0:1746129746.106241:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.106283:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.106312:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052069632 00000100:00100000:2.0:1746129746.106319:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052069632 00010000:00010000:2.0:1746129746.106350:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe28a00/0x48868a4e439488cb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef66 expref: 18 pid: 8437 timeout: 792 lvb_type: 1 00000100:00100000:2.0:1746129746.106391:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5090 00000100:00100000:2.0:1746129746.106398:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+18:1962:x1830949052069632:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129746.106409:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129746.106427:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fe28a00/0x48868a4e439488cb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef66 expref: 18 pid: 8437 timeout: 792 lvb_type: 1 00010000:00010000:2.0:1746129746.106438:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fe28a00/0x48868a4e439488cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef66 expref: 18 pid: 8437 timeout: 792 lvb_type: 1 00010000:00010000:2.0:1746129746.106459:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.106461:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.106471:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e439489b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc8 expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.106479:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e439489b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc8 expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.106525:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e439489b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc8 expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129746.106540:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053257344:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129746.106610:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129746.106626:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052069504 00000100:00100000:2.0:1746129746.106629:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052069504 00000100:00100000:2.0:1746129746.106649:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10614 00000100:00100000:2.0:1746129746.106653:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:28456:x1830949052069504:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129746.106664:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129746.106675:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009411bc00/0x48868a4e439489c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34efcf expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.106687:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.106689:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.106692:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009411bc00/0x48868a4e439489c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efcf expref: 22 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.106704:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009411bc00/0x48868a4e439489c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efcf expref: 22 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.106711:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009411bc00, rc 0) 00000100:00100000:2.0:1746129746.106734:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:28456:x1830949052069504:12345-192.168.204.31@tcp:101:cat.0 Request processed in 80us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.106739:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10614 00010000:00010000:3.0:1746129746.107908:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe28a00/0x48868a4e439488cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef66 expref: 18 pid: 8437 timeout: 792 lvb_type: 1 00000100:00100000:3.0:1746129746.108765:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053257216:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129746.108787:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e439489b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc8 expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.109188:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd82800, rc 0) 00000100:00100000:3.0:1746129746.109250:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28453:x1830949052069376:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 12273us (12444us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129746.109257:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10613 00000100:00100000:2.0:1746129746.109463:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.110068:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052069760 00000100:00100000:0.0:1746129746.110075:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052069760 00000100:00100000:0.0:1746129746.110114:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10615 00000100:00100000:0.0:1746129746.110121:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28457:x1830949052069760:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129746.110133:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129746.110146:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fb66000/0x48868a4e439489c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34efd6 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.110165:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129746.110167:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129746.110174:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb66000/0x48868a4e439489c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efd6 expref: 17 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.110187:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fb66000/0x48868a4e439489c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efd6 expref: 17 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.110194:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fb66000, rc 0) 00000100:00100000:0.0:1746129746.110232:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28457:x1830949052069760:12345-192.168.204.31@tcp:101:cat.0 Request processed in 111us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129746.110236:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10615 00000100:00100000:2.0:1746129746.114113:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053257344:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129746.114132:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129746.114175:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+17:1962:x1830949052069632:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7776us (7890us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.114185:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5090 00000100:00100000:1.0:1746129746.118412:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.119169:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052070016 00000100:00100000:2.0:1746129746.119177:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052070016 00002000:00100000:2.0:1746129746.119214:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3ea:0x0] (1630208->1634303) req@ffff88009be66680 x1830949052070016/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746129746.119214:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:2.0:1746129746.119222:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be66680 with x1830949052070016 ext(1630208->1634303) 00002000:00010000:2.0:1746129746.119227:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009be66680 00000100:00100000:2.0:1746129746.119934:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052070272 00000100:00100000:2.0:1746129746.119939:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052070272 00000100:00100000:0.0:1746129746.119946:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3904 00002000:00100000:2.0:1746129746.119955:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800a5490380 x1830949052070272/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746129746.119955:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949052070016:12345-192.168.204.31@tcp:3:multiop.0 00002000:00100000:2.0:1746129746.119962:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5490380 with x1830949052070272 ext(1048576->2097151) 00002000:00010000:2.0:1746129746.119965:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5490380 00000100:00100000:2.0:1746129746.119976:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3905 00000100:00100000:2.0:1746129746.119981:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052070272:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129746.120104:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949052070016:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 150us (1699us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129746.120111:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3904 00002000:00100000:0.0:1746129746.120116:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1630208->1634303) req@ffff88009be66680 x1830949052070016/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/4536 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129746.120123:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be66680 with x1830949052070016 ext(1630208->1634303) 00002000:00010000:0.0:1746129746.120126:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009be66680 00000100:00100000:0.0:1746129746.128927:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.128969:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.129211:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052070528 00000100:00100000:2.0:1746129746.129219:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052070528 00002000:00100000:2.0:1746129746.129253:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880130504a80 x1830949052070528/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129746.129263:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130504a80 with x1830949052070528 ext(1048576->2097151) 00002000:00010000:2.0:1746129746.129268:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130504a80 00000100:00100000:3.0:1746129746.129279:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052070784 00000100:00100000:3.0:1746129746.129283:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052070784 00000100:00100000:2.0:1746129746.129285:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3906 00000100:00100000:2.0:1746129746.129293:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052070528:12345-192.168.204.31@tcp:3:multiop.0 00002000:00100000:3.0:1746129746.129302:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880130505880 x1830949052070784/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 504/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.129310:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130505880 with x1830949052070784 ext(1048576->2097151) 00002000:00010000:3.0:1746129746.129313:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130505880 00000100:00100000:3.0:1746129746.129325:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3907 00000100:00100000:3.0:1746129746.129330:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949052070784:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129746.131242:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052070272:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11254us (12022us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129746.131252:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3905 00002000:00100000:2.0:1746129746.131260:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800a5490380 x1830949052070272/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/440 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129746.131268:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5490380 with x1830949052070272 ext(1048576->2097151) 00002000:00010000:2.0:1746129746.131273:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5490380 00000100:00100000:0.0:1746129746.148567:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.148967:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052070912 00000100:00100000:2.0:1746129746.148975:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052070912 00000100:00100000:2.0:1746129746.149011:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10616 00000100:00100000:2.0:1746129746.149018:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:28456:x1830949052070912:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129746.149031:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129746.149046:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092840a00/0x48868a4e439489ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34efdd expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.149069:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e439489b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc8 expref: 14 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.149076:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129746.149077:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129746.149080:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092840a00/0x48868a4e439489ce lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efdd expref: 23 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.149107:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e439489b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc8 expref: 14 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.149116:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e439489b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc8 expref: 14 pid: 20441 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746129746.149125:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053257472:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129746.149193:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129746.149443:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052070528:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 20149us (20524us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129746.149451:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3906 00002000:00100000:3.0:1746129746.149458:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880130504a80 x1830949052070528/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/440 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.149466:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130504a80 with x1830949052070528 ext(1048576->2097151) 00002000:00010000:3.0:1746129746.149470:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130504a80 00000100:00100000:0.0:1746129746.153746:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.154546:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052071040 00000100:00100000:2.0:1746129746.154554:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052071040 00000100:00100000:2.0:1746129746.154600:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10617 00000100:00100000:2.0:1746129746.154607:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:28451:x1830949052071040:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129746.154621:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129746.154635:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092841400/0x48868a4e439489d5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34efe4 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.154658:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe29200/0x48868a4e439488c4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef6d expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129746.154665:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.154666:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.154669:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092841400/0x48868a4e439489d5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2822144->3145727] (req 2822144->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efe4 expref: 25 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.154694:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fe29200/0x48868a4e439488c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef6d expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129746.154708:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fe29200/0x48868a4e439488c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef6d expref: 16 pid: 8437 timeout: 792 lvb_type: 1 00000100:00100000:2.0:1746129746.154719:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbeca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053257600:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129746.154798:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129746.156866:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053257600:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129746.156889:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092841400/0x48868a4e439489d5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2822144->3145727] (req 2822144->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efe4 expref: 25 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.156902:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092841400, rc 0) 00000100:00100000:3.0:1746129746.156933:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:28451:x1830949052071040:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2327us (3193us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129746.156942:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10617 00000100:00100000:2.0:1746129746.157765:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053257472:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129746.157780:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092840a00/0x48868a4e439489ce lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efdd expref: 24 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.157790:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092840a00, rc 0) 00000100:00100000:2.0:1746129746.157824:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:28456:x1830949052070912:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8806us (9264us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.157829:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10616 00000100:00100000:3.0:1746129746.158286:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949052070784:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 28954us (29315us total) trans 0 rc 1044480/1044480 00000100:00100000:3.0:1746129746.158294:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3907 00002000:00100000:3.0:1746129746.158302:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880130505880 x1830949052070784/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 504/440 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.158311:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130505880 with x1830949052070784 ext(1048576->2097151) 00010000:00010000:3.0:1746129746.158319:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e439489b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc8 expref: 13 pid: 20441 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746129746.158329:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e439489b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc8 expref: 13 pid: 20441 timeout: 792 lvb_type: 0 00002000:00010000:3.0:1746129746.158335:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130505880 00000100:00100000:0.0:1746129746.158775:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.159171:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.159226:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052071168 00000100:00100000:2.0:1746129746.159231:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052071168 00010000:00010000:2.0:1746129746.159252:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe29200/0x48868a4e439488c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef6d expref: 17 pid: 8437 timeout: 792 lvb_type: 1 00000100:00100000:2.0:1746129746.159281:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5091 00000100:00100000:2.0:1746129746.159288:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+17:1962:x1830949052071168:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129746.159298:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129746.159313:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fe29200/0x48868a4e439488c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef6d expref: 17 pid: 8437 timeout: 792 lvb_type: 1 00010000:00010000:2.0:1746129746.159326:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fe29200/0x48868a4e439488c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef6d expref: 17 pid: 8437 timeout: 792 lvb_type: 1 00010000:00010000:2.0:1746129746.159343:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe29200/0x48868a4e439488c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef6d expref: 17 pid: 8437 timeout: 792 lvb_type: 1 00010000:00010000:2.0:1746129746.159358:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.159360:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.159365:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092841400/0x48868a4e439489d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efe4 expref: 23 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.159371:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092841400/0x48868a4e439489d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efe4 expref: 23 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.159394:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092841400/0x48868a4e439489d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efe4 expref: 23 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129746.159404:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053257728:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129746.159452:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129746.159631:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052071296 00000100:00100000:3.0:1746129746.159635:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052071296 00000100:00100000:3.0:1746129746.159655:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10618 00000100:00100000:3.0:1746129746.159660:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28457:x1830949052071296:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129746.159670:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129746.159678:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acd82a00/0x48868a4e439489dc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34efeb expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.159691:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129746.159694:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd82a00/0x48868a4e439489dc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efeb expref: 14 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.159706:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acd82a00/0x48868a4e439489dc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efeb expref: 14 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.159713:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd82a00, rc 0) 00000100:00100000:3.0:1746129746.159734:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28457:x1830949052071296:12345-192.168.204.31@tcp:101:cat.0 Request processed in 73us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129746.159738:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10618 00000100:00100000:2.0:1746129746.161955:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053257728:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129746.161971:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129746.162007:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+16:1962:x1830949052071168:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2718us (3232us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.162016:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5091 00000100:00100000:0.0:1746129746.162761:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.163062:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052071552 00000100:00100000:3.0:1746129746.163068:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052071552 00002000:00100000:3.0:1746129746.163101:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2822144->2826239) req@ffff880130504e00 x1830949052071552/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.163110:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130504e00 with x1830949052071552 ext(2822144->2826239) 00002000:00010000:3.0:1746129746.163114:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130504e00 00000100:00100000:3.0:1746129746.163129:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3908 00000100:00100000:3.0:1746129746.163134:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949052071552:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129746.163824:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949052071552:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 687us (1062us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129746.163830:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3908 00002000:00100000:3.0:1746129746.163835:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2822144->2826239) req@ffff880130504e00 x1830949052071552/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/4536 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.163841:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130504e00 with x1830949052071552 ext(2822144->2826239) 00002000:00010000:3.0:1746129746.163843:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130504e00 00000100:00100000:0.0:1746129746.164718:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.164764:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.165035:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052071936 00000100:00100000:2.0:1746129746.165041:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052071936 00000100:00100000:2.0:1746129746.165068:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3833 00000100:00100000:2.0:1746129746.165074:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28453:x1830949052071936:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129746.165269:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28453:x1830949052071936:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 195us (552us total) trans 8589943570 rc 0/0 00000100:00100000:2.0:1746129746.165275:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3833 00000100:00100000:3.0:1746129746.165347:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052072064 00000100:00100000:3.0:1746129746.165351:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052072064 00002000:00100000:3.0:1746129746.165375:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1630208->1925119) req@ffff880136884a80 x1830949052072064/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.165383:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136884a80 with x1830949052072064 ext(1630208->1925119) 00010000:00010000:3.0:1746129746.165389:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e439489b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc8 expref: 14 pid: 20441 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746129746.165401:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e439489b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc8 expref: 14 pid: 20441 timeout: 792 lvb_type: 0 00002000:00010000:3.0:1746129746.165407:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136884a80 00000100:00100000:3.0:1746129746.165419:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 548 00000100:00100000:3.0:1746129746.165425:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1964:x1830949052072064:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:0.0:1746129746.169687:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.170085:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052072192 00000100:00100000:1.0:1746129746.170093:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052072192 00000100:00100000:1.0:1746129746.170141:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10619 00000100:00100000:1.0:1746129746.170149:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:28451:x1830949052072192:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129746.170164:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129746.170177:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094baf000/0x48868a4e439489e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eff2 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.170200:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fe29400/0x48868a4e439488d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef74 expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129746.170206:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129746.170208:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129746.170211:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094baf000/0x48868a4e439489e3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->2588671] (req 2097152->2588671) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eff2 expref: 23 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.170235:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fe29400/0x48868a4e439488d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef74 expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129746.170248:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fe29400/0x48868a4e439488d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef74 expref: 17 pid: 8437 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746129746.170258:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053257856:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129746.170978:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129746.173640:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.173725:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052072320 00000100:00100000:2.0:1746129746.173733:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052072320 00010000:00010000:2.0:1746129746.173757:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe29400/0x48868a4e439488d2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef74 expref: 18 pid: 8437 timeout: 792 lvb_type: 1 00000100:00100000:2.0:1746129746.173781:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5092 00000100:00100000:2.0:1746129746.173787:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136886a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+18:1964:x1830949052072320:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129746.173797:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129746.173812:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fe29400/0x48868a4e439488d2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef74 expref: 18 pid: 8437 timeout: 792 lvb_type: 1 00010000:00010000:2.0:1746129746.173821:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fe29400/0x48868a4e439488d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef74 expref: 18 pid: 8437 timeout: 792 lvb_type: 1 00010000:00010000:2.0:1746129746.173839:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.173841:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.173865:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094baf000/0x48868a4e439489e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2588671) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eff2 expref: 23 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.173872:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094baf000/0x48868a4e439489e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2588671) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eff2 expref: 23 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.173903:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094baf000/0x48868a4e439489e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2588671) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eff2 expref: 23 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129746.173912:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053257984:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129746.173970:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26c00 going to sleep for 11 seconds 00010000:00010000:1.0:1746129746.174047:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fe29400/0x48868a4e439488d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef74 expref: 18 pid: 8437 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746129746.174064:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053257856:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129746.174081:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094baf000/0x48868a4e439489e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2588671) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eff2 expref: 23 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.174089:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094baf000, rc 0) 00000100:00100000:1.0:1746129746.174122:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:28451:x1830949052072192:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3974us (4441us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129746.174129:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10619 00000100:00100000:3.0:1746129746.175016:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949052072064:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 9587us (10248us total) trans 17179873067 rc 0/0 00000100:00100000:3.0:1746129746.175024:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 548 00002000:00100000:3.0:1746129746.175031:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1630208->1925119) req@ffff880136884a80 x1830949052072064/t17179873067(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/448 e 0 to 0 dl 1746129757 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.175039:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136884a80 with x1830949052072064 ext(1630208->1925119) 00010000:00010000:3.0:1746129746.175045:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e439489b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc8 expref: 16 pid: 20441 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746129746.175055:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e439489b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc8 expref: 16 pid: 20441 timeout: 792 lvb_type: 0 00002000:00010000:3.0:1746129746.175065:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136884a80 00000100:00100000:2.0:1746129746.177402:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053257984:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129746.177421:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129746.177454:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136886a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+17:1964:x1830949052072320:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3666us (3820us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.177463:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5092 00000100:00100000:0.0:1746129746.179473:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.182313:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052072576 00000100:00100000:3.0:1746129746.182324:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052072576 00002000:00100000:3.0:1746129746.182365:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2584576->2588671) req@ffff88012b026300 x1830949052072576/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.182374:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b026300 with x1830949052072576 ext(2584576->2588671) 00002000:00010000:3.0:1746129746.182379:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b026300 00000100:00100000:3.0:1746129746.182410:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3909 00000100:00100000:3.0:1746129746.182416:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949052072576:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129746.183824:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949052072576:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 1402us (4353us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129746.183832:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3909 00002000:00100000:3.0:1746129746.183839:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2584576->2588671) req@ffff88012b026300 x1830949052072576/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/4536 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.183856:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b026300 with x1830949052072576 ext(2584576->2588671) 00002000:00010000:3.0:1746129746.183860:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b026300 00000100:00100000:0.0:1746129746.186232:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.186344:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052072704 00000100:00100000:2.0:1746129746.186351:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052072704 00010000:00010000:2.0:1746129746.186483:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e439489b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc8 expref: 16 pid: 20441 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746129746.186550:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5093 00000100:00100000:2.0:1746129746.186557:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052072704:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129746.186569:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129746.186587:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e439489b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc8 expref: 16 pid: 20441 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.186599:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e439489b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc8 expref: 16 pid: 20441 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.186620:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acd82800/0x48868a4e439489b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc8 expref: 16 pid: 20441 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.186644:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.186646:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.186652:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092840a00/0x48868a4e439489ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efdd expref: 23 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.186659:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092840a00/0x48868a4e439489ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efdd expref: 23 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129746.186665:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129746.186666:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.186667:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.186670:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acd82a00/0x48868a4e439489dc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efeb expref: 15 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.186676:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd82a00/0x48868a4e439489dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efeb expref: 15 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.186701:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800acd82a00/0x48868a4e439489dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efeb expref: 15 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129746.186709:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052072960 00000100:00100000:2.0:1746129746.186711:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053258112:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129746.186712:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052072960 00000100:00100000:0.0:1746129746.186744:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3834 00000100:00100000:0.0:1746129746.186749:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:28451:x1830949052072960:12345-192.168.204.31@tcp:35:multiop.0 00010000:00010000:2.0:1746129746.186773:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092840a00/0x48868a4e439489ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efdd expref: 23 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129746.186783:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbeca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053258240:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129746.186801:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129746.186904:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28451:x1830949052072960:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 153us (237us total) trans 8589943571 rc 0/0 00000100:00100000:0.0:1746129746.186915:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3834 00000100:00100000:0.0:1746129746.190141:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.190583:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.190712:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052073216 00000100:00100000:3.0:1746129746.190720:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052073216 00002000:00100000:3.0:1746129746.190756:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88012b025880 x1830949052073216/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.190764:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b025880 with x1830949052073216 ext(1048576->2097151) 00002000:00010000:3.0:1746129746.190768:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b025880 00000100:00100000:2.0:1746129746.190780:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053258112:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129746.190787:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052073472 00000100:00100000:3.0:1746129746.190789:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052073472 00000100:00100000:2.0:1746129746.190789:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053258240:192.168.204.31@tcp:105: 00002000:00100000:3.0:1746129746.190799:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88012b025500 x1830949052073472/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.190805:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b025500 with x1830949052073472 ext(1048576->2097151) 00010000:00010000:2.0:1746129746.190806:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:3.0:1746129746.190807:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b025500 00000100:00100000:3.0:1746129746.190820:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3910 00000100:00100000:3.0:1746129746.190826:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949052073216:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129746.190863:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052072704:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4305us (4636us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.190869:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5093 00000100:00100000:2.0:1746129746.190906:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3911 00000100:00100000:2.0:1746129746.190911:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1961:x1830949052073472:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129746.202627:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1961:x1830949052073472:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 11708us (12036us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129746.202638:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3911 00002000:00100000:2.0:1746129746.202647:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88012b025500 x1830949052073472/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/440 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129746.202655:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b025500 with x1830949052073472 ext(1048576->2097151) 00002000:00010000:2.0:1746129746.202659:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b025500 00000100:00100000:0.0:1746129746.209462:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.209515:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.209554:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052073728 00000100:00100000:1.0:1746129746.209562:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052073728 00000100:00100000:1.0:1746129746.209602:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052073600 00000100:00100000:1.0:1746129746.209604:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052073600 00000100:00100000:3.0:1746129746.210197:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949052073216:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 19369us (20060us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129746.210198:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10620 00000100:00100000:3.0:1746129746.210206:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3910 00000100:00100000:2.0:1746129746.210206:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052073728:12345-192.168.204.31@tcp:101:cat.0 00002000:00100000:3.0:1746129746.210214:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88012b025880 x1830949052073216/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/440 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746129746.210218:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:3.0:1746129746.210222:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b025880 with x1830949052073216 ext(1048576->2097151) 00002000:00010000:3.0:1746129746.210227:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b025880 00010000:00010000:2.0:1746129746.210233:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800945cf600/0x48868a4e439489ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f000 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129746.210260:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10621 00000100:00100000:3.0:1746129746.210267:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949052073600:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:2.0:1746129746.210272:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbeca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053258368:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129746.210273:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129746.210281:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5283600/0x48868a4e439489f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34eff9 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129746.210303:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053258496:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129746.210311:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129746.210330:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129746.213033:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053258496:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129746.213062:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5283600/0x48868a4e439489f1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eff9 expref: 16 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129746.213074:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5283600/0x48868a4e439489f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eff9 expref: 16 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129746.213087:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5283600, rc 0) 00000100:00100000:3.0:1746129746.213135:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949052073600:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2869us (3618us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129746.213142:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10621 00000100:00100000:2.0:1746129746.213240:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053258368:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129746.213256:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800945cf600/0x48868a4e439489ea lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f000 expref: 18 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129746.213264:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800945cf600/0x48868a4e439489ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f000 expref: 18 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129746.213281:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800945cf600, rc 0) 00000100:00100000:2.0:1746129746.213298:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052073728:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3094us (3844us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129746.213303:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10620 00000100:00100000:0.0:1746129746.222183:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.222472:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052073856 00000100:00100000:2.0:1746129746.222479:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052073856 00000100:00100000:2.0:1746129746.222533:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10622 00000100:00100000:2.0:1746129746.222540:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28457:x1830949052073856:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129746.222553:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129746.222567:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800945cf400/0x48868a4e439489f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f007 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.222590:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092841400/0x48868a4e439489d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efe4 expref: 23 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.222601:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129746.222602:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129746.222604:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800945cf400/0x48868a4e439489f8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f007 expref: 16 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.222627:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092841400/0x48868a4e439489d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efe4 expref: 23 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.222637:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092841400/0x48868a4e439489d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efe4 expref: 23 pid: 7975 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746129746.222648:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbeca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053258624:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129746.223483:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129746.226258:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.226285:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.226304:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.226315:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.226459:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053258624:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129746.226484:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800945cf400/0x48868a4e439489f8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f007 expref: 16 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.226509:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800945cf400, rc 0) 00000100:00100000:2.0:1746129746.226544:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28457:x1830949052073856:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4004us (4369us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.226551:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10622 00000100:00100000:2.0:1746129746.226591:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052074112 00000100:00100000:2.0:1746129746.226595:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052074112 00002000:00100000:2.0:1746129746.226623:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3469311) req@ffff880095241180 x1830949052074112/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 504/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129746.226638:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095241180 with x1830949052074112 ext(2097152->3469311) 00010000:00010000:2.0:1746129746.226643:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092841400/0x48868a4e439489d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efe4 expref: 24 pid: 7975 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.226654:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092841400/0x48868a4e439489d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efe4 expref: 24 pid: 7975 timeout: 792 lvb_type: 0 00002000:00010000:2.0:1746129746.226661:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095241180 00000100:00100000:2.0:1746129746.226685:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052074880 00000100:00100000:2.0:1746129746.226687:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052074880 00002000:00100000:2.0:1746129746.226700:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3637248->4194303) req@ffff880095240700 x1830949052074880/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129746.226706:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095240700 with x1830949052074880 ext(3637248->4194303) 00002000:00010000:2.0:1746129746.226709:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095240700 00000100:00100000:2.0:1746129746.226717:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052074368 00000100:00100000:2.0:1746129746.226720:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052074368 00002000:00100000:2.0:1746129746.226728:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3469312->4194303) req@ffff880095242a00 x1830949052074368/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129746.226733:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095242a00 with x1830949052074368 ext(3469312->4194303) 00010000:00010000:2.0:1746129746.226737:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092841400/0x48868a4e439489d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efe4 expref: 25 pid: 7975 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.226745:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092841400/0x48868a4e439489d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efe4 expref: 25 pid: 7975 timeout: 792 lvb_type: 0 00002000:00010000:2.0:1746129746.226754:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095242a00 00000100:00100000:2.0:1746129746.226768:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052074624 00000100:00100000:2.0:1746129746.226770:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052074624 00002000:00100000:2.0:1746129746.226780:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2588672->3637247) req@ffff880095243800 x1830949052074624/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129746.226786:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095243800 with x1830949052074624 ext(2588672->3637247) 00002000:00010000:2.0:1746129746.226788:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095243800 00000100:00100000:2.0:1746129746.226797:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 549 00000100:00100000:2.0:1746129746.226802:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1963:x1830949052074112:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129746.227205:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 550 00000100:00100000:3.0:1746129746.227213:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1963:x1830949052074368:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129746.227926:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3912 00000100:00100000:3.0:1746129746.227932:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1964:x1830949052074880:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129746.228304:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3913 00000100:00100000:1.0:1746129746.228311:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949052074624:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129746.230940:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.230970:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052075008 00000100:00100000:0.0:1746129746.230977:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052075008 00002000:00100000:0.0:1746129746.231009:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (2822144->3145727) req@ffff8800a645dc00 x1830949052075008/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129746.231018:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645dc00 with x1830949052075008 ext(2822144->3145727) 00010000:00010000:0.0:1746129746.231025:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092841400/0x48868a4e439489d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efe4 expref: 27 pid: 7975 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.231042:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092841400/0x48868a4e439489d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efe4 expref: 27 pid: 7975 timeout: 792 lvb_type: 0 00002000:00010000:0.0:1746129746.231047:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a645dc00 00000100:00100000:0.0:1746129746.231063:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 551 00000100:00100000:0.0:1746129746.231069:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949052075008:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129746.242297:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1963:x1830949052074368:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15077us (15982us total) trans 0 rc 724992/724992 00000100:00100000:3.0:1746129746.242307:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 550 00002000:00100000:3.0:1746129746.242316:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3469312->4194303) req@ffff880095242a00 x1830949052074368/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/440 e 0 to 0 dl 1746129757 ref 1 fl Complete:H/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.242325:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095242a00 with x1830949052074368 ext(3469312->4194303) 00010000:00010000:3.0:1746129746.242334:0:21600:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092841400/0x48868a4e439489d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efe4 expref: 28 pid: 7975 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746129746.242347:0:21600:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092841400/0x48868a4e439489d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efe4 expref: 28 pid: 7975 timeout: 792 lvb_type: 0 00002000:00010000:3.0:1746129746.242357:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095242a00 00000100:00100000:0.0:1746129746.244743:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1963:x1830949052074624:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16425us (18418us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129746.244753:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3913 00002000:00100000:0.0:1746129746.244762:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2588672->3637247) req@ffff880095243800 x1830949052074624/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/440 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129746.244770:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095243800 with x1830949052074624 ext(2588672->3637247) 00002000:00010000:0.0:1746129746.244775:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095243800 00000100:00100000:3.0:1746129746.250085:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949052075008:12345-192.168.204.31@tcp:4:cat.0 Request processed in 19008us (19143us total) trans 17179873068 rc 0/0 00000100:00100000:3.0:1746129746.250095:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 551 00002000:00100000:3.0:1746129746.250105:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (2822144->3145727) req@ffff8800a645dc00 x1830949052075008/t17179873068(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/448 e 0 to 0 dl 1746129757 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.250114:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645dc00 with x1830949052075008 ext(2822144->3145727) 00010000:00010000:3.0:1746129746.250123:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092841400/0x48868a4e439489d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efe4 expref: 28 pid: 7975 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746129746.250136:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092841400/0x48868a4e439489d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efe4 expref: 28 pid: 7975 timeout: 792 lvb_type: 0 00002000:00010000:3.0:1746129746.250142:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a645dc00 00000100:00100000:2.0:1746129746.252115:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949052074112:12345-192.168.204.31@tcp:3:cat.0 Request processed in 25302us (25853us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129746.252125:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 549 00002000:00100000:2.0:1746129746.252134:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3469311) req@ffff880095241180 x1830949052074112/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 504/440 e 0 to 0 dl 1746129757 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129746.252142:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095241180 with x1830949052074112 ext(2097152->3469311) 00010000:00010000:2.0:1746129746.252150:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092841400/0x48868a4e439489d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efe4 expref: 26 pid: 7975 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.252162:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092841400/0x48868a4e439489d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efe4 expref: 26 pid: 7975 timeout: 792 lvb_type: 0 00002000:00010000:2.0:1746129746.252168:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095241180 00000100:00100000:3.0:1746129746.256213:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949052074880:12345-192.168.204.31@tcp:3:cat.0 Request processed in 28272us (29918us total) trans 0 rc 557056/557056 00000100:00100000:3.0:1746129746.256225:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3912 00002000:00100000:3.0:1746129746.256235:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (3637248->4194303) req@ffff880095240700 x1830949052074880/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/440 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 557056/557056 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.256243:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095240700 with x1830949052074880 ext(3637248->4194303) 00002000:00010000:3.0:1746129746.256248:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095240700 00000100:00100000:0.0:1746129746.259699:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.260255:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052075136 00000100:00100000:2.0:1746129746.260263:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052075136 00000100:00100000:2.0:1746129746.260313:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10623 00000100:00100000:2.0:1746129746.260321:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:28456:x1830949052075136:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129746.260337:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129746.260352:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012a3de800/0x48868a4e439489ff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f00e expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.260374:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129746.260377:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129746.260380:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012a3de800/0x48868a4e439489ff lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f00e expref: 27 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.260391:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012a3de800/0x48868a4e439489ff lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f00e expref: 27 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.260400:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a3de800, rc 0) 00000100:00100000:2.0:1746129746.261483:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:28456:x1830949052075136:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1159us (1786us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.261490:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10623 00000100:00100000:0.0:1746129746.267143:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.267796:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052075264 00000100:00100000:2.0:1746129746.267804:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052075264 00010000:00010000:2.0:1746129746.267835:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092841400/0x48868a4e439489d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efe4 expref: 27 pid: 7975 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746129746.267899:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5094 00000100:00100000:2.0:1746129746.267906:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949052075264:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129746.267919:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129746.267940:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092841400/0x48868a4e439489d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efe4 expref: 27 pid: 7975 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.267951:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092841400/0x48868a4e439489d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efe4 expref: 27 pid: 7975 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.267970:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092841400/0x48868a4e439489d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efe4 expref: 27 pid: 7975 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.268000:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.268002:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.268008:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800945cf400/0x48868a4e439489f8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f007 expref: 15 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.268015:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800945cf400/0x48868a4e439489f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f007 expref: 15 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.268023:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.268024:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.268027:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012a3de800/0x48868a4e439489ff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f00e expref: 26 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.268033:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012a3de800/0x48868a4e439489ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f00e expref: 26 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.268058:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012a3de800/0x48868a4e439489ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f00e expref: 26 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129746.268069:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbeca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053258752:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129746.268161:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800945cf400/0x48868a4e439489f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f007 expref: 15 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129746.268169:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053258880:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129746.268190:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129746.271238:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053258752:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129746.271248:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053258880:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129746.271272:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129746.271304:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949052075264:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3398us (4168us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129746.271313:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5094 00000100:00100000:0.0:1746129746.272571:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.273047:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052075520 00000100:00100000:3.0:1746129746.273053:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052075520 00002000:00100000:3.0:1746129746.273085:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012c040000 x1830949052075520/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.273094:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c040000 with x1830949052075520 ext(2097152->3145727) 00002000:00010000:3.0:1746129746.273098:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c040000 00000100:00100000:3.0:1746129746.273159:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3914 00000100:00100000:3.0:1746129746.273176:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1961:x1830949052075520:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129746.274709:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.274867:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052075776 00000100:00100000:2.0:1746129746.274872:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052075776 00002000:00100000:2.0:1746129746.274894:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800a5491500 x1830949052075776/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129746.274901:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5491500 with x1830949052075776 ext(3145728->4194303) 00002000:00010000:2.0:1746129746.274904:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5491500 00000100:00100000:2.0:1746129746.274927:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3915 00000100:00100000:2.0:1746129746.274932:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949052075776:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129746.280924:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1961:x1830949052075520:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7749us (8347us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129746.280934:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3914 00002000:00100000:3.0:1746129746.280944:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012c040000 x1830949052075520/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/440 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.280952:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c040000 with x1830949052075520 ext(2097152->3145727) 00002000:00010000:3.0:1746129746.280956:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c040000 00000100:00100000:0.0:1746129746.290995:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.291095:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052075904 00000100:00100000:3.0:1746129746.291103:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052075904 00000100:00100000:3.0:1746129746.291140:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10624 00000100:00100000:3.0:1746129746.291147:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28457:x1830949052075904:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129746.291162:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129746.291177:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5283000/0x48868a4e43948a06 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f015 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.291200:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094baf000/0x48868a4e439489e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2588671) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eff2 expref: 22 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.291207:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129746.291208:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129746.291211:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5283000/0x48868a4e43948a06 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f015 expref: 18 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.291236:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094baf000/0x48868a4e439489e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2588671) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eff2 expref: 22 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.291246:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094baf000/0x48868a4e439489e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2588671) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eff2 expref: 22 pid: 7975 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746129746.291257:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053259008:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129746.291881:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949052075776:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16946us (17175us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129746.291890:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3915 00002000:00100000:2.0:1746129746.291897:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800a5491500 x1830949052075776/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/440 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129746.291905:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5491500 with x1830949052075776 ext(3145728->4194303) 00002000:00010000:2.0:1746129746.291908:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5491500 00000100:00100000:3.0:1746129746.292640:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129746.297312:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053259008:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129746.297507:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5283000/0x48868a4e43948a06 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f015 expref: 18 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.297522:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5283000, rc 0) 00000100:00100000:3.0:1746129746.297566:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28457:x1830949052075904:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6418us (6576us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129746.297573:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10624 00000100:00100000:0.0:1746129746.297671:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.297807:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.297864:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052076160 00000100:00100000:3.0:1746129746.297870:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052076160 00000100:00100000:2.0:1746129746.297873:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052076032 00000100:00100000:2.0:1746129746.297876:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052076032 00000100:00100000:3.0:1746129746.297892:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10625 00000100:00100000:3.0:1746129746.297898:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:28456:x1830949052076160:12345-192.168.204.31@tcp:101:cat.0 00002000:00100000:2.0:1746129746.297899:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->2588671) req@ffff88009a04f800 x1830949052076032/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746129746.297907:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:2.0:1746129746.297911:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04f800 with x1830949052076032 ext(2097152->2588671) 00010000:00010000:2.0:1746129746.297916:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094baf000/0x48868a4e439489e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2588671) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eff2 expref: 24 pid: 7975 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746129746.297918:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e43948a0d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f01c expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.297926:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094baf000/0x48868a4e439489e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2588671) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eff2 expref: 25 pid: 7975 timeout: 792 lvb_type: 0 00002000:00010000:2.0:1746129746.297931:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a04f800 00010000:00010000:3.0:1746129746.297932:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129746.297934:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129746.297937:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e43948a0d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f01c expref: 25 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129746.297942:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 552 00010000:00010000:3.0:1746129746.297944:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e43948a0d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f01c expref: 25 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129746.297947:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949052076032:12345-192.168.204.31@tcp:4:cat.0 00010000:00010000:3.0:1746129746.297951:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5282200, rc 0) 00000100:00100000:3.0:1746129746.298123:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:28456:x1830949052076160:12345-192.168.204.31@tcp:101:cat.0 Request processed in 224us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129746.298128:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10625 00000100:00100000:2.0:1746129746.307075:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949052076032:12345-192.168.204.31@tcp:4:cat.0 Request processed in 9119us (9397us total) trans 21474840231 rc 0/0 00000100:00100000:2.0:1746129746.307087:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 552 00002000:00100000:2.0:1746129746.307097:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->2588671) req@ffff88009a04f800 x1830949052076032/t21474840231(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/448 e 0 to 0 dl 1746129757 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129746.307105:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04f800 with x1830949052076032 ext(2097152->2588671) 00010000:00010000:2.0:1746129746.307114:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094baf000/0x48868a4e439489e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2588671) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eff2 expref: 26 pid: 7975 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.307128:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094baf000/0x48868a4e439489e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2588671) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eff2 expref: 26 pid: 7975 timeout: 792 lvb_type: 0 00002000:00010000:2.0:1746129746.307134:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a04f800 00000100:00100000:2.0:1746129746.313998:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.314040:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.314143:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052076416 00000100:00100000:3.0:1746129746.314151:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052076416 00000100:00100000:3.0:1746129746.314197:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9801 00000100:00100000:3.0:1746129746.314206:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28461:x1830949052076416:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129746.314228:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129746.314234:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052076544 00000100:00100000:2.0:1746129746.314237:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052076544 00010000:00010000:3.0:1746129746.314243:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283c00/0x48868a4e43948a14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f023 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.314254:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094baf000/0x48868a4e439489e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2588671) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eff2 expref: 26 pid: 7975 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746129746.314280:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5095 00000100:00100000:2.0:1746129746.314286:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949052076544:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129746.314292:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129746.314308:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094baf000/0x48868a4e439489e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2588671) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eff2 expref: 26 pid: 7975 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.314318:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094baf000/0x48868a4e439489e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2588671) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eff2 expref: 26 pid: 7975 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.314334:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094baf000/0x48868a4e439489e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2588671) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34eff2 expref: 26 pid: 7975 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746129746.314337:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3dea00/0x48868a4e43948a1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.314346:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3dea00/0x48868a4e43948a1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129746.314349:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.314350:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.314353:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3dea00/0x48868a4e43948a1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129746.314355:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5283000/0x48868a4e43948a06 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f015 expref: 17 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.314361:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5283000/0x48868a4e43948a06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f015 expref: 17 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.314362:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df400/0x48868a4e43948a22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.314367:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df400/0x48868a4e43948a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129746.314368:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.314369:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.314372:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df400/0x48868a4e43948a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129746.314372:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e43948a0d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f01c expref: 25 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.314379:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e43948a0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f01c expref: 25 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.314403:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e43948a0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f01c expref: 25 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129746.314412:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbeca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053259136:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129746.314454:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cee00/0x48868a4e43948a29 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.314460:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cee00/0x48868a4e43948a29 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.314466:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cee00/0x48868a4e43948a29 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129746.314472:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129746.314478:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5283000/0x48868a4e43948a06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f015 expref: 17 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129746.314484:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053259264:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129746.314511:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26c00 going to sleep for 11 seconds 00010000:00010000:3.0:1746129746.314546:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3dea00/0x48868a4e43948a1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.314552:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3dea00/0x48868a4e43948a1b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.314559:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3dea00/0x48868a4e43948a1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.314564:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012a3dea00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129746.314567:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3dea00/0x48868a4e43948a1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.314572:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3dea00/0x48868a4e43948a1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.314579:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129746.314582:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129746.314585:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3dea00/0x48868a4e43948a1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.314589:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3dea00/0x48868a4e43948a1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.314600:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df400/0x48868a4e43948a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.314605:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df400/0x48868a4e43948a22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.314613:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df400/0x48868a4e43948a22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.314617:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012a3df400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129746.314619:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df400/0x48868a4e43948a22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.314622:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df400/0x48868a4e43948a22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.314630:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f581400) 00010000:00010000:3.0:1746129746.314632:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129746.314634:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df400/0x48868a4e43948a22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.314637:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df400/0x48868a4e43948a22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.314664:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283c00/0x48868a4e43948a14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f023 expref: 286 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.314674:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cee00/0x48868a4e43948a29 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f023 expref: 285 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.314679:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129746.314681:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129746.314682:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800945cee00, rc 0) 00000100:00100000:3.0:1746129746.314706:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28461:x1830949052076416:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 501us (716us total) trans 8589943572 rc 0/0 00000100:00100000:3.0:1746129746.314711:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9801 00000100:00100000:0.0:1746129746.319604:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.319719:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053259136:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129746.319729:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053259264:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129746.319746:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129746.319782:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1963:x1830949052076544:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5497us (5742us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.319791:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5095 00000100:00100000:3.0:1746129746.320654:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052076800 00000100:00100000:3.0:1746129746.320660:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052076800 00002000:00100000:3.0:1746129746.320693:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880094a4ed80 x1830949052076800/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.320703:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4ed80 with x1830949052076800 ext(3145728->4194303) 00002000:00010000:3.0:1746129746.320708:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a4ed80 00000100:00100000:3.0:1746129746.320966:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3916 00000100:00100000:3.0:1746129746.320974:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1964:x1830949052076800:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129746.330736:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.332385:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.332426:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.332841:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052077056 00000100:00100000:3.0:1746129746.332861:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052077056 00002000:00100000:3.0:1746129746.332895:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880094eb4e00 x1830949052077056/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.332903:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb4e00 with x1830949052077056 ext(2097152->3145727) 00002000:00010000:3.0:1746129746.332908:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eb4e00 00000100:00100000:3.0:1746129746.332921:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052077312 00000100:00100000:3.0:1746129746.332923:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052077312 00002000:00100000:3.0:1746129746.332932:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880094eb4000 x1830949052077312/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.332938:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb4000 with x1830949052077312 ext(3145728->4194303) 00002000:00010000:3.0:1746129746.332940:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eb4000 00000100:00100000:3.0:1746129746.332947:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052077568 00000100:00100000:3.0:1746129746.332949:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052077568 00002000:00100000:3.0:1746129746.332958:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880094eb7480 x1830949052077568/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.332964:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb7480 with x1830949052077568 ext(3145728->4194303) 00002000:00010000:3.0:1746129746.332967:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb7480 00000100:00100000:3.0:1746129746.332976:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3917 00000100:00100000:3.0:1746129746.332982:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949052077056:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129746.333650:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3918 00000100:00100000:2.0:1746129746.333658:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949052077312:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129746.333986:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3919 00000100:00100000:0.0:1746129746.333994:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052077568:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129746.338449:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1964:x1830949052076800:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17468us (18845us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129746.338462:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3916 00002000:00100000:2.0:1746129746.338472:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880094a4ed80 x1830949052076800/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/440 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129746.338481:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4ed80 with x1830949052076800 ext(3145728->4194303) 00002000:00010000:2.0:1746129746.338486:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a4ed80 00000100:00100000:1.0:1746129746.358431:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.358465:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.358774:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052077696 00000100:00100000:3.0:1746129746.358780:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052077696 00000100:00100000:3.0:1746129746.358813:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10626 00000100:00100000:3.0:1746129746.358819:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:28461:x1830949052077696:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129746.358831:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129746.358860:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801360b2e00/0x48868a4e43948a37 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f02a expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.358884:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092840a00/0x48868a4e439489ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efdd expref: 27 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.358891:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acd82a00/0x48868a4e439489dc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efeb expref: 17 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.358897:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.358898:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.358901:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801360b2e00/0x48868a4e43948a37 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1925120->2097151] (req 1925120->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f02a expref: 27 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.358926:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800acd82a00/0x48868a4e439489dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efeb expref: 17 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.358935:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800acd82a00/0x48868a4e439489dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efeb expref: 17 pid: 20441 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746129746.358945:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053259392:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129746.359035:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052077952 00000100:00100000:2.0:1746129746.359039:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052077952 00002000:00100000:2.0:1746129746.359060:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880094eb4700 x1830949052077952/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129746.359067:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb4700 with x1830949052077952 ext(4194304->4964351) 00002000:00010000:2.0:1746129746.359071:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb4700 00000100:00100000:2.0:1746129746.359089:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3920 00000100:00100000:2.0:1746129746.359099:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1964:x1830949052077952:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129746.359185:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949052077312:12345-192.168.204.31@tcp:3:cat.0 Request processed in 25527us (26802us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129746.359193:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3918 00002000:00100000:0.0:1746129746.359199:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880094eb4000 x1830949052077312/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/440 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129746.359206:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb4000 with x1830949052077312 ext(3145728->4194303) 00002000:00010000:0.0:1746129746.359210:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eb4000 00010000:00010000:3.0:1746129746.359242:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092840a00/0x48868a4e439489ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efdd expref: 28 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.359250:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092840a00/0x48868a4e439489ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efdd expref: 28 pid: 20441 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746129746.359257:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053259520:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129746.359274:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129746.359335:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052077056:12345-192.168.204.31@tcp:3:cat.0 Request processed in 26353us (28606us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129746.359341:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3917 00002000:00100000:3.0:1746129746.359345:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880094eb4e00 x1830949052077056/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/440 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.359351:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb4e00 with x1830949052077056 ext(2097152->3145727) 00002000:00010000:3.0:1746129746.359354:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eb4e00 00000100:00100000:3.0:1746129746.363725:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053259392:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129746.365425:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052077568:12345-192.168.204.31@tcp:3:cat.0 Request processed in 31425us (32991us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129746.365436:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3919 00002000:00100000:1.0:1746129746.365446:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880094eb7480 x1830949052077568/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/440 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129746.365454:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb7480 with x1830949052077568 ext(3145728->4194303) 00002000:00010000:1.0:1746129746.365459:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb7480 00000100:00100000:3.0:1746129746.367282:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053259520:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129746.367308:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801360b2e00/0x48868a4e43948a37 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1925120->2097151] (req 1925120->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f02a expref: 29 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.367325:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801360b2e00, rc 0) 00000100:00100000:3.0:1746129746.367371:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:28461:x1830949052077696:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 8551us (8947us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129746.367378:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10626 00000100:00100000:0.0:1746129746.375617:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.375997:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.376008:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052078080 00000100:00100000:2.0:1746129746.376016:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052078080 00010000:00010000:2.0:1746129746.376044:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd82a00/0x48868a4e439489dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efeb expref: 16 pid: 20441 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746129746.376064:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052078208 00000100:00100000:2.0:1746129746.376065:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052078208 00010000:00010000:2.0:1746129746.376073:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092840a00/0x48868a4e439489ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efdd expref: 29 pid: 20441 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746129746.376301:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5096 00000100:00100000:2.0:1746129746.376308:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1961:x1830949052078080:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129746.376320:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129746.376337:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800acd82a00/0x48868a4e439489dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efeb expref: 16 pid: 20441 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.376345:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800acd82a00/0x48868a4e439489dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efeb expref: 16 pid: 20441 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.376362:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acd82a00/0x48868a4e439489dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efeb expref: 16 pid: 20441 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.376378:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129746.376412:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1961:x1830949052078080:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 105us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.376417:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5096 00000100:00100000:2.0:1746129746.377386:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5097 00000100:00100000:2.0:1746129746.377398:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949052078208:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129746.377405:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129746.377415:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092840a00/0x48868a4e439489ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efdd expref: 29 pid: 20441 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.377424:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092840a00/0x48868a4e439489ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efdd expref: 29 pid: 20441 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.377435:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092840a00/0x48868a4e439489ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efdd expref: 29 pid: 20441 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.377447:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.377448:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.377453:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801360b2e00/0x48868a4e43948a37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f02a expref: 28 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.377459:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801360b2e00/0x48868a4e43948a37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f02a expref: 28 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.377484:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801360b2e00/0x48868a4e43948a37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f02a expref: 28 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129746.377492:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053259648:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129746.377563:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949052077952:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18462us (19095us total) trans 0 rc 770048/770048 00000100:00100000:2.0:1746129746.377564:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26180 going to sleep for 11 seconds 00000100:00100000:3.0:1746129746.377572:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3920 00002000:00100000:3.0:1746129746.377580:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880094eb4700 x1830949052077952/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/440 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.377588:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb4700 with x1830949052077952 ext(4194304->4964351) 00002000:00010000:3.0:1746129746.377592:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb4700 00000100:00100000:0.0:1746129746.387977:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.388086:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.388120:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052078592 00000100:00100000:0.0:1746129746.388126:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052078592 00002000:00100000:0.0:1746129746.388160:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (1925120->1929215) req@ffff880094a4c000 x1830949052078592/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129746.388168:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4c000 with x1830949052078592 ext(1925120->1929215) 00002000:00010000:0.0:1746129746.388173:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a4c000 00000100:00100000:0.0:1746129746.388199:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3921 00000100:00100000:0.0:1746129746.388205:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949052078592:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129746.388335:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949052078592:12345-192.168.204.31@tcp:3:cat.0 Request processed in 130us (249us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129746.388341:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3921 00002000:00100000:0.0:1746129746.388345:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (1925120->1929215) req@ffff880094a4c000 x1830949052078592/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/4536 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129746.388351:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4c000 with x1830949052078592 ext(1925120->1929215) 00002000:00010000:0.0:1746129746.388353:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a4c000 00000100:00100000:3.0:1746129746.388623:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052078336 00000100:00100000:3.0:1746129746.388627:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052078336 00000100:00100000:3.0:1746129746.388649:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10627 00000100:00100000:3.0:1746129746.388654:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1964:x1830949052078336:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129746.388662:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129746.388674:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801360b2a00/0x48868a4e43948a3e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f031 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129746.388709:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053259776:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129746.388757:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129746.388932:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053259648:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129746.388945:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129746.388963:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949052078208:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 11568us (12967us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.388969:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5097 00002000:00010000:3.0:1746129746.391352:0:3623:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime: 1746129746 -> 1746129747 00000100:00100000:3.0:1746129746.391376:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053259776:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129746.391401:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801360b2a00/0x48868a4e43948a3e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f031 expref: 16 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129746.391412:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801360b2a00/0x48868a4e43948a3e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f031 expref: 16 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129746.391436:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801360b2a00, rc 0) 00000100:00100000:3.0:1746129746.391538:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1964:x1830949052078336:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2881us (3566us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129746.391546:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10627 00000100:00100000:0.0:1746129746.392541:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.392642:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052078848 00000100:00100000:3.0:1746129746.392647:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052078848 00000100:00100000:3.0:1746129746.392684:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3835 00000100:00100000:3.0:1746129746.392690:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28456:x1830949052078848:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:3.0:1746129746.393199:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:28456:x1830949052078848:12345-192.168.204.31@tcp:35:cat.0 Request processed in 508us (659us total) trans 8589943573 rc 0/0 00000100:00100000:3.0:1746129746.393205:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3835 00000100:00100000:1.0:1746129746.399451:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.399532:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052079104 00000100:00100000:2.0:1746129746.399540:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052079104 00002000:00100000:2.0:1746129746.399577:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880094eb5180 x1830949052079104/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129746.399586:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb5180 with x1830949052079104 ext(4194304->4964351) 00002000:00010000:2.0:1746129746.399590:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb5180 00000100:00100000:2.0:1746129746.399619:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3922 00000100:00100000:2.0:1746129746.399627:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1964:x1830949052079104:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129746.402883:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.404735:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052079232 00000100:00100000:3.0:1746129746.404745:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052079232 00000100:00100000:3.0:1746129746.404783:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10628 00000100:00100000:3.0:1746129746.404790:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:28461:x1830949052079232:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129746.405026:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129746.405042:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801360b3800/0x48868a4e43948a45 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f038 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.405067:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800945cf400/0x48868a4e439489f8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f007 expref: 16 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.405075:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012a3de800/0x48868a4e439489ff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f00e expref: 27 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.405080:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.405082:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.405084:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801360b3800/0x48868a4e43948a45 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->2400255] (req 2097152->2400255) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f038 expref: 27 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.405110:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012a3de800/0x48868a4e439489ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f00e expref: 27 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.405119:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012a3de800/0x48868a4e439489ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f00e expref: 27 pid: 3623 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746129746.405134:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053259904:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129746.406274:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800945cf400/0x48868a4e439489f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f007 expref: 16 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.406285:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800945cf400/0x48868a4e439489f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f007 expref: 16 pid: 3623 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746129746.406294:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053260032:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129746.406328:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129746.413113:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1964:x1830949052079104:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13475us (13658us total) trans 0 rc 770048/770048 00000100:00100000:2.0:1746129746.413126:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3922 00002000:00100000:2.0:1746129746.413137:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880094eb5180 x1830949052079104/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/440 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129746.413146:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb5180 with x1830949052079104 ext(4194304->4964351) 00010000:00010000:2.0:1746129746.413154:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800945cf400/0x48868a4e439489f8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f007 expref: 15 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.413165:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800945cf400/0x48868a4e439489f8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f007 expref: 15 pid: 3623 timeout: 792 lvb_type: 0 00002000:00010000:2.0:1746129746.413171:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094eb5180 00000100:00100000:0.0:1746129746.413901:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.414055:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052079360 00000100:00100000:2.0:1746129746.414061:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052079360 00010000:00010000:2.0:1746129746.414080:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012a3de800/0x48868a4e439489ff lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f00e expref: 28 pid: 3623 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746129746.414098:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5098 00000100:00100000:2.0:1746129746.414103:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949052079360:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129746.414113:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129746.414129:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012a3de800/0x48868a4e439489ff lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f00e expref: 28 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.414141:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012a3de800/0x48868a4e439489ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f00e expref: 28 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.414159:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129746.414184:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949052079360:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 81us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.414189:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5098 00010000:00010000:3.0:1746129746.414338:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012a3de800/0x48868a4e439489ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f00e expref: 27 pid: 3623 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746129746.414353:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053259904:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129746.415353:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053260032:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129746.415373:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801360b3800/0x48868a4e43948a45 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->2400255] (req 2097152->2400255) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f038 expref: 26 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.415383:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801360b3800, rc 0) 00000100:00100000:3.0:1746129746.415415:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:28461:x1830949052079232:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 10626us (12540us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129746.416559:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10628 00000100:00100000:0.0:1746129746.421573:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.421680:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052079616 00000100:00100000:1.0:1746129746.421690:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052079616 00000100:00100000:1.0:1746129746.421751:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9802 00000100:00100000:1.0:1746129746.421757:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28463:x1830949052079616:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129746.421785:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129746.421804:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e43948a4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f03f expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.421952:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39c00/0x48868a4e43948a53 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.421963:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39c00/0x48868a4e43948a53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.421973:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39c00/0x48868a4e43948a53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.421985:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38000/0x48868a4e43948a5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.421990:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38000/0x48868a4e43948a5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.421995:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38000/0x48868a4e43948a5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.422094:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43948a61 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.422101:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43948a61 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.422107:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43948a61 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:1.0:1746129746.422115:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129746.422211:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39c00/0x48868a4e43948a53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.422217:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39c00/0x48868a4e43948a53 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.422222:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39c00/0x48868a4e43948a53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.422227:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a39c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129746.422231:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39c00/0x48868a4e43948a53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.422237:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39c00/0x48868a4e43948a53 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.422246:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129746.422249:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129746.422252:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39c00/0x48868a4e43948a53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.422256:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39c00/0x48868a4e43948a53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.422277:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38000/0x48868a4e43948a5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.422281:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38000/0x48868a4e43948a5a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.422285:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38000/0x48868a4e43948a5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.422289:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a38000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129746.422291:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38000/0x48868a4e43948a5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.422295:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38000/0x48868a4e43948a5a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.422301:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f8a7600) 00010000:00010000:1.0:1746129746.422302:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129746.422304:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38000/0x48868a4e43948a5a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.422308:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38000/0x48868a4e43948a5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.422347:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e43948a4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f03f expref: 13 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.422358:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43948a61 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f03f expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.422363:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129746.422365:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129746.422367:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a38a00, rc 0) 00000100:00100000:1.0:1746129746.422413:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28463:x1830949052079616:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 655us (850us total) trans 8589943574 rc 0/0 00000100:00100000:1.0:1746129746.422419:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9802 00000100:00100000:0.0:1746129746.428599:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.429189:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.429289:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052079744 00000100:00100000:3.0:1746129746.429297:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052079744 00000100:00100000:3.0:1746129746.429357:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052079872 00000100:00100000:3.0:1746129746.429359:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052079872 00000100:00100000:3.0:1746129746.429374:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10629 00000100:00100000:3.0:1746129746.429380:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949052079744:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129746.429398:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129746.429414:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e43948a6f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f046 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129746.429466:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053260160:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129746.429559:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129746.429592:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10630 00000100:00100000:3.0:1746129746.429598:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949052079872:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129746.429604:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129746.429610:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013683f600/0x48868a4e43948a76 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f04d expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.430374:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.430386:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013683f600/0x48868a4e43948a76 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f04d expref: 18 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129746.430395:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013683f600/0x48868a4e43948a76 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f04d expref: 18 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129746.430635:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683f600, rc 0) 00000100:00100000:3.0:1746129746.430675:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949052079872:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1076us (1486us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129746.430682:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10630 00000100:00100000:0.0:1746129746.431446:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.431566:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052080000 00000100:00100000:2.0:1746129746.431571:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052080000 00010000:00010000:2.0:1746129746.431591:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800945cf400/0x48868a4e439489f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f007 expref: 17 pid: 3623 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746129746.431609:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5099 00000100:00100000:2.0:1746129746.431615:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052080000:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129746.431624:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129746.431642:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800945cf400/0x48868a4e439489f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f007 expref: 17 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.431651:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800945cf400/0x48868a4e439489f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f007 expref: 17 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.431667:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800945cf400/0x48868a4e439489f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f007 expref: 17 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.431694:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.431696:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.431702:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801360b3800/0x48868a4e43948a45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f038 expref: 25 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.431709:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801360b3800/0x48868a4e43948a45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f038 expref: 25 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.431732:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801360b3800/0x48868a4e43948a45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f038 expref: 25 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129746.431741:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053260288:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129746.431787:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26180 going to sleep for 11 seconds 00000100:00100000:3.0:1746129746.431958:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053260160:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129746.431979:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e43948a6f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f046 expref: 16 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129746.431986:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e43948a6f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f046 expref: 16 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129746.431992:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801360b3400, rc 0) 00000100:00100000:3.0:1746129746.432009:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1964:x1830949052079744:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2629us (3420us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129746.432014:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10629 00000100:00100000:0.0:1746129746.436779:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.436988:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052080128 00000100:00100000:3.0:1746129746.436995:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052080128 00000100:00100000:3.0:1746129746.437032:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10631 00000100:00100000:3.0:1746129746.437039:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28457:x1830949052080128:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129746.437055:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129746.437070:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013683f800/0x48868a4e43948a7d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f054 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.437096:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801360b3800/0x48868a4e43948a45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f038 expref: 25 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.437103:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129746.437104:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129746.437107:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013683f800/0x48868a4e43948a7d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4960256->5242879] (req 4960256->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f054 expref: 16 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.437137:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801360b3800/0x48868a4e43948a45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f038 expref: 25 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.437147:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801360b3800/0x48868a4e43948a45 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f038 expref: 25 pid: 3623 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746129746.437158:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053260416:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129746.437912:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053260288:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129746.437933:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129746.437966:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1961:x1830949052080000:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6350us (6521us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.437977:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5099 00000100:00100000:3.0:1746129746.438516:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129746.438718:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.438780:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052080384 00000100:00100000:3.0:1746129746.438785:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052080384 00000100:00100000:3.0:1746129746.439431:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3836 00000100:00100000:3.0:1746129746.439439:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:28461:x1830949052080384:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129746.440436:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:28461:x1830949052080384:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 990us (1711us total) trans 8589943575 rc 0/0 00000100:00100000:3.0:1746129746.440451:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3836 00000100:00100000:3.0:1746129746.442984:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053260416:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129746.443013:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013683f800/0x48868a4e43948a7d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [4960256->5242879] (req 4960256->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f054 expref: 15 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.443029:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683f800, rc 0) 00000100:00100000:3.0:1746129746.443068:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28457:x1830949052080128:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6028us (6298us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129746.443075:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10631 00000100:00100000:0.0:1746129746.445716:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.451900:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052080512 00000100:00100000:2.0:1746129746.451915:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052080512 00002000:00100000:2.0:1746129746.451969:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->2400255) req@ffff880094a4ce00 x1830949052080512/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129746.451980:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4ce00 with x1830949052080512 ext(2097152->2400255) 00010000:00010000:2.0:1746129746.451989:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801360b3800/0x48868a4e43948a45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f038 expref: 26 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.452002:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801360b3800/0x48868a4e43948a45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f038 expref: 26 pid: 3623 timeout: 792 lvb_type: 0 00002000:00010000:2.0:1746129746.452009:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094a4ce00 00000100:00100000:2.0:1746129746.452039:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 553 00000100:00100000:2.0:1746129746.452046:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949052080512:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129746.455910:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.456731:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052080640 00000100:00100000:3.0:1746129746.456740:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052080640 00000100:00100000:3.0:1746129746.457400:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10632 00000100:00100000:3.0:1746129746.457410:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28463:x1830949052080640:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129746.457425:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129746.457443:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a14400/0x48868a4e43948a84 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f05b expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.457465:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129746.457467:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129746.457471:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a14400/0x48868a4e43948a84 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2244608->2691071] (req 2244608->2691071) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f05b expref: 16 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.457481:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a14400/0x48868a4e43948a84 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2244608->2691071] (req 2244608->2691071) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f05b expref: 16 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.457489:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a14400, rc 0) 00000100:00100000:3.0:1746129746.459061:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28463:x1830949052080640:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1645us (3151us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129746.459070:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10632 00000100:00100000:3.0:1746129746.461654:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949052080512:12345-192.168.204.31@tcp:4:cat.0 Request processed in 9600us (15935us total) trans 17179873069 rc 0/0 00000100:00100000:3.0:1746129746.461666:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 553 00002000:00100000:3.0:1746129746.461676:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->2400255) req@ffff880094a4ce00 x1830949052080512/t17179873069(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/448 e 0 to 0 dl 1746129757 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.461685:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4ce00 with x1830949052080512 ext(2097152->2400255) 00010000:00010000:3.0:1746129746.461695:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801360b3800/0x48868a4e43948a45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f038 expref: 28 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746129746.461710:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801360b3800/0x48868a4e43948a45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f038 expref: 28 pid: 3623 timeout: 792 lvb_type: 0 00002000:00010000:3.0:1746129746.461716:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094a4ce00 00000100:00100000:0.0:1746129746.472081:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.472186:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052080768 00000100:00100000:2.0:1746129746.472197:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052080768 00010000:00010000:2.0:1746129746.472228:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801360b3800/0x48868a4e43948a45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f038 expref: 28 pid: 3623 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746129746.472254:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5100 00000100:00100000:2.0:1746129746.472260:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949052080768:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129746.472273:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129746.472289:0:7109:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129746 -> 1746129747 00002000:00010000:2.0:1746129746.472291:0:7109:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129746 -> 1746129747 00010000:00010000:2.0:1746129746.472296:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801360b3800/0x48868a4e43948a45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f038 expref: 28 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.472306:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801360b3800/0x48868a4e43948a45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f038 expref: 28 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.472324:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801360b3800/0x48868a4e43948a45 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f038 expref: 28 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.472353:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.472355:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.472362:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013683f800/0x48868a4e43948a7d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2691072->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f054 expref: 15 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.472369:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013683f800/0x48868a4e43948a7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2691072->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f054 expref: 15 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.472377:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.472378:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.472380:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a14400/0x48868a4e43948a84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2244608->2691071] (req 2244608->2691071) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f05b expref: 15 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.472386:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a14400/0x48868a4e43948a84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2244608->2691071] (req 2244608->2691071) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f05b expref: 15 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.472412:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130a14400/0x48868a4e43948a84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2244608->2691071] (req 2244608->2691071) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f05b expref: 15 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129746.472423:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053260544:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129746.472524:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013683f800/0x48868a4e43948a7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2691072->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f054 expref: 15 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129746.472533:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130504000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053260672:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129746.472552:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129746.481764:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.482057:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052080896 00000100:00100000:3.0:1746129746.482066:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052080896 00000100:00100000:3.0:1746129746.482102:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10633 00000100:00100000:3.0:1746129746.482109:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949052080896:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129746.482127:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129746.482141:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fb66200/0x48868a4e43948a8b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f062 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129746.482186:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053260800:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129746.482246:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129746.482517:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.482564:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130504000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053260672:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129746.482565:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052081024 00000100:00100000:0.0:1746129746.482568:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052081024 00000100:00100000:2.0:1746129746.482575:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053260544:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129746.482585:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10634 00010000:00010000:2.0:1746129746.482590:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129746.482590:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949052081024:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129746.482596:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129746.482603:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c840800/0x48868a4e43948a92 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f069 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129746.482610:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949052080768:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 10351us (10538us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.482619:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5100 00010000:00010000:0.0:1746129746.482619:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c840800/0x48868a4e43948a92 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f069 expref: 19 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129746.482629:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c840800/0x48868a4e43948a92 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f069 expref: 19 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129746.482641:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c840800, rc 0) 00000100:00100000:0.0:1746129746.482657:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949052081024:12345-192.168.204.31@tcp:101:cat.0 Request processed in 66us (141us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129746.482664:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10634 00000100:00100000:0.0:1746129746.484321:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.484759:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052081280 00000100:00100000:3.0:1746129746.484766:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052081280 00002000:00100000:3.0:1746129746.484802:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (2244608->2248703) req@ffff880094a4df80 x1830949052081280/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.484812:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4df80 with x1830949052081280 ext(2244608->2248703) 00002000:00010000:3.0:1746129746.484816:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a4df80 00000100:00100000:3.0:1746129746.485386:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3923 00000100:00100000:3.0:1746129746.485395:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1963:x1830949052081280:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129746.485550:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1963:x1830949052081280:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 156us (1236us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129746.485560:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3923 00002000:00100000:3.0:1746129746.485565:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (2244608->2248703) req@ffff880094a4df80 x1830949052081280/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/4536 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.485571:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4df80 with x1830949052081280 ext(2244608->2248703) 00002000:00010000:3.0:1746129746.485574:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a4df80 00002000:00010000:3.0:1746129746.489399:0:3623:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime: 1746129746 -> 1746129747 00002000:00010000:3.0:1746129746.489405:0:3623:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime: 1746129746 -> 1746129747 00000100:00100000:3.0:1746129746.489427:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053260800:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129746.489455:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fb66200/0x48868a4e43948a8b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f062 expref: 17 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129746.489468:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fb66200/0x48868a4e43948a8b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f062 expref: 17 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129746.489483:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fb66200, rc 0) 00000100:00100000:3.0:1746129746.489550:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949052080896:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7439us (7793us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129746.489558:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10633 00000100:00100000:0.0:1746129746.490690:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.491323:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052081536 00000100:00100000:1.0:1746129746.491330:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052081536 00002000:00100000:1.0:1746129746.491357:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2686976->2691071) req@ffff880094a4d880 x1830949052081536/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129746.491365:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4d880 with x1830949052081536 ext(2686976->2691071) 00002000:00010000:1.0:1746129746.491369:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a4d880 00000100:00100000:1.0:1746129746.491390:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3924 00000100:00100000:1.0:1746129746.491395:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1961:x1830949052081536:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129746.491526:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1961:x1830949052081536:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 130us (840us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129746.491534:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3924 00002000:00100000:1.0:1746129746.491539:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2686976->2691071) req@ffff880094a4d880 x1830949052081536/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/4536 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129746.491545:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4d880 with x1830949052081536 ext(2686976->2691071) 00002000:00010000:1.0:1746129746.491548:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a4d880 00000100:00100000:0.0:1746129746.493221:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.493282:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052081792 00000100:00100000:3.0:1746129746.493287:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052081792 00002000:00100000:3.0:1746129746.493310:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (4960256->4964351) req@ffff880094a4fb80 x1830949052081792/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.493317:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4fb80 with x1830949052081792 ext(4960256->4964351) 00002000:00010000:3.0:1746129746.493320:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a4fb80 00000100:00100000:3.0:1746129746.493698:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3925 00000100:00100000:3.0:1746129746.493705:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1963:x1830949052081792:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129746.493818:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1963:x1830949052081792:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 113us (602us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129746.493823:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3925 00002000:00100000:3.0:1746129746.493828:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (4960256->4964351) req@ffff880094a4fb80 x1830949052081792/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/4536 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.493834:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4fb80 with x1830949052081792 ext(4960256->4964351) 00002000:00010000:3.0:1746129746.493837:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a4fb80 00000100:00100000:0.0:1746129746.494719:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.494806:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052082048 00000100:00100000:1.0:1746129746.494811:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052082048 00000100:00100000:1.0:1746129746.494840:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3837 00000100:00100000:1.0:1746129746.494858:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c562050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28463:x1830949052082048:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129746.495004:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c562050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28463:x1830949052082048:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 158us (285us total) trans 8589943576 rc 0/0 00000100:00100000:1.0:1746129746.495010:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3837 00000100:00100000:0.0:1746129746.511988:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.512161:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052082176 00000100:00100000:3.0:1746129746.512169:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052082176 00000100:00100000:3.0:1746129746.512219:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9803 00000100:00100000:3.0:1746129746.512227:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+6:28467:x1830949052082176:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129746.512247:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129746.512261:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66600/0x48868a4e43948a99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f070 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.512308:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67400/0x48868a4e43948aa0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.512318:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67400/0x48868a4e43948aa0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.512326:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67400/0x48868a4e43948aa0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.512337:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66e00/0x48868a4e43948aa7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.512346:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66e00/0x48868a4e43948aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.512350:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66e00/0x48868a4e43948aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.512449:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67000/0x48868a4e43948aae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.512457:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67000/0x48868a4e43948aae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.512463:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67000/0x48868a4e43948aae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129746.512488:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:3.0:1746129746.512504:0:14315:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129746.512518:0:14315:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67000/0x48868a4e43948aae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.512526:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67000/0x48868a4e43948aae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.512532:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67400/0x48868a4e43948aa0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.512537:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67400/0x48868a4e43948aa0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.512542:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67400/0x48868a4e43948aa0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.512546:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fb67400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129746.512549:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67400/0x48868a4e43948aa0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.512555:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67400/0x48868a4e43948aa0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.512564:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129746.512567:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129746.512570:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67400/0x48868a4e43948aa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.512574:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67400/0x48868a4e43948aa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.512599:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66e00/0x48868a4e43948aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.512604:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66e00/0x48868a4e43948aa7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.512608:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66e00/0x48868a4e43948aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.512612:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fb66e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129746.512614:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66e00/0x48868a4e43948aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.512618:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66e00/0x48868a4e43948aa7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.512624:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f581400) 00010000:00010000:3.0:1746129746.512626:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129746.512628:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66e00/0x48868a4e43948aa7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.512632:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66e00/0x48868a4e43948aa7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.512654:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66600/0x48868a4e43948a99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f070 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.512664:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67000/0x48868a4e43948aae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f070 expref: 7 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.512670:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129746.512672:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129746.512674:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fb67000, rc 0) 00000100:00100000:3.0:1746129746.512709:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+7:28467:x1830949052082176:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 483us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129746.512715:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9803 00000100:00100000:0.0:1746129746.515552:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.515585:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.515616:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.515636:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052082304 00000100:00100000:0.0:1746129746.515642:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052082304 00000100:00100000:0.0:1746129746.515668:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052082432 00000100:00100000:0.0:1746129746.515670:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052082432 00000100:00100000:0.0:1746129746.515693:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052082560 00000100:00100000:0.0:1746129746.515695:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052082560 00000100:00100000:0.0:1746129746.515708:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10635 00000100:00100000:0.0:1746129746.515714:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+17:1961:x1830949052082304:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129746.515730:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129746.515743:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c841400/0x48868a4e43948ab5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f077 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129746.515784:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053260928:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129746.515875:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129746.517369:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10636 00000100:00100000:0.0:1746129746.517379:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+18:1962:x1830949052082432:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129746.517392:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129746.517404:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4d96000/0x48868a4e43948abc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f07e expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.517424:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4d96000/0x48868a4e43948abc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f07e expref: 19 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129746.517432:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4d96000/0x48868a4e43948abc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f07e expref: 19 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129746.517445:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d96000, rc 0) 00000100:00100000:0.0:1746129746.517474:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+18:1962:x1830949052082432:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 98us (1889us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129746.517479:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10636 00000100:00100000:0.0:1746129746.517508:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10637 00000100:00100000:0.0:1746129746.517514:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+17:1962:x1830949052082560:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129746.517521:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129746.517529:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4d96600/0x48868a4e43948ac3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f085 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.517539:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129746.517541:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129746.517547:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4d96600/0x48868a4e43948ac3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f085 expref: 18 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129746.517557:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4d96600/0x48868a4e43948ac3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f085 expref: 18 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129746.517564:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d96600, rc 0) 00000100:00100000:0.0:1746129746.517580:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+18:1962:x1830949052082560:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 66us (1964us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129746.517584:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10637 00000100:00100000:2.0:1746129746.520766:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053260928:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129746.520793:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c841400/0x48868a4e43948ab5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f077 expref: 17 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129746.520805:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c841400/0x48868a4e43948ab5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f077 expref: 17 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129746.520826:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c841400, rc 0) 00000100:00100000:2.0:1746129746.520878:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+16:1961:x1830949052082304:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5163us (5331us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129746.520884:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10635 00000100:00100000:0.0:1746129746.527552:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.527635:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052082816 00000100:00100000:1.0:1746129746.527644:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052082816 00000100:00100000:1.0:1746129746.527690:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9804 00000100:00100000:1.0:1746129746.527696:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+7:28467:x1830949052082816:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129746.527714:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129746.527730:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39c00/0x48868a4e43948aca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f08c expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.527808:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39400/0x48868a4e43948ad1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.527820:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cee00/0x48868a4e43948a29 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f023 expref: 286 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.527831:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43948a61 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f03f expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.527836:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67000/0x48868a4e43948aae lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f070 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.527841:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39400/0x48868a4e43948ad1 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.527903:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67000/0x48868a4e43948aae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f070 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.527913:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67000/0x48868a4e43948aae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f070 expref: 8 pid: 14315 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746129746.527923:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d636300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053261056:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129746.527993:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43948a61 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f03f expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.528000:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43948a61 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f03f expref: 12 pid: 1851 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746129746.528007:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d637100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053261184:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129746.531589:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cee00/0x48868a4e43948a29 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f023 expref: 286 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.531606:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cee00/0x48868a4e43948a29 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f023 expref: 286 pid: 14315 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746129746.531620:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d637800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053261312:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129746.531693:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129746.535897:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.535925:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.535943:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052082944 00000100:00100000:0.0:1746129746.535950:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052082944 00010000:00010000:0.0:1746129746.535974:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67000/0x48868a4e43948aae lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f070 expref: 9 pid: 14315 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746129746.536004:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052083200 00000100:00100000:0.0:1746129746.536006:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052083200 00010000:00010000:0.0:1746129746.536016:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cee00/0x48868a4e43948a29 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f023 expref: 287 pid: 14315 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746129746.536028:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5101 00000100:00100000:0.0:1746129746.536034:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+9:1964:x1830949052082944:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129746.536044:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129746.536048:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67000/0x48868a4e43948aae lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f070 expref: 9 pid: 14315 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.536056:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67000/0x48868a4e43948aae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f070 expref: 9 pid: 14315 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.536073:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129746.536078:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39400/0x48868a4e43948ad1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129746.536087:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39400/0x48868a4e43948ad1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129746.536092:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129746.536124:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+9:1964:x1830949052082944:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 89us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129746.536130:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5101 00000100:00100000:0.0:1746129746.536142:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5102 00000100:00100000:0.0:1746129746.536147:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:1962:x1830949052083200:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129746.536153:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129746.536156:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cee00/0x48868a4e43948a29 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f023 expref: 287 pid: 14315 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.536163:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cee00/0x48868a4e43948a29 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f023 expref: 287 pid: 14315 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.536173:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129746.536176:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39400/0x48868a4e43948ad1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129746.536181:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39400/0x48868a4e43948ad1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129746.536185:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129746.536197:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:1962:x1830949052083200:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 50us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129746.536202:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5102 00000100:00100000:0.0:1746129746.536241:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.536256:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052083072 00000100:00100000:0.0:1746129746.536259:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052083072 00010000:00010000:0.0:1746129746.536269:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43948a61 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f03f expref: 13 pid: 1851 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746129746.536282:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5103 00000100:00100000:0.0:1746129746.536286:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949052083072:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129746.536292:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129746.536295:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43948a61 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f03f expref: 13 pid: 1851 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.536303:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43948a61 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f03f expref: 13 pid: 1851 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.536313:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129746.536315:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39400/0x48868a4e43948ad1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129746.536320:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39400/0x48868a4e43948ad1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129746.536326:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39400/0x48868a4e43948ad1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129746.536340:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129746.536354:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949052083072:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 67us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129746.536359:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5103 00010000:00010000:1.0:1746129746.536598:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67000/0x48868a4e43948aae lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f070 expref: 8 pid: 14315 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746129746.536614:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d636300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053261056:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129746.536625:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43948a61 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f03f expref: 12 pid: 1851 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746129746.536633:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d637100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053261184:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129746.536641:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cee00/0x48868a4e43948a29 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f023 expref: 286 pid: 14315 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746129746.536648:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d637800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053261312:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129746.536668:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39400/0x48868a4e43948ad1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.536675:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39400/0x48868a4e43948ad1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.536679:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39400/0x48868a4e43948ad1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:1.0:1746129746.536694:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129746.536801:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39c00/0x48868a4e43948aca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f08c expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.536816:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39400/0x48868a4e43948ad1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f08c expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.536822:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129746.536824:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129746.536826:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a39400, rc 0) 00000100:00100000:1.0:1746129746.536982:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:28467:x1830949052082816:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 9284us (9436us total) trans 8589943577 rc 0/0 00000100:00100000:1.0:1746129746.536988:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9804 00000100:00100000:0.0:1746129746.538893:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.538973:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052083328 00000100:00100000:1.0:1746129746.538980:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052083328 00000100:00100000:1.0:1746129746.539014:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9805 00000100:00100000:1.0:1746129746.539020:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:28467:x1830949052083328:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129746.539037:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129746.539050:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82c00/0x48868a4e43948adf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f093 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.539104:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82800/0x48868a4e43948ae6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.539113:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39400/0x48868a4e43948ad1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f08c expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.539119:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82800/0x48868a4e43948ae6 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.539140:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39400/0x48868a4e43948ad1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f08c expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.539153:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39400/0x48868a4e43948ad1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f08c expref: 9 pid: 1851 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746129746.539162:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d637800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053261440:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129746.540814:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129746.543688:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d637800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053261440:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129746.543715:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82800/0x48868a4e43948ae6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129746.544057:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.544132:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052083456 00000100:00100000:3.0:1746129746.544137:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052083456 00010000:00010000:3.0:1746129746.544161:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39400/0x48868a4e43948ad1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f08c expref: 10 pid: 1851 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746129746.545513:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5104 00000100:00100000:3.0:1746129746.545523:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052083456:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129746.545537:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129746.545548:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39400/0x48868a4e43948ad1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f08c expref: 10 pid: 1851 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746129746.545559:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39400/0x48868a4e43948ad1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f08c expref: 10 pid: 1851 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746129746.545578:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39400/0x48868a4e43948ad1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f08c expref: 10 pid: 1851 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746129746.545608:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129746.545615:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82800/0x48868a4e43948ae6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129746.545622:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82800/0x48868a4e43948ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129746.545628:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82800/0x48868a4e43948ae6 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129746.545646:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129746.545680:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052083456:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 159us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129746.545685:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5104 00010000:00010000:0.0:1746129746.545744:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82800/0x48868a4e43948ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129746.545750:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82800/0x48868a4e43948ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:0.0:1746129746.545780:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:0.0:1746129746.545783:0:1851:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129746.545795:0:1851:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82800/0x48868a4e43948ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129746.545817:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82c00/0x48868a4e43948adf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f093 expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.545830:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82800/0x48868a4e43948ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f093 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.545836:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129746.545838:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129746.545840:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd82800, rc 0) 00000100:00100000:0.0:1746129746.545882:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:28467:x1830949052083328:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 6863us (6994us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129746.545887:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9805 00000100:00100000:2.0:1746129746.550092:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.550881:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052083584 00000100:00100000:0.0:1746129746.550891:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052083584 00000100:00100000:0.0:1746129746.551014:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10638 00000100:00100000:0.0:1746129746.551022:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+16:1962:x1830949052083584:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129746.551040:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129746.551190:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129746.551247:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013683f600/0x48868a4e43948aed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f09a expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129746.551294:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d637800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053261568:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129746.551534:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129746.551575:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052083712 00000100:00100000:3.0:1746129746.551579:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052083712 00000100:00100000:3.0:1746129746.551603:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10639 00000100:00100000:3.0:1746129746.551607:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+18:1962:x1830949052083712:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129746.551613:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129746.551620:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fb67000/0x48868a4e43948af4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f0a1 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.551634:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fb67000/0x48868a4e43948af4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0a1 expref: 19 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129746.551642:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fb67000/0x48868a4e43948af4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0a1 expref: 19 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129746.551653:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fb67000, rc 0) 00000100:00100000:3.0:1746129746.552165:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+18:1962:x1830949052083712:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 554us (973us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129746.552172:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10639 00000100:00100000:1.0:1746129746.554166:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d637800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053261568:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129746.554195:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013683f600/0x48868a4e43948aed lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f09a expref: 17 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129746.554206:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013683f600/0x48868a4e43948aed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f09a expref: 17 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129746.554217:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683f600, rc 0) 00000100:00100000:1.0:1746129746.554260:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+16:1962:x1830949052083584:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3239us (4175us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129746.554267:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10638 00000100:00100000:0.0:1746129746.556119:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.556194:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052083968 00000100:00100000:2.0:1746129746.556200:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052083968 00000100:00100000:2.0:1746129746.556246:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9806 00000100:00100000:2.0:1746129746.556252:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:28467:x1830949052083968:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129746.556264:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129746.556277:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37000/0x48868a4e43948afb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f0a8 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.556350:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37e00/0x48868a4e43948b02 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129746.556361:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37e00/0x48868a4e43948b02 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129746.556370:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37e00/0x48868a4e43948b02 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129746.556380:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129746.556485:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37000/0x48868a4e43948afb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0a8 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.556536:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37e00/0x48868a4e43948b02 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0a8 expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.556543:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129746.556546:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129746.556548:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d37e00, rc 0) 00000100:00100000:2.0:1746129746.556580:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+10:28467:x1830949052083968:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 329us (466us total) trans 8589943578 rc 0/0 00000100:00100000:2.0:1746129746.556586:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9806 00000100:00100000:0.0:1746129746.559373:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.559409:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.559441:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.559569:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.559619:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052084096 00000100:00100000:1.0:1746129746.559626:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052084096 00000100:00100000:0.0:1746129746.559652:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.559657:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052084224 00000100:00100000:1.0:1746129746.559659:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052084224 00000100:00100000:0.0:1746129746.559666:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052084480 00000100:00100000:0.0:1746129746.559668:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052084480 00000100:00100000:1.0:1746129746.559677:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052084736 00000100:00100000:1.0:1746129746.559679:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052084736 00000100:00100000:0.0:1746129746.559680:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052084352 00000100:00100000:0.0:1746129746.559681:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052084352 00000100:00100000:1.0:1746129746.559690:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10640 00000100:00100000:0.0:1746129746.559757:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10641 00000100:00100000:0.0:1746129746.559764:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+20:1962:x1830949052084224:12345-192.168.204.31@tcp:1:lfs.0 00000100:00100000:2.0:1746129746.559784:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10642 00000100:00100000:3.0:1746129746.559789:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10643 00000100:00100000:2.0:1746129746.559789:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+17:1961:x1830949052084480:12345-192.168.204.31@tcp:1:lfs.0 00000100:00100000:3.0:1746129746.559800:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10644 00000100:00100000:3.0:1746129746.559805:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+20:1961:x1830949052084352:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:2.0:1746129746.559819:0:1877:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094d37600/0x48868a4e43948b10 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.559821:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948b17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.559833:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801360b2e00/0x48868a4e43948a37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f02a expref: 26 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.559834:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fe28c00/0x48868a4e439488bd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef5f expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129746.559840:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129746.559841:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fb66000/0x48868a4e439489c7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efd6 expref: 17 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.559841:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129746.559843:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d37600/0x48868a4e43948b10 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.559866:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009411bc00/0x48868a4e439489c0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efcf expref: 24 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.559870:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.559871:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.559873:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948b17 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.559887:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009411bc00/0x48868a4e439489c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efcf expref: 24 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.559887:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801360b2e00/0x48868a4e43948a37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f02a expref: 26 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.559897:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009411bc00/0x48868a4e439489c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efcf expref: 24 pid: 8435 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.559897:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801360b2e00/0x48868a4e43948a37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f02a expref: 26 pid: 3623 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746129746.559908:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053261824:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129746.559908:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053261696:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129746.559966:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fb66000/0x48868a4e439489c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efd6 expref: 17 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.559973:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fb66000/0x48868a4e439489c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efd6 expref: 17 pid: 20441 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746129746.559980:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053261952:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129746.559981:0:7975:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c841400/0x48868a4e43948b1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.559990:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fe28800/0x48868a4e439488b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef58 expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129746.559996:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439489ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efba expref: 24 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.560002:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094f27c00/0x48868a4e4394899d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efac expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.560006:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129746.560007:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129746.560009:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c841400/0x48868a4e43948b1e lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.560021:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094f27c00/0x48868a4e4394899d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efac expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.560031:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094f27c00/0x48868a4e4394899d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efac expref: 17 pid: 1877 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746129746.560039:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053262080:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129746.560113:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129746.560259:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+17:1961:x1830949052084096:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:1.0:1746129746.560278:0:8435:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43948b25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.560286:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe28600/0x48868a4e439488af lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef51 expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129746.560292:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092840200/0x48868a4e43948988 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef9e expref: 26 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.560298:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094b8c600/0x48868a4e43948981 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef97 expref: 15 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.560302:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129746.560303:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129746.560305:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43948b25 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.560317:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094b8c600/0x48868a4e43948981 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef97 expref: 15 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.560323:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094b8c600/0x48868a4e43948981 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef97 expref: 15 pid: 1877 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746129746.560330:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d637800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053262208:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129746.560352:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092840200/0x48868a4e43948988 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef9e expref: 26 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.560358:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092840200/0x48868a4e43948988 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef9e expref: 26 pid: 20441 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746129746.560364:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d637100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053262336:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129746.560378:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fe28600/0x48868a4e439488af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef51 expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129746.560383:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fe28600/0x48868a4e439488af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef51 expref: 17 pid: 8437 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746129746.560390:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d636300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053262464:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129746.560400:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129746.560554:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+20:1961:x1830949052084736:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:3.0:1746129746.560569:0:3623:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fb66800/0x48868a4e43948b2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.560569:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439489ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efba expref: 24 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.560576:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439489ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efba expref: 24 pid: 20441 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746129746.560577:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5283000/0x48868a4e43948a06 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f015 expref: 17 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.560583:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4d96600/0x48868a4e43948ac3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f085 expref: 20 pid: 7975 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129746.560584:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053262592:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129746.560590:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e43948a0d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f01c expref: 24 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.560598:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.560600:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.560602:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb66800/0x48868a4e43948b2c lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.560606:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fe28800/0x48868a4e439488b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef58 expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129746.560613:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e43948a0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f01c expref: 24 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.560613:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fe28800/0x48868a4e439488b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef58 expref: 20 pid: 8437 timeout: 792 lvb_type: 1 00010000:00010000:3.0:1746129746.560619:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e43948a0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f01c expref: 24 pid: 3623 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746129746.560619:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053262720:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129746.560625:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053262848:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129746.560629:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8f00 going to sleep for 11 seconds 00010000:00010000:3.0:1746129746.560642:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4d96600/0x48868a4e43948ac3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f085 expref: 20 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129746.560648:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4d96600/0x48868a4e43948ac3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f085 expref: 20 pid: 7975 timeout: 792 lvb_type: 1 00000100:00100000:3.0:1746129746.560654:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053262976:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129746.560667:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129746.560680:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5283000/0x48868a4e43948a06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f015 expref: 17 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.560688:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5283000/0x48868a4e43948a06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f015 expref: 17 pid: 3623 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746129746.560698:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053263104:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129746.560712:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129746.560770:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052084608 00010000:00010000:2.0:1746129746.560771:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fe28c00/0x48868a4e439488bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef5f expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129746.560773:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052084608 00010000:00010000:2.0:1746129746.560778:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fe28c00/0x48868a4e439488bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef5f expref: 20 pid: 8437 timeout: 792 lvb_type: 1 00000100:00100000:2.0:1746129746.560784:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053263232:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129746.560790:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10645 00000100:00100000:1.0:1746129746.560794:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+18:1961:x1830949052084608:12345-192.168.204.31@tcp:1:lfs.0 00000100:00100000:2.0:1746129746.560801:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803540 going to sleep for 11 seconds 00010000:00010000:1.0:1746129746.560807:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801356e3200/0x48868a4e43948b33 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.560816:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a14400/0x48868a4e43948a84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2244608->2691071] (req 2244608->2691071) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f05b expref: 15 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.560823:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013683f800/0x48868a4e43948a7d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2691072->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f054 expref: 15 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.560828:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746129746.560829:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746129746.560831:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801356e3200/0x48868a4e43948b33 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.560844:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013683f800/0x48868a4e43948a7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2691072->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f054 expref: 15 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.560866:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013683f800/0x48868a4e43948a7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2691072->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f054 expref: 15 pid: 3623 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746129746.560874:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d634a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053263360:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129746.561003:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a14400/0x48868a4e43948a84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2244608->2691071] (req 2244608->2691071) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f05b expref: 15 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.561011:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a14400/0x48868a4e43948a84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2244608->2691071] (req 2244608->2691071) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f05b expref: 15 pid: 3623 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746129746.561018:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d635c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053263488:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129746.561034:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129746.568445:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.568465:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.568479:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.568489:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.568520:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052085120 00000100:00100000:0.0:1746129746.568527:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052085120 00010000:00010000:0.0:1746129746.568555:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe28800/0x48868a4e439488b6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef58 expref: 21 pid: 8437 timeout: 792 lvb_type: 1 00000100:00100000:0.0:1746129746.568576:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052085504 00000100:00100000:0.0:1746129746.568578:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052085504 00010000:00010000:0.0:1746129746.568587:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe28600/0x48868a4e439488af lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef51 expref: 19 pid: 8437 timeout: 792 lvb_type: 1 00000100:00100000:0.0:1746129746.568597:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052085888 00000100:00100000:0.0:1746129746.568599:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052085888 00010000:00010000:0.0:1746129746.568606:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009411bc00/0x48868a4e439489c0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efcf expref: 25 pid: 8435 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746129746.568618:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5105 00000100:00100000:0.0:1746129746.568624:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+21:1964:x1830949052085120:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129746.568636:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129746.568654:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fe28800/0x48868a4e439488b6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef58 expref: 21 pid: 8437 timeout: 792 lvb_type: 1 00010000:00010000:0.0:1746129746.568664:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fe28800/0x48868a4e439488b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef58 expref: 21 pid: 8437 timeout: 792 lvb_type: 1 00010000:00010000:0.0:1746129746.568684:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129746.568719:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+21:1964:x1830949052085120:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 94us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129746.568724:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5105 00000100:00100000:0.0:1746129746.568739:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5106 00000100:00100000:0.0:1746129746.568743:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+19:1964:x1830949052085504:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129746.568750:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129746.568761:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fe28600/0x48868a4e439488af lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef51 expref: 19 pid: 8437 timeout: 792 lvb_type: 1 00010000:00010000:0.0:1746129746.568769:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fe28600/0x48868a4e439488af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef51 expref: 19 pid: 8437 timeout: 792 lvb_type: 1 00010000:00010000:0.0:1746129746.568780:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129746.568796:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+19:1964:x1830949052085504:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 52us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129746.568801:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5106 00000100:00100000:0.0:1746129746.568813:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5107 00000100:00100000:0.0:1746129746.568818:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949052085888:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129746.568825:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129746.568835:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009411bc00/0x48868a4e439489c0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efcf expref: 25 pid: 8435 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.568842:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009411bc00/0x48868a4e439489c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efcf expref: 25 pid: 8435 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.568880:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129746.568896:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949052085888:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 77us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129746.568901:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5107 00000100:00100000:0.0:1746129746.568935:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.568949:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052086016 00000100:00100000:0.0:1746129746.568952:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052086016 00010000:00010000:0.0:1746129746.568962:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e43948a0d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f01c expref: 25 pid: 3623 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746129746.568975:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5108 00000100:00100000:0.0:1746129746.568978:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1964:x1830949052086016:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129746.568984:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129746.568992:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e43948a0d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f01c expref: 25 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.568999:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e43948a0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f01c expref: 25 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.569007:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129746.569020:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1964:x1830949052086016:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 42us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129746.569025:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5108 00000100:00100000:0.0:1746129746.569067:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.569077:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052084864 00000100:00100000:0.0:1746129746.569079:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052084864 00010000:00010000:0.0:1746129746.569088:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439489ab lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efba expref: 25 pid: 20441 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746129746.569101:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5109 00000100:00100000:0.0:1746129746.569105:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949052084864:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129746.569113:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129746.569120:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439489ab lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efba expref: 25 pid: 20441 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.569127:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439489ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efba expref: 25 pid: 20441 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.569136:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129746.569149:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949052084864:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 44us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129746.569153:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5109 00000100:00100000:0.0:1746129746.569185:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.569194:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052085248 00000100:00100000:0.0:1746129746.569197:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052085248 00010000:00010000:0.0:1746129746.569205:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094b8c600/0x48868a4e43948981 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef97 expref: 16 pid: 1877 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746129746.569216:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5110 00000100:00100000:0.0:1746129746.569220:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949052085248:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129746.569226:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129746.569233:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094b8c600/0x48868a4e43948981 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef97 expref: 16 pid: 1877 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.569241:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094b8c600/0x48868a4e43948981 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef97 expref: 16 pid: 1877 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.569251:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129746.569263:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949052085248:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 42us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129746.569267:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5110 00000100:00100000:0.0:1746129746.569313:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.569323:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052085632 00000100:00100000:0.0:1746129746.569325:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052085632 00010000:00010000:0.0:1746129746.569335:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094f27c00/0x48868a4e4394899d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efac expref: 18 pid: 1877 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746129746.569347:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5111 00000100:00100000:0.0:1746129746.569351:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949052085632:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129746.569356:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129746.569363:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094f27c00/0x48868a4e4394899d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efac expref: 18 pid: 1877 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.569371:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094f27c00/0x48868a4e4394899d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efac expref: 18 pid: 1877 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.569382:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129746.569384:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129746.569387:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c841400/0x48868a4e43948b1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.569393:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c841400/0x48868a4e43948b1e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.569408:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129746.569422:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949052085632:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 71us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129746.569427:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5111 00000100:00100000:0.0:1746129746.569469:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.569479:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052085760 00000100:00100000:0.0:1746129746.569482:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052085760 00010000:00010000:0.0:1746129746.569508:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb66000/0x48868a4e439489c7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efd6 expref: 18 pid: 20441 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746129746.569521:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5112 00000100:00100000:0.0:1746129746.569525:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949052085760:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129746.569531:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129746.569538:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fb66000/0x48868a4e439489c7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efd6 expref: 18 pid: 20441 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.569544:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fb66000/0x48868a4e439489c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efd6 expref: 18 pid: 20441 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.569553:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129746.569566:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949052085760:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 41us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129746.569571:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5112 00000100:00100000:0.0:1746129746.569667:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052084992 00000100:00100000:0.0:1746129746.569671:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052084992 00002000:00100000:0.0:1746129746.569693:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (1925120->2097151) req@ffff880094eb5c00 x1830949052084992/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129746.569701:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb5c00 with x1830949052084992 ext(1925120->2097151) 00010000:00010000:0.0:1746129746.569707:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801360b2e00/0x48868a4e43948a37 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f02a expref: 27 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.569715:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801360b2e00/0x48868a4e43948a37 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f02a expref: 27 pid: 3623 timeout: 792 lvb_type: 0 00002000:00010000:0.0:1746129746.569720:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094eb5c00 00000100:00100000:0.0:1746129746.569732:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 554 00000100:00100000:0.0:1746129746.569736:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949052084992:12345-192.168.204.31@tcp:4:cat.0 00010000:00010000:2.0:1746129746.572243:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f27c00/0x48868a4e4394899d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efac expref: 17 pid: 1877 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746129746.572267:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053262080:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129746.572280:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439489ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efba expref: 24 pid: 20441 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746129746.572288:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053262592:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129746.572300:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fe28800/0x48868a4e439488b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef58 expref: 20 pid: 8437 timeout: 792 lvb_type: 1 00000100:00100000:2.0:1746129746.572307:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053262720:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129746.572328:0:7975:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c841400/0x48868a4e43948b1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.572337:0:7975:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c841400/0x48868a4e43948b1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.572343:0:7975:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c841400/0x48868a4e43948b1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.572369:0:7975:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c841400/0x48868a4e43948b1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.572376:0:7975:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c841400/0x48868a4e43948b1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.572383:0:7975:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c841400/0x48868a4e43948b1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.572389:0:7975:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c841400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129746.572392:0:7975:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c841400/0x48868a4e43948b1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.572399:0:7975:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c841400/0x48868a4e43948b1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.572413:0:7975:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c841400/0x48868a4e43948b1e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.572419:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c841400/0x48868a4e43948b1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129746.572482:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+19:1962:x1830949052084224:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 12718us (13071us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.572489:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10641 00010000:00010000:2.0:1746129746.572536:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009411bc00/0x48868a4e439489c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efcf expref: 23 pid: 8435 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746129746.572544:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053261824:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129746.572553:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fb66000/0x48868a4e439489c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efd6 expref: 16 pid: 20441 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746129746.572560:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053261952:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129746.572597:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e43948a0d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f01c expref: 22 pid: 3623 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746129746.572604:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053262848:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129746.572686:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094b8c600/0x48868a4e43948981 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef97 expref: 15 pid: 1877 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746129746.572701:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d637800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053262208:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129746.572710:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d637100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053262336:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129746.572718:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe28600/0x48868a4e439488af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef51 expref: 18 pid: 8437 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746129746.572724:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d636300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053262464:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129746.572741:0:8435:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43948b25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129746.572814:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053261696:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129746.572825:0:1877:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094d37600/0x48868a4e43948b10 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129746.578862:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.578881:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052086144 00000100:00100000:1.0:1746129746.578887:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052086144 00010000:00010000:1.0:1746129746.578914:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe28c00/0x48868a4e439488bd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef5f expref: 19 pid: 8437 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746129746.578937:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5113 00000100:00100000:1.0:1746129746.578944:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+19:1963:x1830949052086144:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129746.578956:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129746.578973:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fe28c00/0x48868a4e439488bd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef5f expref: 19 pid: 8437 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746129746.578983:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fe28c00/0x48868a4e439488bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef5f expref: 19 pid: 8437 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746129746.579010:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129746.579012:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129746.579015:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948b17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.579023:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948b17 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.579039:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129746.579066:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+19:1963:x1830949052086144:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 123us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129746.579072:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5113 00000100:00100000:1.0:1746129746.579105:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.579141:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.579153:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052086272 00000100:00100000:1.0:1746129746.579156:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052086272 00010000:00010000:1.0:1746129746.579167:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013683f800/0x48868a4e43948a7d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2691072->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f054 expref: 15 pid: 3623 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746129746.579180:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5114 00000100:00100000:1.0:1746129746.579185:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1963:x1830949052086272:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129746.579192:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129746.579204:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013683f800/0x48868a4e43948a7d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2691072->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f054 expref: 15 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746129746.579212:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013683f800/0x48868a4e43948a7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2691072->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f054 expref: 15 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746129746.579224:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129746.579238:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1963:x1830949052086272:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 53us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129746.579243:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5114 00000100:00100000:1.0:1746129746.579260:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052086400 00000100:00100000:1.0:1746129746.579263:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052086400 00002000:00100000:1.0:1746129746.579282:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (2244608->2691071) req@ffff88012d637100 x1830949052086400/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129746.579289:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d637100 with x1830949052086400 ext(2244608->2691071) 00010000:00010000:1.0:1746129746.579294:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130a14400/0x48868a4e43948a84 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2244608->2691071] (req 2244608->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f05b expref: 15 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746129746.579302:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130a14400/0x48868a4e43948a84 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2244608->2691071] (req 2244608->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f05b expref: 15 pid: 3623 timeout: 792 lvb_type: 0 00002000:00010000:1.0:1746129746.579308:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d637100 00010000:00010000:0.0:1746129746.579871:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013683f800/0x48868a4e43948a7d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2691072->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f054 expref: 15 pid: 3623 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746129746.579886:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d634a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053263360:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129746.579896:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d635c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053263488:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129746.579910:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801356e3200/0x48868a4e43948b33 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.580203:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fe28c00/0x48868a4e439488bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef5f expref: 18 pid: 8437 timeout: 792 lvb_type: 1 00000100:00100000:2.0:1746129746.580219:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053263232:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129746.580236:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948b17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.580243:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948b17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.580248:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948b17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.580266:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948b17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.580273:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948b17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.580279:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948b17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.580285:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fb66400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129746.580287:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948b17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.580293:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948b17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.580307:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948b17 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.580312:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948b17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129746.580351:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+17:1961:x1830949052084352:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 20546us (20698us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.580357:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10644 00000100:00100000:2.0:1746129746.580393:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.580469:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.580517:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.580541:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053262976:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129746.580550:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053263104:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129746.580578:0:3623:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008fb66800/0x48868a4e43948b2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129746.581181:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052086528 00000100:00100000:0.0:1746129746.581187:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052086528 00010000:00010000:0.0:1746129746.581204:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5283000/0x48868a4e43948a06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f015 expref: 16 pid: 3623 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746129746.581222:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052086656 00000100:00100000:0.0:1746129746.581224:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052086656 00010000:00010000:0.0:1746129746.581232:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4d96600/0x48868a4e43948ac3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f085 expref: 17 pid: 7975 timeout: 792 lvb_type: 1 00000100:00100000:0.0:1746129746.581243:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052085376 00000100:00100000:0.0:1746129746.581246:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052085376 00010000:00010000:0.0:1746129746.581254:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092840200/0x48868a4e43948988 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef9e expref: 29 pid: 20441 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746129746.581266:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5115 00000100:00100000:0.0:1746129746.581271:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1963:x1830949052086528:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129746.581281:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129746.581292:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5283000/0x48868a4e43948a06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f015 expref: 16 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.581301:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5283000/0x48868a4e43948a06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f015 expref: 16 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.581315:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5283000/0x48868a4e43948a06 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f015 expref: 16 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.581325:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129746.582812:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1963:x1830949052086528:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1534us (2411us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129746.582821:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5115 00000100:00100000:3.0:1746129746.582899:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 555 00000100:00100000:1.0:1746129746.582904:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5116 00000100:00100000:3.0:1746129746.582909:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1963:x1830949052086400:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:1.0:1746129746.582912:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+17:1961:x1830949052086656:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129746.582923:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129746.582939:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4d96600/0x48868a4e43948ac3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f085 expref: 17 pid: 7975 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746129746.582949:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4d96600/0x48868a4e43948ac3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f085 expref: 17 pid: 7975 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746129746.582968:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4d96600/0x48868a4e43948ac3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f085 expref: 17 pid: 7975 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746129746.582979:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129746.582980:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129746.582985:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fb66800/0x48868a4e43948b2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.582993:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb66800/0x48868a4e43948b2c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.583011:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129746.583037:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+16:1961:x1830949052086656:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 126us (2567us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129746.583042:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5116 00000100:00100000:1.0:1746129746.583053:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5117 00000100:00100000:1.0:1746129746.583059:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949052085376:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129746.583066:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129746.583079:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092840200/0x48868a4e43948988 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef9e expref: 29 pid: 20441 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746129746.583086:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092840200/0x48868a4e43948988 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef9e expref: 29 pid: 20441 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746129746.583095:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092840200/0x48868a4e43948988 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ef9e expref: 29 pid: 20441 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746129746.583106:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129746.583108:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129746.583110:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43948b25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.583114:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43948b25 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.583126:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129746.583138:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949052085376:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 79us (2620us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129746.583142:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5117 00010000:00010000:1.0:1746129746.583181:0:8435:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43948b25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.583188:0:8435:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43948b25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.583204:0:8435:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43948b25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.583211:0:8435:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43948b25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.583217:0:8435:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43948b25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.583226:0:8435:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a38000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129746.583229:0:8435:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43948b25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.583235:0:8435:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43948b25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.583243:0:8435:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43948b25 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.583248:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43948b25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129746.583283:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+17:1961:x1830949052084096:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 23586us (23916us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129746.583289:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10640 00010000:00010000:2.0:1746129746.583901:0:3623:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008fb66800/0x48868a4e43948b2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.583910:0:3623:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fb66800/0x48868a4e43948b2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.583925:0:3623:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fb66800/0x48868a4e43948b2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.583935:0:3623:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb66800/0x48868a4e43948b2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.583940:0:3623:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008fb66800/0x48868a4e43948b2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.583945:0:3623:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fb66800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129746.583947:0:3623:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fb66800/0x48868a4e43948b2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.583953:0:3623:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fb66800/0x48868a4e43948b2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.583962:0:3623:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008fb66800/0x48868a4e43948b2c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.583967:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fb66800/0x48868a4e43948b2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129746.584005:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949052084736:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 24210us (24435us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.584011:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10643 00000100:00100000:0.0:1746129746.585286:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949052084992:12345-192.168.204.31@tcp:4:cat.0 Request processed in 15542us (16814us total) trans 17179873070 rc 0/0 00000100:00100000:0.0:1746129746.585295:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 554 00002000:00100000:0.0:1746129746.585303:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (1925120->2097151) req@ffff880094eb5c00 x1830949052084992/t17179873070(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/448 e 0 to 0 dl 1746129757 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129746.585312:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb5c00 with x1830949052084992 ext(1925120->2097151) 00010000:00010000:0.0:1746129746.585320:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801360b2e00/0x48868a4e43948a37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f02a expref: 28 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.585331:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801360b2e00/0x48868a4e43948a37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f02a expref: 28 pid: 3623 timeout: 792 lvb_type: 0 00002000:00010000:0.0:1746129746.585336:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094eb5c00 00000100:00100000:1.0:1746129746.588386:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.588722:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052086784 00000100:00100000:2.0:1746129746.588729:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052086784 00010000:00010000:2.0:1746129746.588757:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801360b2e00/0x48868a4e43948a37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f02a expref: 28 pid: 3623 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746129746.588796:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5118 00000100:00100000:2.0:1746129746.588803:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949052086784:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129746.588815:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129746.588996:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801360b2e00/0x48868a4e43948a37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f02a expref: 28 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.589006:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801360b2e00/0x48868a4e43948a37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f02a expref: 28 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.589026:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801360b2e00/0x48868a4e43948a37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f02a expref: 28 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.589040:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.589042:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.589046:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d37600/0x48868a4e43948b10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.589053:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d37600/0x48868a4e43948b10 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.589084:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129746.589123:0:1877:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094d37600/0x48868a4e43948b10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129746.589123:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949052086784:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 319us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.589130:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5118 00010000:00010000:3.0:1746129746.589132:0:1877:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d37600/0x48868a4e43948b10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.589151:0:1877:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094d37600/0x48868a4e43948b10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.589157:0:1877:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094d37600/0x48868a4e43948b10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.589163:0:1877:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094d37600/0x48868a4e43948b10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.589170:0:1877:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d37600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129746.589173:0:1877:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094d37600/0x48868a4e43948b10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.589179:0:1877:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094d37600/0x48868a4e43948b10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.589188:0:1877:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094d37600/0x48868a4e43948b10 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.589193:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d37600/0x48868a4e43948b10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129746.589489:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+16:1961:x1830949052084480:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 29699us (30047us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129746.589513:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10642 00000100:00100000:3.0:1746129746.592547:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1963:x1830949052086400:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 9633us (13432us total) trans 17179873071 rc 0/0 00000100:00100000:3.0:1746129746.592557:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 555 00002000:00100000:3.0:1746129746.592567:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (2244608->2691071) req@ffff88012d637100 x1830949052086400/t17179873071(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/448 e 0 to 0 dl 1746129757 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.592575:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d637100 with x1830949052086400 ext(2244608->2691071) 00010000:00010000:3.0:1746129746.592583:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130a14400/0x48868a4e43948a84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2244608->2691071] (req 2244608->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f05b expref: 16 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746129746.592595:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130a14400/0x48868a4e43948a84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2244608->2691071] (req 2244608->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f05b expref: 16 pid: 3623 timeout: 792 lvb_type: 0 00002000:00010000:3.0:1746129746.592606:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d637100 00000100:00100000:0.0:1746129746.597444:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.597516:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052086912 00000100:00100000:2.0:1746129746.597527:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052086912 00010000:00010000:2.0:1746129746.597554:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a14400/0x48868a4e43948a84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2244608->2691071] (req 2244608->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f05b expref: 16 pid: 3623 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746129746.597590:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5119 00000100:00100000:2.0:1746129746.597596:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052086912:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129746.597607:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129746.597623:0:16449:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129746 -> 1746129747 00010000:00010000:2.0:1746129746.597628:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a14400/0x48868a4e43948a84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2244608->2691071] (req 2244608->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f05b expref: 16 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.597638:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a14400/0x48868a4e43948a84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2244608->2691071] (req 2244608->2691071) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f05b expref: 16 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.597656:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a14400/0x48868a4e43948a84 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2244608->2691071] (req 2244608->2691071) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f05b expref: 16 pid: 3623 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.597669:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.597671:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.597674:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801356e3200/0x48868a4e43948b33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.597681:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801356e3200/0x48868a4e43948b33 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.597709:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129746.597743:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949052086912:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 146us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.597751:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5119 00010000:00010000:1.0:1746129746.597758:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801356e3200/0x48868a4e43948b33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.597767:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801356e3200/0x48868a4e43948b33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.597789:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801356e3200/0x48868a4e43948b33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.597799:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801356e3200/0x48868a4e43948b33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.597805:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801356e3200/0x48868a4e43948b33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.597810:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801356e3200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129746.597813:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801356e3200/0x48868a4e43948b33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.597818:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801356e3200/0x48868a4e43948b33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.597827:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801356e3200/0x48868a4e43948b33 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.597831:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356e3200/0x48868a4e43948b33 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129746.597891:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949052084608:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 37096us (37223us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129746.597897:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10645 00000100:00100000:0.0:1746129746.604794:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.605144:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052087168 00000100:00100000:3.0:1746129746.605151:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052087168 00000100:00100000:3.0:1746129746.605193:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9807 00000100:00100000:3.0:1746129746.605200:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+10:28467:x1830949052087168:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:3.0:1746129746.605241:0:14315:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129746.605263:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd82800/0x48868a4e43948ae6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f093 expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.605289:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129746.605292:0:14315:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129746.605314:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b80600/0x48868a4e43948b3a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.605326:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43948996 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efa5 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.605332:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e439489a4 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efb3 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.605337:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08de00/0x48868a4e439489b2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc1 expref: 285 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.605342:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b80600/0x48868a4e43948b3a lrc: 6/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.605366:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08de00/0x48868a4e439489b2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc1 expref: 285 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.605379:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08de00/0x48868a4e439489b2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc1 expref: 285 pid: 14314 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746129746.605390:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053263616:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129746.605475:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e439489a4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efb3 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.605482:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e439489a4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efb3 expref: 11 pid: 1851 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746129746.605488:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053263744:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129746.605526:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43948996 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efa5 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.605532:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43948996 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efa5 expref: 11 pid: 14315 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746129746.605538:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053263872:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129746.605551:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129746.607267:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.607299:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.607365:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.607383:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052087296 00000100:00100000:0.0:1746129746.607387:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052087296 00010000:00010000:0.0:1746129746.607409:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08de00/0x48868a4e439489b2 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc1 expref: 286 pid: 14314 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746129746.607427:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052087552 00000100:00100000:0.0:1746129746.607429:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052087552 00010000:00010000:0.0:1746129746.607450:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43948996 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efa5 expref: 12 pid: 14315 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746129746.607463:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052087424 00000100:00100000:0.0:1746129746.607465:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052087424 00010000:00010000:0.0:1746129746.607472:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e439489a4 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efb3 expref: 13 pid: 1851 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746129746.607483:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5120 00000100:00100000:0.0:1746129746.607489:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:1962:x1830949052087296:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129746.607515:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129746.607520:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08de00/0x48868a4e439489b2 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc1 expref: 286 pid: 14314 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.607529:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08de00/0x48868a4e439489b2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc1 expref: 286 pid: 14314 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.607545:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129746.607550:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880136b80600/0x48868a4e43948b3a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129746.607556:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129746.607581:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:1962:x1830949052087296:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 92us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129746.607586:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5120 00000100:00100000:0.0:1746129746.607600:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5121 00000100:00100000:0.0:1746129746.607604:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949052087552:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129746.607609:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129746.607613:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43948996 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efa5 expref: 13 pid: 14315 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.607619:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43948996 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efa5 expref: 13 pid: 14315 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.607627:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129746.607630:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880136b80600/0x48868a4e43948b3a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129746.607638:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129746.607650:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949052087552:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 46us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129746.607655:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5121 00000100:00100000:0.0:1746129746.607663:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5122 00000100:00100000:0.0:1746129746.607667:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052087424:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129746.607672:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129746.607675:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e439489a4 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efb3 expref: 12 pid: 1851 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.607682:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e439489a4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efb3 expref: 12 pid: 1851 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746129746.607691:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129746.607694:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880136b80600/0x48868a4e43948b3a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129746.607699:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b80600/0x48868a4e43948b3a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129746.607704:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b80600/0x48868a4e43948b3a lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129746.607717:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129746.607730:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052087424:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 62us (365us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129746.607797:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08de00/0x48868a4e439489b2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efc1 expref: 285 pid: 14314 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746129746.607808:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053263616:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129746.607817:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e439489a4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efb3 expref: 12 pid: 1851 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746129746.607829:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053263744:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129746.607836:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43948996 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34efa5 expref: 11 pid: 14315 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746129746.607844:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053263872:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129746.607896:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880136b80600/0x48868a4e43948b3a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.607902:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880136b80600/0x48868a4e43948b3a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.607907:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b80600/0x48868a4e43948b3a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129746.608349:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5122 00000040:00080000:3.0:1746129746.608582:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2760, 88 off229728 00000004:00080000:3.0:1746129746.608589:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692666740453ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129746.608643:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2701, 88 off224616 00000004:00080000:3.0:1746129746.608647:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692666798812ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129746.608658:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2702, 88 off224704 00000004:00080000:3.0:1746129746.608660:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692666812513ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129746.608667:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2761, 88 off229816 00000004:00080000:3.0:1746129746.608670:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692666821672ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129746.608675:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2762, 88 off229904 00000004:00080000:3.0:1746129746.608678:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692666830011ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129746.608684:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2703, 88 off224792 00000004:00080000:3.0:1746129746.608686:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692666837842ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129746.608691:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2704, 88 off224880 00000004:00080000:3.0:1746129746.608694:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692666846481ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129746.608699:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2705, 88 off224968 00000004:00080000:3.0:1746129746.608701:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692666853388ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129746.608706:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2763, 88 off229992 00000004:00080000:3.0:1746129746.608708:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692666860621ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129746.608714:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2706, 88 off225056 00000004:00080000:3.0:1746129746.608716:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692666867787ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129746.608721:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2764, 88 off230080 00000004:00080000:3.0:1746129746.608723:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692666875446ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129746.608728:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2707, 88 off225144 00000004:00080000:3.0:1746129746.608731:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692666883091ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129746.608737:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2765, 88 off230168 00000004:00080000:3.0:1746129746.608739:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692666891072ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129746.608745:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2766, 88 off230256 00000004:00080000:3.0:1746129746.608747:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692666899571ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129746.608753:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2767, 88 off230344 00000004:00080000:3.0:1746129746.608755:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692666907391ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129746.608761:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2768, 88 off230432 00000004:00080000:3.0:1746129746.608763:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692666915702ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129746.608771:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2708, 88 off225232 00000004:00080000:3.0:1746129746.608773:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692666925242ns, next at 641623252291ns, rc = 0 00000001:00080000:1.0:1746129746.625836:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943571 is committed 00000001:00080000:1.0:1746129746.625866:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943577 is committed 00000004:00010000:2.0:1746129746.625870:0:14315:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012ba3aa00 reply state ffff8800938e8000 transno 8589943579 ns: mdt-lustre-MDT0000_UUID lock: ffff880136b80600/0x48868a4e43948b3a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000001:00080000:1.0:1746129746.625871:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943576 is committed 00000001:00080000:1.0:1746129746.625875:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943578 is committed 00000100:00100000:2.0:1746129746.625880:0:14315:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1746129746.625882:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943579 is committed 00000004:00080000:1.0:1746129746.625885:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1894 committed 00000004:00080000:1.0:1746129746.625890:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1950 committed 00000004:00080000:1.0:1746129746.625894:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1949 committed 00000004:00080000:1.0:1746129746.625896:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1948 committed 00000004:00080000:1.0:1746129746.625897:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1947 committed 00000004:00080000:1.0:1746129746.625898:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1893 committed 00000004:00080000:1.0:1746129746.625899:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1946 committed 00000004:00080000:1.0:1746129746.625900:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1892 committed 00000004:00080000:1.0:1746129746.625902:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1945 committed 00000004:00080000:1.0:1746129746.625903:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1891 committed 00000004:00080000:1.0:1746129746.625904:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1890 committed 00000004:00080000:1.0:1746129746.625905:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1889 committed 00000004:00080000:1.0:1746129746.625906:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1944 committed 00000004:00080000:1.0:1746129746.625907:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1943 committed 00000004:00080000:1.0:1746129746.625908:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1888 committed 00000004:00080000:1.0:1746129746.625909:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1887 committed 00000004:00080000:1.0:1746129746.625910:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1942 committed 00000001:00080000:1.0:1746129746.625913:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943575 is committed 00010000:00080000:2.0:1746129746.625963:0:14315:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746129746.625976:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28467:x1830949052087168:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 20773us (21185us total) trans 8589943579 rc 0/0 00000100:00100000:2.0:1746129746.625984:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9807 00010000:00010000:2.0:1746129746.626012:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b80600/0x48868a4e43948b3a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129746.626018:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b80600/0x48868a4e43948b3a lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129746.626024:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136b80600/0x48868a4e43948b3a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129746.626028:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b80600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129746.626032:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b80600/0x48868a4e43948b3a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129746.626037:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b80600/0x48868a4e43948b3a lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129746.626049:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129746.626051:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129746.626055:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136b80600/0x48868a4e43948b3a lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129746.626059:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b80600/0x48868a4e43948b3a lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00000100:00100000:2.0:1746129746.626082:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053264000:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129746.626119:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129746.626140:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053264512:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129746.626154:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129746.626163:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053265024:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129746.626177:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129746.626190:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1746129746.626194:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053265536:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129746.626206:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129746.626215:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053264128:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129746.626252:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053264000 00000100:00100000:3.0:1746129746.626258:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053264000 00000100:00100000:3.0:1746129746.626281:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053264512 00000100:00100000:3.0:1746129746.626283:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053264512 00000100:00100000:3.0:1746129746.626292:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053265024 00000100:00100000:3.0:1746129746.626293:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053265024 00000100:00100000:3.0:1746129746.626301:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053265536 00000100:00100000:3.0:1746129746.626303:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053265536 00000100:00100000:3.0:1746129746.626312:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10646 00000100:00100000:3.0:1746129746.626318:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+46:3298:x1830949053264000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129746.626377:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053265664:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.626396:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.626415:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053264256:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129746.626427:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.626437:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053264768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129746.626449:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.626458:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053265280:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129746.626468:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+47:3298:x1830949053264000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 149us (348us total) trans 21474840232 rc 0/0 00000100:00100000:1.0:1746129746.626470:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129746.626473:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10646 00000100:00100000:1.0:1746129746.626478:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053265792:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129746.626482:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053265664 00000100:00100000:3.0:1746129746.626484:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053265664 00000100:00100000:1.0:1746129746.626502:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.627175:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1746129746.627185:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053264256 00000100:00100000:3.0:1746129746.627188:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053264256 00000100:00100000:3.0:1746129746.627200:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053264768 00000100:00100000:0.0:1746129746.627201:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053265280 00000100:00100000:3.0:1746129746.627202:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053264768 00000100:00100000:0.0:1746129746.627204:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053265280 00000100:00100000:3.0:1746129746.627207:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053265792 00000100:00100000:3.0:1746129746.627208:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053265792 00000100:00100000:3.0:1746129746.627215:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10647 00000100:00100000:3.0:1746129746.627220:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+48:3298:x1830949053264512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129746.627222:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10648 00000100:00100000:0.0:1746129746.627227:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+54:3298:x1830949053265024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129746.627295:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129746.627297:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746129746.627299:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746129746.627301:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746129746.627302:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746129746.627322:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+49:3298:x1830949053264512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (1167us total) trans 21474840233 rc 0/0 00000100:00100000:0.0:1746129746.627322:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+55:3298:x1830949053265024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (1145us total) trans 17179873072 rc 0/0 00000100:00100000:3.0:1746129746.627327:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10647 00000100:00100000:0.0:1746129746.627329:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10648 00000100:00100000:0.0:1746129746.627337:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10649 00000100:00100000:0.0:1746129746.627341:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+54:3298:x1830949053265536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129746.627412:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+55:3298:x1830949053265536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (1205us total) trans 17179873073 rc 0/0 00000100:00100000:1.0:1746129746.627919:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053264384:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129746.627942:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129746.627943:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10650 00000100:00100000:3.0:1746129746.627949:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+55:3299:x1830949053265664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.627952:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053264896:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129746.627965:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.627972:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053265408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.627984:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.627991:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053265920:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.628002:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.628021:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053264384 00000100:00100000:1.0:1746129746.628024:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053264384 00000100:00100000:3.0:1746129746.628030:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+56:3299:x1830949053265664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (1633us total) trans 17179873074 rc 0/0 00000100:00100000:1.0:1746129746.628036:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053264896 00000100:00100000:1.0:1746129746.628037:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053264896 00000100:00100000:3.0:1746129746.628038:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10650 00000100:00100000:1.0:1746129746.628043:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053265408 00000100:00100000:1.0:1746129746.628044:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053265408 00000100:00100000:3.0:1746129746.628046:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053265920 00000100:00100000:3.0:1746129746.628048:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053265920 00000100:00100000:1.0:1746129746.628051:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10651 00000100:00100000:3.0:1746129746.628056:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10652 00000100:00100000:1.0:1746129746.628056:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3296:x1830949053264256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129746.628059:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+50:3296:x1830949053264768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129746.628100:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10653 00000100:00100000:1.0:1746129746.628105:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+57:3296:x1830949053265280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129746.628150:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+51:3296:x1830949053264768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (1698us total) trans 21474840234 rc 0/0 00000100:00100000:3.0:1746129746.628155:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10652 00000100:00100000:3.0:1746129746.628164:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10654 00000100:00100000:3.0:1746129746.628168:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+58:3296:x1830949053265792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.628193:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3296:x1830949053265280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (1721us total) trans 17179873075 rc 0/0 00000100:00100000:1.0:1746129746.628197:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10653 00000100:00100000:1.0:1746129746.628206:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10655 00000100:00100000:1.0:1746129746.628209:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3296:x1830949053264384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129746.628235:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+58:3296:x1830949053265792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (1743us total) trans 17179873076 rc 0/0 00000100:00100000:3.0:1746129746.628239:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10654 00000100:00100000:3.0:1746129746.628248:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10656 00000100:00100000:3.0:1746129746.628252:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+51:3296:x1830949053264896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129746.628263:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10657 00000100:00100000:3.0:1746129746.628267:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+57:3296:x1830949053265408:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129746.628329:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129746.628331:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746129746.628333:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746129746.628335:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746129746.628336:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746129746.628355:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+58:3296:x1830949053265408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (369us total) trans 17179873077 rc 0/0 00000100:00100000:3.0:1746129746.628359:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10657 00000100:00100000:3.0:1746129746.628372:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10658 00000100:00100000:3.0:1746129746.628376:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+57:3296:x1830949053265920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129746.628448:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+58:3296:x1830949053265920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (445us total) trans 17179873078 rc 0/0 00000100:00100000:3.0:1746129746.628453:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10658 00000100:00100000:0.0:1746129746.628588:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10649 00000100:00100000:2.0:1746129746.628625:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129746.628647:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053264640:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129746.628667:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129746.628677:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053265152:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129746.628691:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746129746.628718:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba3b100/2, rc 0, transno 21474840232 00000100:00100000:2.0:1746129746.628723:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053264000:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129746.628729:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba38000/2, rc 0, transno 21474840233 00000100:00100000:2.0:1746129746.628732:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053264512:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129746.628739:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba38e00/2, rc 0, transno 17179873072 00000100:00100000:2.0:1746129746.628756:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053265024:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129746.628769:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d4380/2, rc 0, transno 17179873073 00000100:00100000:2.0:1746129746.628772:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053265536:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129746.628784:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053264128 00000100:00100000:2.0:1746129746.628787:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053264128 00000100:00100000:2.0:1746129746.628800:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053264640 00000100:00100000:2.0:1746129746.628802:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053264640 00000100:00100000:0.0:1746129746.628807:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053266048:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129746.628809:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053265152 00000100:00100000:2.0:1746129746.628810:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053265152 00000100:00100000:2.0:1746129746.628818:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10659 00000100:00100000:2.0:1746129746.628822:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+53:3298:x1830949053264128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129746.628826:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129746.628845:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053266048 00000100:00100000:0.0:1746129746.628862:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053266048 00000100:00100000:0.0:1746129746.628874:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10660 00000100:00100000:0.0:1746129746.628877:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3298:x1830949053264640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129746.628931:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+55:3298:x1830949053264128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (305us total) trans 21474840236 rc 0/0 00000100:00100000:2.0:1746129746.628937:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10659 00000100:00100000:2.0:1746129746.628945:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10661 00000100:00100000:2.0:1746129746.628949:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3298:x1830949053265152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129746.628956:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+54:3298:x1830949053264640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (288us total) trans 21474840237 rc 0/0 00000100:00100000:0.0:1746129746.628960:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10660 00000100:00100000:0.0:1746129746.628968:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10662 00000100:00100000:0.0:1746129746.628972:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:3298:x1830949053266048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129746.629025:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+60:3298:x1830949053265152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (333us total) trans 17179873079 rc 0/0 00000100:00100000:2.0:1746129746.629030:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10661 00000100:00100000:0.0:1746129746.629033:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3298:x1830949053266048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (206us total) trans 17179873080 rc 0/0 00000100:00100000:0.0:1746129746.629037:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10662 00000004:00080000:0.0:1746129746.629054:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d5c00/2, rc 0, transno 17179873080 00000100:00100000:0.0:1746129746.629057:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053266048:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129746.630350:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba3a680/2, rc 0, transno 21474840236 00000100:00100000:0.0:1746129746.630358:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053264128:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129746.630360:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+54:3296:x1830949053264896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2107us (2393us total) trans 21474840238 rc 0/0 00000100:00100000:2.0:1746129746.630367:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10656 00000004:00080000:0.0:1746129746.630368:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba38a80/2, rc 0, transno 21474840237 00000100:00100000:0.0:1746129746.630371:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053264640:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129746.630377:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba39500/2, rc 0, transno 17179873079 00000100:00100000:0.0:1746129746.630379:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053265152:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129746.630543:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d4e00/2, rc 0, transno 17179873074 00000100:00100000:1.0:1746129746.630548:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053265664:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.630569:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3296:x1830949053264384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2358us (2626us total) trans 21474840235 rc 0/0 00000100:00100000:1.0:1746129746.630574:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10655 00000100:00100000:3.0:1746129746.630584:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.630636:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052087680 00000100:00100000:2.0:1746129746.630640:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052087680 00000100:00100000:2.0:1746129746.630662:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9808 00000100:00100000:2.0:1746129746.630667:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+7:28467:x1830949052087680:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129746.630682:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129746.630795:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3296:x1830949053264256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2739us (4367us total) trans 21474840239 rc 0/0 00000100:00100000:3.0:1746129746.630800:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10651 00010000:00010000:2.0:1746129746.630939:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37000/0x48868a4e43948b41 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f0af expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.630985:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37000/0x48868a4e43948b41 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0af expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1746129746.631075:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba38380/2, rc 0, transno 21474840235 00000100:00100000:3.0:1746129746.631079:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053264384:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129746.631084:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba39880/2, rc 0, transno 21474840238 00000100:00100000:3.0:1746129746.631086:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053264896:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129746.631093:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba39c00/2, rc 0, transno 17179873077 00000100:00100000:3.0:1746129746.631095:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053265408:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129746.631101:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d5880/2, rc 0, transno 17179873078 00000100:00100000:3.0:1746129746.631103:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053265920:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129746.631108:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba3b480/2, rc 0, transno 21474840239 00000100:00100000:3.0:1746129746.631110:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053264256:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129746.631116:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba39180/2, rc 0, transno 21474840234 00000100:00100000:3.0:1746129746.631118:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053264768:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129746.631124:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba39f80/2, rc 0, transno 17179873075 00000100:00100000:3.0:1746129746.631126:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053265280:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129746.631132:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d4700/2, rc 0, transno 17179873076 00000100:00100000:3.0:1746129746.631135:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053265792:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746129746.631158:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37000/0x48868a4e43948b41 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0af expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.631176:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129746.631178:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129746.631181:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d37000, rc 0) 00000100:00100000:2.0:1746129746.631216:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28467:x1830949052087680:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 549us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.631221:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9808 00000100:00100000:0.0:1746129746.633777:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.634049:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052087808 00000100:00100000:2.0:1746129746.634082:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052087808 00000100:00100000:2.0:1746129746.634116:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9809 00000100:00100000:2.0:1746129746.634122:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28467:x1830949052087808:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129746.634139:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129746.634153:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37c00/0x48868a4e43948b48 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f0b6 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.634217:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37a00/0x48868a4e43948b4f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129746.634227:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37a00/0x48868a4e43948b4f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129746.634235:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37a00/0x48868a4e43948b4f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129746.634260:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:2.0:1746129746.634263:0:14315:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129746.634275:0:14315:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37a00/0x48868a4e43948b4f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129746.634293:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37c00/0x48868a4e43948b48 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0b6 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.634304:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37a00/0x48868a4e43948b4f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0b6 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.634310:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129746.634313:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129746.634315:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d37a00, rc 0) 00000100:00100000:2.0:1746129746.634353:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:28467:x1830949052087808:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 231us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.634359:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9809 00000100:00100000:2.0:1746129746.637802:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.637838:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.637904:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052087936 00000100:00100000:3.0:1746129746.637912:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052087936 00000100:00100000:3.0:1746129746.638093:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10663 00000100:00100000:3.0:1746129746.638101:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052087936:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129746.638116:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129746.638132:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b80400/0x48868a4e43948b56 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f0bd expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129746.638152:0:4589:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e8:0x0] initial LVB size: 1048576, mtime: 0x6813d352, atime: 0x6813d352, ctime: 0x6813d352, blocks: 0x807 00010000:00010000:3.0:1746129746.638168:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.638170:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.638177:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b80400/0x48868a4e43948b56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0bd expref: 16 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129746.638191:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b80400/0x48868a4e43948b56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0bd expref: 16 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129746.638200:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b80400, rc 0) 00000100:00100000:3.0:1746129746.638247:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+16:1962:x1830949052087936:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 147us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129746.638253:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10663 00000100:00100000:1.0:1746129746.638329:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052088064 00000100:00100000:1.0:1746129746.638333:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052088064 00000100:00100000:1.0:1746129746.638350:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10664 00000100:00100000:1.0:1746129746.638355:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052088064:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129746.638361:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129746.638370:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801356e3400/0x48868a4e43948b5d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f0c4 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129746.638384:0:3624:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e6:0x0] initial LVB size: 2097152, mtime: 0x6813d352, atime: 0x6813d352, ctime: 0x6813d352, blocks: 0x81f 00010000:00010000:1.0:1746129746.638391:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129746.638393:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746129746.638396:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129746.638397:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801356e3400/0x48868a4e43948b5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0c4 expref: 16 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129746.638406:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801356e3400/0x48868a4e43948b5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0c4 expref: 16 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129746.638413:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356e3400, rc 0) 00000100:00100000:2.0:1746129746.638415:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.638431:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+16:1962:x1830949052088064:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 76us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129746.638436:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10664 00000100:00100000:1.0:1746129746.638445:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052088192 00000100:00100000:1.0:1746129746.638447:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052088192 00000100:00100000:1.0:1746129746.638457:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052088320 00000100:00100000:1.0:1746129746.638459:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052088320 00000100:00100000:2.0:1746129746.638462:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10665 00000100:00100000:2.0:1746129746.638468:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+16:1962:x1830949052088192:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:1.0:1746129746.638469:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10666 00000100:00100000:1.0:1746129746.638473:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+16:1962:x1830949052088320:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129746.638474:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129746.638477:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129746.638481:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d36a00/0x48868a4e43948b64 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f0cb expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.638483:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801356e3000/0x48868a4e43948b6b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f0d2 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129746.638504:0:3624:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3ea:0x0] initial LVB size: 2097152, mtime: 0x6813d353, atime: 0x6813d352, ctime: 0x6813d353, blocks: 0x81f 00002000:00010000:2.0:1746129746.638506:0:1877:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e7:0x0] initial LVB size: 2097152, mtime: 0x6813d352, atime: 0x6813d352, ctime: 0x6813d352, blocks: 0x821 00010000:00010000:2.0:1746129746.638512:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129746.638512:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.638513:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129746.638513:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.638517:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d36a00/0x48868a4e43948b64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0cb expref: 17 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129746.638517:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801356e3000/0x48868a4e43948b6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0d2 expref: 17 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129746.638525:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801356e3000/0x48868a4e43948b6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0d2 expref: 17 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129746.638526:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d36a00/0x48868a4e43948b64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0cb expref: 17 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129746.638532:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d36a00, rc 0) 00010000:00010000:1.0:1746129746.638532:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356e3000, rc 0) 00000100:00100000:1.0:1746129746.638549:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+17:1962:x1830949052088320:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 75us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129746.638554:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10666 00000100:00100000:2.0:1746129746.639310:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+17:1962:x1830949052088192:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 839us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.639316:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10665 00000100:00100000:0.0:1746129746.639405:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.639436:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.639584:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052088448 00000100:00100000:2.0:1746129746.639587:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052088448 00000100:00100000:2.0:1746129746.639603:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052088576 00000100:00100000:2.0:1746129746.639605:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052088576 00000100:00100000:2.0:1746129746.639689:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10667 00000100:00100000:2.0:1746129746.639695:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+17:1962:x1830949052088448:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:3.0:1746129746.639701:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10668 00010000:00010000:2.0:1746129746.639704:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129746.639707:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+17:1962:x1830949052088576:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129746.639712:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129746.639713:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9a00/0x48868a4e43948b72 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f0d9 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.639719:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b80600/0x48868a4e43948b79 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f0e0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129746.639725:0:1877:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3eb:0x0] initial LVB size: 4960928, mtime: 0x6813d353, atime: 0x6813d353, ctime: 0x6813d353, blocks: 0x1629 00002000:00010000:3.0:1746129746.639728:0:4589:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e8:0x0] initial LVB size: 4194304, mtime: 0x6813d352, atime: 0x6813d352, ctime: 0x6813d352, blocks: 0x1029 00010000:00010000:2.0:1746129746.639732:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.639733:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.639734:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.639734:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.639738:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b80600/0x48868a4e43948b79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0e0 expref: 18 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129746.639738:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9a00/0x48868a4e43948b72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0d9 expref: 18 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129746.639748:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b80600/0x48868a4e43948b79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0e0 expref: 18 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129746.639748:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9a00/0x48868a4e43948b72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0d9 expref: 18 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129746.639754:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b80600, rc 0) 00010000:00010000:2.0:1746129746.639754:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d7f9a00, rc 0) 00000100:00100000:3.0:1746129746.639776:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+18:1962:x1830949052088576:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 70us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.639776:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+18:1962:x1830949052088448:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 81us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129746.639780:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10668 00000100:00100000:2.0:1746129746.639789:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10667 00000100:00100000:1.0:1746129746.647936:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.647977:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052088832 00000100:00100000:3.0:1746129746.647985:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052088832 00000100:00100000:3.0:1746129746.648044:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3926 00000100:00100000:3.0:1746129746.648052:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6141239f-0c60-480d-830c-e22ba61457b0+18:1962:x1830949052088832:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129746.648082:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880136b80c00/0x48868a4e43948b80 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.648094:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.648096:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.648100:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b80c00/0x48868a4e43948b80 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.648112:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b80c00/0x48868a4e43948b80 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129746.651873:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.651915:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.652745:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052089088 00000100:00100000:1.0:1746129746.652755:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052089088 00000100:00100000:1.0:1746129746.652809:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052089344 00000100:00100000:1.0:1746129746.652812:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052089344 00000100:00100000:1.0:1746129746.652845:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3927 00000100:00100000:1.0:1746129746.652872:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6141239f-0c60-480d-830c-e22ba61457b0+19:1962:x1830949052089088:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:1.0:1746129746.652902:0:21599:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8801356e2e00/0x48868a4e43948b87 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.652914:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129746.652916:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129746.652921:0:21599:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801356e2e00/0x48868a4e43948b87 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.652932:0:21599:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801356e2e00/0x48868a4e43948b87 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129746.653376:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3928 00000100:00100000:0.0:1746129746.653383:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6141239f-0c60-480d-830c-e22ba61457b0+19:1962:x1830949052089344:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:0.0:1746129746.653397:0:21605:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88013688b600/0x48868a4e43948b8e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.653403:0:21605:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129746.653404:0:21605:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129746.653406:0:21605:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013688b600/0x48868a4e43948b8e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.653413:0:21605:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013688b600/0x48868a4e43948b8e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129746.655450:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.655902:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052089600 00000100:00100000:3.0:1746129746.655909:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052089600 00000100:00100000:3.0:1746129746.655949:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3929 00000100:00100000:3.0:1746129746.655955:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6141239f-0c60-480d-830c-e22ba61457b0+20:1961:x1830949052089600:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129746.655979:0:21600:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880136b81400/0x48868a4e43948b95 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.655990:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.655991:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.655995:0:21600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b81400/0x48868a4e43948b95 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.656004:0:21600:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b81400/0x48868a4e43948b95 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129746.658344:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.659222:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052089856 00000100:00100000:1.0:1746129746.659230:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052089856 00000100:00100000:1.0:1746129746.659272:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3930 00000100:00100000:1.0:1746129746.659279:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6141239f-0c60-480d-830c-e22ba61457b0+22:1962:x1830949052089856:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:1.0:1746129746.659333:0:8440:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880132683600/0x48868a4e43948b9c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.659345:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129746.659347:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129746.659351:0:8440:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132683600/0x48868a4e43948b9c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.660047:0:8440:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132683600/0x48868a4e43948b9c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.666262:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880136b80c00/0x48868a4e43948b80 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.666277:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136b80c00/0x48868a4e43948b80 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.666285:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136b80c00/0x48868a4e43948b80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.666291:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b80c00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129746.666295:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136b80c00/0x48868a4e43948b80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.666306:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136b80c00/0x48868a4e43948b80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.666322:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136b80c00/0x48868a4e43948b80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.666327:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b80c00/0x48868a4e43948b80 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129746.666422:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6141239f-0c60-480d-830c-e22ba61457b0+22:1962:x1830949052088832:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 18366us (18488us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129746.666431:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3926 00000100:00100000:0.0:1746129746.667080:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.667534:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052090112 00000100:00100000:3.0:1746129746.667541:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052090112 00000100:00100000:3.0:1746129746.668166:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3931 00000100:00100000:3.0:1746129746.668175:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6141239f-0c60-480d-830c-e22ba61457b0+22:1962:x1830949052090112:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129746.668203:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880136b81800/0x48868a4e43948ba3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.668214:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.668215:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.668219:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b81800/0x48868a4e43948ba3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.668229:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b81800/0x48868a4e43948ba3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129746.672212:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.672298:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052090368 00000100:00100000:3.0:1746129746.672307:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052090368 00000100:00100000:3.0:1746129746.672359:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3932 00000100:00100000:3.0:1746129746.672367:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6141239f-0c60-480d-830c-e22ba61457b0+22:1962:x1830949052090368:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129746.672397:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880136b81e00/0x48868a4e43948baa lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.672409:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.672410:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.672415:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b81e00/0x48868a4e43948baa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.672426:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b81e00/0x48868a4e43948baa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129746.673436:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.673457:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052090624 00000100:00100000:3.0:1746129746.673461:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052090624 00000100:00100000:1.0:1746129746.673589:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3933 00000100:00100000:1.0:1746129746.673596:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6141239f-0c60-480d-830c-e22ba61457b0+24:1962:x1830949052090624:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:1.0:1746129746.673617:0:21602:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880132683800/0x48868a4e43948bb1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.673625:0:21602:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129746.673627:0:21602:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129746.673630:0:21602:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132683800/0x48868a4e43948bb1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.673638:0:21602:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132683800/0x48868a4e43948bb1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.675003:0:21599:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8801356e2e00/0x48868a4e43948b87 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.675015:0:21599:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801356e2e00/0x48868a4e43948b87 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.675022:0:21599:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801356e2e00/0x48868a4e43948b87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.675028:0:21599:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801356e2e00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129746.675032:0:21599:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801356e2e00/0x48868a4e43948b87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.675038:0:21599:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801356e2e00/0x48868a4e43948b87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.675052:0:21599:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801356e2e00/0x48868a4e43948b87 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.675062:0:21599:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801356e2e00/0x48868a4e43948b87 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129746.675109:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6141239f-0c60-480d-830c-e22ba61457b0+24:1962:x1830949052089088:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 22236us (23260us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129746.675116:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3927 00010000:00010000:2.0:1746129746.680228:0:21605:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88013688b600/0x48868a4e43948b8e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.680243:0:21605:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013688b600/0x48868a4e43948b8e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.680250:0:21605:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013688b600/0x48868a4e43948b8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.680256:0:21605:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013688b600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129746.680259:0:21605:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013688b600/0x48868a4e43948b8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.680266:0:21605:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013688b600/0x48868a4e43948b8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.680282:0:21605:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013688b600/0x48868a4e43948b8e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.680292:0:21605:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013688b600/0x48868a4e43948b8e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129746.680379:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6141239f-0c60-480d-830c-e22ba61457b0+22:1962:x1830949052089344:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 26990us (28456us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129746.680389:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3928 00010000:00010000:3.0:1746129746.683406:0:21600:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880136b81400/0x48868a4e43948b95 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.683419:0:21600:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136b81400/0x48868a4e43948b95 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.683425:0:21600:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136b81400/0x48868a4e43948b95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.683430:0:21600:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b81400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129746.683433:0:21600:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136b81400/0x48868a4e43948b95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.683440:0:21600:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136b81400/0x48868a4e43948b95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.683454:0:21600:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136b81400/0x48868a4e43948b95 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.683459:0:21600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b81400/0x48868a4e43948b95 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129746.683535:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6141239f-0c60-480d-830c-e22ba61457b0+22:1961:x1830949052089600:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 27576us (28088us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129746.683544:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3929 00010000:00010000:1.0:1746129746.688449:0:8440:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880132683600/0x48868a4e43948b9c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.688464:0:8440:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880132683600/0x48868a4e43948b9c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.688471:0:8440:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880132683600/0x48868a4e43948b9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.688477:0:8440:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132683600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129746.688481:0:8440:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880132683600/0x48868a4e43948b9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.688497:0:8440:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880132683600/0x48868a4e43948b9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.688515:0:8440:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880132683600/0x48868a4e43948b9c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.688520:0:8440:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132683600/0x48868a4e43948b9c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129746.688629:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6141239f-0c60-480d-830c-e22ba61457b0+20:1962:x1830949052089856:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 29345us (30285us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129746.688638:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3930 00010000:00010000:3.0:1746129746.692321:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880136b81800/0x48868a4e43948ba3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.692337:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136b81800/0x48868a4e43948ba3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.692344:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136b81800/0x48868a4e43948ba3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.692350:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b81800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129746.692353:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136b81800/0x48868a4e43948ba3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.692359:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136b81800/0x48868a4e43948ba3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.692375:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136b81800/0x48868a4e43948ba3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.692380:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b81800/0x48868a4e43948ba3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129746.692451:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6141239f-0c60-480d-830c-e22ba61457b0+20:1962:x1830949052090112:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 24274us (25368us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129746.692459:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3931 00010000:00010000:3.0:1746129746.695729:0:8441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880136b81e00/0x48868a4e43948baa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.695743:0:8441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136b81e00/0x48868a4e43948baa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.695749:0:8441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136b81e00/0x48868a4e43948baa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.695754:0:8441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b81e00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129746.695757:0:8441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136b81e00/0x48868a4e43948baa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.695764:0:8441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136b81e00/0x48868a4e43948baa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.695779:0:8441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136b81e00/0x48868a4e43948baa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.695790:0:8441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b81e00/0x48868a4e43948baa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129746.696180:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6141239f-0c60-480d-830c-e22ba61457b0+18:1962:x1830949052090368:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 23810us (23971us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129746.696189:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3932 00010000:00010000:1.0:1746129746.700094:0:21602:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880132683800/0x48868a4e43948bb1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.700113:0:21602:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880132683800/0x48868a4e43948bb1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.700121:0:21602:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880132683800/0x48868a4e43948bb1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.700127:0:21602:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132683800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129746.700130:0:21602:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880132683800/0x48868a4e43948bb1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.700137:0:21602:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880132683800/0x48868a4e43948bb1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.700153:0:21602:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880132683800/0x48868a4e43948bb1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.700159:0:21602:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132683800/0x48868a4e43948bb1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129746.700234:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6141239f-0c60-480d-830c-e22ba61457b0+18:1962:x1830949052090624:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 26635us (26797us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129746.700244:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3933 00000100:00100000:2.0:1746129746.706904:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.707218:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052090880 00000100:00100000:1.0:1746129746.707227:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052090880 00000100:00100000:1.0:1746129746.707273:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9810 00000100:00100000:1.0:1746129746.707280:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:28467:x1830949052090880:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:1.0:1746129746.707323:0:1851:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129746.707345:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37a00/0x48868a4e43948b4f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0b6 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.707546:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129746.707550:0:1851:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129746.707581:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132682000/0x48868a4e43948bb8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.707591:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132682000/0x48868a4e43948bb8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129746.707599:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132682000/0x48868a4e43948bb8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00010000:1.0:1746129746.707759:0:1851:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012b027100 reply state ffff88012e2d1000 transno 8589943580 ns: mdt-lustre-MDT0000_UUID lock: ffff880132682000/0x48868a4e43948bb8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:1.0:1746129746.707765:0:1851:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746129746.708128:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+10:28467:x1830949052090880:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 847us (1231us total) trans 8589943580 rc 0/0 00000100:00100000:1.0:1746129746.708134:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9810 00010000:00010000:2.0:1746129746.714351:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880132682000/0x48868a4e43948bb8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129746.714366:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132682000/0x48868a4e43948bb8 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129746.714372:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132682000/0x48868a4e43948bb8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129746.714379:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132682000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129746.714383:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132682000/0x48868a4e43948bb8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129746.714388:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132682000/0x48868a4e43948bb8 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129746.714402:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129746.714405:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129746.714408:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132682000/0x48868a4e43948bb8 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129746.714412:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132682000/0x48868a4e43948bb8 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129746.721217:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.721258:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.721287:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.721312:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.721321:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052091008 00000100:00100000:2.0:1746129746.721321:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052091136 00000100:00100000:0.0:1746129746.721327:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.721329:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052091008 00000100:00100000:2.0:1746129746.721329:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052091136 00000100:00100000:0.0:1746129746.721340:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052091264 00000100:00100000:0.0:1746129746.721344:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052091264 00000100:00100000:2.0:1746129746.721360:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052091392 00000100:00100000:2.0:1746129746.721362:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052091392 00000100:00100000:3.0:1746129746.721579:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052091520 00000100:00100000:3.0:1746129746.721583:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052091520 00000100:00100000:3.0:1746129746.721602:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10669 00000100:00100000:3.0:1746129746.721607:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+19:1964:x1830949052091136:12345-192.168.204.31@tcp:2:lfs.0 00000100:00100000:1.0:1746129746.721686:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10670 00000100:00100000:1.0:1746129746.721693:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+20:1963:x1830949052091008:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:3.0:1746129746.721770:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129746.721773:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129746 -> 1746129747 00002000:00010000:3.0:1746129746.721775:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129746 -> 1746129747 00002000:00010000:3.0:1746129746.721777:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129746 -> 1746129747 00002000:00010000:3.0:1746129746.721778:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2079 00002000:00010000:1.0:1746129746.721786:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746129746.721788:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129746 -> 1746129747 00002000:00010000:1.0:1746129746.721790:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129746 -> 1746129747 00002000:00010000:1.0:1746129746.721791:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129746 -> 1746129747 00002000:00010000:1.0:1746129746.721792:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:3.0:1746129746.721817:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+20:1964:x1830949052091136:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 209us (557us total) trans 21474840240 rc 0/0 00000100:00100000:1.0:1746129746.721817:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+21:1963:x1830949052091008:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 124us (610us total) trans 17179873081 rc 0/0 00000100:00100000:1.0:1746129746.721823:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10670 00000100:00100000:3.0:1746129746.722062:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10669 00000100:00100000:1.0:1746129746.722068:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10671 00000100:00100000:3.0:1746129746.722075:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10672 00000100:00100000:1.0:1746129746.722075:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+19:1963:x1830949052091264:12345-192.168.204.31@tcp:2:lfs.0 00000100:00100000:3.0:1746129746.722079:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+20:1964:x1830949052091392:12345-192.168.204.31@tcp:2:lfs.0 00000100:00100000:2.0:1746129746.722091:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10673 00000100:00100000:2.0:1746129746.722097:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+20:1963:x1830949052091520:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:3.0:1746129746.722134:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129746.722134:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129746.722136:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129747 -> 1746129747 00002000:00010000:1.0:1746129746.722136:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129746 -> 1746129747 00002000:00010000:1.0:1746129746.722138:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129746 -> 1746129747 00002000:00010000:3.0:1746129746.722139:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746129746 -> 1746129747 00002000:00010000:3.0:1746129746.722140:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129747 -> 1746129747 00002000:00010000:1.0:1746129746.722140:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129746 -> 1746129747 00002000:00010000:1.0:1746129746.722141:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:3.0:1746129746.722142:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746129746.722162:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+20:1963:x1830949052091264:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 83us (870us total) trans 21474840241 rc 0/0 00002000:00010000:2.0:1746129746.722166:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00000100:00100000:1.0:1746129746.722167:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10671 00002000:00010000:2.0:1746129746.722168:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129747 -> 1746129747 00002000:00010000:2.0:1746129746.722170:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129747 -> 1746129747 00002000:00010000:2.0:1746129746.722171:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129747 -> 1746129747 00002000:00010000:2.0:1746129746.722173:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5673 -> 5673 00000100:00100000:3.0:1746129746.722875:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+22:1964:x1830949052091392:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 792us (1559us total) trans 17179873082 rc 0/0 00000100:00100000:3.0:1746129746.722881:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10672 00000100:00100000:2.0:1746129746.722959:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+21:1963:x1830949052091520:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 860us (1629us total) trans 17179873083 rc 0/0 00000100:00100000:2.0:1746129746.722965:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10673 00000100:00100000:1.0:1746129746.722982:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.723000:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052091648 00000100:00100000:2.0:1746129746.723004:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052091648 00000100:00100000:2.0:1746129746.723021:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10674 00000100:00100000:2.0:1746129746.723026:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+20:1964:x1830949052091648:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:2.0:1746129746.723103:0:3623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746129746.723105:0:3623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129746 -> 1746129747 00002000:00010000:2.0:1746129746.723107:0:3623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129746 -> 1746129747 00002000:00010000:2.0:1746129746.723109:0:3623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129746 -> 1746129747 00002000:00010000:2.0:1746129746.723110:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746129746.723128:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+21:1964:x1830949052091648:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 102us (147us total) trans 21474840242 rc 0/0 00000100:00100000:2.0:1746129746.723135:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10674 00000100:00100000:0.0:1746129746.734696:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.734801:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052091904 00000100:00100000:3.0:1746129746.734808:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052091904 00000100:00100000:1.0:1746129746.736771:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3838 00000100:00100000:1.0:1746129746.736785:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:28467:x1830949052091904:12345-192.168.204.31@tcp:35:lfs.0 00000004:00010000:1.0:1746129746.736844:0:15740:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x368:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37e00/0x48868a4e43948b02 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0a8 expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.736904:0:15740:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880132682400/0x48868a4e43948bbf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15740 initiator: MDT0 00010000:00010000:1.0:1746129746.736915:0:15740:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37000/0x48868a4e43948b41 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0af expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.736921:0:15740:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132682400/0x48868a4e43948bbf lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15740 initiator: MDT0 00010000:00010000:1.0:1746129746.736951:0:15740:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37000/0x48868a4e43948b41 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0af expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.736961:0:15740:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37000/0x48868a4e43948b41 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0af expref: 9 pid: 14315 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746129746.737197:0:15740:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d634000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:15740:1830949053266176:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129746.737699:0:15740:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129746.740232:0:15740:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d634000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:15740:1830949053266176:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129746.740256:0:15740:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880132682400/0x48868a4e43948bbf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 00000100:00100000:0.0:1746129746.741805:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.741998:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052092032 00000100:00100000:2.0:1746129746.742004:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052092032 00010000:00010000:2.0:1746129746.742032:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37000/0x48868a4e43948b41 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0af expref: 10 pid: 14315 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746129746.742057:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5123 00000100:00100000:2.0:1746129746.742062:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052092032:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129746.742074:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129746.742079:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37000/0x48868a4e43948b41 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0af expref: 10 pid: 14315 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.742087:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37000/0x48868a4e43948b41 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0af expref: 10 pid: 14315 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.742103:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37000/0x48868a4e43948b41 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0af expref: 10 pid: 14315 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.742126:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129746.742130:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880132682400/0x48868a4e43948bbf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 00010000:00010000:2.0:1746129746.742137:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132682400/0x48868a4e43948bbf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15740 initiator: MDT0 00010000:00010000:2.0:1746129746.742142:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132682400/0x48868a4e43948bbf lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15740 initiator: MDT0 00010000:00010000:2.0:1746129746.742158:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129746.742190:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052092032:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 128us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.742195:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5123 00010000:00010000:1.0:1746129746.742326:0:15740:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880132682400/0x48868a4e43948bbf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 00010000:00010000:1.0:1746129746.742332:0:15740:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132682400/0x48868a4e43948bbf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 00000040:00080000:1.0:1746129746.742839:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2769, 88 off230520 00000004:00080000:1.0:1746129746.742845:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692800996723ns, next at 641639930618ns, rc = 0 00000040:00080000:1.0:1746129746.742910:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2709, 88 off225320 00000004:00080000:1.0:1746129746.742913:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692801065573ns, next at 641623252291ns, rc = 0 00000040:00080000:1.0:1746129746.742923:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2710, 88 off225408 00000004:00080000:1.0:1746129746.742925:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692801077547ns, next at 641623252291ns, rc = 0 00000040:00080000:1.0:1746129746.742932:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2770, 88 off230608 00000004:00080000:1.0:1746129746.742934:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692801085841ns, next at 641639930618ns, rc = 0 00000040:00080000:1.0:1746129746.742939:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2771, 88 off230696 00000004:00080000:1.0:1746129746.742941:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692801093349ns, next at 641639930618ns, rc = 0 00000040:00080000:1.0:1746129746.742946:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2711, 88 off225496 00000004:00080000:1.0:1746129746.742948:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692801100451ns, next at 641623252291ns, rc = 0 00000040:00080000:1.0:1746129746.742953:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2712, 88 off225584 00000004:00080000:1.0:1746129746.742955:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692801107283ns, next at 641623252291ns, rc = 0 00000040:00080000:1.0:1746129746.742960:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2713, 88 off225672 00000004:00080000:1.0:1746129746.742962:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692801113998ns, next at 641623252291ns, rc = 0 00000040:00080000:1.0:1746129746.742967:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2772, 88 off230784 00000004:00080000:1.0:1746129746.742969:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692801121337ns, next at 641639930618ns, rc = 0 00000040:00080000:1.0:1746129746.742975:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2714, 88 off225760 00000004:00080000:1.0:1746129746.742977:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692801128871ns, next at 641623252291ns, rc = 0 00000040:00080000:1.0:1746129746.742982:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2773, 88 off230872 00000004:00080000:1.0:1746129746.742984:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692801136028ns, next at 641639930618ns, rc = 0 00000040:00080000:1.0:1746129746.742989:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2715, 88 off225848 00000004:00080000:1.0:1746129746.742991:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692801143223ns, next at 641623252291ns, rc = 0 00000040:00080000:1.0:1746129746.742996:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2774, 88 off230960 00000004:00080000:1.0:1746129746.742999:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692801150816ns, next at 641639930618ns, rc = 0 00000040:00080000:1.0:1746129746.743004:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2775, 88 off231048 00000004:00080000:1.0:1746129746.743006:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692801158502ns, next at 641639930618ns, rc = 0 00000040:00080000:1.0:1746129746.743012:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2776, 88 off231136 00000004:00080000:1.0:1746129746.743015:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692801166931ns, next at 641639930618ns, rc = 0 00000040:00080000:1.0:1746129746.743020:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2777, 88 off231224 00000004:00080000:1.0:1746129746.743022:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692801174068ns, next at 641639930618ns, rc = 0 00000040:00080000:1.0:1746129746.743028:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2716, 88 off225936 00000004:00080000:1.0:1746129746.743030:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692801181931ns, next at 641623252291ns, rc = 0 00000004:00010000:1.0:1746129746.771670:0:15740:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009476b100 reply state ffff88009b836400 transno 8589943581 ns: mdt-lustre-MDT0000_UUID lock: ffff880132682400/0x48868a4e43948bbf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 00000100:00100000:1.0:1746129746.771681:0:15740:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746129746.771690:0:15740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129746.771692:0:15740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746129746.771699:0:15740:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37e00/0x48868a4e43948b02 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0a8 expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129746.771810:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:28467:x1830949052091904:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 35028us (37119us total) trans 8589943581 rc 0/0 00000100:00100000:1.0:1746129746.771817:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3838 00000001:00080000:1.0:1746129746.771868:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943581 is committed 00000004:00080000:1.0:1746129746.771873:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1902 committed 00000004:00080000:1.0:1746129746.771878:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1959 committed 00000004:00080000:1.0:1746129746.771882:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1958 committed 00000004:00080000:1.0:1746129746.771884:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1957 committed 00000004:00080000:1.0:1746129746.771885:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1956 committed 00000004:00080000:1.0:1746129746.771888:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1901 committed 00000004:00080000:1.0:1746129746.771889:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1955 committed 00000004:00080000:1.0:1746129746.771890:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1900 committed 00000004:00080000:1.0:1746129746.771892:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1954 committed 00000004:00080000:1.0:1746129746.771893:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1899 committed 00000004:00080000:1.0:1746129746.771894:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1898 committed 00000004:00080000:1.0:1746129746.771895:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1897 committed 00000004:00080000:1.0:1746129746.771897:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1953 committed 00000004:00080000:1.0:1746129746.771898:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1952 committed 00000004:00080000:1.0:1746129746.771900:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1896 committed 00000004:00080000:1.0:1746129746.771901:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1895 committed 00000004:00080000:1.0:1746129746.771903:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1951 committed 00010000:00010000:1.0:1746129746.771919:0:3283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880132682400/0x48868a4e43948bbf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15740 initiator: MDT0 00010000:00010000:1.0:1746129746.771925:0:3283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132682400/0x48868a4e43948bbf lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15740 initiator: MDT0 00010000:00010000:1.0:1746129746.771931:0:3283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132682400/0x48868a4e43948bbf lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15740 initiator: MDT0 00010000:00010000:1.0:1746129746.771936:0:3283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132682400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129746.771939:0:3283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132682400/0x48868a4e43948bbf lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15740 initiator: MDT0 00010000:00010000:1.0:1746129746.771945:0:3283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132682400/0x48868a4e43948bbf lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15740 initiator: MDT0 00010000:00010000:1.0:1746129746.771956:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129746.771958:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129746.771961:0:3283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132682400/0x48868a4e43948bbf lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15740 initiator: MDT0 00010000:00010000:1.0:1746129746.771965:0:3283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132682400/0x48868a4e43948bbf lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15740 initiator: MDT0 00000100:00100000:1.0:1746129746.773679:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053266304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129746.773730:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.773757:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053266816:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129746.773771:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.773783:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053267328:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.773796:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.773808:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053267840:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.773819:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129746.773921:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053266560:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129746.774459:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053266432:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129746.775512:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1746129746.775519:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053266688:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129746.775542:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.776692:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053267200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129746.776716:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129746.776834:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053266304 00000100:00100000:2.0:1746129746.776842:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053266304 00000100:00100000:2.0:1746129746.776886:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053266816 00000100:00100000:2.0:1746129746.776889:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053266816 00000100:00100000:2.0:1746129746.776898:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053267328 00000100:00100000:2.0:1746129746.776900:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053267328 00000100:00100000:2.0:1746129746.776910:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053267840 00000100:00100000:2.0:1746129746.776912:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053267840 00000100:00100000:2.0:1746129746.776920:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053266688 00000100:00100000:2.0:1746129746.776922:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053266688 00000100:00100000:2.0:1746129746.776932:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10675 00000100:00100000:2.0:1746129746.776939:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+55:3299:x1830949053266304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129746.777119:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129746.777121:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129747 -> 1746129747 00002000:00010000:2.0:1746129746.777123:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129747 -> 1746129747 00002000:00010000:2.0:1746129746.777125:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129747 -> 1746129747 00002000:00010000:2.0:1746129746.777127:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746129746.777155:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+56:3299:x1830949053266304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 217us (3426us total) trans 21474840243 rc 0/0 00000100:00100000:2.0:1746129746.777161:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10675 00000100:00100000:2.0:1746129746.777175:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10676 00000100:00100000:2.0:1746129746.777178:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+55:3299:x1830949053266816:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129746.777244:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746129746.777246:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746129746.777247:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746129746.777249:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746129746.777251:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746129746.777269:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+56:3299:x1830949053266816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (3497us total) trans 21474840244 rc 0/0 00000100:00100000:2.0:1746129746.777274:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10676 00000100:00100000:2.0:1746129746.777283:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10677 00000100:00100000:2.0:1746129746.777287:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+60:3299:x1830949053267328:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129746.777374:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746129746.777376:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129747 -> 1746129747 00002000:00010000:2.0:1746129746.777378:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129747 -> 1746129747 00002000:00010000:2.0:1746129746.777380:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129747 -> 1746129747 00002000:00010000:2.0:1746129746.777381:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:2.0:1746129746.777401:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+61:3299:x1830949053267328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 114us (3604us total) trans 17179873084 rc 0/0 00000100:00100000:2.0:1746129746.777406:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10677 00000100:00100000:2.0:1746129746.777414:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10678 00000100:00100000:2.0:1746129746.777419:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+60:3299:x1830949053267840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129746.777503:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+61:3299:x1830949053267840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (3681us total) trans 17179873085 rc 0/0 00000100:00100000:2.0:1746129746.777508:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10678 00000100:00100000:2.0:1746129746.777516:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10679 00000100:00100000:2.0:1746129746.777520:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+55:3299:x1830949053266688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129746.777594:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+56:3299:x1830949053266688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (2051us total) trans 21474840245 rc 0/0 00000100:00100000:2.0:1746129746.777599:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10679 00000100:00100000:0.0:1746129746.777714:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.778144:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053267712:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.778169:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.778180:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053268224:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.778194:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746129746.778218:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d634000/2, rc 0, transno 21474840243 00000100:00100000:1.0:1746129746.778223:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053266304:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129746.778231:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b00ea00/2, rc 0, transno 21474840244 00000100:00100000:1.0:1746129746.778234:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053266816:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129746.778241:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b00c380/2, rc 0, transno 17179873084 00000100:00100000:1.0:1746129746.778247:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053267328:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129746.778254:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b00fb80/2, rc 0, transno 17179873085 00000100:00100000:1.0:1746129746.778257:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053267840:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129746.778265:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba85c00/2, rc 0, transno 21474840245 00000100:00100000:1.0:1746129746.778267:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053266688:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129746.778282:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053267200 00000100:00100000:1.0:1746129746.778286:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053267200 00000100:00100000:1.0:1746129746.778303:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053267712 00000100:00100000:1.0:1746129746.778304:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053267712 00000100:00100000:1.0:1746129746.778310:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053268224 00000100:00100000:1.0:1746129746.778311:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053268224 00000100:00100000:1.0:1746129746.778317:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10680 00000100:00100000:1.0:1746129746.778321:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:3299:x1830949053267200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129746.778404:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3299:x1830949053267200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (1687us total) trans 21474840246 rc 0/0 00000100:00100000:1.0:1746129746.778408:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10680 00000100:00100000:1.0:1746129746.778416:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10681 00000100:00100000:1.0:1746129746.778419:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+62:3299:x1830949053267712:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129746.778470:0:3623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746129746.778472:0:3623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746129746.778473:0:3623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746129746.778474:0:3623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746129746.778476:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129746.778501:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+63:3299:x1830949053267712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (332us total) trans 17179873086 rc 0/0 00000100:00100000:1.0:1746129746.778505:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10681 00000100:00100000:1.0:1746129746.778512:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10682 00000100:00100000:1.0:1746129746.778515:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+62:3299:x1830949053268224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.778584:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+63:3299:x1830949053268224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (387us total) trans 17179873087 rc 0/0 00000100:00100000:1.0:1746129746.778588:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10682 00000100:00100000:1.0:1746129746.778607:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052092160 00000100:00100000:1.0:1746129746.778610:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052092160 00000100:00100000:1.0:1746129746.778628:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9811 00000100:00100000:1.0:1746129746.778633:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+6:28467:x1830949052092160:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129746.778647:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129746.778659:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d96c00/0x48868a4e43948bc6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f0e7 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.778698:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d96c00/0x48868a4e43948bc6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0e7 expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.778708:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d96c00/0x48868a4e43948bc6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0e7 expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.778722:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129746.778725:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129746.778727:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d96c00, rc 0) 00000100:00100000:1.0:1746129746.778754:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+7:28467:x1830949052092160:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 121us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129746.778759:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9811 00000100:00100000:1.0:1746129746.778901:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746129746.778908:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053268352:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.778927:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.778953:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053268352 00000100:00100000:1.0:1746129746.778956:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053268352 00000100:00100000:1.0:1746129746.778970:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10683 00000100:00100000:1.0:1746129746.778974:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+63:3298:x1830949053268352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.779049:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+64:3298:x1830949053268352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (121us total) trans 17179873088 rc 0/0 00000100:00100000:1.0:1746129746.779054:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10683 00000004:00080000:1.0:1746129746.779074:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009207d180/2, rc 0, transno 17179873088 00000100:00100000:1.0:1746129746.779078:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053268352:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129746.779089:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b00f100/2, rc 0, transno 21474840246 00000100:00100000:1.0:1746129746.779092:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053267200:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129746.779097:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b00d180/2, rc 0, transno 17179873086 00000100:00100000:1.0:1746129746.779100:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053267712:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129746.779105:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c137b80/2, rc 0, transno 17179873087 00000100:00100000:1.0:1746129746.779107:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053268224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129746.779168:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129746.779184:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053266944:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129746.779201:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129746.779211:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053267456:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129746.779221:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129746.779227:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053267968:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129746.779236:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129746.779252:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129746.779264:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053267072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129746.779278:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129746.779289:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053267584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129746.779303:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129746.779310:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053268096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129746.779319:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129746.779335:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053266432 00000100:00100000:0.0:1746129746.779337:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053266432 00000100:00100000:0.0:1746129746.779348:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053266944 00000100:00100000:0.0:1746129746.779349:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053266944 00000100:00100000:0.0:1746129746.779354:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053267456 00000100:00100000:0.0:1746129746.779356:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053267456 00000100:00100000:0.0:1746129746.779360:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053267968 00000100:00100000:0.0:1746129746.779362:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053267968 00000100:00100000:0.0:1746129746.779367:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053266560 00000100:00100000:0.0:1746129746.779368:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053266560 00000100:00100000:0.0:1746129746.779372:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053267072 00000100:00100000:0.0:1746129746.779373:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053267072 00000100:00100000:0.0:1746129746.779377:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053267584 00000100:00100000:0.0:1746129746.779378:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053267584 00000100:00100000:0.0:1746129746.779383:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053268096 00000100:00100000:0.0:1746129746.779384:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053268096 00000100:00100000:0.0:1746129746.779390:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10684 00000100:00100000:0.0:1746129746.779394:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+60:3296:x1830949053266432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129746.779468:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129746.779471:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129747 -> 1746129747 00002000:00010000:0.0:1746129746.779473:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129747 -> 1746129747 00002000:00010000:0.0:1746129746.779475:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129747 -> 1746129747 00002000:00010000:0.0:1746129746.779476:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129746.779509:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+61:3296:x1830949053266432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (341us total) trans 21474840247 rc 0/0 00000100:00100000:0.0:1746129746.779514:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10684 00000100:00100000:0.0:1746129746.779522:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10685 00000100:00100000:0.0:1746129746.779525:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+60:3296:x1830949053266944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129746.779595:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+61:3296:x1830949053266944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (392us total) trans 21474840248 rc 0/0 00000100:00100000:0.0:1746129746.779600:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10685 00000100:00100000:0.0:1746129746.779607:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10686 00000100:00100000:0.0:1746129746.779611:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+67:3296:x1830949053267456:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129746.779680:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129746.779683:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129747 -> 1746129747 00002000:00010000:0.0:1746129746.779684:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746129747 -> 1746129747 00002000:00010000:0.0:1746129746.779685:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129747 -> 1746129747 00002000:00010000:0.0:1746129746.779687:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746129746.779703:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+68:3296:x1830949053267456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (481us total) trans 17179873089 rc 0/0 00000100:00100000:0.0:1746129746.779707:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10686 00000100:00100000:0.0:1746129746.779715:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10687 00000100:00100000:0.0:1746129746.779718:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+67:3296:x1830949053267968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129746.779781:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+68:3296:x1830949053267968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (543us total) trans 17179873090 rc 0/0 00000100:00100000:0.0:1746129746.779786:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10687 00000100:00100000:0.0:1746129746.779794:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10688 00000100:00100000:0.0:1746129746.779797:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+60:3297:x1830949053266560:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129746.779877:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746129746.779880:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129747 -> 1746129747 00002000:00010000:0.0:1746129746.779882:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129747 -> 1746129747 00002000:00010000:0.0:1746129746.779884:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129747 -> 1746129747 00002000:00010000:0.0:1746129746.779886:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746129746.779906:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+61:3297:x1830949053266560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 108us (653us total) trans 21474840249 rc 0/0 00000100:00100000:0.0:1746129746.779910:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10688 00000100:00100000:0.0:1746129746.779918:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10689 00000100:00100000:0.0:1746129746.779921:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a342c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+60:3297:x1830949053267072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129746.779988:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a342c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+61:3297:x1830949053267072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (708us total) trans 21474840250 rc 0/0 00000100:00100000:0.0:1746129746.779993:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10689 00000100:00100000:0.0:1746129746.780088:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10690 00000100:00100000:0.0:1746129746.780092:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+67:3297:x1830949053267584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129746.780156:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:0.0:1746129746.780158:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129747 -> 1746129747 00002000:00010000:0.0:1746129746.780160:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129747 -> 1746129747 00002000:00010000:0.0:1746129746.780161:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129747 -> 1746129747 00002000:00010000:0.0:1746129746.780163:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5673 -> 5673 00000100:00100000:0.0:1746129746.780181:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+68:3297:x1830949053267584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (877us total) trans 17179873091 rc 0/0 00000100:00100000:0.0:1746129746.780185:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10690 00000100:00100000:0.0:1746129746.780193:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10691 00000100:00100000:0.0:1746129746.780197:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+67:3297:x1830949053268096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129746.780255:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+68:3297:x1830949053268096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (934us total) trans 17179873092 rc 0/0 00000100:00100000:0.0:1746129746.780259:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10691 00000004:00080000:0.0:1746129746.780282:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba87480/2, rc 0, transno 21474840247 00000100:00100000:0.0:1746129746.780286:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053266432:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129746.780291:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b00ca80/2, rc 0, transno 21474840248 00000100:00100000:0.0:1746129746.780293:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053266944:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129746.780298:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b00ce00/2, rc 0, transno 17179873089 00000100:00100000:0.0:1746129746.780301:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053267456:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129746.780305:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b00c000/2, rc 0, transno 17179873090 00000100:00100000:0.0:1746129746.780307:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053267968:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129746.780317:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba84380/2, rc 0, transno 21474840249 00000100:00100000:0.0:1746129746.780319:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053266560:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129746.780322:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b00d880/2, rc 0, transno 21474840250 00000100:00100000:0.0:1746129746.780324:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053267072:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129746.780328:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b00e680/2, rc 0, transno 17179873091 00000100:00100000:0.0:1746129746.780330:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053267584:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129746.780334:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b00d500/2, rc 0, transno 17179873092 00000100:00100000:0.0:1746129746.780336:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053268096:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129746.786809:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.787112:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052092416 00000100:00100000:1.0:1746129746.787121:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052092416 00000100:00100000:1.0:1746129746.787159:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3839 00000100:00100000:1.0:1746129746.787167:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6141239f-0c60-480d-830c-e22ba61457b0+7:28467:x1830949052092416:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:1.0:1746129746.787375:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28467:x1830949052092416:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 208us (573us total) trans 8589943582 rc 0/0 00000100:00100000:1.0:1746129746.787381:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3839 00000100:00100000:0.0:1746129746.816306:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.817747:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.817836:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052092672 00000100:00100000:1.0:1746129746.817845:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052092672 00000100:00100000:1.0:1746129746.817907:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9812 00000100:00100000:1.0:1746129746.817915:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+281:28480:x1830949052092672:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129746.817935:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129746.817949:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37800/0x48868a4e43948bcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f0ee expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.818039:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37600/0x48868a4e43948bd4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129746.818052:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37600/0x48868a4e43948bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129746.818061:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37600/0x48868a4e43948bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129746.818071:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37c00/0x48868a4e43948bdb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129746.818075:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37c00/0x48868a4e43948bdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129746.818078:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37c00/0x48868a4e43948bdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129746.818161:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37e00/0x48868a4e43948be2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129746.818169:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37e00/0x48868a4e43948be2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129746.818174:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37e00/0x48868a4e43948be2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:1.0:1746129746.818182:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129746.818247:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37600/0x48868a4e43948bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129746.818252:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37600/0x48868a4e43948bd4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129746.818258:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37600/0x48868a4e43948bd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129746.818266:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d37600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129746.818269:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37600/0x48868a4e43948bd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129746.818274:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37600/0x48868a4e43948bd4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129746.818281:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129746.818283:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129746.818286:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37600/0x48868a4e43948bd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129746.818290:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37600/0x48868a4e43948bd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129746.818303:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37c00/0x48868a4e43948bdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129746.818308:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37c00/0x48868a4e43948bdb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129746.818311:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37c00/0x48868a4e43948bdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129746.818314:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d37c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129746.818316:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37c00/0x48868a4e43948bdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129746.818320:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37c00/0x48868a4e43948bdb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129746.818324:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093a1d300) 00010000:00010000:1.0:1746129746.818325:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129746.818327:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37c00/0x48868a4e43948bdb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129746.818331:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37c00/0x48868a4e43948bdb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129746.818361:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37800/0x48868a4e43948bcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0ee expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.818369:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37e00/0x48868a4e43948be2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0ee expref: 283 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.818375:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129746.818376:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129746.818378:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d37e00, rc 0) 00000100:00100000:1.0:1746129746.818426:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28480:x1830949052092672:12345-192.168.204.31@tcp:101:cat.0 Request processed in 512us (2127us total) trans 8589943583 rc 0/0 00000100:00100000:1.0:1746129746.818431:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9812 00000100:00100000:2.0:1746129746.825149:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052092928 00000100:00100000:2.0:1746129746.825160:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052092928 00000100:00100000:3.0:1746129746.825308:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9813 00000100:00100000:3.0:1746129746.825317:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:28476:x1830949052092928:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129746.825339:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129746.825354:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a75e00/0x48868a4e43948bf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f0f5 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.825442:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a74e00/0x48868a4e43948bf7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129746.825452:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a74e00/0x48868a4e43948bf7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129746.825461:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a74e00/0x48868a4e43948bf7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129746.825471:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a75800/0x48868a4e43948bfe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129746.825476:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a75800/0x48868a4e43948bfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129746.825484:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a75800/0x48868a4e43948bfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129746.825580:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a74400/0x48868a4e43948c05 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129746.825587:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a74400/0x48868a4e43948c05 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129746.825592:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a74400/0x48868a4e43948c05 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129746.825599:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129746.825669:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a74e00/0x48868a4e43948bf7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129746.825674:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a74e00/0x48868a4e43948bf7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129746.825679:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a74e00/0x48868a4e43948bf7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129746.825684:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a74e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129746.825687:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a74e00/0x48868a4e43948bf7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129746.825691:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a74e00/0x48868a4e43948bf7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129746.825699:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129746.825701:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129746.825704:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a74e00/0x48868a4e43948bf7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129746.825711:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a74e00/0x48868a4e43948bf7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129746.826865:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a75800/0x48868a4e43948bfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129746.826872:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a75800/0x48868a4e43948bfe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129746.826878:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a75800/0x48868a4e43948bfe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129746.826882:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a75800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129746.826884:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a75800/0x48868a4e43948bfe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129746.826889:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a75800/0x48868a4e43948bfe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129746.826897:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880135f99800) 00010000:00010000:3.0:1746129746.826899:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129746.826901:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a75800/0x48868a4e43948bfe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129746.826905:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a75800/0x48868a4e43948bfe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129746.826946:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a75e00/0x48868a4e43948bf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0f5 expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.826954:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a74400/0x48868a4e43948c05 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0f5 expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.826964:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129746.826966:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129746.826968:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a74400, rc 0) 00000100:00100000:3.0:1746129746.830454:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28476:x1830949052092928:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5127us (12698us total) trans 8589943584 rc 0/0 00000100:00100000:3.0:1746129746.830465:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9813 00000100:00100000:0.0:1746129746.831430:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.831472:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.831506:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052093312 00000100:00100000:0.0:1746129746.831512:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052093312 00000100:00100000:3.0:1746129746.831618:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052093056 00000100:00100000:3.0:1746129746.831622:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052093056 00000100:00100000:3.0:1746129746.831643:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10692 00000100:00100000:3.0:1746129746.831649:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:28480:x1830949052093056:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129746.831662:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129746.831677:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a75a00/0x48868a4e43948c13 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f0fc expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.831697:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.831699:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129746.831705:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a75a00/0x48868a4e43948c13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0fc expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.831717:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a75a00/0x48868a4e43948c13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0fc expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.831726:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a75a00, rc 0) 00000100:00100000:3.0:1746129746.831767:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:28480:x1830949052093056:12345-192.168.204.31@tcp:101:cat.0 Request processed in 118us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129746.831772:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10692 00000100:00100000:1.0:1746129746.832775:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9814 00000100:00100000:1.0:1746129746.832784:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28479:x1830949052093312:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129746.832796:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129746.832807:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37a00/0x48868a4e43948c1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f103 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.832888:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37800/0x48868a4e43948c21 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129746.832898:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37e00/0x48868a4e43948be2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0ee expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.832909:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a74400/0x48868a4e43948c05 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0f5 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.832914:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37800/0x48868a4e43948c21 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129746.832935:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130a74400/0x48868a4e43948c05 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0f5 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.832944:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a74400/0x48868a4e43948c05 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0f5 expref: 8 pid: 1851 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746129746.832952:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053268480:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129746.833024:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37e00/0x48868a4e43948be2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0ee expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.833032:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37e00/0x48868a4e43948be2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0ee expref: 284 pid: 14315 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746129746.833039:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053268608:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129746.833058:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b7b0ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129746.836472:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.838601:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.838733:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053268480:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129746.838744:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053268608:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129746.838765:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37800/0x48868a4e43948c21 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:2.0:1746129746.838824:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052093440 00000100:00100000:2.0:1746129746.838831:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052093440 00010000:00010000:2.0:1746129746.838983:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37e00/0x48868a4e43948be2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0ee expref: 285 pid: 14315 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746129746.839007:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5124 00000100:00100000:2.0:1746129746.839014:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:1963:x1830949052093440:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129746.839028:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129746.839034:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37e00/0x48868a4e43948be2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0ee expref: 285 pid: 14315 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.839042:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37e00/0x48868a4e43948be2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0ee expref: 285 pid: 14315 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.839060:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37e00/0x48868a4e43948be2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0ee expref: 285 pid: 14315 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746129746.839795:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052093568 00000100:00100000:3.0:1746129746.839799:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052093568 00000100:00100000:3.0:1746129746.839834:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9815 00000100:00100000:3.0:1746129746.839840:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28480:x1830949052093568:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129746.839865:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129746.839875:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a74200/0x48868a4e43948c28 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f10a expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.839917:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a74200/0x48868a4e43948c28 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f10a expref: 286 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.839927:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a74200/0x48868a4e43948c28 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f10a expref: 286 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.839942:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129746.839944:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129746.839947:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a74200, rc 0) 00000100:00100000:3.0:1746129746.839985:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:28480:x1830949052093568:12345-192.168.204.31@tcp:101:cat.0 Request processed in 145us (1390us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129746.839990:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9815 00000100:00100000:3.0:1746129746.840040:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.840115:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052093696 00000100:00100000:3.0:1746129746.840118:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052093696 00010000:00010000:3.0:1746129746.840128:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a74400/0x48868a4e43948c05 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0f5 expref: 9 pid: 1851 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.840211:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129746.840215:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37800/0x48868a4e43948c21 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129746.840221:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37800/0x48868a4e43948c21 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129746.840225:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129746.840246:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:1963:x1830949052093440:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1234us (3780us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.840254:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5124 00000100:00100000:2.0:1746129746.840285:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5125 00000100:00100000:2.0:1746129746.840290:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052093696:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129746.840296:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129746.840300:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130a74400/0x48868a4e43948c05 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0f5 expref: 9 pid: 1851 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.840309:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130a74400/0x48868a4e43948c05 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0f5 expref: 9 pid: 1851 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.840319:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a74400/0x48868a4e43948c05 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0f5 expref: 9 pid: 1851 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.840327:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129746.840329:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37800/0x48868a4e43948c21 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129746.840334:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37800/0x48868a4e43948c21 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129746.840338:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37800/0x48868a4e43948c21 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129746.843106:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.843184:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052093952 00000100:00100000:0.0:1746129746.843191:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052093952 00000100:00100000:0.0:1746129746.843224:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9816 00000100:00100000:0.0:1746129746.843230:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28482:x1830949052093952:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129746.843248:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129746.843262:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66c00/0x48868a4e43948c2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f111 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.843352:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66e00/0x48868a4e43948c36 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129746.843363:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66e00/0x48868a4e43948c36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129746.843371:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66e00/0x48868a4e43948c36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129746.843382:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67600/0x48868a4e43948c3d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129746.843387:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67600/0x48868a4e43948c3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129746.843392:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67600/0x48868a4e43948c3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129746.843482:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67000/0x48868a4e43948c44 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129746.843500:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67000/0x48868a4e43948c44 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129746.843506:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67000/0x48868a4e43948c44 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:0.0:1746129746.843514:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129746.843648:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66e00/0x48868a4e43948c36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129746.843655:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66e00/0x48868a4e43948c36 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129746.843660:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66e00/0x48868a4e43948c36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129746.843665:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fb66e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129746.843668:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66e00/0x48868a4e43948c36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129746.843673:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66e00/0x48868a4e43948c36 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129746.843682:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:0.0:1746129746.843684:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129746.843688:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66e00/0x48868a4e43948c36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129746.843692:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66e00/0x48868a4e43948c36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129746.843714:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67600/0x48868a4e43948c3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129746.843718:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67600/0x48868a4e43948c3d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129746.843722:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67600/0x48868a4e43948c3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129746.843728:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fb67600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129746.843731:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67600/0x48868a4e43948c3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129746.843735:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67600/0x48868a4e43948c3d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129746.843740:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f99bd00) 00010000:00010000:0.0:1746129746.843741:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129746.843743:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67600/0x48868a4e43948c3d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129746.845951:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67600/0x48868a4e43948c3d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129746.846010:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66c00/0x48868a4e43948c2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f111 expref: 12 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.846022:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67000/0x48868a4e43948c44 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f111 expref: 11 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.846029:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129746.846031:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746129746.846033:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fb67000, rc 0) 00000100:00100000:0.0:1746129746.846088:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28482:x1830949052093952:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2857us (2987us total) trans 8589943585 rc 0/0 00000100:00100000:0.0:1746129746.846096:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9816 00010000:00010000:2.0:1746129746.846514:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129746.846573:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37800/0x48868a4e43948c21 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129746.846579:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37800/0x48868a4e43948c21 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:1.0:1746129746.846593:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129746.846688:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37a00/0x48868a4e43948c1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f103 expref: 286 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.846701:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37800/0x48868a4e43948c21 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f103 expref: 285 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.846707:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129746.846709:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129746.846711:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d37800, rc 0) 00000100:00100000:1.0:1746129746.846733:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28479:x1830949052093312:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 13951us (15260us total) trans 8589943586 rc 0/0 00000100:00100000:1.0:1746129746.846738:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9814 00000100:00100000:3.0:1746129746.846799:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949052093696:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6508us (6758us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129746.846806:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5125 00000100:00100000:0.0:1746129746.848531:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.850372:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052094208 00000100:00100000:2.0:1746129746.850382:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052094208 00000100:00100000:1.0:1746129746.851732:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3840 00000100:00100000:1.0:1746129746.851743:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28482:x1830949052094208:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129746.851938:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28482:x1830949052094208:12345-192.168.204.31@tcp:35:cat.0 Request processed in 197us (3413us total) trans 8589943587 rc 0/0 00000100:00100000:1.0:1746129746.851944:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3840 00000100:00100000:0.0:1746129746.854188:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.854279:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052094464 00000100:00100000:1.0:1746129746.854285:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052094464 00002000:00100000:1.0:1746129746.854318:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012b8e6300 x1830949052094464/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129746.854328:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e6300 with x1830949052094464 ext(0->1048575) 00002000:00010000:1.0:1746129746.854332:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8e6300 00000100:00100000:1.0:1746129746.854661:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3934 00000100:00100000:1.0:1746129746.854668:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949052094464:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129746.856088:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.856671:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052094592 00000100:00100000:2.0:1746129746.856678:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052094592 00000100:00100000:2.0:1746129746.856726:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10693 00000100:00100000:2.0:1746129746.856733:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28482:x1830949052094592:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129746.856747:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129746.856761:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092841c00/0x48868a4e43948c59 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f118 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.856781:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.856782:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.856790:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092841c00/0x48868a4e43948c59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f118 expref: 16 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.856803:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092841c00/0x48868a4e43948c59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f118 expref: 16 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.856813:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092841c00, rc 0) 00000100:00100000:2.0:1746129746.856873:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28482:x1830949052094592:12345-192.168.204.31@tcp:101:cat.0 Request processed in 114us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.856878:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10693 00000100:00100000:0.0:1746129746.860464:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.860569:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052094848 00000100:00100000:1.0:1746129746.860577:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052094848 00000100:00100000:1.0:1746129746.860766:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9817 00000100:00100000:1.0:1746129746.860774:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28479:x1830949052094848:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129746.860794:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129746.860797:0:14315:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746129746.860818:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a74200/0x48868a4e43948c28 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f10a expref: 285 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.860832:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129746.860835:0:14315:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129746.860843:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013688be00/0x48868a4e43948c60 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f11f expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.860900:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013688bc00/0x48868a4e43948c67 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129746.860909:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d96c00/0x48868a4e43948bc6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0e7 expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.860915:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67000/0x48868a4e43948c44 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f111 expref: 10 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.860925:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013688bc00/0x48868a4e43948c67 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129746.860947:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67000/0x48868a4e43948c44 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f111 expref: 10 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.860955:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67000/0x48868a4e43948c44 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f111 expref: 10 pid: 14314 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746129746.860964:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053268736:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129746.861086:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d96c00/0x48868a4e43948bc6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0e7 expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.861096:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d96c00/0x48868a4e43948bc6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0e7 expref: 7 pid: 1851 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746129746.861104:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053268864:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129746.861133:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129746.863156:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949052094464:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8481us (8967us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129746.863166:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3934 00002000:00100000:1.0:1746129746.863175:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012b8e6300 x1830949052094464/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/440 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129746.863183:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e6300 with x1830949052094464 ext(0->1048575) 00002000:00010000:1.0:1746129746.863188:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8e6300 00000100:00100000:2.0:1746129746.863221:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053268736:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129746.863232:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053268864:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129746.863249:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013688bc00/0x48868a4e43948c67 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129746.864755:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.864821:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.864951:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052095104 00000100:00100000:3.0:1746129746.864957:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052095104 00010000:00010000:3.0:1746129746.864983:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d96c00/0x48868a4e43948bc6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0e7 expref: 8 pid: 1851 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746129746.865193:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052094976 00000100:00100000:3.0:1746129746.865196:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052094976 00010000:00010000:3.0:1746129746.865208:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67000/0x48868a4e43948c44 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f111 expref: 11 pid: 14314 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746129746.865221:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5126 00000100:00100000:3.0:1746129746.865226:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052095104:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129746.865236:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129746.865240:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d96c00/0x48868a4e43948bc6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0e7 expref: 8 pid: 1851 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746129746.865249:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d96c00/0x48868a4e43948bc6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0e7 expref: 8 pid: 1851 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746129746.865265:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d96c00/0x48868a4e43948bc6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0e7 expref: 8 pid: 1851 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746129746.865277:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129746.865280:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88013688bc00/0x48868a4e43948c67 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.865286:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88013688bc00/0x48868a4e43948c67 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.865290:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129746.865321:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5127 00000100:00100000:2.0:1746129746.865328:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052094976:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129746.865335:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129746.865339:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67000/0x48868a4e43948c44 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f111 expref: 11 pid: 14314 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.865347:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67000/0x48868a4e43948c44 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f111 expref: 11 pid: 14314 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.865357:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67000/0x48868a4e43948c44 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f111 expref: 11 pid: 14314 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746129746.865375:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129746.865378:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88013688bc00/0x48868a4e43948c67 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129746.865383:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013688bc00/0x48868a4e43948c67 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129746.865388:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013688bc00/0x48868a4e43948c67 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00000100:00100000:3.0:1746129746.865977:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+7:1962:x1830949052095104:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 747us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129746.865983:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5126 00010000:00010000:2.0:1746129746.866039:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129746.866054:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949052094976:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 727us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.866059:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5127 00010000:00010000:3.0:1746129746.866102:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013688bc00/0x48868a4e43948c67 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129746.866108:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013688bc00/0x48868a4e43948c67 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:02000000:3.0:1746129746.866143:0:14315:0:(lod_object.c:7771:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00000100:00100000:0.0:1746129746.866392:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000040:00080000:3.0:1746129746.866634:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2778, 88 off231312 00000004:00080000:3.0:1746129746.866639:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692924790872ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129746.866683:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2717, 88 off226024 00000004:00080000:3.0:1746129746.866686:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692924838301ns, next at 641623252291ns, rc = 0 00000100:00100000:1.0:1746129746.867160:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052095360 00000100:00100000:1.0:1746129746.867168:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052095360 00002000:00100000:1.0:1746129746.867203:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880136884e00 x1830949052095360/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129746.867213:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136884e00 with x1830949052095360 ext(0->1048575) 00002000:00010000:1.0:1746129746.867217:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136884e00 00000100:00100000:1.0:1746129746.867250:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3935 00000100:00100000:1.0:1746129746.867258:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052095360:12345-192.168.204.31@tcp:3:cat.0 00000040:00080000:3.0:1746129746.869383:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2718, 88 off226112 00000004:00080000:3.0:1746129746.869393:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692927544086ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129746.869408:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2779, 88 off231400 00000004:00080000:3.0:1746129746.869412:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692927563367ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129746.869430:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2780, 88 off231488 00000004:00080000:3.0:1746129746.869433:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692927584743ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129746.869439:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2719, 88 off226200 00000004:00080000:3.0:1746129746.869442:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692927594127ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129746.869449:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2720, 88 off226288 00000004:00080000:3.0:1746129746.869451:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692927603006ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129746.869457:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2721, 88 off226376 00000004:00080000:3.0:1746129746.869459:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692927611703ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129746.869466:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2781, 88 off231576 00000004:00080000:3.0:1746129746.869468:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692927619929ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129746.869474:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2722, 88 off226464 00000004:00080000:3.0:1746129746.869479:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692927630782ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129746.869494:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2782, 88 off231664 00000004:00080000:3.0:1746129746.869496:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692927648657ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129746.869505:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2723, 88 off226552 00000004:00080000:3.0:1746129746.869508:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692927659768ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129746.869513:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2783, 88 off231752 00000004:00080000:3.0:1746129746.869515:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692927667382ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129746.869522:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2784, 88 off231840 00000004:00080000:3.0:1746129746.869524:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692927676442ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129746.869530:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2785, 88 off231928 00000004:00080000:3.0:1746129746.869532:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692927684397ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129746.869538:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2786, 88 off232016 00000004:00080000:3.0:1746129746.869541:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692927692738ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129746.869547:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2724, 88 off226640 00000004:00080000:3.0:1746129746.869549:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692927700886ns, next at 641623252291ns, rc = 0 00000100:00100000:0.0:1746129746.878305:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.878342:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052095488 00000100:00100000:0.0:1746129746.878351:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052095488 00000100:00100000:0.0:1746129746.878419:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10694 00000100:00100000:0.0:1746129746.878427:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:28480:x1830949052095488:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129746.878441:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129746.878762:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fb66600/0x48868a4e43948c6e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f126 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.878789:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129746.878791:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129746.878800:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb66600/0x48868a4e43948c6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f126 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.878815:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fb66600/0x48868a4e43948c6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f126 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.878826:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fb66600, rc 0) 00000100:00100000:0.0:1746129746.879108:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:28480:x1830949052095488:12345-192.168.204.31@tcp:101:cat.0 Request processed in 678us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129746.879115:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10694 00000100:00100000:1.0:1746129746.880763:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052095360:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13498us (14363us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129746.880773:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3935 00002000:00100000:1.0:1746129746.880783:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880136884e00 x1830949052095360/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/440 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129746.880791:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136884e00 with x1830949052095360 ext(0->1048575) 00002000:00010000:1.0:1746129746.880796:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136884e00 00000100:00100000:0.0:1746129746.881528:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.881605:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052095616 00000100:00100000:0.0:1746129746.881613:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052095616 00000100:00100000:0.0:1746129746.881649:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9818 00000100:00100000:0.0:1746129746.881657:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:28480:x1830949052095616:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129746.881673:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129746.881689:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66c00/0x48868a4e43948c75 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f12d expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.881739:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013688bc00/0x48868a4e43948c67 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129746.881748:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66c00/0x48868a4e43948c75 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f12d expref: 288 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.881762:0:1851:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88013688bc00/0x48868a4e43948c67 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129746.881775:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66c00/0x48868a4e43948c75 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f12d expref: 288 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.881786:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129746.881789:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129746.881792:0:1851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66c00/0x48868a4e43948c75 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f12d expref: 288 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.881798:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fb66c00, rc 0) 00000100:00100000:0.0:1746129746.881830:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:28480:x1830949052095616:12345-192.168.204.31@tcp:101:cat.0 Request processed in 173us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129746.881836:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9818 00000100:00100000:1.0:1746129746.895295:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.896346:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052095744 00000100:00100000:0.0:1746129746.896358:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052095744 00000100:00100000:0.0:1746129746.896400:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10695 00000100:00100000:0.0:1746129746.896410:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28482:x1830949052095744:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129746.896426:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129746.896442:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e43948c7c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f134 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.896466:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129746.896468:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129746.896476:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e43948c7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f134 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.896502:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e43948c7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f134 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.896513:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c840c00, rc 0) 00000100:00100000:0.0:1746129746.896567:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28482:x1830949052095744:12345-192.168.204.31@tcp:101:cat.0 Request processed in 157us (1279us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129746.896573:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10695 00000100:00100000:0.0:1746129746.899114:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.899148:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052095872 00000100:00100000:0.0:1746129746.899155:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052095872 00000100:00100000:0.0:1746129746.899192:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9819 00000100:00100000:0.0:1746129746.899201:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28482:x1830949052095872:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129746.899220:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129746.899235:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840a00/0x48868a4e43948c83 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f13b expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.899292:0:14314:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840a00/0x48868a4e43948c83 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f13b expref: 11 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.899303:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840a00/0x48868a4e43948c83 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f13b expref: 11 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.899314:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129746.899316:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129746.899321:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66c00/0x48868a4e43948c75 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f12d expref: 287 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129746.899326:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c840a00, rc 0) 00000100:00100000:0.0:1746129746.899369:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28482:x1830949052095872:12345-192.168.204.31@tcp:101:cat.0 Request processed in 168us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129746.899375:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9819 00000001:00080000:0.0:1746129746.907479:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943585 is committed 00000001:00080000:0.0:1746129746.907503:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943587 is committed 00000001:00080000:0.0:1746129746.907507:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943586 is committed 00000001:00080000:0.0:1746129746.907512:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943582 is committed 00000001:00080000:0.0:1746129746.907515:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943588 is committed 00000004:00080000:0.0:1746129746.907518:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1910 committed 00000004:00080000:0.0:1746129746.907523:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1968 committed 00000004:00080000:0.0:1746129746.907527:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1967 committed 00000004:00080000:0.0:1746129746.907528:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1966 committed 00000004:00080000:0.0:1746129746.907530:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1965 committed 00000004:00080000:0.0:1746129746.907531:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1909 committed 00000004:00080000:0.0:1746129746.907533:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1964 committed 00000004:00080000:0.0:1746129746.907535:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1908 committed 00000004:00080000:0.0:1746129746.907536:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1963 committed 00000004:00080000:0.0:1746129746.907538:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1907 committed 00000004:00080000:0.0:1746129746.907539:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1906 committed 00000004:00080000:0.0:1746129746.907540:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1905 committed 00000004:00080000:0.0:1746129746.907541:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1962 committed 00000004:00080000:0.0:1746129746.907543:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1961 committed 00000004:00080000:0.0:1746129746.907544:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1904 committed 00000004:00080000:0.0:1746129746.907545:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1903 committed 00000004:00080000:0.0:1746129746.907547:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1960 committed 00000100:00100000:0.0:1746129746.907577:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053268992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129746.907627:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.907655:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053269248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129746.907664:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053269504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.907673:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129746.907678:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053269120:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.907687:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053269760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129746.907690:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.907698:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129746.907700:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053269632:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.907708:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746129746.907711:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.907712:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053269376:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.907723:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129746.907730:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053268992 00000100:00100000:1.0:1746129746.907731:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053269888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129746.907735:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053268992 00000100:00100000:1.0:1746129746.907744:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129746.907756:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053269248 00000100:00100000:0.0:1746129746.907758:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053269248 00000100:00100000:1.0:1746129746.907761:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053269120 00000100:00100000:1.0:1746129746.907763:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053269120 00000100:00100000:0.0:1746129746.907767:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053269760 00000100:00100000:0.0:1746129746.907769:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053269760 00000100:00100000:1.0:1746129746.907774:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053269632 00000100:00100000:1.0:1746129746.907776:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053269632 00000100:00100000:0.0:1746129746.907776:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053269376 00000100:00100000:0.0:1746129746.907777:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053269376 00000100:00100000:1.0:1746129746.907783:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053269888 00000100:00100000:1.0:1746129746.907785:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053269888 00000100:00100000:0.0:1746129746.907788:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10696 00000100:00100000:1.0:1746129746.907793:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10697 00000100:00100000:0.0:1746129746.907794:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+74:3296:x1830949053268992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.907797:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+74:3298:x1830949053269248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129746.907809:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10698 00000100:00100000:0.0:1746129746.907812:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+74:3297:x1830949053269120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.907844:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10699 00000100:00100000:1.0:1746129746.907863:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+74:3298:x1830949053269760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129746.907933:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10700 00000100:00100000:0.0:1746129746.907937:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3297:x1830949053269632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.907964:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+76:3298:x1830949053269760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 100us (264us total) trans 17179873093 rc 0/0 00000100:00100000:1.0:1746129746.907970:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10699 00000100:00100000:1.0:1746129746.907981:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10701 00000100:00100000:1.0:1746129746.907984:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+76:3298:x1830949053269376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129746.908011:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3297:x1830949053269632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (299us total) trans 17179873095 rc 0/0 00000100:00100000:0.0:1746129746.908016:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10700 00000100:00100000:0.0:1746129746.908026:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10702 00000100:00100000:0.0:1746129746.908030:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3298:x1830949053269888:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129746.908044:0:3623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746129746.908047:0:3623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746129746.908049:0:3623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746129746.908051:0:3623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746129746.908052:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129746.908070:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+76:3298:x1830949053269376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (345us total) trans 17179873096 rc 0/0 00000100:00100000:1.0:1746129746.908074:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10701 00000100:00100000:0.0:1746129746.908096:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3298:x1830949053269888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (351us total) trans 17179873097 rc 0/0 00000100:00100000:0.0:1746129746.908101:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10702 00000004:00080000:0.0:1746129746.908128:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936dc000/2, rc 0, transno 17179873095 00000100:00100000:0.0:1746129746.908135:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053269632:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129746.908137:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:1.0:1746129746.908139:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129747 -> 1746129747 00002000:00010000:1.0:1746129746.908141:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129747 -> 1746129747 00002000:00010000:1.0:1746129746.908143:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129747 -> 1746129747 00002000:00010000:1.0:1746129746.908145:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5673 -> 5673 00000100:00100000:0.0:1746129746.908145:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.908162:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+76:3298:x1830949053269248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 364us (488us total) trans 17179873098 rc 0/0 00000100:00100000:0.0:1746129746.908164:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053269504 00000100:00100000:1.0:1746129746.908168:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10697 00000100:00100000:0.0:1746129746.908168:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053269504 00000100:00100000:0.0:1746129746.908180:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10703 00000004:00080000:1.0:1746129746.908184:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009207dc00/2, rc 0, transno 17179873096 00000100:00100000:0.0:1746129746.908184:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+76:3296:x1830949053269504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.908187:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053269376:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129746.908193:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936dc700/2, rc 0, transno 17179873097 00000100:00100000:1.0:1746129746.908196:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053269888:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129746.908201:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009207e680/2, rc 0, transno 17179873098 00000100:00100000:1.0:1746129746.908204:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053269248:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129746.908209:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936dc380/2, rc 0, transno 17179873093 00000100:00100000:1.0:1746129746.908211:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053269760:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.908235:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746129746.908239:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053270016:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.908255:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129746.908258:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+77:3296:x1830949053269504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (112us total) trans 17179873099 rc 0/0 00000100:00100000:0.0:1746129746.908263:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10703 00000100:00100000:1.0:1746129746.908268:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053270016 00000100:00100000:1.0:1746129746.908271:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053270016 00000004:00080000:0.0:1746129746.908278:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009207c380/2, rc 0, transno 17179873099 00000100:00100000:1.0:1746129746.908281:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10704 00000100:00100000:0.0:1746129746.908281:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053269504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.908285:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+77:3297:x1830949053270016:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129746.908325:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129746.908327:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129747 -> 1746129747 00002000:00010000:0.0:1746129746.908329:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746129747 -> 1746129747 00002000:00010000:0.0:1746129746.908330:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129747 -> 1746129747 00002000:00010000:0.0:1746129746.908332:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746129746.908353:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+78:3297:x1830949053270016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (97us total) trans 17179873100 rc 0/0 00000100:00100000:0.0:1746129746.908353:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+78:3297:x1830949053269120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 539us (661us total) trans 17179873094 rc 0/0 00000100:00100000:0.0:1746129746.908357:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10698 00000100:00100000:1.0:1746129746.908359:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10704 00000004:00080000:1.0:1746129746.908373:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936dd880/2, rc 0, transno 17179873100 00000100:00100000:1.0:1746129746.908376:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053270016:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129746.908383:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009207e300/2, rc 0, transno 17179873094 00000100:00100000:1.0:1746129746.908385:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053269120:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129746.908408:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746129746.908410:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129747 -> 1746129747 00002000:00010000:0.0:1746129746.908412:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129747 -> 1746129747 00002000:00010000:0.0:1746129746.908413:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129747 -> 1746129747 00002000:00010000:0.0:1746129746.908415:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2055 -> 2055 00010000:00010000:3.0:1746129746.908650:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013688bc00/0x48868a4e43948c67 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f11f expref: 285 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.908661:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129746.908664:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746129746.908668:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66c00/0x48868a4e43948c75 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f12d expref: 285 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.908678:0:14315:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66c00/0x48868a4e43948c75 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f12d expref: 285 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.908684:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66c00/0x48868a4e43948c75 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f12d expref: 285 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.908694:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840a00/0x48868a4e43948c83 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f13b expref: 7 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.908701:0:14315:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840a00/0x48868a4e43948c83 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f13b expref: 7 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.908706:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840a00/0x48868a4e43948c83 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f13b expref: 7 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.908730:0:14315:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840a00/0x48868a4e43948c83 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f13b expref: 7 pid: 14314 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129746.908741:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053271168:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129746.908932:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053270400:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746129746.909955:0:14315:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66c00/0x48868a4e43948c75 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f12d expref: 285 pid: 1851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129746.909967:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053271296:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129746.909994:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bd1d540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129746.910079:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+77:3296:x1830949053268992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2283us (2449us total) trans 17179873101 rc 0/0 00000100:00100000:0.0:1746129746.910086:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10696 00000100:00100000:0.0:1746129746.910111:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053270528:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129746.910129:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.910132:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053270144:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129746.910148:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053270272:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129746.910157:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053271040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129746.910162:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.910188:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c042d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053270784:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129746.910201:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.910217:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.910225:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053270656:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129746.910238:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.910254:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053270528 00000100:00100000:0.0:1746129746.910257:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.910258:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053270528 00000100:00100000:1.0:1746129746.910273:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053270272 00000100:00100000:1.0:1746129746.910275:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053270272 00000004:00080000:0.0:1746129746.910277:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009207d500/2, rc 0, transno 17179873101 00000100:00100000:0.0:1746129746.910281:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053268992:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129746.910282:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053270784 00000100:00100000:1.0:1746129746.910283:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053270784 00000100:00100000:1.0:1746129746.910291:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053270144 00000100:00100000:0.0:1746129746.910292:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053270656 00000100:00100000:1.0:1746129746.910293:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053270144 00000100:00100000:0.0:1746129746.910294:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053270656 00000100:00100000:1.0:1746129746.910299:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053271040 00000100:00100000:1.0:1746129746.910301:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053271040 00000100:00100000:0.0:1746129746.910304:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10705 00000100:00100000:0.0:1746129746.910309:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+66:3296:x1830949053270528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129746.910797:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10706 00000100:00100000:1.0:1746129746.910803:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+66:3298:x1830949053270272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129746.910822:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10707 00000100:00100000:2.0:1746129746.910828:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3298:x1830949053270784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129746.910872:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10708 00000100:00100000:2.0:1746129746.910876:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3297:x1830949053270144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129746.910961:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129746.910964:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129747 -> 1746129747 00002000:00010000:1.0:1746129746.910966:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129747 -> 1746129747 00002000:00010000:1.0:1746129746.910968:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129747 -> 1746129747 00002000:00010000:1.0:1746129746.910970:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746129746.910981:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+68:3298:x1830949053270784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 152us (778us total) trans 21474840252 rc 0/0 00000100:00100000:1.0:1746129746.910985:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+68:3298:x1830949053270272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 183us (823us total) trans 21474840251 rc 0/0 00000100:00100000:2.0:1746129746.910986:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10707 00000100:00100000:1.0:1746129746.910989:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10706 00000100:00100000:2.0:1746129746.910996:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10709 00000100:00100000:2.0:1746129746.911000:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3297:x1830949053270656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129746.911028:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10710 00000100:00100000:3.0:1746129746.911033:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+66:3296:x1830949053271040:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129746.911059:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746129746.911062:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746129746.911063:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746129746.911065:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746129746.911066:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746129746.911086:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+68:3297:x1830949053270656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (848us total) trans 21474840253 rc 0/0 00000100:00100000:2.0:1746129746.911091:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10709 00000100:00100000:3.0:1746129746.911109:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+68:3296:x1830949053271040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (851us total) trans 21474840254 rc 0/0 00000100:00100000:3.0:1746129746.911114:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10710 00002000:00010000:2.0:1746129746.911120:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129746.911122:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129747 -> 1746129747 00002000:00010000:2.0:1746129746.911124:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129747 -> 1746129747 00002000:00010000:2.0:1746129746.911125:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129747 -> 1746129747 00002000:00010000:2.0:1746129746.911127:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2079 00000004:00080000:3.0:1746129746.911132:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5491180/2, rc 0, transno 21474840254 00000100:00100000:3.0:1746129746.911136:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053271040:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129746.911141:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+67:3297:x1830949053270144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 265us (924us total) trans 21474840255 rc 0/0 00000100:00100000:2.0:1746129746.911146:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10708 00000100:00100000:1.0:1746129746.911187:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.911203:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053270912:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129746.911219:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129746.911233:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053270400 00000100:00100000:1.0:1746129746.911236:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053270400 00000100:00100000:1.0:1746129746.911247:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053270912 00000100:00100000:1.0:1746129746.911249:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053270912 00000100:00100000:0.0:1746129746.912357:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+68:3296:x1830949053270528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2044us (2223us total) trans 21474840256 rc 0/0 00000100:00100000:0.0:1746129746.912365:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10705 00000100:00100000:0.0:1746129746.912381:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10711 00000100:00100000:0.0:1746129746.912387:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+67:3299:x1830949053270400:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129746.912463:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746129746.912466:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129747 -> 1746129747 00002000:00010000:0.0:1746129746.912467:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129747 -> 1746129747 00002000:00010000:0.0:1746129746.912469:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129747 -> 1746129747 00002000:00010000:0.0:1746129746.912471:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746129746.912504:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+68:3299:x1830949053270400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 118us (1316us total) trans 21474840257 rc 0/0 00000100:00100000:0.0:1746129746.912509:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10711 00000004:00080000:2.0:1746129746.912589:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b024000/2, rc 0, transno 21474840255 00000100:00100000:2.0:1746129746.912595:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053270144:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129746.912611:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba38700/2, rc 0, transno 21474840253 00000100:00100000:2.0:1746129746.912614:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053270656:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129746.912636:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10712 00000004:00080000:2.0:1746129746.912637:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba3b800/2, rc 0, transno 21474840251 00000100:00100000:2.0:1746129746.912639:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053270272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129746.912641:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+68:3299:x1830949053270912:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129746.912646:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c042d80/2, rc 0, transno 21474840252 00000100:00100000:2.0:1746129746.912649:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c042d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053270784:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129746.912726:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+69:3299:x1830949053270912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (1506us total) trans 21474840258 rc 0/0 00000100:00100000:1.0:1746129746.912731:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10712 00000004:00080000:1.0:1746129746.912755:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba3bb80/2, rc 0, transno 21474840257 00000100:00100000:1.0:1746129746.912758:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053270400:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129746.912762:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c040380/2, rc 0, transno 21474840258 00000100:00100000:1.0:1746129746.912764:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053270912:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129746.912876:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba3ad80/2, rc 0, transno 21474840256 00000100:00100000:3.0:1746129746.912880:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053270528:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129746.914603:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.914648:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.914730:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053271168:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129746.915025:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052096000 00000100:00100000:0.0:1746129746.915030:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052096000 00000100:00100000:0.0:1746129746.915502:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052096128 00000100:00100000:0.0:1746129746.915506:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052096128 00000100:00100000:1.0:1746129746.915507:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3841 00000100:00100000:1.0:1746129746.915514:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:28480:x1830949052096000:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:0.0:1746129746.915613:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3842 00000100:00100000:0.0:1746129746.915619:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c560c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28482:x1830949052096128:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:0.0:1746129746.915670:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c560c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28482:x1830949052096128:12345-192.168.204.31@tcp:49:cat.0 Request processed in 51us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129746.915675:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3842 00000100:00100000:3.0:1746129746.915843:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053271296:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129746.915886:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013688be00/0x48868a4e43948c60 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f11f expref: 286 pid: 14315 timeout: 0 lvb_type: 3 00000100:00100000:1.0:1746129746.915896:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28480:x1830949052096000:12345-192.168.204.31@tcp:49:cat.0 Request processed in 382us (1299us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129746.915902:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013688bc00/0x48868a4e43948c67 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f11f expref: 285 pid: 14315 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129746.915904:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3841 00010000:00010000:3.0:1746129746.915917:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013688bc00, rc 0) 00000100:00100000:3.0:1746129746.915933:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28479:x1830949052094848:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 55161us (55476us total) trans 8589943588 rc 0/0 00000100:00100000:3.0:1746129746.915938:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9817 00000100:00100000:0.0:1746129746.924885:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.924963:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052096384 00000100:00100000:2.0:1746129746.924971:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052096384 00000100:00100000:2.0:1746129746.925016:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10713 00000100:00100000:2.0:1746129746.925023:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:28479:x1830949052096384:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129746.925038:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129746.925052:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931f7c00/0x48868a4e43948c8a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f142 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.925075:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d36a00/0x48868a4e43948b64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0cb expref: 20 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129746.925081:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.925082:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.925086:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931f7c00/0x48868a4e43948c8a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1646592->1921023] (req 1646592->1921023) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f142 expref: 24 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.925110:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d36a00/0x48868a4e43948b64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0cb expref: 20 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129746.925120:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d36a00/0x48868a4e43948b64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0cb expref: 20 pid: 1877 timeout: 792 lvb_type: 1 00000100:00100000:2.0:1746129746.925129:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053271424:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129746.926168:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b80300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129746.928065:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.928095:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.928376:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052096640 00000100:00100000:1.0:1746129746.928383:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052096640 00002000:00100000:1.0:1746129746.928417:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012d635880 x1830949052096640/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129746.928426:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d635880 with x1830949052096640 ext(1048576->2097151) 00002000:00010000:1.0:1746129746.928430:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d635880 00000100:00100000:1.0:1746129746.928459:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052096768 00000100:00100000:1.0:1746129746.928461:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052096768 00002000:00100000:1.0:1746129746.928475:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012d636680 x1830949052096768/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129746.928481:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d636680 with x1830949052096768 ext(1048576->2097151) 00002000:00010000:1.0:1746129746.928494:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d636680 00000100:00100000:1.0:1746129746.928509:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3936 00000100:00100000:1.0:1746129746.928516:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949052096640:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129746.928587:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3937 00000100:00100000:2.0:1746129746.928594:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052096768:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129746.928832:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053271424:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129746.929520:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931f7c00/0x48868a4e43948c8a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1646592->1921023] (req 1646592->1921023) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f142 expref: 25 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.929669:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931f7c00, rc 0) 00000100:00100000:2.0:1746129746.929726:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:28479:x1830949052096384:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4702us (4846us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.929732:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10713 00000100:00100000:1.0:1746129746.929888:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.930230:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.930285:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052097024 00000100:00100000:2.0:1746129746.930289:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052097024 00010000:00010000:2.0:1746129746.930308:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d36a00/0x48868a4e43948b64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0cb expref: 21 pid: 1877 timeout: 792 lvb_type: 1 00000100:00100000:2.0:1746129746.930325:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5128 00000100:00100000:2.0:1746129746.930331:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+21:1962:x1830949052097024:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129746.930342:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129746.930355:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d36a00/0x48868a4e43948b64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0cb expref: 21 pid: 1877 timeout: 792 lvb_type: 1 00010000:00010000:2.0:1746129746.930363:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d36a00/0x48868a4e43948b64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0cb expref: 21 pid: 1877 timeout: 792 lvb_type: 1 00010000:00010000:2.0:1746129746.930381:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d36a00/0x48868a4e43948b64 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0cb expref: 21 pid: 1877 timeout: 792 lvb_type: 1 00010000:00010000:2.0:1746129746.930402:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.930404:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.930410:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931f7c00/0x48868a4e43948c8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1921023) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f142 expref: 25 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.930416:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931f7c00/0x48868a4e43948c8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1921023) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f142 expref: 25 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.930440:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800931f7c00/0x48868a4e43948c8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1921023) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f142 expref: 25 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129746.930450:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053271552:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129746.930511:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b80300 going to sleep for 11 seconds 00000100:00100000:2.0:1746129746.930524:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052096896 00000100:00100000:2.0:1746129746.930526:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052096896 00000100:00100000:2.0:1746129746.930967:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10714 00000100:00100000:2.0:1746129746.930974:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28476:x1830949052096896:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129746.930984:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129746.930996:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800931f6200/0x48868a4e43948c91 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f149 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.931011:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801356e3000/0x48868a4e43948b6b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0d2 expref: 20 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129746.931016:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.931018:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.931020:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800931f6200/0x48868a4e43948c91 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1339392->2019327] (req 1339392->2019327) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f149 expref: 17 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.931045:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801356e3000/0x48868a4e43948b6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0d2 expref: 20 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129746.931054:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801356e3000/0x48868a4e43948b6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0d2 expref: 20 pid: 3624 timeout: 792 lvb_type: 1 00000100:00100000:2.0:1746129746.931061:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053271680:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129746.931966:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b80a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129746.934691:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053271552:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129746.934710:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129746.934758:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+20:1962:x1830949052097024:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4425us (4526us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.934766:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5128 00000100:00100000:0.0:1746129746.937410:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.937639:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052097280 00000100:00100000:1.0:1746129746.937647:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052097280 00002000:00100000:1.0:1746129746.937680:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1916928->1921023) req@ffff88012d637800 x1830949052097280/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129746.937688:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d637800 with x1830949052097280 ext(1916928->1921023) 00002000:00010000:1.0:1746129746.937693:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d637800 00000100:00100000:2.0:1746129746.939112:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949052096640:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 10592us (11053us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129746.939121:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3936 00002000:00100000:2.0:1746129746.939128:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012d635880 x1830949052096640/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/440 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129746.939136:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d635880 with x1830949052096640 ext(1048576->2097151) 00002000:00010000:2.0:1746129746.939139:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d635880 00000100:00100000:2.0:1746129746.939162:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3938 00000100:00100000:2.0:1746129746.939170:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949052097280:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129746.939505:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949052097280:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 334us (2100us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129746.939511:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3938 00002000:00100000:2.0:1746129746.939517:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1916928->1921023) req@ffff88012d637800 x1830949052097280/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/4536 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129746.939523:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d637800 with x1830949052097280 ext(1916928->1921023) 00002000:00010000:2.0:1746129746.939527:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d637800 00000100:00100000:2.0:1746129746.939970:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053271680:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129746.939989:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800931f6200/0x48868a4e43948c91 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1339392->2019327] (req 1339392->2019327) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f149 expref: 17 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.940003:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931f6200, rc 0) 00000100:00100000:2.0:1746129746.940301:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28476:x1830949052096896:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 9326us (10412us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.940307:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10714 00000100:00100000:0.0:1746129746.941565:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.942218:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052097408 00000100:00100000:2.0:1746129746.942225:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052097408 00010000:00010000:2.0:1746129746.942252:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801356e3000/0x48868a4e43948b6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0d2 expref: 21 pid: 3624 timeout: 792 lvb_type: 1 00000100:00100000:2.0:1746129746.942289:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5129 00000100:00100000:2.0:1746129746.942296:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+21:1961:x1830949052097408:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129746.942306:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129746.942325:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff8801356e3000/0x48868a4e43948b6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0d2 expref: 21 pid: 3624 timeout: 792 lvb_type: 1 00010000:00010000:2.0:1746129746.942336:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801356e3000/0x48868a4e43948b6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0d2 expref: 21 pid: 3624 timeout: 792 lvb_type: 1 00010000:00010000:2.0:1746129746.942356:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356e3000/0x48868a4e43948b6b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0d2 expref: 21 pid: 3624 timeout: 792 lvb_type: 1 00010000:00010000:2.0:1746129746.942369:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.942370:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.942376:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931f6200/0x48868a4e43948c91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1339392->2019327) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f149 expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.942383:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800931f6200/0x48868a4e43948c91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1339392->2019327) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f149 expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.942409:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800931f6200/0x48868a4e43948c91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1339392->2019327) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f149 expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129746.942419:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbedc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053271808:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129746.942503:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b80a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129746.943147:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052096768:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14551us (15048us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129746.943155:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3937 00002000:00100000:3.0:1746129746.943162:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012d636680 x1830949052096768/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/440 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.943170:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d636680 with x1830949052096768 ext(1048576->2097151) 00002000:00010000:3.0:1746129746.943175:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d636680 00000100:00100000:0.0:1746129746.945838:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.946024:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbedc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053271808:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129746.946039:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129746.946072:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+20:1961:x1830949052097408:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3777us (4510us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.946080:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5129 00000100:00100000:3.0:1746129746.946909:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052097664 00000100:00100000:3.0:1746129746.946916:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052097664 00002000:00100000:3.0:1746129746.946946:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009c134380 x1830949052097664/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 504/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.946959:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c134380 with x1830949052097664 ext(1048576->2097151) 00002000:00010000:3.0:1746129746.946963:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c134380 00000100:00100000:3.0:1746129746.946976:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3939 00000100:00100000:3.0:1746129746.946981:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052097664:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129746.955354:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052097664:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 8364us (9514us total) trans 0 rc 774144/774144 00000100:00100000:3.0:1746129746.955365:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3939 00002000:00100000:3.0:1746129746.955374:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009c134380 x1830949052097664/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 504/440 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 774144/774144 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.955383:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c134380 with x1830949052097664 ext(1048576->2097151) 00002000:00010000:3.0:1746129746.955389:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c134380 00000100:00100000:0.0:1746129746.957584:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.957672:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052097920 00000100:00100000:3.0:1746129746.957679:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052097920 00002000:00100000:3.0:1746129746.957715:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (2015232->2019327) req@ffff88009c137100 x1830949052097920/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.957723:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c137100 with x1830949052097920 ext(2015232->2019327) 00002000:00010000:3.0:1746129746.957728:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c137100 00000100:00100000:3.0:1746129746.957755:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3940 00000100:00100000:3.0:1746129746.957761:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052097920:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129746.957925:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052097920:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 163us (348us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129746.957932:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3940 00002000:00100000:3.0:1746129746.957938:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (2015232->2019327) req@ffff88009c137100 x1830949052097920/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/4536 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.957945:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c137100 with x1830949052097920 ext(2015232->2019327) 00002000:00010000:3.0:1746129746.957948:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c137100 00000100:00100000:0.0:1746129746.959538:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.959876:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052098048 00000100:00100000:2.0:1746129746.959882:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052098048 00000100:00100000:2.0:1746129746.959910:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10715 00000100:00100000:2.0:1746129746.959916:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28482:x1830949052098048:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129746.959928:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129746.959943:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094668200/0x48868a4e43948c98 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f150 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.959964:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931f7c00/0x48868a4e43948c8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1921023) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f142 expref: 23 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.959971:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129746.959972:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129746.959975:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094668200/0x48868a4e43948c98 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f150 expref: 17 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.959998:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931f7c00/0x48868a4e43948c8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1921023) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f142 expref: 23 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.960008:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931f7c00/0x48868a4e43948c8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1921023) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f142 expref: 23 pid: 1140 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746129746.960019:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053271936:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129746.960476:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b80a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129746.962100:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129746.962353:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.962423:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052098304 00000100:00100000:2.0:1746129746.962428:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052098304 00000100:00100000:2.0:1746129746.962462:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3843 00000100:00100000:2.0:1746129746.962468:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28476:x1830949052098304:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129746.962701:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28476:x1830949052098304:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 232us (604us total) trans 8589943589 rc 0/0 00000100:00100000:2.0:1746129746.962707:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3843 00000100:00100000:3.0:1746129746.962804:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053271936:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129746.962819:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052098432 00000100:00100000:1.0:1746129746.962823:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052098432 00010000:00010000:3.0:1746129746.962824:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094668200/0x48868a4e43948c98 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f150 expref: 17 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129746.962837:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094668200, rc 0) 00000100:00100000:1.0:1746129746.962870:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10716 00000100:00100000:3.0:1746129746.962872:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28482:x1830949052098048:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2957us (3338us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129746.962875:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:28480:x1830949052098432:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:3.0:1746129746.962878:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10715 00010000:00010000:1.0:1746129746.962883:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129746.962894:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fd43400/0x48868a4e43948c9f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f157 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.963005:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931f6200/0x48868a4e43948c91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1339392->2019327) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f149 expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.963012:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129746.963014:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129746.963018:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd43400/0x48868a4e43948c9f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f157 expref: 29 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.963039:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800931f6200/0x48868a4e43948c91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1339392->2019327) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f149 expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.963048:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800931f6200/0x48868a4e43948c91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1339392->2019327) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f149 expref: 16 pid: 1140 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746129746.963058:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053272064:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129746.963060:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.963108:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd57000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129746.963121:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052098560 00000100:00100000:1.0:1746129746.963124:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052098560 00002000:00100000:1.0:1746129746.963146:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1646592->1921023) req@ffff88009fbeca80 x1830949052098560/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129746.963160:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbeca80 with x1830949052098560 ext(1646592->1921023) 00010000:00010000:1.0:1746129746.963165:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931f7c00/0x48868a4e43948c8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f142 expref: 24 pid: 1140 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746129746.963172:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931f7c00/0x48868a4e43948c8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f142 expref: 24 pid: 1140 timeout: 793 lvb_type: 0 00002000:00010000:1.0:1746129746.963177:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fbeca80 00000100:00100000:1.0:1746129746.963197:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 556 00000100:00100000:1.0:1746129746.963203:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949052098560:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:1.0:1746129746.964431:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053272064:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129746.964458:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fd43400/0x48868a4e43948c9f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f157 expref: 29 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.964467:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd43400, rc 0) 00000100:00100000:1.0:1746129746.964501:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:28480:x1830949052098432:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1625us (2147us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129746.964507:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10716 00000100:00100000:1.0:1746129746.970262:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.970894:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052098688 00000100:00100000:3.0:1746129746.970902:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052098688 00002000:00100000:3.0:1746129746.970932:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1339392->2019327) req@ffff8800936dfb80 x1830949052098688/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.970942:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dfb80 with x1830949052098688 ext(1339392->2019327) 00010000:00010000:3.0:1746129746.970949:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800931f6200/0x48868a4e43948c91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1339392->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f149 expref: 17 pid: 1140 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746129746.970960:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800931f6200/0x48868a4e43948c91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1339392->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f149 expref: 17 pid: 1140 timeout: 793 lvb_type: 0 00002000:00010000:3.0:1746129746.970966:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936dfb80 00000100:00100000:3.0:1746129746.970991:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 557 00000100:00100000:3.0:1746129746.970997:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052098688:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:0.0:1746129746.971133:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949052098560:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 7928us (8070us total) trans 21474840259 rc 0/0 00000100:00100000:0.0:1746129746.971139:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 556 00002000:00100000:0.0:1746129746.971145:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1646592->1921023) req@ffff88009fbeca80 x1830949052098560/t21474840259(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/448 e 0 to 0 dl 1746129757 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129746.971152:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbeca80 with x1830949052098560 ext(1646592->1921023) 00010000:00010000:0.0:1746129746.971158:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931f7c00/0x48868a4e43948c8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f142 expref: 26 pid: 1140 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746129746.971166:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931f7c00/0x48868a4e43948c8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f142 expref: 26 pid: 1140 timeout: 793 lvb_type: 0 00002000:00010000:0.0:1746129746.971171:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fbeca80 00000100:00100000:1.0:1746129746.973924:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.974018:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052098816 00000100:00100000:2.0:1746129746.974024:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052098816 00010000:00010000:2.0:1746129746.974051:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931f7c00/0x48868a4e43948c8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f142 expref: 26 pid: 1140 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746129746.974139:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5130 00000100:00100000:2.0:1746129746.974147:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949052098816:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129746.974158:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129746.974174:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931f7c00/0x48868a4e43948c8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1646592->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f142 expref: 26 pid: 1140 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129746.974184:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931f7c00/0x48868a4e43948c8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1646592->1921023) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f142 expref: 26 pid: 1140 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129746.974203:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931f7c00/0x48868a4e43948c8a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1646592->1921023) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f142 expref: 26 pid: 1140 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129746.974377:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.974380:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.974386:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094668200/0x48868a4e43948c98 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f150 expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.974394:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094668200/0x48868a4e43948c98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f150 expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.974422:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094668200/0x48868a4e43948c98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f150 expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129746.974433:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbedc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053272192:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129746.974752:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013065e480 going to sleep for 11 seconds 00000100:00100000:2.0:1746129746.978904:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbedc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053272192:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129746.978920:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129746.978970:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949052098816:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4822us (5050us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.978979:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5130 00000100:00100000:2.0:1746129746.980920:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.981265:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052099072 00000100:00100000:3.0:1746129746.981276:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052099072 00002000:00100000:3.0:1746129746.981307:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009fbedc00 x1830949052099072/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.981315:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbedc00 with x1830949052099072 ext(1048576->2097151) 00002000:00010000:3.0:1746129746.981320:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbedc00 00000100:00100000:3.0:1746129746.981336:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3941 00000100:00100000:3.0:1746129746.981343:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052099072:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129746.985580:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949052098688:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 14573us (15316us total) trans 17179873102 rc 0/0 00000100:00100000:3.0:1746129746.985591:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 557 00002000:00100000:3.0:1746129746.985601:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1339392->2019327) req@ffff8800936dfb80 x1830949052098688/t17179873102(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/448 e 0 to 0 dl 1746129757 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.985611:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dfb80 with x1830949052098688 ext(1339392->2019327) 00010000:00010000:3.0:1746129746.985620:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800931f6200/0x48868a4e43948c91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1339392->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f149 expref: 19 pid: 1140 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746129746.985633:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800931f6200/0x48868a4e43948c91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1339392->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f149 expref: 19 pid: 1140 timeout: 793 lvb_type: 0 00002000:00010000:3.0:1746129746.985639:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936dfb80 00000100:00100000:0.0:1746129746.990912:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129746.991078:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052099200 00000100:00100000:2.0:1746129746.991086:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052099200 00010000:00010000:2.0:1746129746.991117:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800931f6200/0x48868a4e43948c91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1339392->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f149 expref: 19 pid: 1140 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746129746.991141:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5131 00000100:00100000:2.0:1746129746.991148:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1964:x1830949052099200:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129746.991159:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129746.991176:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800931f6200/0x48868a4e43948c91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1339392->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f149 expref: 19 pid: 1140 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129746.991187:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800931f6200/0x48868a4e43948c91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1339392->2019327) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f149 expref: 19 pid: 1140 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129746.991209:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800931f6200/0x48868a4e43948c91 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1339392->2019327) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f149 expref: 19 pid: 1140 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129746.991236:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.991238:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129746.991243:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fd43400/0x48868a4e43948c9f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f157 expref: 28 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.991250:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd43400/0x48868a4e43948c9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f157 expref: 28 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129746.991279:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fd43400/0x48868a4e43948c9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f157 expref: 28 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129746.991299:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053272320:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129746.991356:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013065e480 going to sleep for 11 seconds 00000100:00100000:3.0:1746129746.992155:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052099072:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 10809us (11236us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129746.992164:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3941 00002000:00100000:3.0:1746129746.992173:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009fbedc00 x1830949052099072/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:487/0 lens 488/440 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.992479:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbedc00 with x1830949052099072 ext(1048576->2097151) 00002000:00010000:3.0:1746129746.992492:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbedc00 00000100:00100000:2.0:1746129746.996088:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053272320:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129746.996107:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129746.996142:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949052099200:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4993us (5235us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129746.996151:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5131 00000100:00100000:0.0:1746129746.997891:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129746.998154:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052099328 00000100:00100000:1.0:1746129746.998160:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052099328 00000100:00100000:1.0:1746129746.998194:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10717 00000100:00100000:1.0:1746129746.998200:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28482:x1830949052099328:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129746.998218:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129746.998232:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fd42c00/0x48868a4e43948ca6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f15e expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.998251:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129746.998252:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129746.998258:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd42c00/0x48868a4e43948ca6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f15e expref: 19 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.998269:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fd42c00/0x48868a4e43948ca6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f15e expref: 19 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129746.998277:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd42c00, rc 0) 00000100:00100000:1.0:1746129746.998307:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:28482:x1830949052099328:12345-192.168.204.31@tcp:101:cat.0 Request processed in 108us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129746.998312:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10717 00000100:00100000:0.0:1746129746.998749:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129746.998873:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052099584 00000100:00100000:3.0:1746129746.998876:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052099584 00002000:00100000:3.0:1746129746.998899:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009c135c00 x1830949052099584/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/0 e 0 to 0 dl 1746129757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129746.998907:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c135c00 with x1830949052099584 ext(1048576->2097151) 00002000:00010000:3.0:1746129746.998911:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c135c00 00000100:00100000:3.0:1746129746.998921:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3942 00000100:00100000:3.0:1746129746.998926:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949052099584:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129747.005625:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.005710:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052099840 00000100:00100000:2.0:1746129747.005717:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052099840 00002000:00100000:2.0:1746129747.005757:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009c135500 x1830949052099840/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:488/0 lens 488/0 e 0 to 0 dl 1746129758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129747.005771:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c135500 with x1830949052099840 ext(1048576->2097151) 00002000:00010000:2.0:1746129747.005775:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c135500 00000100:00100000:2.0:1746129747.005801:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3943 00000100:00100000:2.0:1746129747.005807:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1961:x1830949052099840:12345-192.168.204.31@tcp:3:multiop.0 00000100:00080000:0.0:1746129747.008326:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746129747.013041:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949052099584:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 14106us (14285us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129747.013051:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3942 00002000:00100000:3.0:1746129747.013061:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009c135c00 x1830949052099584/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:487/0 lens 488/440 e 0 to 0 dl 1746129757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129747.013069:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c135c00 with x1830949052099584 ext(1048576->2097151) 00002000:00010000:3.0:1746129747.013074:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c135c00 00010000:00010000:2.0:1746129747.019059:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746129747.021075:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1961:x1830949052099840:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 15259us (15450us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129747.021085:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3943 00002000:00100000:2.0:1746129747.021094:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009c135500 x1830949052099840/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:488/0 lens 488/440 e 0 to 0 dl 1746129758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129747.021104:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c135500 with x1830949052099840 ext(1048576->2097151) 00002000:00010000:2.0:1746129747.021109:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c135500 00000100:00100000:0.0:1746129747.026943:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.027065:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052099968 00000100:00100000:2.0:1746129747.027074:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052099968 00000100:00100000:2.0:1746129747.028164:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10718 00000100:00080000:1.0:1746129747.028169:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746129747.028174:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1963:x1830949052099968:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129747.028189:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129747.028206:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129747.028243:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052100096 00000100:00100000:1.0:1746129747.028247:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052100096 00000100:00100000:1.0:1746129747.028276:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10719 00000100:00100000:1.0:1746129747.028282:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949052100096:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129747.028289:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129747.028301:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fd42a00/0x48868a4e43948cad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f16c expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129747.028305:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129747.028320:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129747.028321:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129747.028323:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129747.028329:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd42a00/0x48868a4e43948cad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f16c expref: 20 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129747.028343:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fd42a00/0x48868a4e43948cad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f16c expref: 20 pid: 8435 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129747.028348:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052100224 00000100:00100000:0.0:1746129747.028348:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.028351:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052100224 00010000:00010000:1.0:1746129747.028352:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd42a00, rc 0) 00000100:00100000:0.0:1746129747.028362:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052100352 00000100:00100000:0.0:1746129747.028365:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052100352 00000100:00100000:2.0:1746129747.028370:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052100480 00000100:00100000:2.0:1746129747.028371:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052100480 00000100:00100000:2.0:1746129747.028383:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10720 00000100:00100000:2.0:1746129747.028387:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052100224:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:1.0:1746129747.028388:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949052100096:12345-192.168.204.31@tcp:101:cat.0 Request processed in 106us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129747.028392:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10719 00010000:00010000:2.0:1746129747.028393:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129747.028400:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135f76e00/0x48868a4e43948cb4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f173 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.028410:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129747.028411:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129747.028415:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135f76e00/0x48868a4e43948cb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f173 expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129747.028416:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10721 00000100:00100000:1.0:1746129747.028420:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1964:x1830949052100480:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129747.028424:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135f76e00/0x48868a4e43948cb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f173 expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129747.028424:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129747.028428:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fd42e00/0x48868a4e43948cbb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f181 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.028430:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135f76e00, rc 0) 00010000:00010000:1.0:1746129747.028436:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129747.028437:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129747.028440:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd42e00/0x48868a4e43948cbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f181 expref: 27 pid: 8435 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129747.028444:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052100224:12345-192.168.204.31@tcp:101:cat.0 Request processed in 58us (141us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129747.028448:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fd42e00/0x48868a4e43948cbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f181 expref: 27 pid: 8435 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129747.028449:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10720 00010000:00010000:1.0:1746129747.028454:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd42e00, rc 0) 00000100:00100000:2.0:1746129747.028459:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10722 00000100:00100000:2.0:1746129747.028463:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1963:x1830949052100352:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:1.0:1746129747.028464:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949052100480:12345-192.168.204.31@tcp:101:cat.0 Request processed in 44us (117us total) trans 0 rc 0/0 00010000:00010000:2.0:1746129747.028468:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129747.028468:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10721 00010000:00010000:2.0:1746129747.028472:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135f76a00/0x48868a4e43948cc2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f17a expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1746129747.028479:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746129747.028480:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129747.028481:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00080000:1.0:1746129747.028481:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746129747.028498:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135f76a00/0x48868a4e43948cc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f17a expref: 30 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129747.028507:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135f76a00/0x48868a4e43948cc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f17a expref: 30 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129747.028518:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135f76a00, rc 0) 00000100:00100000:2.0:1746129747.028533:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1963:x1830949052100352:12345-192.168.204.31@tcp:101:cat.0 Request processed in 69us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129747.028537:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10722 00010000:00010000:3.0:1746129747.030468:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fb66e00/0x48868a4e43948cc9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f165 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.030508:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129747.030510:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129747.030518:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb66e00/0x48868a4e43948cc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f165 expref: 27 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129747.030532:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fb66e00/0x48868a4e43948cc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f165 expref: 27 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129747.030541:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fb66e00, rc 0) 00000100:00100000:3.0:1746129747.030597:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949052099968:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2424us (3659us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129747.030605:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10718 00000100:00100000:0.0:1746129747.041792:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129747.041828:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129747.041890:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129747.041921:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129747.041936:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052100736 00000100:00100000:3.0:1746129747.041945:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052100736 00002000:00100000:3.0:1746129747.041982:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880094768e00 x1830949052100736/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:488/0 lens 488/0 e 0 to 0 dl 1746129758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129747.041992:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094768e00 with x1830949052100736 ext(2097152->3145727) 00002000:00010000:3.0:1746129747.041997:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094768e00 00000100:00100000:3.0:1746129747.042010:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052100992 00000100:00100000:3.0:1746129747.042013:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052100992 00002000:00100000:3.0:1746129747.042023:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009476a680 x1830949052100992/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:488/0 lens 488/0 e 0 to 0 dl 1746129758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129747.042030:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476a680 with x1830949052100992 ext(3145728->4194303) 00002000:00010000:3.0:1746129747.042032:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009476a680 00000100:00100000:3.0:1746129747.042040:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052101248 00000100:00100000:3.0:1746129747.042042:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052101248 00002000:00100000:3.0:1746129747.042052:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880094768700 x1830949052101248/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:488/0 lens 488/0 e 0 to 0 dl 1746129758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129747.042057:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094768700 with x1830949052101248 ext(2097152->3145727) 00002000:00010000:3.0:1746129747.042060:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094768700 00000100:00100000:3.0:1746129747.042066:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052101376 00000100:00100000:3.0:1746129747.042069:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052101376 00002000:00100000:3.0:1746129747.042076:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880094769880 x1830949052101376/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:488/0 lens 488/0 e 0 to 0 dl 1746129758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129747.042081:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769880 with x1830949052101376 ext(3145728->4194303) 00002000:00010000:3.0:1746129747.042083:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094769880 00000100:00100000:2.0:1746129747.042084:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3944 00000100:00100000:2.0:1746129747.042144:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1962:x1830949052100736:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129747.043286:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3945 00000100:00100000:3.0:1746129747.043295:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052100992:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129747.045121:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3946 00000100:00100000:1.0:1746129747.045140:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3947 00000100:00100000:1.0:1746129747.045147:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1961:x1830949052101376:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129747.046201:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949052101248:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129747.048722:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.048754:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.048768:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.048795:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.048818:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052101760 00000100:00100000:3.0:1746129747.048819:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052102016 00000100:00100000:2.0:1746129747.048824:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052101760 00000100:00100000:3.0:1746129747.048825:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052102016 00002000:00100000:3.0:1746129747.048867:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012ba1aa00 x1830949052102016/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:488/0 lens 488/0 e 0 to 0 dl 1746129758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129747.048867:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a5491880 x1830949052101760/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:488/0 lens 488/0 e 0 to 0 dl 1746129758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129747.048875:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba1aa00 with x1830949052102016 ext(3145728->4194303) 00002000:00100000:2.0:1746129747.048875:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5491880 with x1830949052101760 ext(2097152->3145727) 00002000:00010000:3.0:1746129747.048879:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba1aa00 00002000:00010000:2.0:1746129747.048879:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5491880 00000100:00100000:3.0:1746129747.048893:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052102272 00000100:00100000:3.0:1746129747.048895:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052102272 00002000:00100000:3.0:1746129747.048905:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800936df800 x1830949052102272/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:488/0 lens 488/0 e 0 to 0 dl 1746129758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129747.048911:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936df800 with x1830949052102272 ext(2097152->3145727) 00002000:00010000:3.0:1746129747.048914:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936df800 00000100:00100000:2.0:1746129747.048982:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052102528 00000100:00100000:2.0:1746129747.048985:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052102528 00002000:00100000:2.0:1746129747.048998:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009adaf100 x1830949052102528/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:488/0 lens 488/0 e 0 to 0 dl 1746129758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129747.049005:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adaf100 with x1830949052102528 ext(3145728->4194303) 00002000:00010000:2.0:1746129747.049007:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adaf100 00000100:00100000:2.0:1746129747.049025:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3948 00000100:00100000:2.0:1746129747.049031:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1964:x1830949052102016:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129747.049883:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3949 00000100:00100000:3.0:1746129747.049892:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1964:x1830949052101760:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129747.049922:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3950 00000100:00100000:0.0:1746129747.049933:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3951 00000100:00100000:0.0:1746129747.049938:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1963:x1830949052102528:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129747.053268:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1964:x1830949052102272:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129747.056385:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052100736:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14286us (14593us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129747.056397:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3944 00002000:00100000:3.0:1746129747.056407:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880094768e00 x1830949052100736/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:488/0 lens 488/440 e 0 to 0 dl 1746129758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129747.056415:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094768e00 with x1830949052100736 ext(2097152->3145727) 00002000:00010000:3.0:1746129747.056422:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094768e00 00000100:00100000:3.0:1746129747.065822:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949052100992:12345-192.168.204.31@tcp:3:cat.0 Request processed in 22519us (23984us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129747.065833:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3945 00002000:00100000:3.0:1746129747.065843:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009476a680 x1830949052100992/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:488/0 lens 488/440 e 0 to 0 dl 1746129758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129747.065877:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476a680 with x1830949052100992 ext(3145728->4194303) 00002000:00010000:3.0:1746129747.065882:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009476a680 00000100:00100000:3.0:1746129747.082430:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949052101376:12345-192.168.204.31@tcp:3:cat.0 Request processed in 37276us (40499us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129747.082441:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3947 00002000:00100000:3.0:1746129747.082450:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880094769880 x1830949052101376/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:488/0 lens 488/440 e 0 to 0 dl 1746129758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129747.082459:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769880 with x1830949052101376 ext(3145728->4194303) 00002000:00010000:3.0:1746129747.082464:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094769880 00000100:00100000:0.0:1746129747.086672:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129747.087162:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052102784 00000100:00100000:3.0:1746129747.087170:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052102784 00000100:00080000:1.0:1746129747.087248:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746129747.087310:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9820 00000100:00100000:3.0:1746129747.087318:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28486:x1830949052102784:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129747.087341:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129747.087356:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0054e00/0x48868a4e43948cd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f188 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.087442:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055000/0x48868a4e43948cd7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.087453:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055000/0x48868a4e43948cd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.087461:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055000/0x48868a4e43948cd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.087471:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055200/0x48868a4e43948cde lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.087476:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055200/0x48868a4e43948cde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.087480:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055200/0x48868a4e43948cde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.087583:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055400/0x48868a4e43948ce5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.087590:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055400/0x48868a4e43948ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.087596:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055400/0x48868a4e43948ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129747.087604:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129747.087666:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055000/0x48868a4e43948cd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.087679:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055000/0x48868a4e43948cd7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.087685:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055000/0x48868a4e43948cd7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.087689:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0055000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129747.087692:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055000/0x48868a4e43948cd7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.087698:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055000/0x48868a4e43948cd7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.087707:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129747.087709:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129747.087713:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055000/0x48868a4e43948cd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.087718:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055000/0x48868a4e43948cd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129747.091120:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052101248:12345-192.168.204.31@tcp:3:cat.0 Request processed in 45981us (49219us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129747.091130:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3946 00002000:00100000:0.0:1746129747.091140:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880094768700 x1830949052101248/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:488/0 lens 488/440 e 0 to 0 dl 1746129758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129747.091149:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094768700 with x1830949052101248 ext(2097152->3145727) 00002000:00010000:0.0:1746129747.091154:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094768700 00010000:00010000:3.0:1746129747.091283:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055200/0x48868a4e43948cde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.091291:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055200/0x48868a4e43948cde lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.091296:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055200/0x48868a4e43948cde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.091300:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0055200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129747.091303:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055200/0x48868a4e43948cde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.091312:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055200/0x48868a4e43948cde lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.091324:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e8c7a00) 00010000:00010000:3.0:1746129747.091326:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129747.091329:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055200/0x48868a4e43948cde lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.091333:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055200/0x48868a4e43948cde lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.091380:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0054e00/0x48868a4e43948cd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f188 expref: 287 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.091391:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055400/0x48868a4e43948ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f188 expref: 286 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.091397:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129747.091399:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129747.091401:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0055400, rc 0) 00000100:00100000:3.0:1746129747.091420:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:28486:x1830949052102784:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4104us (4756us total) trans 8589943590 rc 0/0 00000100:00100000:3.0:1746129747.091426:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9820 00000100:00100000:2.0:1746129747.102017:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949052102016:12345-192.168.204.31@tcp:3:cat.0 Request processed in 52977us (53252us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129747.102027:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3948 00002000:00100000:2.0:1746129747.102037:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012ba1aa00 x1830949052102016/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:488/0 lens 488/440 e 0 to 0 dl 1746129758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129747.102045:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba1aa00 with x1830949052102016 ext(3145728->4194303) 00002000:00010000:2.0:1746129747.102051:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba1aa00 00000100:00100000:0.0:1746129747.104249:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129747.110652:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052103040 00000100:00100000:3.0:1746129747.110663:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052103040 00000100:00080000:1.0:1746129747.110719:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746129747.110728:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9821 00000100:00100000:3.0:1746129747.110736:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28488:x1830949052103040:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129747.110761:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129747.110777:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055600/0x48868a4e43948cf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f18f expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.110880:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055800/0x48868a4e43948cfa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.110891:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055800/0x48868a4e43948cfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.110900:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055800/0x48868a4e43948cfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.110910:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055a00/0x48868a4e43948d01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.110915:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055a00/0x48868a4e43948d01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.110920:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055a00/0x48868a4e43948d01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.110995:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055c00/0x48868a4e43948d08 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.111002:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055c00/0x48868a4e43948d08 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.111007:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055c00/0x48868a4e43948d08 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129747.111014:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129747.111073:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055800/0x48868a4e43948cfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.111079:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055800/0x48868a4e43948cfa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.111085:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055800/0x48868a4e43948cfa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.111090:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0055800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129747.111093:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055800/0x48868a4e43948cfa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.111098:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055800/0x48868a4e43948cfa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.111106:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129747.111109:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129747.111112:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055800/0x48868a4e43948cfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.111116:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055800/0x48868a4e43948cfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.111139:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055a00/0x48868a4e43948d01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.111144:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055a00/0x48868a4e43948d01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.111148:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055a00/0x48868a4e43948d01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.111152:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0055a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129747.111154:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055a00/0x48868a4e43948d01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.111159:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055a00/0x48868a4e43948d01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.111168:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e8c7e00) 00010000:00010000:3.0:1746129747.111170:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129747.111172:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055a00/0x48868a4e43948d01 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.111177:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055a00/0x48868a4e43948d01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.111203:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055600/0x48868a4e43948cf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f18f expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.111212:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055c00/0x48868a4e43948d08 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f18f expref: 11 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.111218:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129747.111220:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129747.111222:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0055c00, rc 0) 00000100:00100000:0.0:1746129747.112294:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.112512:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1964:x1830949052101760:12345-192.168.204.31@tcp:3:cat.0 Request processed in 62618us (63793us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129747.112521:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3949 00002000:00100000:2.0:1746129747.112529:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a5491880 x1830949052101760/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:488/0 lens 488/440 e 0 to 0 dl 1746129758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129747.112537:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5491880 with x1830949052101760 ext(2097152->3145727) 00002000:00010000:2.0:1746129747.112541:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5491880 00000100:00100000:2.0:1746129747.112558:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052103296 00000100:00100000:2.0:1746129747.112561:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052103296 00002000:00100000:2.0:1746129747.112579:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009476a300 x1830949052103296/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:488/0 lens 488/0 e 0 to 0 dl 1746129758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129747.112586:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476a300 with x1830949052103296 ext(4194304->4964351) 00002000:00010000:2.0:1746129747.112588:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009476a300 00000100:00100000:2.0:1746129747.112614:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3952 00000100:00100000:2.0:1746129747.112620:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949052103296:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129747.113536:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28488:x1830949052103040:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2796us (9290us total) trans 8589943591 rc 0/0 00000100:00100000:3.0:1746129747.113543:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9821 00000100:00100000:0.0:1746129747.119598:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1964:x1830949052102272:12345-192.168.204.31@tcp:3:cat.0 Request processed in 69662us (70820us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129747.119607:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3950 00002000:00100000:0.0:1746129747.119615:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800936df800 x1830949052102272/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:488/0 lens 488/440 e 0 to 0 dl 1746129758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129747.119630:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936df800 with x1830949052102272 ext(2097152->3145727) 00002000:00010000:0.0:1746129747.119635:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936df800 00000100:00100000:1.0:1746129747.131156:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.131778:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949052102528:12345-192.168.204.31@tcp:3:cat.0 Request processed in 81838us (82979us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129747.131789:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3951 00002000:00100000:2.0:1746129747.131798:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009adaf100 x1830949052102528/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:488/0 lens 488/440 e 0 to 0 dl 1746129758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129747.131806:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adaf100 with x1830949052102528 ext(3145728->4194303) 00002000:00010000:2.0:1746129747.131811:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adaf100 00000100:00100000:0.0:1746129747.131992:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052103552 00000100:00100000:0.0:1746129747.132000:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052103552 00000100:00100000:0.0:1746129747.132045:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3844 00000100:00100000:0.0:1746129747.132052:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:28486:x1830949052103552:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:0.0:1746129747.132202:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:28486:x1830949052103552:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 150us (1053us total) trans 8589943592 rc 0/0 00000100:00100000:0.0:1746129747.132208:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3844 00000100:00100000:2.0:1746129747.135755:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949052103296:12345-192.168.204.31@tcp:3:cat.0 Request processed in 23126us (23456us total) trans 0 rc 770048/770048 00000100:00100000:2.0:1746129747.135767:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3952 00002000:00100000:2.0:1746129747.135777:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009476a300 x1830949052103296/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:488/0 lens 488/440 e 0 to 0 dl 1746129758 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129747.135787:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476a300 with x1830949052103296 ext(4194304->4964351) 00002000:00010000:2.0:1746129747.135792:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009476a300 00000100:00100000:0.0:1746129747.143427:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.143637:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052103808 00000100:00100000:2.0:1746129747.143645:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052103808 00002000:00100000:2.0:1746129747.143682:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009a56c000 x1830949052103808/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:488/0 lens 488/0 e 0 to 0 dl 1746129758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129747.143691:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56c000 with x1830949052103808 ext(4194304->4964351) 00002000:00010000:2.0:1746129747.143695:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a56c000 00000100:00100000:2.0:1746129747.145178:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3953 00000100:00100000:2.0:1746129747.145192:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1963:x1830949052103808:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129747.159539:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1963:x1830949052103808:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14344us (16114us total) trans 0 rc 770048/770048 00000100:00100000:2.0:1746129747.159549:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3953 00002000:00100000:2.0:1746129747.159558:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009a56c000 x1830949052103808/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:488/0 lens 488/440 e 0 to 0 dl 1746129758 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129747.159567:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56c000 with x1830949052103808 ext(4194304->4964351) 00002000:00010000:2.0:1746129747.159572:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a56c000 00000100:00100000:0.0:1746129747.171439:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.171692:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052104064 00000100:00100000:2.0:1746129747.171700:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052104064 00000100:00100000:2.0:1746129747.174176:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3845 00000100:00100000:2.0:1746129747.174191:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:28480:x1830949052104064:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129747.174390:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:28480:x1830949052104064:12345-192.168.204.31@tcp:35:cat.0 Request processed in 204us (2956us total) trans 8589943593 rc 0/0 00000100:00100000:2.0:1746129747.174396:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3845 00000100:00100000:0.0:1746129747.291782:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129747.291899:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052104320 00000100:00100000:3.0:1746129747.291909:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052104320 00000100:00100000:3.0:1746129747.291947:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9822 00000100:00100000:3.0:1746129747.291954:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28495:x1830949052104320:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129747.291974:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129747.291988:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055e00/0x48868a4e43948d16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f196 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.292100:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055600/0x48868a4e43948d1d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.292110:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055600/0x48868a4e43948d1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.292119:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055600/0x48868a4e43948d1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.292130:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055a00/0x48868a4e43948d24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.292135:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055a00/0x48868a4e43948d24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.292140:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055a00/0x48868a4e43948d24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.292230:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055800/0x48868a4e43948d2b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.292236:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055800/0x48868a4e43948d2b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.292241:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055800/0x48868a4e43948d2b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129747.292249:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129747.292317:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055600/0x48868a4e43948d1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.292323:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055600/0x48868a4e43948d1d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.292331:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055600/0x48868a4e43948d1d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.292336:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0055600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129747.292340:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055600/0x48868a4e43948d1d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.292345:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055600/0x48868a4e43948d1d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.292354:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129747.292356:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129747.292360:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055600/0x48868a4e43948d1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.292364:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055600/0x48868a4e43948d1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.292396:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055a00/0x48868a4e43948d24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.292401:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055a00/0x48868a4e43948d24 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.292406:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055a00/0x48868a4e43948d24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.292410:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0055a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129747.292412:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055a00/0x48868a4e43948d24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.292416:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055a00/0x48868a4e43948d24 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.292425:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e8c7e00) 00010000:00010000:3.0:1746129747.292427:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129747.292429:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055a00/0x48868a4e43948d24 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.292433:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055a00/0x48868a4e43948d24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.292464:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055e00/0x48868a4e43948d16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f196 expref: 14 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.292475:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055800/0x48868a4e43948d2b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f196 expref: 13 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.292492:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129747.292494:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129747.292496:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0055800, rc 0) 00000100:00100000:3.0:1746129747.292536:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28495:x1830949052104320:12345-192.168.204.31@tcp:101:cat.0 Request processed in 582us (761us total) trans 8589943594 rc 0/0 00000100:00100000:3.0:1746129747.292541:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9822 00000100:00100000:0.0:1746129747.304012:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.304510:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052104576 00000100:00100000:2.0:1746129747.304520:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052104576 00000100:00100000:2.0:1746129747.304578:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3846 00000100:00100000:2.0:1746129747.304586:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28495:x1830949052104576:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129747.304815:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28495:x1830949052104576:12345-192.168.204.31@tcp:35:cat.0 Request processed in 229us (810us total) trans 8589943595 rc 0/0 00000100:00100000:2.0:1746129747.304821:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3846 00000100:00100000:0.0:1746129747.305207:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129747.307920:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052104704 00000100:00100000:3.0:1746129747.307929:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052104704 00000100:00100000:3.0:1746129747.307983:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 557 00000100:00100000:3.0:1746129747.307990:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1963:x1830949052104704:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129747.308003:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129747.308022:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055800/0x48868a4e43948d2b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f196 expref: 14 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.308302:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129747.308306:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129747.308568:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1963:x1830949052104704:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 577us (3360us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129747.308574:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 557 00000100:00100000:0.0:1746129747.316165:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.316248:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052104960 00000100:00100000:2.0:1746129747.316256:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052104960 00002000:00100000:2.0:1746129747.316298:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009a56d180 x1830949052104960/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:488/0 lens 488/0 e 0 to 0 dl 1746129758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129747.316309:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56d180 with x1830949052104960 ext(0->1048575) 00002000:00010000:2.0:1746129747.316314:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a56d180 00000100:00100000:2.0:1746129747.316338:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3954 00000100:00100000:2.0:1746129747.316348:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949052104960:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129747.325329:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.325407:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052105216 00000100:00100000:2.0:1746129747.325415:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052105216 00000100:00100000:2.0:1746129747.325464:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9823 00000100:00100000:2.0:1746129747.325471:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:28497:x1830949052105216:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129747.325499:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129747.325515:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69800/0x48868a4e43948d39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f19d expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.326085:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69a00/0x48868a4e43948d40 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.326097:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69a00/0x48868a4e43948d40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.326106:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69a00/0x48868a4e43948d40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.326118:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69c00/0x48868a4e43948d47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.326123:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69c00/0x48868a4e43948d47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.326128:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69c00/0x48868a4e43948d47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.326214:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69e00/0x48868a4e43948d4e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.326221:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69e00/0x48868a4e43948d4e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.327041:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69e00/0x48868a4e43948d4e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129747.327052:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129747.327140:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69a00/0x48868a4e43948d40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.327147:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69a00/0x48868a4e43948d40 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.327152:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69a00/0x48868a4e43948d40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.327156:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8f69a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129747.327159:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69a00/0x48868a4e43948d40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.327164:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69a00/0x48868a4e43948d40 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.327174:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129747.327177:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129747.327180:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69a00/0x48868a4e43948d40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.327184:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69a00/0x48868a4e43948d40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.327213:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69c00/0x48868a4e43948d47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.327218:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69c00/0x48868a4e43948d47 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.327225:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69c00/0x48868a4e43948d47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.327229:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8f69c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129747.327231:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69c00/0x48868a4e43948d47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.327235:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69c00/0x48868a4e43948d47 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.327241:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012bfcaf00) 00010000:00010000:2.0:1746129747.327243:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129747.327245:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69c00/0x48868a4e43948d47 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.327250:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69c00/0x48868a4e43948d47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.327291:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69800/0x48868a4e43948d39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f19d expref: 291 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.327300:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69e00/0x48868a4e43948d4e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f19d expref: 290 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.327305:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129747.327306:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129747.327308:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8f69e00, rc 0) 00000100:00100000:2.0:1746129747.328219:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:28497:x1830949052105216:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2745us (2898us total) trans 8589943596 rc 0/0 00000100:00100000:2.0:1746129747.328227:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9823 00000100:00100000:2.0:1746129747.338687:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949052104960:12345-192.168.204.31@tcp:3:cat.0 Request processed in 22333us (22520us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129747.338697:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3954 00002000:00100000:2.0:1746129747.338706:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009a56d180 x1830949052104960/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:488/0 lens 488/440 e 0 to 0 dl 1746129758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129747.338714:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56d180 with x1830949052104960 ext(0->1048575) 00002000:00010000:2.0:1746129747.338719:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a56d180 00000100:00100000:0.0:1746129747.348462:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129747.349634:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052105344 00000100:00100000:3.0:1746129747.349643:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052105344 00000100:00100000:3.0:1746129747.349697:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 558 00000100:00100000:3.0:1746129747.349705:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:1961:x1830949052105344:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129747.349716:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129747.349736:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69e00/0x48868a4e43948d4e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f19d expref: 290 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.349764:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129747.349768:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129747.349804:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:1961:x1830949052105344:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 100us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129747.349810:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 558 00000100:00100000:0.0:1746129747.355945:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129747.355993:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.356177:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052105600 00000100:00100000:2.0:1746129747.356187:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052105600 00002000:00100000:2.0:1746129747.356230:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009a56dc00 x1830949052105600/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:488/0 lens 488/0 e 0 to 0 dl 1746129758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129747.356239:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56dc00 with x1830949052105600 ext(0->1048575) 00002000:00010000:2.0:1746129747.356243:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a56dc00 00000100:00100000:2.0:1746129747.356258:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052105856 00000100:00100000:2.0:1746129747.356261:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052105856 00002000:00100000:2.0:1746129747.356274:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009a56df80 x1830949052105856/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:488/0 lens 488/0 e 0 to 0 dl 1746129758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129747.356280:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56df80 with x1830949052105856 ext(1048576->2097151) 00002000:00010000:2.0:1746129747.356283:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a56df80 00000100:00100000:2.0:1746129747.356294:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3955 00000100:00100000:2.0:1746129747.356301:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949052105600:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129747.357694:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3956 00000100:00100000:2.0:1746129747.357705:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949052105856:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129747.374680:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949052105600:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18370us (18733us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129747.374690:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3955 00002000:00100000:2.0:1746129747.374699:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009a56dc00 x1830949052105600/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:488/0 lens 488/440 e 0 to 0 dl 1746129758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129747.374709:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56dc00 with x1830949052105600 ext(0->1048575) 00002000:00010000:2.0:1746129747.374714:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a56dc00 00000100:00100000:2.0:1746129747.380174:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949052105856:12345-192.168.204.31@tcp:3:cat.0 Request processed in 22462us (24169us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129747.380197:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3956 00002000:00100000:2.0:1746129747.380207:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009a56df80 x1830949052105856/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:488/0 lens 488/440 e 0 to 0 dl 1746129758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129747.380216:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56df80 with x1830949052105856 ext(1048576->2097151) 00002000:00010000:2.0:1746129747.380268:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a56df80 00000100:00100000:0.0:1746129747.398017:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129747.398474:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052105984 00000100:00100000:3.0:1746129747.398506:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052105984 00000100:00100000:3.0:1746129747.398587:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10723 00000100:00100000:3.0:1746129747.398594:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:28486:x1830949052105984:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129747.398610:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129747.398624:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fb66800/0x48868a4e43948d5c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f1a4 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.398655:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9a00/0x48868a4e43948b72 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0d9 expref: 19 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129747.398662:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135f76a00/0x48868a4e43948cc2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f17a expref: 31 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129747.398668:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fd42a00/0x48868a4e43948cad lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f16c expref: 19 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129747.398674:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129747.398676:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129747.398679:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fb66800/0x48868a4e43948d5c lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4141056->4194303] (req 4141056->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1a4 expref: 31 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.398701:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fd42a00/0x48868a4e43948cad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f16c expref: 19 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129747.398710:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fd42a00/0x48868a4e43948cad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f16c expref: 19 pid: 8435 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746129747.398719:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053272448:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129747.400358:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135f76a00/0x48868a4e43948cc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f17a expref: 31 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129747.400372:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135f76a00/0x48868a4e43948cc2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f17a expref: 31 pid: 8436 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746129747.400383:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053272576:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129747.401211:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129747.401291:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9a00/0x48868a4e43948b72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0d9 expref: 19 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129747.401300:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9a00/0x48868a4e43948b72 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0d9 expref: 19 pid: 1877 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746129747.401309:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053272704:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129747.401349:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bd1df00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129747.401366:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053272448:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129747.401469:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052106240 00000100:00100000:2.0:1746129747.401475:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052106240 00000100:00100000:2.0:1746129747.401515:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3847 00000100:00100000:2.0:1746129747.401520:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:28497:x1830949052106240:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129747.401658:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:28497:x1830949052106240:12345-192.168.204.31@tcp:35:cat.0 Request processed in 137us (449us total) trans 8589943597 rc 0/0 00000100:00100000:2.0:1746129747.401664:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3847 00000100:00100000:1.0:1746129747.409496:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129747.409519:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129747.409564:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.409576:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052106368 00000100:00100000:2.0:1746129747.409584:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052106368 00000100:00100000:0.0:1746129747.409610:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052106624 00000100:00100000:0.0:1746129747.409613:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052106624 00010000:00010000:2.0:1746129747.409615:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd42a00/0x48868a4e43948cad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f16c expref: 20 pid: 8435 timeout: 793 lvb_type: 1 00010000:00010000:0.0:1746129747.409624:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135f76a00/0x48868a4e43948cc2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f17a expref: 32 pid: 8436 timeout: 793 lvb_type: 1 00000100:00100000:0.0:1746129747.409646:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052106496 00000100:00100000:0.0:1746129747.409649:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052106496 00000100:00100000:2.0:1746129747.409652:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5132 00000100:00100000:2.0:1746129747.409659:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949052106624:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129747.409662:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9a00/0x48868a4e43948b72 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0d9 expref: 20 pid: 1877 timeout: 793 lvb_type: 1 00010000:00010000:2.0:1746129747.409671:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129747.409672:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5133 00000100:00100000:0.0:1746129747.409676:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949052106368:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129747.409681:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129747.409688:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135f76a00/0x48868a4e43948cc2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f17a expref: 32 pid: 8436 timeout: 793 lvb_type: 1 00010000:00010000:0.0:1746129747.409689:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fd42a00/0x48868a4e43948cad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f16c expref: 20 pid: 8435 timeout: 793 lvb_type: 1 00010000:00010000:2.0:1746129747.409697:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135f76a00/0x48868a4e43948cc2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f17a expref: 32 pid: 8436 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746129747.409749:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5134 00000100:00100000:3.0:1746129747.409756:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+20:1962:x1830949052106496:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129747.409762:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129747.409787:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fd42a00/0x48868a4e43948cad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f16c expref: 20 pid: 8435 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746129747.409808:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9a00/0x48868a4e43948b72 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0d9 expref: 20 pid: 1877 timeout: 793 lvb_type: 1 00010000:00010000:2.0:1746129747.409810:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129747.409815:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9a00/0x48868a4e43948b72 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0d9 expref: 20 pid: 1877 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746129747.409824:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129747.409845:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+20:1962:x1830949052106496:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 90us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129747.409859:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949052106624:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 186us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129747.409865:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5134 00000100:00100000:2.0:1746129747.409867:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5132 00010000:00010000:3.0:1746129747.409903:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135f76a00/0x48868a4e43948cc2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f17a expref: 31 pid: 8436 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746129747.409916:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053272576:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129747.409924:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9a00/0x48868a4e43948b72 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0d9 expref: 19 pid: 1877 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746129747.409932:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053272704:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129747.409952:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fb66800/0x48868a4e43948d5c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4141056->4194303] (req 4141056->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1a4 expref: 30 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.409961:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fb66800, rc 0) 00000100:00100000:3.0:1746129747.409983:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:28486:x1830949052105984:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 11389us (11974us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129747.409988:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10723 00000100:00080000:2.0:1746129747.409996:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1746129747.410083:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fd42a00/0x48868a4e43948cad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f16c expref: 20 pid: 8435 timeout: 793 lvb_type: 1 00010000:00010000:0.0:1746129747.410118:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129747.410120:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129747.410127:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fb66800/0x48868a4e43948d5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1a4 expref: 29 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129747.410134:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fb66800/0x48868a4e43948d5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1a4 expref: 29 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129747.410159:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fb66800/0x48868a4e43948d5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1a4 expref: 29 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129747.410169:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a56e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053272832:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129747.410220:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129747.414865:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.415438:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.415488:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052107008 00000100:00100000:2.0:1746129747.415495:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052107008 00000100:00100000:2.0:1746129747.415532:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10724 00000100:00100000:2.0:1746129747.415539:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28488:x1830949052107008:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129747.415554:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129747.415568:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69600/0x48868a4e43948d63 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f1ab expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.415592:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b80600/0x48868a4e43948b79 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0e0 expref: 19 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129747.415600:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fd42e00/0x48868a4e43948cbb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f181 expref: 26 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129747.415606:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135f76e00/0x48868a4e43948cb4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f173 expref: 19 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129747.415611:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129747.415613:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129747.415616:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69600/0x48868a4e43948d63 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3923968->4194303] (req 3923968->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ab expref: 19 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.415639:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135f76e00/0x48868a4e43948cb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f173 expref: 19 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129747.415648:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135f76e00/0x48868a4e43948cb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f173 expref: 19 pid: 8436 timeout: 793 lvb_type: 1 00000100:00100000:2.0:1746129747.415658:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136318a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053272960:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129747.416491:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052106880 00000100:00100000:3.0:1746129747.416497:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052106880 00002000:00100000:3.0:1746129747.416527:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4141056->4145151) req@ffff88009adac000 x1830949052106880/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:488/0 lens 488/0 e 0 to 0 dl 1746129758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129747.416535:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adac000 with x1830949052106880 ext(4141056->4145151) 00002000:00010000:3.0:1746129747.416538:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adac000 00000100:00100000:3.0:1746129747.416553:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3957 00000100:00100000:3.0:1746129747.416558:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949052106880:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129747.416692:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949052106880:12345-192.168.204.31@tcp:3:cat.0 Request processed in 132us (1855us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129747.416701:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3957 00002000:00100000:3.0:1746129747.416706:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4141056->4145151) req@ffff88009adac000 x1830949052106880/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:488/0 lens 488/4536 e 0 to 0 dl 1746129758 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129747.416741:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adac000 with x1830949052106880 ext(4141056->4145151) 00002000:00010000:3.0:1746129747.416744:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adac000 00000100:00100000:0.0:1746129747.416844:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a56e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053272832:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129747.416875:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129747.417373:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fd42e00/0x48868a4e43948cbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f181 expref: 26 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129747.417383:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fd42e00/0x48868a4e43948cbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f181 expref: 26 pid: 8435 timeout: 793 lvb_type: 1 00000100:00100000:2.0:1746129747.417393:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053273088:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129747.417450:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136b80600/0x48868a4e43948b79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0e0 expref: 19 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129747.417457:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136b80600/0x48868a4e43948b79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0e0 expref: 19 pid: 4589 timeout: 793 lvb_type: 1 00000100:00100000:2.0:1746129747.417465:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053273216:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129747.417493:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013065e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129747.417561:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949052106368:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7882us (8070us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129747.417570:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5133 00000100:00100000:2.0:1746129747.420973:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136318a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053272960:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129747.420985:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053273088:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129747.420992:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053273216:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129747.421016:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69600/0x48868a4e43948d63 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3923968->4194303] (req 3923968->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ab expref: 19 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.421043:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8f69600, rc 0) 00000100:00100000:2.0:1746129747.421412:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:28488:x1830949052107008:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5871us (5973us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129747.421420:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10724 00000100:00100000:0.0:1746129747.425285:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129747.425347:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052107136 00000100:00100000:1.0:1746129747.425355:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052107136 00000100:00100000:0.0:1746129747.425371:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129747.425403:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136b80600/0x48868a4e43948b79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0e0 expref: 20 pid: 4589 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746129747.425434:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5135 00000100:00100000:1.0:1746129747.425440:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+20:1963:x1830949052107136:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129747.425451:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129747.425469:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136b80600/0x48868a4e43948b79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0e0 expref: 20 pid: 4589 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746129747.425488:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136b80600/0x48868a4e43948b79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0e0 expref: 20 pid: 4589 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746129747.425507:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b80600/0x48868a4e43948b79 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0e0 expref: 20 pid: 4589 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746129747.425523:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129747.425558:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+19:1963:x1830949052107136:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 118us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129747.425563:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5135 00000100:00080000:2.0:1746129747.425702:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746129747.425753:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052107264 00000100:00100000:3.0:1746129747.425757:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052107264 00000100:00100000:3.0:1746129747.425777:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10725 00000100:00100000:3.0:1746129747.425782:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:28486:x1830949052107264:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129747.425793:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129747.425802:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948d6a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f1b2 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.425817:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129747.425821:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69600/0x48868a4e43948d63 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3923968->4194303] (req 3923968->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ab expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.425826:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129747.425828:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948d6a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->4141055] (req 3145728->4141055) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b2 expref: 28 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.425879:0:7976:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69600/0x48868a4e43948d63 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3923968->4194303] (req 3923968->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ab expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.425890:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948d6a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->4141055] (req 3145728->4141055) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b2 expref: 28 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.425901:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fb66400, rc 0) 00000100:00100000:3.0:1746129747.425934:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:28486:x1830949052107264:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 151us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129747.425939:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10725 00000100:00100000:2.0:1746129747.427769:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129747.428431:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052107392 00000100:00100000:0.0:1746129747.428437:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052107392 00010000:00010000:0.0:1746129747.428460:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd42e00/0x48868a4e43948cbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f181 expref: 28 pid: 8435 timeout: 793 lvb_type: 1 00000100:00100000:0.0:1746129747.428502:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5136 00000100:00100000:0.0:1746129747.428508:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949052107392:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129747.428518:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129747.428533:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fd42e00/0x48868a4e43948cbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f181 expref: 28 pid: 8435 timeout: 793 lvb_type: 1 00010000:00010000:0.0:1746129747.428542:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fd42e00/0x48868a4e43948cbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f181 expref: 28 pid: 8435 timeout: 793 lvb_type: 1 00010000:00010000:0.0:1746129747.428558:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fd42e00/0x48868a4e43948cbb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f181 expref: 28 pid: 8435 timeout: 793 lvb_type: 1 00010000:00010000:0.0:1746129747.428595:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129747.428625:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949052107392:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 116us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129747.428630:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5136 00000100:00100000:0.0:1746129747.433533:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.433719:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052107520 00000100:00100000:2.0:1746129747.433727:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052107520 00010000:00010000:2.0:1746129747.433755:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135f76e00/0x48868a4e43948cb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f173 expref: 19 pid: 8436 timeout: 793 lvb_type: 1 00000100:00100000:2.0:1746129747.433783:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5137 00000100:00100000:2.0:1746129747.433789:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1964:x1830949052107520:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129747.433799:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129747.433816:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135f76e00/0x48868a4e43948cb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f173 expref: 19 pid: 8436 timeout: 793 lvb_type: 1 00010000:00010000:2.0:1746129747.433825:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135f76e00/0x48868a4e43948cb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f173 expref: 19 pid: 8436 timeout: 793 lvb_type: 1 00010000:00010000:2.0:1746129747.433843:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135f76e00/0x48868a4e43948cb4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f173 expref: 19 pid: 8436 timeout: 793 lvb_type: 1 00010000:00010000:2.0:1746129747.434818:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129747.434821:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129747.434829:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69600/0x48868a4e43948d63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ab expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.434838:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69600/0x48868a4e43948d63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ab expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.435012:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69600/0x48868a4e43948d63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ab expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.435023:0:10980:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69600/0x48868a4e43948d63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ab expref: 18 pid: 7976 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746129747.435038:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053273472:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129747.435912:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013065e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129747.437165:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053273472:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129747.437181:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129747.437214:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949052107520:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3425us (3688us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129747.437223:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5137 00000100:00100000:0.0:1746129747.437713:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129747.437876:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052107776 00000100:00100000:3.0:1746129747.437882:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052107776 00002000:00100000:3.0:1746129747.437912:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (3923968->3928063) req@ffff88009a56d880 x1830949052107776/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:488/0 lens 488/0 e 0 to 0 dl 1746129758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129747.437921:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56d880 with x1830949052107776 ext(3923968->3928063) 00010000:00010000:3.0:1746129747.437927:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69600/0x48868a4e43948d63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ab expref: 18 pid: 7976 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746129747.437939:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69600/0x48868a4e43948d63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ab expref: 18 pid: 7976 timeout: 793 lvb_type: 0 00002000:00010000:3.0:1746129747.437944:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a56d880 00000100:00100000:3.0:1746129747.437959:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 558 00000100:00100000:3.0:1746129747.437965:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1963:x1830949052107776:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129747.438109:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1963:x1830949052107776:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 143us (396us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129747.438115:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 558 00002000:00100000:3.0:1746129747.438120:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (3923968->3928063) req@ffff88009a56d880 x1830949052107776/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:488/0 lens 488/4536 e 0 to 0 dl 1746129758 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129747.438132:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56d880 with x1830949052107776 ext(3923968->3928063) 00010000:00010000:3.0:1746129747.438137:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69600/0x48868a4e43948d63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ab expref: 18 pid: 7976 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746129747.438146:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69600/0x48868a4e43948d63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ab expref: 18 pid: 7976 timeout: 793 lvb_type: 0 00002000:00010000:3.0:1746129747.438151:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a56d880 00000100:00100000:0.0:1746129747.445685:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129747.445738:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129747.450526:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052108032 00000100:00100000:3.0:1746129747.450539:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052108032 00002000:00100000:3.0:1746129747.450580:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (3923968->4194303) req@ffff88009a56e680 x1830949052108032/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:488/0 lens 488/0 e 0 to 0 dl 1746129758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129747.450589:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56e680 with x1830949052108032 ext(3923968->4194303) 00010000:00010000:3.0:1746129747.450598:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69600/0x48868a4e43948d63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ab expref: 18 pid: 7976 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746129747.450609:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69600/0x48868a4e43948d63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ab expref: 18 pid: 7976 timeout: 793 lvb_type: 0 00002000:00010000:3.0:1746129747.450615:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a56e680 00000100:00100000:3.0:1746129747.450641:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 559 00000100:00100000:3.0:1746129747.450646:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949052108032:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:1.0:1746129747.451154:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052108160 00000100:00100000:1.0:1746129747.451159:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052108160 00000100:00100000:1.0:1746129747.451184:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10726 00000100:00100000:1.0:1746129747.451189:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:28488:x1830949052108160:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129747.451198:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129747.451211:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135f76200/0x48868a4e43948d71 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f1b9 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129747.451230:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fb66800/0x48868a4e43948d5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1a4 expref: 29 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129747.451237:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129747.451239:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129747.451242:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135f76200/0x48868a4e43948d71 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [4194304->4853759] (req 4194304->4853759) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b9 expref: 20 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129747.451271:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fb66800/0x48868a4e43948d5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1a4 expref: 29 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129747.451279:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fb66800/0x48868a4e43948d5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1a4 expref: 29 pid: 7976 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746129747.451290:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053273600:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129747.451350:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd57780 going to sleep for 11 seconds 00000100:00100000:1.0:1746129747.456570:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053273600:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129747.456594:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135f76200/0x48868a4e43948d71 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [4194304->4853759] (req 4194304->4853759) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b9 expref: 20 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129747.456608:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135f76200, rc 0) 00000100:00100000:1.0:1746129747.456646:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:28488:x1830949052108160:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5455us (10906us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129747.456654:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10726 00000100:00100000:0.0:1746129747.461223:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.461430:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052108288 00000100:00100000:2.0:1746129747.461438:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052108288 00002000:00100000:2.0:1746129747.461483:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4141056->4194303) req@ffff88009a56f100 x1830949052108288/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:488/0 lens 488/0 e 0 to 0 dl 1746129758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129747.461491:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56f100 with x1830949052108288 ext(4141056->4194303) 00010000:00010000:2.0:1746129747.461499:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fb66800/0x48868a4e43948d5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1a4 expref: 30 pid: 7976 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129747.461509:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fb66800/0x48868a4e43948d5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1a4 expref: 30 pid: 7976 timeout: 793 lvb_type: 0 00002000:00010000:2.0:1746129747.461515:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a56f100 00000100:00100000:2.0:1746129747.461544:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 560 00000100:00100000:2.0:1746129747.461551:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949052108288:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129747.465380:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949052108032:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 14724us (19693us total) trans 21474840260 rc 0/0 00000100:00100000:3.0:1746129747.465395:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 559 00002000:00100000:3.0:1746129747.465405:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (3923968->4194303) req@ffff88009a56e680 x1830949052108032/t21474840260(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:488/0 lens 488/448 e 0 to 0 dl 1746129758 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129747.465417:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56e680 with x1830949052108032 ext(3923968->4194303) 00010000:00010000:3.0:1746129747.465426:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69600/0x48868a4e43948d63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ab expref: 20 pid: 7976 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746129747.465437:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69600/0x48868a4e43948d63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ab expref: 20 pid: 7976 timeout: 793 lvb_type: 0 00002000:00010000:3.0:1746129747.465443:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a56e680 00000100:00100000:2.0:1746129747.466160:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949052108288:12345-192.168.204.31@tcp:4:cat.0 Request processed in 4607us (4941us total) trans 17179873103 rc 0/0 00000100:00100000:2.0:1746129747.466169:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 560 00002000:00100000:2.0:1746129747.466175:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4141056->4194303) req@ffff88009a56f100 x1830949052108288/t17179873103(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:488/0 lens 488/448 e 0 to 0 dl 1746129758 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129747.466181:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56f100 with x1830949052108288 ext(4141056->4194303) 00010000:00010000:2.0:1746129747.466187:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fb66800/0x48868a4e43948d5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1a4 expref: 32 pid: 7976 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129747.466195:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fb66800/0x48868a4e43948d5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1a4 expref: 32 pid: 7976 timeout: 793 lvb_type: 0 00002000:00010000:2.0:1746129747.466200:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a56f100 00000100:00100000:0.0:1746129747.470642:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129747.470691:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129747.472543:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052108416 00000100:00100000:1.0:1746129747.472552:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052108416 00010000:00010000:1.0:1746129747.472586:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fb66800/0x48868a4e43948d5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1a4 expref: 32 pid: 7976 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746129747.472622:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052108544 00000100:00100000:1.0:1746129747.472624:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052108544 00010000:00010000:1.0:1746129747.472633:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69600/0x48868a4e43948d63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ab expref: 20 pid: 7976 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746129747.472655:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5138 00000100:00100000:1.0:1746129747.472661:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949052108416:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129747.472672:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746129747.472687:0:7107:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129747 -> 1746129748 00002000:00010000:1.0:1746129747.472689:0:7107:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129747 -> 1746129748 00010000:00010000:1.0:1746129747.472693:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fb66800/0x48868a4e43948d5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1a4 expref: 32 pid: 7976 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746129747.472701:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fb66800/0x48868a4e43948d5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1a4 expref: 32 pid: 7976 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746129747.472717:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fb66800/0x48868a4e43948d5c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1a4 expref: 32 pid: 7976 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746129747.472731:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129747.472733:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129747.472738:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135f76200/0x48868a4e43948d71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b9 expref: 19 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129747.472744:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135f76200/0x48868a4e43948d71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b9 expref: 19 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129747.472768:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135f76200/0x48868a4e43948d71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b9 expref: 19 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129747.472781:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053273728:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129747.472842:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd57780 going to sleep for 11 seconds 00000100:00100000:1.0:1746129747.472898:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5139 00000100:00100000:1.0:1746129747.472904:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1963:x1830949052108544:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129747.472911:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746129747.472921:0:10979:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129747 -> 1746129748 00002000:00010000:1.0:1746129747.472923:0:10979:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129747 -> 1746129748 00010000:00010000:1.0:1746129747.472926:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69600/0x48868a4e43948d63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ab expref: 20 pid: 7976 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746129747.472934:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69600/0x48868a4e43948d63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ab expref: 20 pid: 7976 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746129747.472944:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69600/0x48868a4e43948d63 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ab expref: 20 pid: 7976 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746129747.472952:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129747.472953:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129747.472956:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948d6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4141055) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b2 expref: 26 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129747.472962:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948d6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4141055) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b2 expref: 26 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129747.472975:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948d6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4141055) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b2 expref: 26 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129747.472983:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053273856:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129747.473010:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd57e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129747.478134:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053273856:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129747.478152:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129747.478191:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1963:x1830949052108544:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5285us (7498us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129747.478200:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5139 00000100:00100000:2.0:1746129747.478651:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053273728:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129747.478660:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129747.478678:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949052108416:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6016us (8043us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129747.478683:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5138 00000100:00100000:0.0:1746129747.481651:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129747.481710:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129747.481790:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052108800 00000100:00100000:3.0:1746129747.481797:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052108800 00002000:00100000:3.0:1746129747.481836:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (4136960->4141055) req@ffff88009a56fb80 x1830949052108800/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:488/0 lens 488/0 e 0 to 0 dl 1746129758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129747.481865:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56fb80 with x1830949052108800 ext(4136960->4141055) 00002000:00010000:3.0:1746129747.481870:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a56fb80 00000100:00100000:3.0:1746129747.481884:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052109056 00000100:00100000:3.0:1746129747.481886:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052109056 00002000:00100000:3.0:1746129747.481898:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (4849664->4853759) req@ffff88012b8e4000 x1830949052109056/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:488/0 lens 488/0 e 0 to 0 dl 1746129758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129747.481904:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e4000 with x1830949052109056 ext(4849664->4853759) 00002000:00010000:3.0:1746129747.481906:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8e4000 00000100:00100000:3.0:1746129747.481917:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3958 00000100:00100000:3.0:1746129747.481923:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949052108800:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129747.482055:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949052108800:12345-192.168.204.31@tcp:3:cat.0 Request processed in 131us (410us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129747.482061:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3958 00002000:00100000:3.0:1746129747.482066:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (4136960->4141055) req@ffff88009a56fb80 x1830949052108800/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:488/0 lens 488/4536 e 0 to 0 dl 1746129758 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129747.482072:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56fb80 with x1830949052108800 ext(4136960->4141055) 00002000:00010000:3.0:1746129747.482074:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a56fb80 00000100:00100000:3.0:1746129747.482102:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3959 00000100:00100000:3.0:1746129747.482108:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1963:x1830949052109056:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129747.482178:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1963:x1830949052109056:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 69us (466us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129747.482182:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3959 00002000:00100000:3.0:1746129747.482186:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (4849664->4853759) req@ffff88012b8e4000 x1830949052109056/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:488/0 lens 488/4536 e 0 to 0 dl 1746129758 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129747.482191:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e4000 with x1830949052109056 ext(4849664->4853759) 00002000:00010000:3.0:1746129747.482193:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8e4000 00000100:00100000:0.0:1746129747.485036:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129747.485191:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052109312 00000100:00100000:3.0:1746129747.485199:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052109312 00000100:00100000:3.0:1746129747.485231:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3848 00000100:00100000:3.0:1746129747.485237:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c563050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28488:x1830949052109312:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129747.486754:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c563050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28488:x1830949052109312:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 1511us (1721us total) trans 8589943598 rc 0/0 00000100:00100000:3.0:1746129747.486763:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3848 00000100:00100000:0.0:1746129747.499968:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.500084:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052109440 00000100:00100000:2.0:1746129747.500091:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052109440 00000100:00100000:2.0:1746129747.500144:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9824 00000100:00100000:2.0:1746129747.500150:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+6:28503:x1830949052109440:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129747.500170:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129747.500184:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69200/0x48868a4e43948d78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f1c0 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.500228:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69800/0x48868a4e43948d7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.500238:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69800/0x48868a4e43948d7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.500246:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69800/0x48868a4e43948d7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.500256:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69c00/0x48868a4e43948d86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.500261:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69c00/0x48868a4e43948d86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.500265:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69c00/0x48868a4e43948d86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.500352:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f68800/0x48868a4e43948d8d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.500361:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37800/0x48868a4e43948c21 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f103 expref: 289 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.500367:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f68800/0x48868a4e43948d8d lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.500391:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37800/0x48868a4e43948c21 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f103 expref: 289 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.500402:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37800/0x48868a4e43948c21 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f103 expref: 289 pid: 14315 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746129747.500411:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053273984:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129747.500506:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013065e9c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746129747.500674:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129747.503903:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129747.503959:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052109696 00000100:00100000:3.0:1746129747.503964:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052109696 00000100:00100000:3.0:1746129747.503999:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3849 00000100:00100000:3.0:1746129747.504005:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:14511:x1830949052109696:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746129747.504185:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:14511:x1830949052109696:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 179us (284us total) trans 8589943599 rc 0/0 00000100:00100000:3.0:1746129747.504191:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3849 00000100:00100000:2.0:1746129747.504260:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053273984:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129747.504279:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f68800/0x48868a4e43948d8d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129747.505141:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.505201:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052109824 00000100:00100000:2.0:1746129747.505205:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052109824 00010000:00010000:2.0:1746129747.505222:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37800/0x48868a4e43948c21 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f103 expref: 291 pid: 14315 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746129747.505279:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5140 00000100:00100000:2.0:1746129747.505285:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:1962:x1830949052109824:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129747.505296:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129747.505301:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37800/0x48868a4e43948c21 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f103 expref: 291 pid: 14315 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129747.505309:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37800/0x48868a4e43948c21 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f103 expref: 291 pid: 14315 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129747.505326:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37800/0x48868a4e43948c21 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f103 expref: 291 pid: 14315 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129747.505518:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129747.505523:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f68800/0x48868a4e43948d8d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.505531:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f68800/0x48868a4e43948d8d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.505537:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f68800/0x48868a4e43948d8d lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.505566:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129747.505589:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:1962:x1830949052109824:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 303us (449us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129747.505594:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f68800/0x48868a4e43948d8d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:2.0:1746129747.505595:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5140 00010000:00010000:3.0:1746129747.505600:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f68800/0x48868a4e43948d8d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129747.505627:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:3.0:1746129747.505630:0:1851:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129747.505641:0:1851:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f68800/0x48868a4e43948d8d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129747.505649:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f68800/0x48868a4e43948d8d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129747.505657:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69800/0x48868a4e43948d7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129747.505662:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69800/0x48868a4e43948d7f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129747.505667:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69800/0x48868a4e43948d7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129747.505673:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8f69800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129747.505676:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69800/0x48868a4e43948d7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129747.505682:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69800/0x48868a4e43948d7f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129747.505690:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129747.505692:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129747.505694:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69800/0x48868a4e43948d7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129747.505698:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69800/0x48868a4e43948d7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129747.505707:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69c00/0x48868a4e43948d86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129747.505712:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69c00/0x48868a4e43948d86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129747.505716:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69c00/0x48868a4e43948d86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129747.505719:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8f69c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129747.505721:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69c00/0x48868a4e43948d86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129747.505725:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69c00/0x48868a4e43948d86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129747.505730:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012bfcaa00) 00010000:00010000:3.0:1746129747.505732:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129747.505734:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69c00/0x48868a4e43948d86 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129747.505738:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69c00/0x48868a4e43948d86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129747.505763:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f69200/0x48868a4e43948d78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1c0 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.506066:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f68800/0x48868a4e43948d8d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1c0 expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.506072:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129747.506074:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129747.506076:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8f68800, rc 0) 00000100:00100000:3.0:1746129747.506172:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+7:28503:x1830949052109440:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 6021us (6211us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129747.506178:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9824 00000100:00100000:0.0:1746129747.509491:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129747.509526:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129747.509550:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052109952 00000100:00100000:1.0:1746129747.509558:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052109952 00000100:00100000:0.0:1746129747.509560:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129747.509588:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052110208 00000100:00100000:1.0:1746129747.509591:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052110208 00000100:00100000:0.0:1746129747.509599:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052110080 00000100:00100000:0.0:1746129747.509601:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052110080 00000100:00100000:1.0:1746129747.509606:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10727 00000100:00100000:1.0:1746129747.509612:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+19:1961:x1830949052109952:12345-192.168.204.31@tcp:101:mirror_io.0 00000100:00100000:0.0:1746129747.509615:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10728 00000100:00100000:0.0:1746129747.509619:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+20:1961:x1830949052110208:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129747.509627:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129747.509627:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129747.509640:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135f77000/0x48868a4e43948d94 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f1c7 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129747.509640:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f200/0x48868a4e43948d9b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f1d5 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129747.509657:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129747.509659:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129747.509665:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135f77000/0x48868a4e43948d94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1c7 expref: 20 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129747.509676:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135f77000/0x48868a4e43948d94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1c7 expref: 20 pid: 1140 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129747.509679:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053274112:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129747.509689:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135f77000, rc 0) 00000100:00100000:0.0:1746129747.509739:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129747.509763:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10729 00000100:00100000:0.0:1746129747.509768:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+21:1961:x1830949052110080:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129747.509774:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129747.509780:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ec00/0x48868a4e43948da2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f1ce expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129747.509788:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129747.509789:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129747.509793:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ec00/0x48868a4e43948da2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ce expref: 22 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129747.509802:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ec00/0x48868a4e43948da2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ce expref: 22 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129747.509808:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6ec00, rc 0) 00000100:00100000:1.0:1746129747.510284:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+20:1961:x1830949052109952:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 671us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129747.510284:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+22:1961:x1830949052110080:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 514us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129747.510290:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10727 00000100:00100000:0.0:1746129747.510292:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10729 00002000:00010000:2.0:1746129747.512550:0:20441:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime: 1746129747 -> 1746129748 00000100:00100000:2.0:1746129747.512570:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053274112:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129747.512592:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f200/0x48868a4e43948d9b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1d5 expref: 21 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129747.512603:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f200/0x48868a4e43948d9b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1d5 expref: 21 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129747.512611:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6f200, rc 0) 00000100:00100000:2.0:1746129747.512651:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+20:1961:x1830949052110208:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 3030us (3123us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129747.512657:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10728 00000100:00100000:0.0:1746129747.512706:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.513273:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052110336 00000100:00100000:2.0:1746129747.513279:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052110336 00000100:00100000:2.0:1746129747.513698:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10730 00000100:00100000:2.0:1746129747.513707:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+20:1962:x1830949052110336:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129747.513718:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129747.513730:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8f68200/0x48868a4e43948da9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f1dc expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129747.513765:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053274240:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129747.514191:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013065e9c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746129747.515455:0:20441:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746129747 -> 1746129748 00000100:00100000:2.0:1746129747.515486:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053274240:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129747.515505:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8f68200/0x48868a4e43948da9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1dc expref: 21 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129747.515515:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8f68200/0x48868a4e43948da9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1dc expref: 21 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129747.515522:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8f68200, rc 0) 00000100:00100000:2.0:1746129747.515561:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+20:1962:x1830949052110336:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 1855us (2854us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129747.515567:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10730 00000100:00100000:0.0:1746129747.518208:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129747.518540:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052110592 00000100:00100000:3.0:1746129747.518549:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052110592 00000100:00100000:3.0:1746129747.518595:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9825 00000100:00100000:3.0:1746129747.518606:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+7:28503:x1830949052110592:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129747.518623:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129747.518638:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd42400/0x48868a4e43948db0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f1e3 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.518726:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd42600/0x48868a4e43948db7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129747.518738:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f68800/0x48868a4e43948d8d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1c0 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.518745:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd42600/0x48868a4e43948db7 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129747.518770:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f68800/0x48868a4e43948d8d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1c0 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.518780:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f68800/0x48868a4e43948d8d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1c0 expref: 8 pid: 1851 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746129747.518790:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053274368:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129747.519184:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bd1df00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129747.520286:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053274368:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129747.520315:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd42600/0x48868a4e43948db7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129747.520593:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.520696:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052110720 00000100:00100000:2.0:1746129747.520701:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052110720 00010000:00010000:2.0:1746129747.520719:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f68800/0x48868a4e43948d8d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1c0 expref: 9 pid: 1851 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746129747.520747:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5141 00000100:00100000:2.0:1746129747.520753:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052110720:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129747.520763:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129747.520767:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f68800/0x48868a4e43948d8d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1c0 expref: 9 pid: 1851 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129747.520776:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f68800/0x48868a4e43948d8d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1c0 expref: 9 pid: 1851 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129747.520796:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f68800/0x48868a4e43948d8d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1c0 expref: 9 pid: 1851 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129747.520809:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129747.520812:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd42600/0x48868a4e43948db7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.520820:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd42600/0x48868a4e43948db7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.520825:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd42600/0x48868a4e43948db7 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.520879:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129747.520913:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052110720:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 159us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129747.520919:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5141 00010000:00010000:3.0:1746129747.521356:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd42600/0x48868a4e43948db7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129747.521362:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd42600/0x48868a4e43948db7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129747.521377:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129747.521501:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd42400/0x48868a4e43948db0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1e3 expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.521533:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd42600/0x48868a4e43948db7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1e3 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.521539:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129747.521541:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129747.521544:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd42600, rc 0) 00000100:00100000:3.0:1746129747.521579:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:28503:x1830949052110592:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 2977us (3379us total) trans 8589943600 rc 0/0 00000100:00100000:3.0:1746129747.521585:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9825 00000100:00100000:0.0:1746129747.525770:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129747.525887:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052110976 00000100:00100000:3.0:1746129747.525894:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052110976 00000100:00100000:3.0:1746129747.525932:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9826 00000100:00100000:3.0:1746129747.525939:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:28503:x1830949052110976:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129747.525959:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129747.525963:0:1851:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746129747.525985:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd42600/0x48868a4e43948db7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1e3 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.526014:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129747.526019:0:1851:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129747.526028:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd42000/0x48868a4e43948dc5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f1ea expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.526101:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd42800/0x48868a4e43948dcc lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129747.526111:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd42800/0x48868a4e43948dcc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129747.526118:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd42800/0x48868a4e43948dcc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129747.526127:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129747.526216:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd42000/0x48868a4e43948dc5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ea expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.526232:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd42800/0x48868a4e43948dcc lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ea expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.526238:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129747.526240:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129747.526242:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd42800, rc 0) 00000100:00100000:3.0:1746129747.526294:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:28503:x1830949052110976:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 355us (530us total) trans 8589943601 rc 0/0 00000100:00100000:3.0:1746129747.526300:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9826 00000100:00100000:2.0:1746129747.529114:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129747.529195:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052111104 00000100:00100000:0.0:1746129747.529202:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052111104 00000100:00100000:0.0:1746129747.529244:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9827 00000100:00100000:0.0:1746129747.529250:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:28503:x1830949052111104:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129747.529267:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129747.529280:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f200/0x48868a4e43948dda lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f1f1 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129747.529325:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f200/0x48868a4e43948dda lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1f1 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129747.529337:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f200/0x48868a4e43948dda lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1f1 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129747.529351:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129747.529354:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129747.529356:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6f200, rc 0) 00000100:00100000:0.0:1746129747.529401:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+10:28503:x1830949052111104:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 151us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129747.529406:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9827 00000100:00100000:0.0:1746129747.533737:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.535017:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052111232 00000100:00100000:2.0:1746129747.535025:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052111232 00000100:00100000:0.0:1746129747.535579:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.535888:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052111360 00000100:00100000:2.0:1746129747.535891:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052111360 00000100:00100000:2.0:1746129747.535911:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10731 00000100:00100000:2.0:1746129747.535918:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+20:1961:x1830949052111232:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:2.0:1746129747.535952:0:20441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a8f69800/0x48868a4e43948de1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.535967:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b80400/0x48868a4e43948b56 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0bd expref: 20 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129747.535978:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092841c00/0x48868a4e43948c59 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f118 expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.535983:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a75a00/0x48868a4e43948c13 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0fc expref: 30 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.535988:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129747.535990:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129747.535991:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8f69800/0x48868a4e43948de1 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.536014:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a75a00/0x48868a4e43948c13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0fc expref: 30 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.536024:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a75a00/0x48868a4e43948c13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0fc expref: 30 pid: 8436 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746129747.536035:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053274496:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129747.536130:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10732 00000100:00100000:0.0:1746129747.536136:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+20:1961:x1830949052111360:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:0.0:1746129747.536153:0:3623:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f600/0x48868a4e43948de8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129747.536162:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801356e3400/0x48868a4e43948b5d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0c4 expref: 20 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129747.536168:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e43948c7c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f134 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129747.536178:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fb66600/0x48868a4e43948c6e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f126 expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129747.536182:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129747.536183:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129747.536185:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f600/0x48868a4e43948de8 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129747.536199:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fb66600/0x48868a4e43948c6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f126 expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129747.536206:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fb66600/0x48868a4e43948c6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f126 expref: 26 pid: 8436 timeout: 793 lvb_type: 0 00000100:00100000:0.0:1746129747.536214:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053274624:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129747.536951:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129747.536996:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129747.537065:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129747.537090:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129747.537570:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092841c00/0x48868a4e43948c59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f118 expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.537580:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092841c00/0x48868a4e43948c59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f118 expref: 19 pid: 4589 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746129747.537590:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053274752:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129747.537679:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136b80400/0x48868a4e43948b56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0bd expref: 20 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129747.537687:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136b80400/0x48868a4e43948b56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0bd expref: 20 pid: 4589 timeout: 793 lvb_type: 1 00000100:00100000:2.0:1746129747.537694:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136318a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053274880:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129747.537712:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013065e9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746129747.537842:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e43948c7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f134 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129747.537863:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e43948c7c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f134 expref: 18 pid: 8436 timeout: 793 lvb_type: 0 00000100:00100000:0.0:1746129747.537871:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053275008:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129747.537905:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801356e3400/0x48868a4e43948b5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0c4 expref: 20 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129747.537912:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801356e3400/0x48868a4e43948b5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0c4 expref: 20 pid: 3624 timeout: 793 lvb_type: 1 00000100:00100000:0.0:1746129747.537937:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053275136:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129747.537955:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3249c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129747.538716:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052111616 00000100:00100000:3.0:1746129747.538723:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052111616 00000100:00100000:3.0:1746129747.538751:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052111872 00000100:00100000:3.0:1746129747.538753:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052111872 00000100:00100000:3.0:1746129747.538763:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052111488 00000100:00100000:3.0:1746129747.538765:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052111488 00000100:00100000:3.0:1746129747.538774:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052111744 00000100:00100000:3.0:1746129747.538776:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052111744 00000100:00100000:3.0:1746129747.538789:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10733 00000100:00100000:3.0:1746129747.538794:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+22:1961:x1830949052111616:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:3.0:1746129747.538822:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008fd43c00/0x48868a4e43948def lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.538833:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fd43400/0x48868a4e43948c9f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f157 expref: 30 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.538840:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ec00/0x48868a4e43948da2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ce expref: 22 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129747.538863:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fd42c00/0x48868a4e43948ca6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f15e expref: 19 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.538869:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129747.538870:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129747.538872:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd43c00/0x48868a4e43948def lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.538890:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fd42c00/0x48868a4e43948ca6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f15e expref: 19 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.538897:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fd42c00/0x48868a4e43948ca6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f15e expref: 19 pid: 8435 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746129747.538905:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053275264:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129747.538936:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ec00/0x48868a4e43948da2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ce expref: 22 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129747.538943:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ec00/0x48868a4e43948da2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ce expref: 22 pid: 3623 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746129747.538949:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053275392:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129747.538970:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fd43400/0x48868a4e43948c9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f157 expref: 30 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.538981:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fd43400/0x48868a4e43948c9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f157 expref: 30 pid: 8435 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746129747.538988:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053275520:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129747.539018:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bd1df00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129747.539037:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10734 00000100:00100000:3.0:1746129747.539042:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+22:1961:x1830949052111872:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:3.0:1746129747.539061:0:7976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a14c200/0x48868a4e43948df6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.539070:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948d6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4141055) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b2 expref: 26 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.539075:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129747.539076:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129747.539078:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a14c200/0x48868a4e43948df6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.539091:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948d6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4141055) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b2 expref: 26 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.539098:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948d6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4141055) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b2 expref: 26 pid: 7976 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746129747.539105:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053275648:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129747.539123:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa48c180 going to sleep for 11 seconds 00000100:00100000:3.0:1746129747.539144:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10735 00000100:00100000:3.0:1746129747.539149:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+22:1961:x1830949052111488:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:3.0:1746129747.539161:0:10930:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a14c800/0x48868a4e43948dfd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.539170:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094668200/0x48868a4e43948c98 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f150 expref: 18 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.539175:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135f77000/0x48868a4e43948d94 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1c7 expref: 22 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129747.539181:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fb66e00/0x48868a4e43948cc9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f165 expref: 26 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129747.539186:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129747.539187:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129747.539189:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a14c800/0x48868a4e43948dfd lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.539201:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fb66e00/0x48868a4e43948cc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f165 expref: 26 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129747.539207:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fb66e00/0x48868a4e43948cc9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f165 expref: 26 pid: 7976 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746129747.539214:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c136a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053275776:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129747.539238:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135f77000/0x48868a4e43948d94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1c7 expref: 22 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129747.539244:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135f77000/0x48868a4e43948d94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1c7 expref: 22 pid: 1140 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746129747.539250:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c135f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053275904:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129747.539268:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094668200/0x48868a4e43948c98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f150 expref: 18 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.539275:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094668200/0x48868a4e43948c98 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f150 expref: 18 pid: 1140 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746129747.539281:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b024700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053276032:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129747.539294:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa48cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129747.539316:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10736 00000100:00100000:3.0:1746129747.539321:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+22:1961:x1830949052111744:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:3.0:1746129747.539336:0:1877:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43948e04 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.539344:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135f76200/0x48868a4e43948d71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b9 expref: 19 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.539349:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129747.539350:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129747.539352:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43948e04 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.539366:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135f76200/0x48868a4e43948d71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b9 expref: 19 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.539373:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135f76200/0x48868a4e43948d71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b9 expref: 19 pid: 1140 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746129747.539380:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a56e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053276160:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129747.539396:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa48c540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129747.543421:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129747.543452:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129747.543506:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052112000 00000100:00100000:0.0:1746129747.543512:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052112000 00010000:00010000:0.0:1746129747.543541:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a75a00/0x48868a4e43948c13 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0fc expref: 31 pid: 8436 timeout: 793 lvb_type: 0 00000100:00100000:0.0:1746129747.543561:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052112128 00000100:00100000:0.0:1746129747.543563:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052112128 00010000:00010000:0.0:1746129747.543572:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb66600/0x48868a4e43948c6e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f126 expref: 27 pid: 8436 timeout: 793 lvb_type: 0 00000100:00100000:0.0:1746129747.543584:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5142 00000100:00100000:0.0:1746129747.543590:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949052112000:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129747.543600:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129747.543618:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a75a00/0x48868a4e43948c13 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0fc expref: 31 pid: 8436 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746129747.543628:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a75a00/0x48868a4e43948c13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0fc expref: 31 pid: 8436 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746129747.543648:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129747.543679:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949052112000:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 90us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129747.543685:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5142 00000100:00100000:0.0:1746129747.543699:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5143 00000100:00100000:0.0:1746129747.543703:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949052112128:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129747.543710:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129747.543721:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fb66600/0x48868a4e43948c6e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f126 expref: 27 pid: 8436 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746129747.543727:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fb66600/0x48868a4e43948c6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f126 expref: 27 pid: 8436 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746129747.543737:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129747.543750:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949052112128:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 46us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129747.543753:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5143 00010000:00010000:2.0:1746129747.543877:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a75a00/0x48868a4e43948c13 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0fc expref: 30 pid: 8436 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746129747.543891:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053274496:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129747.544014:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fb66600/0x48868a4e43948c6e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f126 expref: 26 pid: 8436 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746129747.544027:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053274624:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129747.558752:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129747.558770:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129747.558839:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053275264:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129747.558876:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053275392:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129747.558961:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136318a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053274880:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129747.559031:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129747.559082:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053275008:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129747.559091:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053275136:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129747.559112:0:3623:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f600/0x48868a4e43948de8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129747.559215:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129747.559246:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052112256 00000100:00100000:3.0:1746129747.559251:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052112256 00010000:00010000:3.0:1746129747.559279:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136b80400/0x48868a4e43948b56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0bd expref: 23 pid: 4589 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746129747.559299:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052112512 00000100:00100000:3.0:1746129747.559301:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052112512 00010000:00010000:3.0:1746129747.559309:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801356e3400/0x48868a4e43948b5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0c4 expref: 23 pid: 3624 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746129747.559324:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052112768 00000100:00100000:3.0:1746129747.559325:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052112768 00010000:00010000:3.0:1746129747.559347:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ec00/0x48868a4e43948da2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ce expref: 24 pid: 3623 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746129747.559361:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5144 00000100:00100000:3.0:1746129747.559370:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+24:1962:x1830949052112256:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129747.559380:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129747.559397:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136b80400/0x48868a4e43948b56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0bd expref: 24 pid: 4589 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746129747.559404:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136b80400/0x48868a4e43948b56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0bd expref: 24 pid: 4589 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746129747.559422:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b80400/0x48868a4e43948b56 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0bd expref: 24 pid: 4589 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746129747.559438:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129747.559485:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+23:1962:x1830949052112256:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 102us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129747.559492:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5144 00000100:00100000:3.0:1746129747.559509:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5145 00000100:00100000:3.0:1746129747.559515:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+23:1962:x1830949052112512:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129747.559522:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129747.559532:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801356e3400/0x48868a4e43948b5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0c4 expref: 23 pid: 3624 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746129747.559540:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801356e3400/0x48868a4e43948b5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0c4 expref: 23 pid: 3624 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746129747.559552:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801356e3400/0x48868a4e43948b5d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f0c4 expref: 23 pid: 3624 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746129747.559564:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129747.559580:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+22:1962:x1830949052112512:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 66us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129747.559585:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5145 00000100:00100000:3.0:1746129747.559595:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5146 00000100:00100000:3.0:1746129747.559600:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+22:1962:x1830949052112768:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129747.559606:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129747.559614:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ec00/0x48868a4e43948da2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ce expref: 22 pid: 3623 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746129747.559621:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ec00/0x48868a4e43948da2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ce expref: 22 pid: 3623 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746129747.559630:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ec00/0x48868a4e43948da2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ce expref: 22 pid: 3623 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746129747.559637:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129747.559651:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+21:1962:x1830949052112768:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 51us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129747.559656:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5146 00000100:00100000:2.0:1746129747.560056:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052112384 00000100:00100000:2.0:1746129747.560059:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052112384 00010000:00010000:2.0:1746129747.560071:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e43948c7c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f134 expref: 19 pid: 8436 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746129747.560085:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5147 00000100:00100000:2.0:1746129747.560089:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949052112384:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129747.560094:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129747.560101:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e43948c7c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f134 expref: 19 pid: 8436 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129747.560108:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e43948c7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f134 expref: 19 pid: 8436 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129747.560119:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e43948c7c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f134 expref: 19 pid: 8436 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129747.560131:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129747.560132:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129747.560136:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f600/0x48868a4e43948de8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.560143:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f600/0x48868a4e43948de8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.560159:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129747.560176:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052112384:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 85us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129747.560181:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5147 00010000:00010000:1.0:1746129747.560238:0:3623:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f600/0x48868a4e43948de8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129747.560246:0:3623:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f600/0x48868a4e43948de8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129747.560262:0:3623:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f600/0x48868a4e43948de8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129747.560268:0:3623:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f600/0x48868a4e43948de8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129747.560279:0:3623:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f600/0x48868a4e43948de8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129747.560285:0:3623:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb6f600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129747.560289:0:3623:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f600/0x48868a4e43948de8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129747.560295:0:3623:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f600/0x48868a4e43948de8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129747.560304:0:3623:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f600/0x48868a4e43948de8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129747.560310:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f600/0x48868a4e43948de8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129747.560349:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+21:1961:x1830949052111360:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 24214us (24774us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129747.560355:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10732 00000100:00100000:0.0:1746129747.560742:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129747.560815:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.560980:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052112640 00000100:00100000:2.0:1746129747.560983:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052112640 00010000:00010000:2.0:1746129747.560995:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd42c00/0x48868a4e43948ca6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f15e expref: 20 pid: 8435 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746129747.561010:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5148 00000100:00100000:2.0:1746129747.561014:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949052112640:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129747.561020:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129747.561027:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fd42c00/0x48868a4e43948ca6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f15e expref: 20 pid: 8435 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129747.561038:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fd42c00/0x48868a4e43948ca6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f15e expref: 20 pid: 8435 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129747.561049:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fd42c00/0x48868a4e43948ca6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f15e expref: 20 pid: 8435 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129747.561068:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129747.561087:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949052112640:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 73us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129747.561092:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5148 00000100:00100000:2.0:1746129747.561160:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c136a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053275776:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129747.561169:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c135f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053275904:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129747.561175:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b024700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053276032:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129747.561188:0:10930:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a14c800/0x48868a4e43948dfd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129747.561205:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a56e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053276160:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129747.561213:0:1877:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43948e04 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129747.561233:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053275648:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129747.561241:0:7976:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a14c200/0x48868a4e43948df6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129747.561538:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053274752:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129747.561554:0:20441:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a8f69800/0x48868a4e43948de1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129747.561612:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052113024 00000100:00100000:1.0:1746129747.561616:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052113024 00002000:00100000:1.0:1746129747.561640:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4141055) req@ffff8800a02fe300 x1830949052113024/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:488/0 lens 488/0 e 0 to 0 dl 1746129758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129747.561649:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02fe300 with x1830949052113024 ext(3145728->4141055) 00010000:00010000:1.0:1746129747.561654:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948d6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4141055) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b2 expref: 26 pid: 7976 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746129747.561663:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948d6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4141055) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b2 expref: 26 pid: 7976 timeout: 793 lvb_type: 0 00002000:00010000:1.0:1746129747.561672:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a02fe300 00000100:00100000:1.0:1746129747.561685:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 561 00000100:00100000:1.0:1746129747.561689:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1964:x1830949052113024:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129747.562271:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129747.562286:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129747.562298:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129747.562308:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052113152 00000100:00100000:3.0:1746129747.562311:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052113152 00010000:00010000:3.0:1746129747.562323:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb66e00/0x48868a4e43948cc9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f165 expref: 27 pid: 7976 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746129747.562336:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052113536 00000100:00100000:3.0:1746129747.562338:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052113536 00010000:00010000:3.0:1746129747.562345:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094668200/0x48868a4e43948c98 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f150 expref: 18 pid: 1140 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746129747.562353:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052112896 00000100:00100000:3.0:1746129747.562355:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052112896 00010000:00010000:3.0:1746129747.562361:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092841c00/0x48868a4e43948c59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f118 expref: 19 pid: 4589 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746129747.562372:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5149 00000100:00100000:3.0:1746129747.562377:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949052113152:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129747.562380:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129747.562384:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129747.562393:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fb66e00/0x48868a4e43948cc9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f165 expref: 28 pid: 7976 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746129747.562400:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fb66e00/0x48868a4e43948cc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f165 expref: 28 pid: 7976 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746129747.562408:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129747.562418:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fb66e00/0x48868a4e43948cc9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f165 expref: 28 pid: 7976 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746129747.562422:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052113408 00000100:00100000:1.0:1746129747.562424:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052113408 00010000:00010000:3.0:1746129747.562427:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746129747.562437:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4853759) req@ffff8800a00c4a80 x1830949052113408/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:488/0 lens 488/0 e 0 to 0 dl 1746129758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746129747.562443:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949052113152:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 66us (173us total) trans 0 rc 0/0 00002000:00100000:1.0:1746129747.562444:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c4a80 with x1830949052113408 ext(4194304->4853759) 00000100:00100000:3.0:1746129747.562448:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5149 00010000:00010000:1.0:1746129747.562449:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135f76200/0x48868a4e43948d71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b9 expref: 20 pid: 1140 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746129747.562455:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135f76200/0x48868a4e43948d71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b9 expref: 20 pid: 1140 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746129747.562459:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052113280 00002000:00010000:1.0:1746129747.562460:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a00c4a80 00000100:00100000:3.0:1746129747.562461:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052113280 00010000:00010000:3.0:1746129747.562468:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135f77000/0x48868a4e43948d94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1c7 expref: 21 pid: 1140 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746129747.562486:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 562 00000100:00100000:3.0:1746129747.562489:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5150 00000100:00100000:1.0:1746129747.562491:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949052113408:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:3.0:1746129747.562493:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052113536:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129747.562498:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129747.562504:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094668200/0x48868a4e43948c98 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f150 expref: 18 pid: 1140 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746129747.562511:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094668200/0x48868a4e43948c98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f150 expref: 18 pid: 1140 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746129747.562522:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094668200/0x48868a4e43948c98 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f150 expref: 18 pid: 1140 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746129747.562529:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129747.562542:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052113536:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 48us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129747.562547:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5150 00000100:00100000:3.0:1746129747.562571:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5151 00000100:00100000:3.0:1746129747.562576:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949052112896:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129747.562581:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129747.562589:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092841c00/0x48868a4e43948c59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f118 expref: 20 pid: 4589 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746129747.562596:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092841c00/0x48868a4e43948c59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f118 expref: 20 pid: 4589 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746129747.562606:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092841c00/0x48868a4e43948c59 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f118 expref: 20 pid: 4589 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746129747.562613:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129747.562615:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129747.562618:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8f69800/0x48868a4e43948de1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.562625:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8f69800/0x48868a4e43948de1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.562638:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129747.562649:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949052112896:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 73us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129747.562653:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5151 00000100:00100000:3.0:1746129747.562661:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5152 00000100:00100000:3.0:1746129747.562665:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+21:1962:x1830949052113280:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129747.562670:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129747.562675:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135f77000/0x48868a4e43948d94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1c7 expref: 21 pid: 1140 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746129747.562682:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135f77000/0x48868a4e43948d94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1c7 expref: 21 pid: 1140 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746129747.562691:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135f77000/0x48868a4e43948d94 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1c7 expref: 21 pid: 1140 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746129747.562698:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129747.562699:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129747.562701:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a14c800/0x48868a4e43948dfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.562707:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a14c800/0x48868a4e43948dfd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.562717:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129747.562728:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+20:1962:x1830949052113280:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 62us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129747.562733:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5152 00010000:00010000:3.0:1746129747.562752:0:20441:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a8f69800/0x48868a4e43948de1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.562758:0:20441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8f69800/0x48868a4e43948de1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.562775:0:20441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a8f69800/0x48868a4e43948de1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.562782:0:20441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8f69800/0x48868a4e43948de1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.562788:0:20441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a8f69800/0x48868a4e43948de1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.562792:0:20441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8f69800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129747.562795:0:20441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a8f69800/0x48868a4e43948de1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.562802:0:20441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a8f69800/0x48868a4e43948de1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.562809:0:20441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a8f69800/0x48868a4e43948de1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.562814:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8f69800/0x48868a4e43948de1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129747.562844:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+20:1961:x1830949052111232:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 26927us (29115us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129747.562866:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10731 00010000:00010000:2.0:1746129747.562978:0:10930:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a14c800/0x48868a4e43948dfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.562985:0:10930:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a14c800/0x48868a4e43948dfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.562996:0:10930:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a14c800/0x48868a4e43948dfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.563001:0:10930:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a14c800/0x48868a4e43948dfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.563007:0:10930:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a14c800/0x48868a4e43948dfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.563012:0:10930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a14c800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129747.563015:0:10930:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a14c800/0x48868a4e43948dfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.563020:0:10930:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a14c800/0x48868a4e43948dfd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.563029:0:10930:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a14c800/0x48868a4e43948dfd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.563039:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a14c800/0x48868a4e43948dfd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129747.563076:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+19:1961:x1830949052111488:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 23927us (26010us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129747.563082:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10735 00000100:00100000:2.0:1746129747.563120:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053275520:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129747.563144:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008fd43c00/0x48868a4e43948def lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129747.572292:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.572691:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052113664 00000100:00100000:2.0:1746129747.572699:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052113664 00010000:00010000:2.0:1746129747.572729:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd43400/0x48868a4e43948c9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f157 expref: 30 pid: 8435 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746129747.572766:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5153 00000100:00100000:2.0:1746129747.572773:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949052113664:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129747.572785:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129747.572803:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fd43400/0x48868a4e43948c9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f157 expref: 30 pid: 8435 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129747.572812:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fd43400/0x48868a4e43948c9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f157 expref: 30 pid: 8435 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129747.572832:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fd43400/0x48868a4e43948c9f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f157 expref: 30 pid: 8435 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129747.572873:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129747.572875:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129747.573303:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fd43c00/0x48868a4e43948def lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.573312:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd43c00/0x48868a4e43948def lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.573340:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129747.573384:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949052113664:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 610us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129747.573391:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5153 00010000:00010000:0.0:1746129747.574468:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008fd43c00/0x48868a4e43948def lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129747.574491:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fd43c00/0x48868a4e43948def lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129747.574513:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008fd43c00/0x48868a4e43948def lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129747.574520:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd43c00/0x48868a4e43948def lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129747.574526:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008fd43c00/0x48868a4e43948def lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129747.574532:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fd43c00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129747.574536:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fd43c00/0x48868a4e43948def lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129747.574542:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fd43c00/0x48868a4e43948def lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129747.574554:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008fd43c00/0x48868a4e43948def lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129747.574559:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fd43c00/0x48868a4e43948def lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129747.576294:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+19:1961:x1830949052111616:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 37493us (39339us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129747.576304:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10733 00000100:00100000:1.0:1746129747.588896:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949052113024:12345-192.168.204.31@tcp:4:cat.0 Request processed in 27198us (28072us total) trans 21474840261 rc 0/0 00000100:00100000:1.0:1746129747.588910:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 561 00002000:00100000:1.0:1746129747.588919:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4141055) req@ffff8800a02fe300 x1830949052113024/t21474840261(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:488/0 lens 488/448 e 0 to 0 dl 1746129758 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129747.588927:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02fe300 with x1830949052113024 ext(3145728->4141055) 00010000:00010000:1.0:1746129747.588936:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948d6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4141055) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b2 expref: 27 pid: 7976 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746129747.588946:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948d6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4141055) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b2 expref: 27 pid: 7976 timeout: 793 lvb_type: 0 00002000:00010000:1.0:1746129747.588953:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a02fe300 00000100:00100000:2.0:1746129747.592141:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949052113408:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 29640us (29722us total) trans 17179873104 rc 0/0 00000100:00100000:2.0:1746129747.592151:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 562 00002000:00100000:2.0:1746129747.592159:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4853759) req@ffff8800a00c4a80 x1830949052113408/t17179873104(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:488/0 lens 488/448 e 0 to 0 dl 1746129758 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129747.592168:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c4a80 with x1830949052113408 ext(4194304->4853759) 00010000:00010000:2.0:1746129747.592176:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135f76200/0x48868a4e43948d71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b9 expref: 20 pid: 1140 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129747.592187:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135f76200/0x48868a4e43948d71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b9 expref: 20 pid: 1140 timeout: 793 lvb_type: 0 00002000:00010000:2.0:1746129747.592193:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a00c4a80 00000100:00100000:0.0:1746129747.592801:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129747.592921:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052113792 00000100:00100000:3.0:1746129747.592928:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052113792 00010000:00010000:3.0:1746129747.592949:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948d6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4141055) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b2 expref: 27 pid: 7976 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746129747.592995:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5154 00000100:00100000:3.0:1746129747.593002:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949052113792:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129747.593013:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129747.593030:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948d6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4141055) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b2 expref: 27 pid: 7976 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746129747.593038:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948d6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4141055) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b2 expref: 27 pid: 7976 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746129747.593056:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fb66400/0x48868a4e43948d6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4141055) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b2 expref: 27 pid: 7976 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746129747.593196:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129747.593198:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129747.593202:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a14c200/0x48868a4e43948df6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.593211:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a14c200/0x48868a4e43948df6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.593393:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129747.593456:0:7976:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a14c200/0x48868a4e43948df6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.593468:0:7976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a14c200/0x48868a4e43948df6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.593539:0:7976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a14c200/0x48868a4e43948df6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.593545:0:7976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a14c200/0x48868a4e43948df6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.593552:0:7976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a14c200/0x48868a4e43948df6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.593558:0:7976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a14c200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129747.593561:0:7976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a14c200/0x48868a4e43948df6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.593568:0:7976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a14c200/0x48868a4e43948df6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.593578:0:7976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a14c200/0x48868a4e43948df6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.593584:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a14c200/0x48868a4e43948df6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129747.593639:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949052113792:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 637us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129747.593645:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5154 00000100:00100000:2.0:1746129747.593939:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+18:1961:x1830949052111872:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 54895us (56940us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129747.593947:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10734 00000100:00100000:0.0:1746129747.593996:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129747.594076:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052113920 00000100:00100000:3.0:1746129747.594079:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052113920 00010000:00010000:3.0:1746129747.594090:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135f76200/0x48868a4e43948d71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b9 expref: 20 pid: 1140 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746129747.594109:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5155 00000100:00100000:3.0:1746129747.594114:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1963:x1830949052113920:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129747.594120:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129747.594202:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135f76200/0x48868a4e43948d71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b9 expref: 20 pid: 1140 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746129747.594211:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135f76200/0x48868a4e43948d71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b9 expref: 20 pid: 1140 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746129747.594222:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135f76200/0x48868a4e43948d71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1b9 expref: 20 pid: 1140 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746129747.594230:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129747.594231:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129747.594233:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43948e04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.594239:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43948e04 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.594259:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129747.594276:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1963:x1830949052113920:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 162us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129747.594284:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5155 00010000:00010000:2.0:1746129747.594570:0:1877:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43948e04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.594578:0:1877:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43948e04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.594591:0:1877:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43948e04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.594596:0:1877:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43948e04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.594601:0:1877:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43948e04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.594606:0:1877:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a14d600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129747.594608:0:1877:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43948e04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.594613:0:1877:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43948e04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.594621:0:1877:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43948e04 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129747.594626:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43948e04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129747.594672:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+18:1961:x1830949052111744:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 55350us (57580us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129747.594678:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10736 00000100:00100000:1.0:1746129747.597023:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129747.597137:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052114176 00000100:00100000:3.0:1746129747.597143:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052114176 00000100:00100000:3.0:1746129747.597269:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9828 00000100:00100000:3.0:1746129747.597277:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+10:28503:x1830949052114176:12345-192.168.204.31@tcp:36:mirror_io.0 00010000:00010000:3.0:1746129747.597314:0:1851:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129747.597333:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f200/0x48868a4e43948dda lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1f1 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.597346:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129747.597350:0:1851:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129747.597371:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00a8600/0x48868a4e43948e0b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129747.597381:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013688bc00/0x48868a4e43948c67 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f11f expref: 289 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.597387:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66c00/0x48868a4e43948c75 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f12d expref: 289 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.597393:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840a00/0x48868a4e43948c83 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f13b expref: 13 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.597400:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055400/0x48868a4e43948ce5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f188 expref: 289 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.597406:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055c00/0x48868a4e43948d08 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f18f expref: 13 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.597417:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00a8600/0x48868a4e43948e0b lrc: 8/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129747.597440:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055c00/0x48868a4e43948d08 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f18f expref: 13 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.597449:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055c00/0x48868a4e43948d08 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f18f expref: 13 pid: 14315 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746129747.597460:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a56ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053276288:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129747.598121:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055400/0x48868a4e43948ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f188 expref: 289 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.598129:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055400/0x48868a4e43948ce5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f188 expref: 289 pid: 14315 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746129747.598137:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a56c380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053276416:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129747.598501:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840a00/0x48868a4e43948c83 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f13b expref: 13 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.598510:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840a00/0x48868a4e43948c83 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f13b expref: 13 pid: 14314 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746129747.598517:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a56ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053276544:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129747.598661:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66c00/0x48868a4e43948c75 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f12d expref: 289 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.598672:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66c00/0x48868a4e43948c75 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f12d expref: 289 pid: 1851 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746129747.598679:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a56e300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053276672:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129747.598702:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013688bc00/0x48868a4e43948c67 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f11f expref: 289 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.598708:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013688bc00/0x48868a4e43948c67 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f11f expref: 289 pid: 14315 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746129747.598714:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a56ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053276800:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129747.598728:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa48c540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129747.600400:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129747.600438:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a56ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053276288:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129747.600439:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129747.600447:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a56c380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053276416:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129747.600454:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a56ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053276544:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129747.600460:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a56e300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053276672:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129747.600465:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a56ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053276800:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129747.600498:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00a8600/0x48868a4e43948e0b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129747.601101:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.601206:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052114560 00000100:00100000:2.0:1746129747.601211:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052114560 00000100:00100000:0.0:1746129747.601212:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129747.601239:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66c00/0x48868a4e43948c75 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f12d expref: 290 pid: 1851 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746129747.601257:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052114304 00000100:00100000:2.0:1746129747.601259:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052114304 00010000:00010000:2.0:1746129747.601266:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055c00/0x48868a4e43948d08 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f18f expref: 14 pid: 14315 timeout: 793 lvb_type: 0 00000100:00100000:0.0:1746129747.601273:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129747.601281:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052114688 00000100:00100000:2.0:1746129747.601282:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052114688 00010000:00010000:2.0:1746129747.601289:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013688bc00/0x48868a4e43948c67 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f11f expref: 291 pid: 14315 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746129747.601296:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052114432 00000100:00100000:2.0:1746129747.601297:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052114432 00010000:00010000:2.0:1746129747.601304:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055400/0x48868a4e43948ce5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f188 expref: 292 pid: 14315 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746129747.601310:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052114816 00000100:00100000:2.0:1746129747.601311:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052114816 00010000:00010000:2.0:1746129747.601317:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840a00/0x48868a4e43948c83 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f13b expref: 15 pid: 14314 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746129747.601324:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5156 00000100:00100000:2.0:1746129747.601331:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:1963:x1830949052114560:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129747.601341:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5157 00010000:00010000:2.0:1746129747.601341:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129747.601347:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949052114304:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129747.601347:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66c00/0x48868a4e43948c75 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f12d expref: 292 pid: 1851 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746129747.601355:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129747.601360:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055c00/0x48868a4e43948d08 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f18f expref: 15 pid: 14315 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129747.601360:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66c00/0x48868a4e43948c75 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f12d expref: 292 pid: 1851 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746129747.601368:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055c00/0x48868a4e43948d08 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f18f expref: 15 pid: 14315 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746129747.601390:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5158 00000100:00100000:1.0:1746129747.601398:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:1962:x1830949052114688:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129747.601404:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129747.601408:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013688bc00/0x48868a4e43948c67 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f11f expref: 292 pid: 14315 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129747.601803:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66c00/0x48868a4e43948c75 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f12d expref: 292 pid: 1851 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746129747.602051:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055c00/0x48868a4e43948d08 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f18f expref: 15 pid: 14315 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746129747.602055:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013688bc00/0x48868a4e43948c67 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f11f expref: 291 pid: 14315 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746129747.602062:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129747.602066:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00a8600/0x48868a4e43948e0b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129747.602074:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129747.602087:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129747.602091:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00a8600/0x48868a4e43948e0b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.602097:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129747.602112:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052114304:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 764us (1671us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129747.602115:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:1963:x1830949052114560:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 784us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129747.602121:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5156 00010000:00010000:1.0:1746129747.602270:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013688bc00/0x48868a4e43948c67 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f11f expref: 290 pid: 14315 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746129747.602284:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129747.602288:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00a8600/0x48868a4e43948e0b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129747.602293:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129747.602313:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:1962:x1830949052114688:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 916us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129747.603107:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5157 00000100:00100000:2.0:1746129747.603115:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5159 00000100:00100000:1.0:1746129747.603134:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5158 00000100:00100000:1.0:1746129747.603147:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5160 00000100:00100000:1.0:1746129747.603152:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1963:x1830949052114816:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129747.603160:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129747.603164:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840a00/0x48868a4e43948c83 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f13b expref: 13 pid: 14314 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746129747.603170:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840a00/0x48868a4e43948c83 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f13b expref: 13 pid: 14314 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746129747.603177:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840a00/0x48868a4e43948c83 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f13b expref: 13 pid: 14314 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746129747.603183:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129747.603185:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00a8600/0x48868a4e43948e0b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129747.603188:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129747.603201:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1963:x1830949052114816:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 50us (1929us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129747.603204:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5160 00000100:00100000:2.0:1746129747.603238:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:1962:x1830949052114432:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129747.603243:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129747.603246:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055400/0x48868a4e43948ce5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f188 expref: 288 pid: 14315 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129747.603251:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055400/0x48868a4e43948ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f188 expref: 288 pid: 14315 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129747.603260:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0055400/0x48868a4e43948ce5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f188 expref: 288 pid: 14315 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746129747.603266:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129747.603268:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00a8600/0x48868a4e43948e0b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.603272:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00a8600/0x48868a4e43948e0b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.603276:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00a8600/0x48868a4e43948e0b lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129747.603298:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129747.603309:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:1962:x1830949052114432:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 73us (2097us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129747.603312:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5159 00010000:00010000:3.0:1746129747.603359:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00a8600/0x48868a4e43948e0b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129747.603363:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00a8600/0x48868a4e43948e0b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000040:00080000:3.0:1746129747.603884:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2787, 88 off232104 00000004:00080000:3.0:1746129747.603892:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693662043331ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129747.603942:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2725, 88 off226728 00000004:00080000:3.0:1746129747.603947:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693662098721ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129747.603957:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2726, 88 off226816 00000004:00080000:3.0:1746129747.603959:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693662111492ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129747.603966:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2788, 88 off232192 00000004:00080000:3.0:1746129747.603969:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693662120968ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129747.603975:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2789, 88 off232280 00000004:00080000:3.0:1746129747.603978:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693662129819ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129747.603984:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2727, 88 off226904 00000004:00080000:3.0:1746129747.603986:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693662138347ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129747.603997:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2728, 88 off226992 00000004:00080000:3.0:1746129747.604001:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693662153409ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129747.604007:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2729, 88 off227080 00000004:00080000:3.0:1746129747.604010:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693662161816ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129747.604016:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2790, 88 off232368 00000004:00080000:3.0:1746129747.604018:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693662170078ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129747.604023:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2730, 88 off227168 00000004:00080000:3.0:1746129747.604026:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693662178042ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129747.604032:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2791, 88 off232456 00000004:00080000:3.0:1746129747.604035:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693662186699ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129747.604040:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2731, 88 off227256 00000004:00080000:3.0:1746129747.604042:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693662194069ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129747.604047:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2792, 88 off232544 00000004:00080000:3.0:1746129747.604050:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693662201837ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129747.604055:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2793, 88 off232632 00000004:00080000:3.0:1746129747.604057:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693662209561ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129747.604063:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2794, 88 off232720 00000004:00080000:3.0:1746129747.604065:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693662217518ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129747.604071:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2795, 88 off232808 00000004:00080000:3.0:1746129747.604073:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693662225423ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129747.604079:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2732, 88 off227344 00000004:00080000:3.0:1746129747.604082:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693662233778ns, next at 641623252291ns, rc = 0 00000001:00080000:0.0:1746129747.623504:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943592 is committed 00000001:00080000:0.0:1746129747.623515:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943597 is committed 00000001:00080000:0.0:1746129747.623525:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943595 is committed 00000001:00080000:0.0:1746129747.623533:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943602 is committed 00000004:00080000:0.0:1746129747.623536:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1918 committed 00000004:00010000:3.0:1746129747.623691:0:1851:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a00c4e00 reply state ffff88009bf04800 transno 8589943602 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00a8600/0x48868a4e43948e0b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:3.0:1746129747.623701:0:1851:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746129747.623783:0:1851:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746129747.623796:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+10:28503:x1830949052114176:12345-192.168.204.31@tcp:36:mirror_io.0 Request processed in 26516us (26775us total) trans 8589943602 rc 0/0 00000100:00100000:3.0:1746129747.623804:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9828 00010000:00010000:1.0:1746129747.623870:0:3283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00a8600/0x48868a4e43948e0b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129747.623877:0:3283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00a8600/0x48868a4e43948e0b lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129747.623883:0:3283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00a8600/0x48868a4e43948e0b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129747.623888:0:3283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a00a8600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129747.623891:0:3283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00a8600/0x48868a4e43948e0b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129747.623897:0:3283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00a8600/0x48868a4e43948e0b lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129747.623908:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129747.623911:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129747.623915:0:3283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00a8600/0x48868a4e43948e0b lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129747.623919:0:3283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00a8600/0x48868a4e43948e0b lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00000004:00080000:0.0:1746129747.624152:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1977 committed 00000004:00080000:0.0:1746129747.624158:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1976 committed 00000004:00080000:0.0:1746129747.624160:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1975 committed 00000004:00080000:0.0:1746129747.624161:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1974 committed 00000004:00080000:0.0:1746129747.624162:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1917 committed 00000004:00080000:0.0:1746129747.624164:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1973 committed 00000004:00080000:0.0:1746129747.624165:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1916 committed 00000004:00080000:0.0:1746129747.624166:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1972 committed 00000004:00080000:0.0:1746129747.624167:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1915 committed 00000004:00080000:0.0:1746129747.624169:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1914 committed 00000004:00080000:0.0:1746129747.624170:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1913 committed 00000004:00080000:0.0:1746129747.624172:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1971 committed 00000004:00080000:0.0:1746129747.624173:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1970 committed 00000004:00080000:0.0:1746129747.624174:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1912 committed 00000004:00080000:0.0:1746129747.624176:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1911 committed 00000004:00080000:0.0:1746129747.624178:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1969 committed 00000001:00080000:0.0:1746129747.624187:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943599 is committed 00000001:00080000:0.0:1746129747.624190:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943598 is committed 00000100:00100000:2.0:1746129747.624336:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053276928:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129747.624375:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129747.624394:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053277440:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129747.624409:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129747.624424:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746129747.624428:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136318a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053277312:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129747.624442:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129747.624451:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053277824:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129747.624463:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129747.624487:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053277056:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129747.624503:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129747.624514:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053277568:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129747.624525:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129747.624537:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746129747.624541:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053277184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129747.624555:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129747.624565:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053277696:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129747.624576:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129747.624596:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053276928 00000100:00100000:2.0:1746129747.624600:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053276928 00000100:00100000:2.0:1746129747.624630:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053277440 00000100:00100000:2.0:1746129747.624632:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053277440 00000100:00100000:2.0:1746129747.624640:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053277312 00000100:00100000:2.0:1746129747.624642:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053277312 00000100:00100000:2.0:1746129747.624650:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053277824 00000100:00100000:2.0:1746129747.624651:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053277824 00000100:00100000:2.0:1746129747.624670:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053277056 00000100:00100000:2.0:1746129747.624672:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053277056 00000100:00100000:2.0:1746129747.624678:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053277568 00000100:00100000:2.0:1746129747.624680:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053277568 00000100:00100000:2.0:1746129747.624685:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053277184 00000100:00100000:2.0:1746129747.624686:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053277184 00000100:00100000:2.0:1746129747.624690:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053277696 00000100:00100000:2.0:1746129747.624692:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053277696 00000100:00100000:2.0:1746129747.624700:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10737 00000100:00100000:2.0:1746129747.624705:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+76:3297:x1830949053276928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129747.624891:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+77:3297:x1830949053276928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 185us (515us total) trans 21474840262 rc 0/0 00000100:00100000:2.0:1746129747.624897:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10737 00000100:00100000:2.0:1746129747.624909:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10738 00000100:00100000:2.0:1746129747.624914:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+76:3297:x1830949053277440:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129747.624981:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746129747.624984:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746129747.624985:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746129747.624987:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746129747.624989:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746129747.625007:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+77:3297:x1830949053277440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (597us total) trans 21474840263 rc 0/0 00000100:00100000:2.0:1746129747.625012:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10738 00000100:00100000:2.0:1746129747.625021:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10739 00000100:00100000:2.0:1746129747.625026:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+76:3297:x1830949053277312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129747.625097:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+77:3297:x1830949053277312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (654us total) trans 21474840264 rc 0/0 00000100:00100000:2.0:1746129747.625102:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10739 00000100:00100000:2.0:1746129747.625112:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10740 00000100:00100000:2.0:1746129747.625116:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+76:3297:x1830949053277824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129747.625183:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+77:3297:x1830949053277824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (719us total) trans 21474840265 rc 0/0 00000100:00100000:2.0:1746129747.625187:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10740 00000100:00100000:2.0:1746129747.625199:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10741 00000100:00100000:2.0:1746129747.625202:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+76:3298:x1830949053277056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129747.625278:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+77:3298:x1830949053277056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (773us total) trans 21474840266 rc 0/0 00000100:00100000:2.0:1746129747.625283:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10741 00000100:00100000:2.0:1746129747.625292:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10742 00000100:00100000:2.0:1746129747.625296:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+76:3298:x1830949053277568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129747.625360:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+77:3298:x1830949053277568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (833us total) trans 21474840267 rc 0/0 00000100:00100000:2.0:1746129747.625364:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10742 00000100:00100000:2.0:1746129747.625373:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10743 00000100:00100000:2.0:1746129747.625377:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+76:3298:x1830949053277184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129747.625449:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+77:3298:x1830949053277184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (892us total) trans 21474840268 rc 0/0 00000100:00100000:2.0:1746129747.625453:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10743 00000100:00100000:2.0:1746129747.625462:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10744 00000100:00100000:2.0:1746129747.625466:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+76:3298:x1830949053277696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129747.625546:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+77:3298:x1830949053277696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (969us total) trans 21474840269 rc 0/0 00000100:00100000:2.0:1746129747.625551:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10744 00000004:00080000:2.0:1746129747.625593:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136319880/2, rc 0, transno 21474840268 00000100:00100000:2.0:1746129747.625598:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053277184:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129747.625604:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04f100/2, rc 0, transno 21474840269 00000100:00100000:2.0:1746129747.625607:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053277696:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129747.625612:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136319500/2, rc 0, transno 21474840266 00000100:00100000:2.0:1746129747.625614:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053277056:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129747.625620:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04d880/2, rc 0, transno 21474840267 00000100:00100000:2.0:1746129747.625622:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053277568:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129747.625634:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136318a80/2, rc 0, transno 21474840264 00000100:00100000:2.0:1746129747.625637:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136318a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053277312:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129747.625642:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b024700/2, rc 0, transno 21474840265 00000100:00100000:2.0:1746129747.625644:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053277824:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129747.625650:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013631bb80/2, rc 0, transno 21474840262 00000100:00100000:2.0:1746129747.625652:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053276928:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129747.625657:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136319180/2, rc 0, transno 21474840263 00000100:00100000:2.0:1746129747.625660:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053277440:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129747.626113:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053278336:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129747.626139:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129747.626153:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053278848:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129747.626165:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129747.626175:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746129747.626179:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053277952:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129747.626190:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129747.626199:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053278464:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129747.626208:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129747.626222:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053278336 00000100:00100000:3.0:1746129747.626225:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053278336 00000100:00100000:3.0:1746129747.626242:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053278848 00000100:00100000:3.0:1746129747.626244:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053278848 00000100:00100000:3.0:1746129747.626250:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053277952 00000100:00100000:3.0:1746129747.626252:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053277952 00000100:00100000:3.0:1746129747.626258:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053278464 00000100:00100000:3.0:1746129747.626260:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053278464 00000100:00100000:3.0:1746129747.626268:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10745 00000100:00100000:3.0:1746129747.626272:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+80:3296:x1830949053278336:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129747.626362:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129747.626364:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746129747.626366:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746129747.626368:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746129747.626369:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746129747.626390:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+81:3296:x1830949053278336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 117us (250us total) trans 17179873105 rc 0/0 00000100:00100000:3.0:1746129747.626395:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10745 00000100:00100000:3.0:1746129747.626406:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10746 00000100:00100000:3.0:1746129747.626410:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+80:3296:x1830949053278848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129747.626482:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+81:3296:x1830949053278848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (304us total) trans 17179873106 rc 0/0 00000100:00100000:3.0:1746129747.626486:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10746 00000100:00100000:3.0:1746129747.626494:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10747 00000100:00100000:3.0:1746129747.626498:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+80:3296:x1830949053277952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129747.626562:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+81:3296:x1830949053277952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (371us total) trans 17179873107 rc 0/0 00000100:00100000:3.0:1746129747.626566:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10747 00000100:00100000:3.0:1746129747.626573:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10748 00000100:00100000:3.0:1746129747.626576:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+80:3296:x1830949053278464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129747.626633:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+81:3296:x1830949053278464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (422us total) trans 17179873108 rc 0/0 00000100:00100000:3.0:1746129747.626637:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10748 00000004:00080000:3.0:1746129747.626664:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c5180/2, rc 0, transno 17179873107 00000100:00100000:3.0:1746129747.626671:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053277952:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129747.626677:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c5f80/2, rc 0, transno 17179873108 00000100:00100000:3.0:1746129747.626679:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053278464:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129747.626685:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c5c00/2, rc 0, transno 17179873105 00000100:00100000:3.0:1746129747.626687:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053278336:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129747.626692:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c6a00/2, rc 0, transno 17179873106 00000100:00100000:3.0:1746129747.626694:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053278848:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1746129747.627302:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746129747.627306:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746129747.627426:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129747.627527:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052114944 00000100:00100000:0.0:1746129747.627531:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052114944 00000100:00100000:0.0:1746129747.627562:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9829 00000100:00100000:0.0:1746129747.627567:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+7:28503:x1830949052114944:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129747.627581:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129747.627593:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e400/0x48868a4e43948e12 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f1f8 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129747.627629:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e400/0x48868a4e43948e12 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1f8 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129747.627640:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e400/0x48868a4e43948e12 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1f8 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129747.627652:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129747.627654:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129747.627656:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6e400, rc 0) 00000100:00100000:0.0:1746129747.627682:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:28503:x1830949052114944:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 115us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129747.627687:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9829 00000100:00100000:3.0:1746129747.628021:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053278976:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129747.628048:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129747.628146:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053278976 00000100:00100000:0.0:1746129747.628150:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053278976 00000100:00100000:0.0:1746129747.628173:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10749 00000100:00100000:0.0:1746129747.628178:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+81:3297:x1830949053278976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129747.628288:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+82:3297:x1830949053278976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (238us total) trans 17179873109 rc 0/0 00000100:00100000:0.0:1746129747.628294:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10749 00000004:00080000:3.0:1746129747.628393:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c6d80/2, rc 0, transno 17179873109 00000100:00100000:3.0:1746129747.628398:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053278976:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129747.628565:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053278208:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129747.628587:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129747.629210:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053278080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129747.630450:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053278208 00000100:00100000:0.0:1746129747.630456:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053278208 00000100:00100000:2.0:1746129747.630523:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053278720:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129747.630549:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129747.630575:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053278720 00000100:00100000:2.0:1746129747.630578:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053278720 00000100:00100000:2.0:1746129747.630602:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10750 00000100:00100000:2.0:1746129747.630607:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+83:3299:x1830949053278720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129747.630749:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+84:3299:x1830949053278720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 142us (199us total) trans 17179873110 rc 0/0 00000100:00100000:2.0:1746129747.630755:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10750 00000004:00080000:2.0:1746129747.630807:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c6680/2, rc 0, transno 17179873110 00000100:00100000:2.0:1746129747.630812:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053278720:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129747.631082:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129747.631307:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053278592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129747.631325:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129747.631589:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053278080 00000100:00100000:1.0:1746129747.631593:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053278080 00000100:00100000:3.0:1746129747.631659:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053278592 00000100:00100000:3.0:1746129747.631663:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053278592 00000100:00100000:3.0:1746129747.631680:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10751 00000100:00100000:3.0:1746129747.631685:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+85:3299:x1830949053278208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129747.631799:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+86:3299:x1830949053278208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 113us (3210us total) trans 17179873111 rc 0/0 00000100:00100000:3.0:1746129747.631804:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10751 00000100:00100000:3.0:1746129747.631815:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10752 00000100:00100000:3.0:1746129747.631819:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+85:3298:x1830949053278080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129747.631922:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+86:3298:x1830949053278080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (839us total) trans 17179873112 rc 0/0 00000100:00100000:3.0:1746129747.631928:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10752 00000100:00100000:3.0:1746129747.631937:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10753 00000100:00100000:3.0:1746129747.631942:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+85:3298:x1830949053278592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129747.632012:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+86:3298:x1830949053278592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (686us total) trans 17179873113 rc 0/0 00000100:00100000:3.0:1746129747.632018:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10753 00000100:00100000:2.0:1746129747.632288:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000004:00080000:2.0:1746129747.632316:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c5880/2, rc 0, transno 17179873111 00000100:00100000:2.0:1746129747.632320:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053278208:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129747.632601:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c5500/2, rc 0, transno 17179873112 00000100:00100000:1.0:1746129747.632605:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053278080:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129747.632613:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c6300/2, rc 0, transno 17179873113 00000100:00100000:1.0:1746129747.632615:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053278592:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129747.633064:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052115072 00000100:00100000:3.0:1746129747.633068:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052115072 00000100:00100000:3.0:1746129747.633101:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9830 00000100:00100000:3.0:1746129747.633106:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28503:x1830949052115072:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129747.633118:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129747.633130:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c400/0x48868a4e43948e19 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f1ff expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.633185:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c000/0x48868a4e43948e20 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.633196:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c000/0x48868a4e43948e20 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.633205:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c000/0x48868a4e43948e20 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129747.633225:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:3.0:1746129747.633228:0:14315:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129747.633239:0:14315:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c000/0x48868a4e43948e20 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129747.633257:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c400/0x48868a4e43948e19 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ff expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.633268:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c000/0x48868a4e43948e20 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ff expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129747.633275:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129747.633277:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129747.633280:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a14c000, rc 0) 00000100:00100000:3.0:1746129747.633308:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:28503:x1830949052115072:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 202us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129747.633313:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9830 00000100:00100000:0.0:1746129747.636261:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129747.636316:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052115200 00000100:00100000:1.0:1746129747.636324:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052115200 00000100:00100000:1.0:1746129747.636515:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10754 00000100:00100000:1.0:1746129747.636522:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+18:1962:x1830949052115200:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129747.636537:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129747.636552:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00a8600/0x48868a4e43948e27 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f206 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129747.636572:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e8:0x0] initial LVB size: 1048576, mtime: 0x6813d353, atime: 0x6813d353, ctime: 0x6813d353, blocks: 0x807 00010000:00010000:1.0:1746129747.636586:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129747.636588:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129747.636595:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00a8600/0x48868a4e43948e27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f206 expref: 19 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129747.636607:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00a8600/0x48868a4e43948e27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f206 expref: 19 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129747.636615:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00a8600, rc 0) 00000100:00100000:1.0:1746129747.636665:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+19:1962:x1830949052115200:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 142us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129747.636670:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10754 00000100:00100000:0.0:1746129747.640558:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129747.640593:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129747.640617:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129747.640644:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129747.640708:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129747.640730:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052115456 00000100:00100000:0.0:1746129747.640736:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052115456 00000100:00100000:0.0:1746129747.640769:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052115328 00000100:00100000:0.0:1746129747.640772:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052115328 00000100:00100000:0.0:1746129747.640781:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052115584 00000100:00100000:0.0:1746129747.640782:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052115584 00000100:00100000:0.0:1746129747.640790:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052115712 00000100:00100000:0.0:1746129747.640791:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052115712 00000100:00100000:0.0:1746129747.640798:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052115840 00000100:00100000:0.0:1746129747.640799:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052115840 00000100:00100000:0.0:1746129747.640811:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10755 00000100:00100000:0.0:1746129747.640816:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+20:1961:x1830949052115456:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129747.640832:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129747.640867:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb6fe00/0x48868a4e43948e2e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f214 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129747.640890:0:7975:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e7:0x0] initial LVB size: 2097152, mtime: 0x6813d353, atime: 0x6813d353, ctime: 0x6813d353, blocks: 0x821 00010000:00010000:0.0:1746129747.640905:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129747.640907:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129747.640914:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6fe00/0x48868a4e43948e2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f214 expref: 21 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129747.640928:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb6fe00/0x48868a4e43948e2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f214 expref: 21 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129747.640937:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6fe00, rc 0) 00000100:00100000:0.0:1746129747.640974:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+21:1961:x1830949052115456:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 157us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129747.640979:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10755 00000100:00100000:0.0:1746129747.640993:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10756 00000100:00100000:0.0:1746129747.640997:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+20:1962:x1830949052115328:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129747.641003:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129747.641010:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f600/0x48868a4e43948e35 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f20d expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129747.641019:0:7975:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e6:0x0] initial LVB size: 2097152, mtime: 0x6813d353, atime: 0x6813d353, ctime: 0x6813d353, blocks: 0x81f 00010000:00010000:0.0:1746129747.641026:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129747.641027:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129747.641031:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f600/0x48868a4e43948e35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f20d expref: 21 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129747.641038:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f600/0x48868a4e43948e35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f20d expref: 21 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129747.641044:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6f600, rc 0) 00000100:00100000:0.0:1746129747.641060:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+21:1962:x1830949052115328:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 62us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129747.641068:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10756 00000100:00100000:0.0:1746129747.641077:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10757 00000100:00100000:0.0:1746129747.641081:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+20:1962:x1830949052115584:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129747.641086:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129747.641095:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f400/0x48868a4e43948e3c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f21b expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129747.641108:0:7975:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3ea:0x0] initial LVB size: 2097152, mtime: 0x6813d353, atime: 0x6813d353, ctime: 0x6813d353, blocks: 0x81f 00010000:00010000:0.0:1746129747.641116:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129747.641117:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129747.641121:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f400/0x48868a4e43948e3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f21b expref: 21 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129747.641131:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f400/0x48868a4e43948e3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f21b expref: 21 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129747.641137:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6f400, rc 0) 00000100:00100000:0.0:1746129747.641152:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+21:1962:x1830949052115584:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 70us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129747.641156:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10757 00000100:00100000:0.0:1746129747.641165:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10758 00000100:00100000:0.0:1746129747.641169:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+20:1961:x1830949052115712:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129747.641175:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129747.641181:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f800/0x48868a4e43948e43 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f222 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129747.641195:0:7975:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3eb:0x0] initial LVB size: 4960928, mtime: 0x6813d354, atime: 0x6813d353, ctime: 0x6813d354, blocks: 0x1629 00010000:00010000:0.0:1746129747.641202:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129747.641203:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129747.641207:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f800/0x48868a4e43948e43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f222 expref: 21 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129747.641214:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f800/0x48868a4e43948e43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f222 expref: 21 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129747.641220:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6f800, rc 0) 00000100:00100000:2.0:1746129747.641230:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10759 00000100:00100000:0.0:1746129747.641235:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+21:1961:x1830949052115712:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 65us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129747.641236:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+20:1962:x1830949052115840:12345-192.168.204.31@tcp:101:mirror_io.0 00000100:00100000:0.0:1746129747.641239:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10758 00010000:00010000:2.0:1746129747.641242:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129747.641250:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136a84800/0x48868a4e43948e4a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f229 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129747.641261:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e8:0x0] initial LVB size: 4194304, mtime: 0x6813d354, atime: 0x6813d353, ctime: 0x6813d354, blocks: 0x1029 00010000:00010000:2.0:1746129747.641268:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129747.641269:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129747.641273:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136a84800/0x48868a4e43948e4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f229 expref: 21 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129747.641281:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136a84800/0x48868a4e43948e4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f229 expref: 21 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129747.641287:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a84800, rc 0) 00000100:00100000:2.0:1746129747.641304:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+21:1962:x1830949052115840:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 68us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129747.641308:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10759 00010000:00010000:2.0:1746129748.021062:0:12137:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129748.372725:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129748.372775:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129748.375012:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052116096 00000100:00100000:0.0:1746129748.375020:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129748.375023:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052116096 00000100:00100000:1.0:1746129748.375418:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052116224 00000100:00100000:1.0:1746129748.375421:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052116224 00000100:00100000:1.0:1746129748.375439:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 282 00000100:00100000:1.0:1746129748.375446:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949052116096:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1746129748.375506:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 283 00000100:00100000:1.0:1746129748.375522:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949052116096:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 76us (2804us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129748.375528:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 282 00000100:00100000:1.0:1746129748.375651:0:14311:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052115968 00000100:00100000:1.0:1746129748.375655:0:14311:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052115968 00000100:00100000:1.0:1746129748.375673:0:14311:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 165 00000100:00100000:1.0:1746129748.375677:0:14311:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5278c6ae-40e3-4880-9941-e4a223d3f965+15:1962:x1830949052115968:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1746129748.375697:0:14311:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5278c6ae-40e3-4880-9941-e4a223d3f965+15:1962:x1830949052115968:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 20us (2922us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129748.375701:0:14311:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 165 00000100:00100000:3.0:1746129748.375913:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052116224:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1746129748.376560:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052116224:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 1045us (1542us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129748.376567:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 283 00000100:00100000:0.0:1746129748.650021:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129748.650503:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052116480 00000100:00100000:2.0:1746129748.650512:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052116480 00000100:00100000:2.0:1746129748.650818:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3960 00000100:00100000:2.0:1746129748.650826:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6141239f-0c60-480d-830c-e22ba61457b0+21:1962:x1830949052116480:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:2.0:1746129748.650903:0:21604:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880136a84400/0x48868a4e43948e51 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.650916:0:21604:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129748.650917:0:21604:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129748.650922:0:21604:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136a84400/0x48868a4e43948e51 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.650932:0:21604:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136a84400/0x48868a4e43948e51 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129748.657429:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129748.659578:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129748.661506:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052116992 00000100:00100000:1.0:1746129748.661516:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052116992 00000100:00100000:1.0:1746129748.661574:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3961 00000100:00100000:1.0:1746129748.661581:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6141239f-0c60-480d-830c-e22ba61457b0+23:1961:x1830949052116992:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:1.0:1746129748.661609:0:21601:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a00a9c00/0x48868a4e43948e58 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129748.661620:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129748.661621:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129748.661625:0:21601:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00a9c00/0x48868a4e43948e58 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129748.661636:0:21601:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00a9c00/0x48868a4e43948e58 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129748.664685:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129748.664701:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129748.664712:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129748.664730:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129748.664748:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129748.664776:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052116864 00000100:00100000:0.0:1746129748.664782:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052116864 00000100:00100000:0.0:1746129748.664818:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052117120 00000100:00100000:0.0:1746129748.664820:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052117120 00000100:00100000:0.0:1746129748.664829:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052117504 00000100:00100000:0.0:1746129748.664830:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052117504 00000100:00100000:0.0:1746129748.664838:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052117760 00000100:00100000:0.0:1746129748.664840:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052117760 00000100:00100000:0.0:1746129748.664845:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052117376 00000100:00100000:0.0:1746129748.664865:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052117376 00000100:00100000:0.0:1746129748.664875:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052117632 00000100:00100000:0.0:1746129748.664877:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052117632 00000100:00100000:0.0:1746129748.664887:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3962 00000100:00100000:0.0:1746129748.664894:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135400e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6141239f-0c60-480d-830c-e22ba61457b0+26:1961:x1830949052116864:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:0.0:1746129748.664920:0:25617:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e000/0x48868a4e43948e5f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.664932:0:25617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129748.664934:0:25617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129748.664937:0:25617:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e000/0x48868a4e43948e5f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.664949:0:25617:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e000/0x48868a4e43948e5f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129748.665357:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3963 00000100:00100000:3.0:1746129748.665366:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6141239f-0c60-480d-830c-e22ba61457b0+26:1961:x1830949052117120:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:3.0:1746129748.665383:0:8440:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a14c800/0x48868a4e43948e66 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.665391:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129748.665392:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129748.665396:0:8440:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a14c800/0x48868a4e43948e66 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.665404:0:8440:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a14c800/0x48868a4e43948e66 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129748.665932:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3964 00000100:00100000:0.0:1746129748.665939:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6141239f-0c60-480d-830c-e22ba61457b0+24:1961:x1830949052117504:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:0.0:1746129748.665955:0:21602:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e43948e6d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.665963:0:21602:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129748.665964:0:21602:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129748.665967:0:21602:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e43948e6d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.665974:0:21602:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e43948e6d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129748.667106:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3965 00000100:00100000:3.0:1746129748.667115:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6141239f-0c60-480d-830c-e22ba61457b0+25:1961:x1830949052117760:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:3.0:1746129748.667135:0:21599:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a14d800/0x48868a4e43948e74 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.667144:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129748.667145:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129748.667149:0:21599:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a14d800/0x48868a4e43948e74 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.667158:0:21599:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a14d800/0x48868a4e43948e74 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129748.667951:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3966 00000100:00100000:2.0:1746129748.667960:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135401c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6141239f-0c60-480d-830c-e22ba61457b0+26:1961:x1830949052117376:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:2.0:1746129748.667980:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880136a86400/0x48868a4e43948e7b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.667989:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129748.667990:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129748.667992:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136a86400/0x48868a4e43948e7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.668001:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136a86400/0x48868a4e43948e7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129748.668118:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3967 00000100:00100000:3.0:1746129748.668125:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6141239f-0c60-480d-830c-e22ba61457b0+26:1961:x1830949052117632:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:3.0:1746129748.668141:0:21605:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a14da00/0x48868a4e43948e82 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.668147:0:21605:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129748.668148:0:21605:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129748.668152:0:21605:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a14da00/0x48868a4e43948e82 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.668159:0:21605:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a14da00/0x48868a4e43948e82 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.678541:0:21604:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880136a84400/0x48868a4e43948e51 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.678557:0:21604:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136a84400/0x48868a4e43948e51 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.678569:0:21604:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136a84400/0x48868a4e43948e51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.678575:0:21604:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136a84400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129748.678579:0:21604:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136a84400/0x48868a4e43948e51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.678585:0:21604:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136a84400/0x48868a4e43948e51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.678601:0:21604:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136a84400/0x48868a4e43948e51 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.678606:0:21604:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136a84400/0x48868a4e43948e51 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129748.680191:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6141239f-0c60-480d-830c-e22ba61457b0+27:1962:x1830949052116480:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 29359us (30169us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129748.680202:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3960 00010000:00010000:0.0:1746129748.680734:0:21601:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a00a9c00/0x48868a4e43948e58 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.680745:0:21601:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00a9c00/0x48868a4e43948e58 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.680752:0:21601:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a00a9c00/0x48868a4e43948e58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.680757:0:21601:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a00a9c00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129748.680760:0:21601:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a00a9c00/0x48868a4e43948e58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.680766:0:21601:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a00a9c00/0x48868a4e43948e58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.680778:0:21601:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a00a9c00/0x48868a4e43948e58 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.680784:0:21601:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00a9c00/0x48868a4e43948e58 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129748.681986:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6141239f-0c60-480d-830c-e22ba61457b0+25:1961:x1830949052116992:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 20401us (24560us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129748.681995:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3961 00010000:00010000:0.0:1746129748.689623:0:25617:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e000/0x48868a4e43948e5f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.689637:0:25617:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e000/0x48868a4e43948e5f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.689643:0:25617:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e000/0x48868a4e43948e5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.689649:0:25617:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb6e000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129748.689653:0:25617:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e000/0x48868a4e43948e5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.689659:0:25617:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e000/0x48868a4e43948e5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.689675:0:25617:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e000/0x48868a4e43948e5f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.689681:0:25617:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e000/0x48868a4e43948e5f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129748.689790:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135400e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6141239f-0c60-480d-830c-e22ba61457b0+23:1961:x1830949052116864:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 24891us (30216us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129748.689800:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3962 00010000:00010000:1.0:1746129748.696896:0:21602:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e43948e6d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129748.696909:0:21602:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e43948e6d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129748.696916:0:21602:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e43948e6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129748.696921:0:21602:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb6e800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129748.696925:0:21602:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e43948e6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129748.696931:0:21602:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e43948e6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129748.696947:0:21602:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e43948e6d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129748.696964:0:21602:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e43948e6d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129748.697044:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6141239f-0c60-480d-830c-e22ba61457b0+27:1961:x1830949052117504:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 31101us (32337us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129748.697054:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3964 00010000:00010000:3.0:1746129748.701412:0:8440:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a14c800/0x48868a4e43948e66 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.701426:0:8440:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a14c800/0x48868a4e43948e66 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.701433:0:8440:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a14c800/0x48868a4e43948e66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.701438:0:8440:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a14c800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129748.701442:0:8440:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a14c800/0x48868a4e43948e66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.701448:0:8440:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a14c800/0x48868a4e43948e66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.701473:0:8440:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a14c800/0x48868a4e43948e66 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.701479:0:8440:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a14c800/0x48868a4e43948e66 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129748.701539:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6141239f-0c60-480d-830c-e22ba61457b0+21:1961:x1830949052117120:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 36171us (36857us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129748.701548:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3963 00010000:00010000:3.0:1746129748.710199:0:21599:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a14d800/0x48868a4e43948e74 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.710214:0:21599:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a14d800/0x48868a4e43948e74 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.710221:0:21599:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a14d800/0x48868a4e43948e74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.710227:0:21599:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a14d800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129748.710232:0:21599:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a14d800/0x48868a4e43948e74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.710243:0:21599:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a14d800/0x48868a4e43948e74 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.710258:0:21599:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a14d800/0x48868a4e43948e74 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.710263:0:21599:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a14d800/0x48868a4e43948e74 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129748.710348:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6141239f-0c60-480d-830c-e22ba61457b0+25:1961:x1830949052117760:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 43231us (45630us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129748.710357:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3965 00010000:00010000:3.0:1746129748.712971:0:21605:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a14da00/0x48868a4e43948e82 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.712985:0:21605:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a14da00/0x48868a4e43948e82 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.712992:0:21605:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a14da00/0x48868a4e43948e82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.712997:0:21605:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a14da00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129748.713000:0:21605:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a14da00/0x48868a4e43948e82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.713006:0:21605:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a14da00/0x48868a4e43948e82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.713020:0:21605:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a14da00/0x48868a4e43948e82 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.713026:0:21605:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a14da00/0x48868a4e43948e82 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129748.713096:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6141239f-0c60-480d-830c-e22ba61457b0+23:1961:x1830949052117632:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 44967us (48342us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129748.713106:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3967 00010000:00010000:2.0:1746129748.722084:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880136a86400/0x48868a4e43948e7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.722100:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136a86400/0x48868a4e43948e7b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.722107:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136a86400/0x48868a4e43948e7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.722117:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136a86400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129748.722120:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136a86400/0x48868a4e43948e7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.722126:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136a86400/0x48868a4e43948e7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.722140:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136a86400/0x48868a4e43948e7b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.722144:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136a86400/0x48868a4e43948e7b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129748.723422:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135401c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6141239f-0c60-480d-830c-e22ba61457b0+21:1961:x1830949052117376:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 55458us (58684us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129748.723431:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3966 00000100:00100000:0.0:1746129748.732080:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129748.732169:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052118016 00000100:00100000:2.0:1746129748.732176:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052118016 00000100:00100000:2.0:1746129748.732227:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 559 00000100:00100000:2.0:1746129748.732234:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135402300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+9:28503:x1830949052118016:12345-192.168.204.31@tcp:103:mirror_io.0 00010000:00010000:2.0:1746129748.732246:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129748.732265:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd42800/0x48868a4e43948dcc lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ea expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.732307:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129748.732311:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129748.732345:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135402300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+8:28503:x1830949052118016:12345-192.168.204.31@tcp:103:mirror_io.0 Request processed in 112us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129748.732351:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 559 00000100:00100000:1.0:1746129748.733661:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129748.733712:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052118272 00000100:00100000:3.0:1746129748.733717:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052118272 00000100:00100000:3.0:1746129748.733751:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3850 00000100:00100000:3.0:1746129748.733760:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+8:28503:x1830949052118272:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:3.0:1746129748.733974:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:28503:x1830949052118272:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 214us (314us total) trans 8589943603 rc 0/0 00000100:00100000:3.0:1746129748.733979:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3850 00000100:00100000:0.0:1746129748.735579:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129748.735655:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052118528 00000100:00100000:2.0:1746129748.735660:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052118528 00000100:00100000:2.0:1746129748.735697:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3851 00000100:00100000:2.0:1746129748.735703:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:28503:x1830949052118528:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:2.0:1746129748.736283:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6141239f-0c60-480d-830c-e22ba61457b0+10:28503:x1830949052118528:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 578us (706us total) trans 8589943604 rc 0/0 00000100:00100000:2.0:1746129748.736289:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3851 00000100:00100000:0.0:1746129748.764080:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129748.764146:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052118784 00000100:00100000:1.0:1746129748.764154:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052118784 00000100:00100000:1.0:1746129748.764234:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9831 00000100:00100000:1.0:1746129748.764241:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e191c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+281:28517:x1830949052118784:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129748.764261:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129748.764276:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b3400/0x48868a4e43948e89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f230 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129748.764361:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2a00/0x48868a4e43948e90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129748.764371:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2a00/0x48868a4e43948e90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129748.764380:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2a00/0x48868a4e43948e90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129748.764390:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2800/0x48868a4e43948e97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129748.764395:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2800/0x48868a4e43948e97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129748.764400:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2800/0x48868a4e43948e97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129748.764517:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2600/0x48868a4e43948e9e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129748.764524:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2600/0x48868a4e43948e9e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129748.764529:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2600/0x48868a4e43948e9e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:1.0:1746129748.764540:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129748.764608:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2a00/0x48868a4e43948e90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129748.764614:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2a00/0x48868a4e43948e90 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129748.764618:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2a00/0x48868a4e43948e90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129748.764622:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a80b2a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129748.764625:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2a00/0x48868a4e43948e90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129748.764630:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2a00/0x48868a4e43948e90 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129748.764638:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129748.764640:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129748.764643:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2a00/0x48868a4e43948e90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129748.764647:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2a00/0x48868a4e43948e90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129748.764673:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2800/0x48868a4e43948e97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129748.764678:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2800/0x48868a4e43948e97 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129748.764682:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2800/0x48868a4e43948e97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129748.764689:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a80b2800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129748.764691:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2800/0x48868a4e43948e97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129748.764695:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2800/0x48868a4e43948e97 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129748.764701:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009b251600) 00010000:00010000:1.0:1746129748.764702:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129748.764705:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2800/0x48868a4e43948e97 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129748.764709:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2800/0x48868a4e43948e97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129748.764740:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b3400/0x48868a4e43948e89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f230 expref: 284 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129748.764749:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2600/0x48868a4e43948e9e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f230 expref: 283 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129748.764754:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129748.764756:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129748.764758:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a80b2600, rc 0) 00000100:00100000:1.0:1746129748.764805:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e191c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28517:x1830949052118784:12345-192.168.204.31@tcp:101:cat.0 Request processed in 564us (732us total) trans 8589943605 rc 0/0 00000100:00100000:1.0:1746129748.764811:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9831 00000100:00100000:0.0:1746129748.770518:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129748.770578:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052119040 00000100:00100000:3.0:1746129748.770586:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052119040 00000100:00100000:3.0:1746129748.770636:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9832 00000100:00100000:3.0:1746129748.770645:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:28513:x1830949052119040:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129748.770663:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129748.770677:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14da00/0x48868a4e43948eac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f237 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.770764:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14d800/0x48868a4e43948eb3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129748.770776:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14d800/0x48868a4e43948eb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129748.770784:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14d800/0x48868a4e43948eb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129748.770795:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c800/0x48868a4e43948eba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129748.770800:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c800/0x48868a4e43948eba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129748.770805:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c800/0x48868a4e43948eba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129748.770913:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c400/0x48868a4e43948ec1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129748.770920:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c400/0x48868a4e43948ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129748.770926:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c400/0x48868a4e43948ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129748.770933:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129748.770992:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14d800/0x48868a4e43948eb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129748.770998:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14d800/0x48868a4e43948eb3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129748.771002:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14d800/0x48868a4e43948eb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129748.771010:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a14d800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129748.771013:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14d800/0x48868a4e43948eb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129748.771018:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14d800/0x48868a4e43948eb3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129748.771026:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129748.771029:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129748.771031:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14d800/0x48868a4e43948eb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129748.771036:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14d800/0x48868a4e43948eb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129748.771061:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c800/0x48868a4e43948eba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129748.771065:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c800/0x48868a4e43948eba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129748.771070:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c800/0x48868a4e43948eba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129748.771073:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a14c800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129748.771076:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c800/0x48868a4e43948eba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129748.771080:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c800/0x48868a4e43948eba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129748.771086:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f581100) 00010000:00010000:3.0:1746129748.771088:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129748.771091:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c800/0x48868a4e43948eba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129748.771095:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c800/0x48868a4e43948eba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129748.771124:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14da00/0x48868a4e43948eac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f237 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.771133:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c400/0x48868a4e43948ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f237 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.771137:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129748.771139:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129748.771141:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a14c400, rc 0) 00000100:00100000:3.0:1746129748.771188:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28513:x1830949052119040:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 543us (677us total) trans 8589943606 rc 0/0 00000100:00100000:3.0:1746129748.771194:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9832 00000100:00100000:0.0:1746129748.780109:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129748.780144:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129748.780174:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129748.780185:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129748.780195:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129748.780203:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052119168 00000100:00100000:0.0:1746129748.780209:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052119424 00000100:00100000:3.0:1746129748.780210:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052119168 00000100:00100000:0.0:1746129748.780212:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052119424 00000100:00100000:0.0:1746129748.780242:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052119680 00000100:00100000:0.0:1746129748.780244:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052119680 00000100:00100000:3.0:1746129748.780246:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052119296 00000100:00100000:3.0:1746129748.780247:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052119296 00000100:00100000:0.0:1746129748.780256:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10760 00000100:00100000:3.0:1746129748.780265:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10761 00000100:00100000:0.0:1746129748.780265:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949052119424:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:3.0:1746129748.780269:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1963:x1830949052119168:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129748.780279:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129748.780279:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129748.780293:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43948ecf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f23e expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.780293:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fb66600/0x48868a4e43948ed6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f24c expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.780309:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129748.780309:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129748.780311:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129748.780311:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129748.780318:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43948ecf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f23e expref: 31 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129748.780318:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb66600/0x48868a4e43948ed6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f24c expref: 28 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129748.780330:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43948ecf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f23e expref: 31 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129748.780330:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fb66600/0x48868a4e43948ed6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f24c expref: 28 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129748.780338:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a14d600, rc 0) 00010000:00010000:0.0:1746129748.780338:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fb66600, rc 0) 00000100:00100000:3.0:1746129748.780368:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949052119168:12345-192.168.204.31@tcp:101:cat.0 Request processed in 98us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129748.780368:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1963:x1830949052119424:12345-192.168.204.31@tcp:101:cat.0 Request processed in 106us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129748.780374:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10761 00000100:00100000:0.0:1746129748.780469:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10760 00000100:00100000:3.0:1746129748.780473:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10762 00000100:00100000:3.0:1746129748.780478:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1963:x1830949052119680:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:0.0:1746129748.780480:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10763 00010000:00010000:3.0:1746129748.780484:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129748.780484:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949052119296:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129748.780488:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129748.780489:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a14d200/0x48868a4e43948edd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f25a expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.780492:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fb67600/0x48868a4e43948ee4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f245 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.780499:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129748.780499:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129748.780500:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129748.780501:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129748.780504:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a14d200/0x48868a4e43948edd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f25a expref: 31 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129748.780504:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb67600/0x48868a4e43948ee4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f245 expref: 28 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129748.780512:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a14d200/0x48868a4e43948edd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f25a expref: 31 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129748.780512:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fb67600/0x48868a4e43948ee4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f245 expref: 28 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129748.780518:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a14d200, rc 0) 00010000:00010000:0.0:1746129748.780518:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fb67600, rc 0) 00000100:00100000:3.0:1746129748.780531:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949052119680:12345-192.168.204.31@tcp:101:cat.0 Request processed in 54us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129748.780537:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1963:x1830949052119296:12345-192.168.204.31@tcp:101:cat.0 Request processed in 53us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129748.780539:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10762 00000100:00100000:0.0:1746129748.780541:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10763 00000100:00100000:0.0:1746129748.780566:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129748.780582:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052119552 00000100:00100000:3.0:1746129748.780585:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052119552 00000100:00100000:0.0:1746129748.780591:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052120064 00000100:00100000:0.0:1746129748.780594:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052120064 00000100:00100000:3.0:1746129748.780596:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10764 00000100:00100000:3.0:1746129748.780600:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949052119552:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129748.780606:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129748.780611:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9833 00010000:00010000:3.0:1746129748.780612:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a14c600/0x48868a4e43948eeb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f253 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129748.780615:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28518:x1830949052120064:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129748.780620:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129748.780621:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129748.780625:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a14c600/0x48868a4e43948eeb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f253 expref: 32 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129748.780625:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129748.780632:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a14c600/0x48868a4e43948eeb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f253 expref: 32 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129748.780633:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66c00/0x48868a4e43948ef2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f268 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.780638:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a14c600, rc 0) 00000100:00100000:3.0:1746129748.780651:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1963:x1830949052119552:12345-192.168.204.31@tcp:101:cat.0 Request processed in 51us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129748.780656:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10764 00000100:00100000:3.0:1746129748.780693:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129748.780700:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43948ef9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00000100:00100000:3.0:1746129748.780702:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052119808 00000100:00100000:3.0:1746129748.780705:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052119808 00010000:00010000:0.0:1746129748.780710:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c000/0x48868a4e43948e20 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ff expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129748.780717:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10765 00010000:00010000:0.0:1746129748.780717:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2600/0x48868a4e43948e9e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f230 expref: 284 pid: 1851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129748.780721:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1963:x1830949052119808:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129748.780723:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c400/0x48868a4e43948ec1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f237 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.780728:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129748.780728:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43948ef9 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129748.780734:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e43948f00 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f261 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.780742:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129748.780743:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129748.780747:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e43948f00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f261 expref: 29 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129748.780747:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c400/0x48868a4e43948ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f237 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.780755:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e43948f00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f261 expref: 29 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129748.780756:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c400/0x48868a4e43948ec1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f237 expref: 8 pid: 14315 timeout: 794 lvb_type: 0 00010000:00010000:3.0:1746129748.780761:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c840c00, rc 0) 00000100:00100000:0.0:1746129748.780765:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053279104:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129748.780773:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1963:x1830949052119808:12345-192.168.204.31@tcp:101:cat.0 Request processed in 52us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129748.780777:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10765 00010000:00010000:0.0:1746129748.780808:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2600/0x48868a4e43948e9e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f230 expref: 284 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.780815:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2600/0x48868a4e43948e9e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f230 expref: 284 pid: 1851 timeout: 794 lvb_type: 0 00000100:00100000:0.0:1746129748.780826:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053279232:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129748.780873:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c000/0x48868a4e43948e20 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ff expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.780880:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c000/0x48868a4e43948e20 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ff expref: 9 pid: 14315 timeout: 794 lvb_type: 0 00000100:00100000:0.0:1746129748.780886:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053279360:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129748.780915:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129748.781774:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129748.781785:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129748.781797:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129748.781818:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129748.781828:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129748.781837:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052120320 00000100:00100000:0.0:1746129748.781840:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052120320 00000100:00100000:0.0:1746129748.781869:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052120576 00000100:00100000:0.0:1746129748.781870:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052120576 00000100:00100000:0.0:1746129748.781877:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052120832 00000100:00100000:0.0:1746129748.781878:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052120832 00000100:00100000:0.0:1746129748.781884:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052120192 00000100:00100000:0.0:1746129748.781885:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052120192 00000100:00100000:0.0:1746129748.781891:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052120448 00000100:00100000:0.0:1746129748.781892:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052120448 00000100:00100000:0.0:1746129748.781901:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10766 00000100:00100000:0.0:1746129748.781906:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1964:x1830949052120320:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129748.781913:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129748.781920:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c12c800/0x48868a4e43948f07 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f276 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.781930:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129748.781932:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129748.781936:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c12c800/0x48868a4e43948f07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f276 expref: 20 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129748.781944:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c12c800/0x48868a4e43948f07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f276 expref: 20 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129748.781950:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c12c800, rc 0) 00000100:00100000:0.0:1746129748.781966:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949052120320:12345-192.168.204.31@tcp:101:cat.0 Request processed in 60us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129748.781970:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10766 00000100:00100000:0.0:1746129748.781978:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10767 00000100:00100000:0.0:1746129748.781981:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949052120576:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129748.781986:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129748.781991:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c12d200/0x48868a4e43948f0e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f284 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.781998:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129748.781999:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129748.782002:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c12d200/0x48868a4e43948f0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f284 expref: 21 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129748.782009:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c12d200/0x48868a4e43948f0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f284 expref: 21 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129748.782019:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c12d200, rc 0) 00000100:00100000:0.0:1746129748.782028:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1964:x1830949052120576:12345-192.168.204.31@tcp:101:cat.0 Request processed in 46us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129748.782032:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10767 00000100:00100000:0.0:1746129748.782037:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10768 00000100:00100000:0.0:1746129748.782040:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a342450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1964:x1830949052120832:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129748.782044:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129748.782048:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c12d000/0x48868a4e43948f15 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f292 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.782054:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129748.782055:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129748.782058:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c12d000/0x48868a4e43948f15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f292 expref: 20 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129748.782064:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c12d000/0x48868a4e43948f15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f292 expref: 20 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129748.782069:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c12d000, rc 0) 00000100:00100000:0.0:1746129748.782077:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a342450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949052120832:12345-192.168.204.31@tcp:101:cat.0 Request processed in 37us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129748.782081:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10768 00000100:00100000:0.0:1746129748.782159:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10769 00000100:00100000:0.0:1746129748.782163:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949052120192:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129748.782169:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129748.782174:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c12ce00/0x48868a4e43948f1c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f26f expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.782182:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129748.782183:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129748.782187:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c12ce00/0x48868a4e43948f1c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f26f expref: 21 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129748.782194:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c12ce00/0x48868a4e43948f1c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f26f expref: 21 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129748.782199:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c12ce00, rc 0) 00000100:00100000:0.0:1746129748.782215:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1964:x1830949052120192:12345-192.168.204.31@tcp:101:cat.0 Request processed in 52us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129748.782219:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10769 00000100:00100000:0.0:1746129748.782227:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10770 00000100:00100000:0.0:1746129748.782231:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1964:x1830949052120448:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129748.782235:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129748.782240:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c12cc00/0x48868a4e43948f23 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f27d expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.782247:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129748.782248:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129748.782251:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c12cc00/0x48868a4e43948f23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f27d expref: 20 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129748.782258:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c12cc00/0x48868a4e43948f23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f27d expref: 20 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129748.782264:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c12cc00, rc 0) 00000100:00100000:0.0:1746129748.782276:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949052120448:12345-192.168.204.31@tcp:101:cat.0 Request processed in 45us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129748.782280:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10770 00000100:00100000:0.0:1746129748.782317:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129748.782366:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052120704 00000100:00100000:0.0:1746129748.782369:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052120704 00000100:00100000:0.0:1746129748.782381:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10771 00000100:00100000:0.0:1746129748.782385:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1964:x1830949052120704:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129748.782390:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129748.782396:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c12c400/0x48868a4e43948f2a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f28b expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.782404:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129748.782405:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129748.782408:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c12c400/0x48868a4e43948f2a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f28b expref: 22 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129748.782415:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c12c400/0x48868a4e43948f2a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f28b expref: 22 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129748.782420:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c12c400, rc 0) 00000100:00100000:0.0:1746129748.782436:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1964:x1830949052120704:12345-192.168.204.31@tcp:101:cat.0 Request processed in 51us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129748.782441:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10771 00000100:00100000:2.0:1746129748.791514:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129748.791632:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052120960 00000100:00100000:1.0:1746129748.791641:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052120960 00010000:00010000:1.0:1746129748.791675:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c400/0x48868a4e43948ec1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f237 expref: 9 pid: 14315 timeout: 794 lvb_type: 0 00000100:00100000:1.0:1746129748.791706:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5161 00000100:00100000:1.0:1746129748.791716:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052120960:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129748.791729:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129748.791735:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c400/0x48868a4e43948ec1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f237 expref: 9 pid: 14315 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746129748.791745:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c400/0x48868a4e43948ec1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f237 expref: 9 pid: 14315 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746129748.791764:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129748.791769:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43948ef9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129748.791777:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43948ef9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129748.791782:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129748.791828:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052120960:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 111us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129748.791834:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5161 00010000:00010000:0.0:1746129748.794666:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c400/0x48868a4e43948ec1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f237 expref: 8 pid: 14315 timeout: 794 lvb_type: 0 00000100:00100000:0.0:1746129748.794702:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053279104:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129748.796146:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129748.796185:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129748.796260:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053279232:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129748.796268:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053279360:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129748.796289:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43948ef9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:3.0:1746129748.796431:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052121216 00000100:00100000:3.0:1746129748.796437:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052121216 00010000:00010000:3.0:1746129748.796471:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c000/0x48868a4e43948e20 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ff expref: 10 pid: 14315 timeout: 794 lvb_type: 0 00000100:00100000:3.0:1746129748.796501:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052121088 00000100:00100000:3.0:1746129748.796503:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052121088 00010000:00010000:3.0:1746129748.796527:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2600/0x48868a4e43948e9e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f230 expref: 285 pid: 1851 timeout: 794 lvb_type: 0 00000100:00100000:3.0:1746129748.796552:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5162 00000100:00100000:3.0:1746129748.796559:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135400380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+10:1964:x1830949052121216:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129748.796572:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129748.796576:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c000/0x48868a4e43948e20 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ff expref: 10 pid: 14315 timeout: 794 lvb_type: 0 00010000:00010000:3.0:1746129748.796584:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c000/0x48868a4e43948e20 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ff expref: 10 pid: 14315 timeout: 794 lvb_type: 0 00010000:00010000:3.0:1746129748.796599:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14c000/0x48868a4e43948e20 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1ff expref: 10 pid: 14315 timeout: 794 lvb_type: 0 00010000:00010000:3.0:1746129748.796613:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129748.796617:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43948ef9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129748.796623:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43948ef9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129748.796627:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129748.796660:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135400380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+9:1964:x1830949052121216:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 102us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129748.796665:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5162 00000100:00100000:3.0:1746129748.796679:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5163 00000100:00100000:3.0:1746129748.796684:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:1964:x1830949052121088:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129748.796689:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129748.796693:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2600/0x48868a4e43948e9e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f230 expref: 285 pid: 1851 timeout: 794 lvb_type: 0 00010000:00010000:3.0:1746129748.796700:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2600/0x48868a4e43948e9e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f230 expref: 285 pid: 1851 timeout: 794 lvb_type: 0 00010000:00010000:3.0:1746129748.796710:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80b2600/0x48868a4e43948e9e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f230 expref: 285 pid: 1851 timeout: 794 lvb_type: 0 00010000:00010000:3.0:1746129748.796718:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129748.796721:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43948ef9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129748.796726:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43948ef9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129748.796731:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43948ef9 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129748.796745:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129748.796760:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:1964:x1830949052121088:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 76us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129748.796764:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5163 00010000:00010000:3.0:1746129748.796808:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43948ef9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129748.796812:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43948ef9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129748.796829:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129748.796957:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66c00/0x48868a4e43948ef2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f268 expref: 285 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.796967:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43948ef9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f268 expref: 284 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.796977:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129748.796978:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129748.796980:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fb66800, rc 0) 00000100:00100000:3.0:1746129748.796999:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28518:x1830949052120064:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 16384us (16897us total) trans 8589943607 rc 0/0 00000100:00100000:3.0:1746129748.797004:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9833 00000100:00100000:0.0:1746129748.807256:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129748.807294:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129748.807367:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052121344 00000100:00100000:3.0:1746129748.807375:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052121344 00000100:00100000:3.0:1746129748.810230:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9834 00000100:00100000:3.0:1746129748.810249:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28516:x1830949052121344:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129748.810278:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129748.810296:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e8200/0x48868a4e43948f38 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f299 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.810356:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e8200/0x48868a4e43948f38 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f299 expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.810370:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e8200/0x48868a4e43948f38 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f299 expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.810389:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129748.810392:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129748.810395:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6e8200, rc 0) 00000100:00100000:3.0:1746129748.811298:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28516:x1830949052121344:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1052us (4046us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129748.811306:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9834 00000100:00100000:0.0:1746129748.811500:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129748.811515:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129748.811551:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129748.811603:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052121600 00000100:00100000:2.0:1746129748.811610:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052121600 00002000:00100000:2.0:1746129748.811638:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880135403480 x1830949052121600/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:489/0 lens 488/0 e 0 to 0 dl 1746129759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129748.811645:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135403480 with x1830949052121600 ext(0->1048575) 00002000:00010000:2.0:1746129748.811649:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135403480 00000100:00100000:2.0:1746129748.811671:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052121984 00000100:00100000:2.0:1746129748.811673:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052121984 00002000:00100000:2.0:1746129748.811685:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880135403800 x1830949052121984/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:489/0 lens 488/0 e 0 to 0 dl 1746129759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129748.811696:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135403800 with x1830949052121984 ext(1048576->2097151) 00002000:00010000:2.0:1746129748.811699:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135403800 00000100:00100000:2.0:1746129748.811706:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052121856 00000100:00100000:2.0:1746129748.811708:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052121856 00002000:00100000:2.0:1746129748.811717:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff880135403b80 x1830949052121856/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:489/0 lens 488/0 e 0 to 0 dl 1746129759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129748.811723:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135403b80 with x1830949052121856 ext(1048576->2097151) 00002000:00010000:2.0:1746129748.811725:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135403b80 00000100:00100000:2.0:1746129748.811732:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052122368 00000100:00100000:2.0:1746129748.811733:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052122368 00002000:00100000:2.0:1746129748.811741:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880135402300 x1830949052122368/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:489/0 lens 488/0 e 0 to 0 dl 1746129759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129748.811746:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135402300 with x1830949052122368 ext(1048576->2097151) 00002000:00010000:2.0:1746129748.811749:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135402300 00000100:00100000:2.0:1746129748.811759:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3968 00000100:00100000:2.0:1746129748.811764:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1963:x1830949052121600:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129748.812921:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3969 00000100:00100000:2.0:1746129748.812929:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1963:x1830949052121984:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129748.813716:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3970 00000100:00100000:1.0:1746129748.813725:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949052121856:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129748.814655:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3971 00000100:00100000:1.0:1746129748.814664:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1963:x1830949052122368:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129748.833298:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1963:x1830949052121600:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21525us (25995us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129748.833310:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3968 00002000:00100000:2.0:1746129748.833320:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880135403480 x1830949052121600/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:489/0 lens 488/440 e 0 to 0 dl 1746129759 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129748.833509:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135403480 with x1830949052121600 ext(0->1048575) 00002000:00010000:2.0:1746129748.833514:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135403480 00000100:00100000:0.0:1746129748.839004:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129748.839034:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129748.839056:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129748.839075:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129748.839110:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052122624 00000100:00100000:3.0:1746129748.839118:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052122624 00002000:00100000:3.0:1746129748.839153:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880135400380 x1830949052122624/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:489/0 lens 488/0 e 0 to 0 dl 1746129759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129748.839162:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135400380 with x1830949052122624 ext(0->1048575) 00002000:00010000:3.0:1746129748.839167:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135400380 00000100:00100000:3.0:1746129748.839182:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052122880 00000100:00100000:3.0:1746129748.839185:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052122880 00002000:00100000:3.0:1746129748.839195:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009423ca80 x1830949052122880/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:489/0 lens 488/0 e 0 to 0 dl 1746129759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129748.839201:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423ca80 with x1830949052122880 ext(1048576->2097151) 00002000:00010000:3.0:1746129748.839203:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009423ca80 00000100:00100000:3.0:1746129748.839212:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052123136 00000100:00100000:3.0:1746129748.839214:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052123136 00002000:00100000:3.0:1746129748.839221:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880135d8d880 x1830949052123136/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:489/0 lens 488/0 e 0 to 0 dl 1746129759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129748.839226:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8d880 with x1830949052123136 ext(1048576->2097151) 00002000:00010000:3.0:1746129748.839228:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d8d880 00000100:00100000:3.0:1746129748.839234:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052123392 00000100:00100000:3.0:1746129748.839235:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052123392 00002000:00100000:3.0:1746129748.839243:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880135d8f100 x1830949052123392/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:489/0 lens 488/0 e 0 to 0 dl 1746129759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129748.839247:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8f100 with x1830949052123392 ext(1048576->2097151) 00002000:00010000:3.0:1746129748.839250:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135d8f100 00000100:00100000:3.0:1746129748.839259:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3972 00000100:00100000:3.0:1746129748.839264:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1964:x1830949052122624:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129748.839315:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949052121856:12345-192.168.204.31@tcp:3:cat.0 Request processed in 25591us (27797us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129748.839322:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3970 00002000:00100000:0.0:1746129748.839328:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff880135403b80 x1830949052121856/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:489/0 lens 488/440 e 0 to 0 dl 1746129759 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129748.839335:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135403b80 with x1830949052121856 ext(1048576->2097151) 00002000:00010000:0.0:1746129748.839339:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135403b80 00000100:00100000:0.0:1746129748.839353:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3973 00000100:00100000:0.0:1746129748.839357:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1964:x1830949052122880:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129748.839532:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3974 00000100:00100000:1.0:1746129748.839539:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1964:x1830949052123136:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129748.839589:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3975 00000100:00100000:2.0:1746129748.839595:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1964:x1830949052123392:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129748.843741:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129748.844061:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052123520 00000100:00100000:2.0:1746129748.844068:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052123520 00000100:00100000:2.0:1746129748.844400:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9835 00000100:00100000:2.0:1746129748.844408:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28517:x1830949052123520:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129748.844429:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129748.844444:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87600/0x48868a4e43948f3f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f2a0 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.844499:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87600/0x48868a4e43948f3f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2a0 expref: 285 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.844509:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87600/0x48868a4e43948f3f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2a0 expref: 285 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.844523:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129748.844525:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129748.844528:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a87600, rc 0) 00000100:00100000:2.0:1746129748.844551:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28517:x1830949052123520:12345-192.168.204.31@tcp:101:cat.0 Request processed in 144us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129748.844556:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9835 00000100:00100000:0.0:1746129748.845619:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129748.845979:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1963:x1830949052122368:12345-192.168.204.31@tcp:3:cat.0 Request processed in 31317us (34426us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129748.845988:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3971 00002000:00100000:1.0:1746129748.845995:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880135402300 x1830949052122368/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:489/0 lens 488/440 e 0 to 0 dl 1746129759 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129748.846004:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135402300 with x1830949052122368 ext(1048576->2097151) 00002000:00010000:1.0:1746129748.846009:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135402300 00000100:00100000:1.0:1746129748.846401:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052123776 00000100:00100000:1.0:1746129748.846406:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052123776 00000100:00100000:1.0:1746129748.846611:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9836 00000100:00100000:1.0:1746129748.846618:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28513:x1830949052123776:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129748.846629:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129748.846632:0:14315:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746129748.846650:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e8200/0x48868a4e43948f38 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f299 expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129748.846676:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129748.846680:0:14315:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129748.846688:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ac00/0x48868a4e43948f46 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f2a7 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129748.846723:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ae00/0x48868a4e43948f4d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129748.846733:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e400/0x48868a4e43948e12 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1f8 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129748.846743:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87600/0x48868a4e43948f3f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2a0 expref: 284 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129748.846748:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ae00/0x48868a4e43948f4d lrc: 5/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129748.846771:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87600/0x48868a4e43948f3f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2a0 expref: 284 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129748.846781:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87600/0x48868a4e43948f3f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2a0 expref: 284 pid: 1851 timeout: 794 lvb_type: 0 00000100:00100000:1.0:1746129748.846790:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053279488:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129748.846868:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e400/0x48868a4e43948e12 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1f8 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129748.846875:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e400/0x48868a4e43948e12 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1f8 expref: 8 pid: 1851 timeout: 794 lvb_type: 0 00000100:00100000:1.0:1746129748.846881:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053279616:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129748.846898:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129748.848973:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053279488:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129748.848982:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053279616:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129748.848998:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ae00/0x48868a4e43948f4d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129748.849302:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129748.849370:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052123904 00000100:00100000:1.0:1746129748.849374:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052123904 00010000:00010000:1.0:1746129748.849395:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e400/0x48868a4e43948e12 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1f8 expref: 9 pid: 1851 timeout: 794 lvb_type: 0 00000100:00100000:1.0:1746129748.849412:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5164 00000100:00100000:1.0:1746129748.849417:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:1964:x1830949052123904:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129748.849426:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129748.849431:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e400/0x48868a4e43948e12 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1f8 expref: 9 pid: 1851 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746129748.849439:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e400/0x48868a4e43948e12 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1f8 expref: 9 pid: 1851 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746129748.851590:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e400/0x48868a4e43948e12 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f1f8 expref: 9 pid: 1851 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746129748.851607:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129748.851612:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ae00/0x48868a4e43948f4d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129748.851618:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ae00/0x48868a4e43948f4d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129748.851623:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129748.851686:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+8:1964:x1830949052123904:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2265us (2382us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129748.851696:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5164 00000100:00100000:2.0:1746129748.859558:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1963:x1830949052121984:12345-192.168.204.31@tcp:3:cat.0 Request processed in 46617us (48045us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129748.859571:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3969 00002000:00100000:2.0:1746129748.859583:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880135403800 x1830949052121984/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:489/0 lens 488/440 e 0 to 0 dl 1746129759 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129748.859592:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135403800 with x1830949052121984 ext(1048576->2097151) 00002000:00010000:2.0:1746129748.859598:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135403800 00000100:00100000:1.0:1746129748.867404:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1964:x1830949052122880:12345-192.168.204.31@tcp:3:cat.0 Request processed in 28038us (28360us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129748.867415:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3973 00002000:00100000:1.0:1746129748.867424:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009423ca80 x1830949052122880/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:489/0 lens 488/440 e 0 to 0 dl 1746129759 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129748.867433:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423ca80 with x1830949052122880 ext(1048576->2097151) 00002000:00010000:1.0:1746129748.867438:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009423ca80 00000100:00100000:1.0:1746129748.869787:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949052123136:12345-192.168.204.31@tcp:3:cat.0 Request processed in 30240us (30721us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129748.869796:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3974 00002000:00100000:1.0:1746129748.869804:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880135d8d880 x1830949052123136/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:489/0 lens 488/440 e 0 to 0 dl 1746129759 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129748.869812:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8d880 with x1830949052123136 ext(1048576->2097151) 00002000:00010000:1.0:1746129748.869816:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d8d880 00000100:00100000:2.0:1746129748.874133:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1964:x1830949052123392:12345-192.168.204.31@tcp:3:cat.0 Request processed in 34529us (35047us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129748.874144:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3975 00002000:00100000:2.0:1746129748.874154:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880135d8f100 x1830949052123392/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:489/0 lens 488/440 e 0 to 0 dl 1746129759 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129748.874163:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8f100 with x1830949052123392 ext(1048576->2097151) 00002000:00010000:2.0:1746129748.874168:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135d8f100 00000100:00100000:3.0:1746129748.879676:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1964:x1830949052122624:12345-192.168.204.31@tcp:3:cat.0 Request processed in 40405us (40673us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129748.879684:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3972 00002000:00100000:3.0:1746129748.879692:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880135400380 x1830949052122624/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:489/0 lens 488/440 e 0 to 0 dl 1746129759 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129748.879698:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135400380 with x1830949052122624 ext(0->1048575) 00002000:00010000:3.0:1746129748.879703:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135400380 00000100:00100000:0.0:1746129748.880664:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129748.880893:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129748.880939:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052124032 00000100:00100000:2.0:1746129748.880946:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052124032 00000100:00100000:2.0:1746129748.880988:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9837 00000100:00100000:2.0:1746129748.880994:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28517:x1830949052124032:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129748.881007:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129748.881021:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87a00/0x48868a4e43948f54 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f2ae expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.881065:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ae00/0x48868a4e43948f4d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129748.881071:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87a00/0x48868a4e43948f54 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ae expref: 286 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.881088:0:1851:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ae00/0x48868a4e43948f4d lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129748.881097:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87a00/0x48868a4e43948f54 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ae expref: 286 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.881106:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129748.881108:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129748.881111:0:1851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ae00/0x48868a4e43948f4d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129748.881116:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a87a00, rc 0) 00000100:00100000:2.0:1746129748.881137:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:28517:x1830949052124032:12345-192.168.204.31@tcp:101:cat.0 Request processed in 144us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129748.881141:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9837 00000100:00100000:1.0:1746129748.881244:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052124160 00000100:00100000:1.0:1746129748.881248:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052124160 00010000:00010000:1.0:1746129748.881263:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87600/0x48868a4e43948f3f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2a0 expref: 286 pid: 1851 timeout: 794 lvb_type: 0 00000100:00100000:1.0:1746129748.881290:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5165 00000100:00100000:1.0:1746129748.881295:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:1962:x1830949052124160:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129748.881303:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129748.881307:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87600/0x48868a4e43948f3f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2a0 expref: 286 pid: 1851 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746129748.881319:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87600/0x48868a4e43948f3f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2a0 expref: 286 pid: 1851 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746129748.881334:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87600/0x48868a4e43948f3f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2a0 expref: 286 pid: 1851 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746129748.881346:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129748.881349:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ae00/0x48868a4e43948f4d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129748.881355:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ae00/0x48868a4e43948f4d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129748.881360:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ae00/0x48868a4e43948f4d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129748.881366:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87a00/0x48868a4e43948f54 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ae expref: 285 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129748.881378:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129748.881385:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ae00/0x48868a4e43948f4d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129748.881391:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ae00/0x48868a4e43948f4d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00000100:00100000:1.0:1746129748.881556:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:1962:x1830949052124160:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 104us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129748.881564:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5165 00000040:00080000:0.0:1746129748.882184:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2796, 88 off232896 00000004:00080000:0.0:1746129748.882191:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 694940342703ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129748.882238:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2733, 88 off227432 00000004:00080000:0.0:1746129748.882243:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 694940394671ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129748.882263:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2734, 88 off227520 00000004:00080000:0.0:1746129748.882266:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 694940418456ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129748.882356:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2797, 88 off232984 00000004:00080000:0.0:1746129748.882360:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 694940512069ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129748.882376:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2798, 88 off233072 00000004:00080000:0.0:1746129748.882379:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 694940531371ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129748.882386:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2735, 88 off227608 00000004:00080000:0.0:1746129748.882388:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 694940540156ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129748.882394:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2736, 88 off227696 00000004:00080000:0.0:1746129748.882396:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 694940548199ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129748.882402:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2737, 88 off227784 00000004:00080000:0.0:1746129748.882404:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 694940556262ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129748.882410:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2799, 88 off233160 00000004:00080000:0.0:1746129748.882412:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 694940564413ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129748.882418:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2738, 88 off227872 00000004:00080000:0.0:1746129748.882421:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 694940573022ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129748.882427:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2800, 88 off233248 00000004:00080000:0.0:1746129748.882429:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 694940580828ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129748.882436:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2739, 88 off227960 00000004:00080000:0.0:1746129748.882439:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 694940591131ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129748.882445:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2801, 88 off233336 00000004:00080000:0.0:1746129748.882463:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 694940615018ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129748.882571:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2802, 88 off233424 00000004:00080000:0.0:1746129748.882575:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 694940727252ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129748.882583:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2803, 88 off233512 00000004:00080000:0.0:1746129748.882586:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 694940738238ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129748.882593:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2804, 88 off233600 00000004:00080000:0.0:1746129748.882596:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 694940748203ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129748.882604:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2740, 88 off228048 00000004:00080000:0.0:1746129748.882606:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 694940758488ns, next at 641623252291ns, rc = 0 00000100:00100000:0.0:1746129748.885913:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129748.886090:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052124288 00000100:00100000:2.0:1746129748.886098:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052124288 00000100:00100000:2.0:1746129748.886708:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9838 00000100:00100000:2.0:1746129748.886717:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28516:x1830949052124288:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129748.886733:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129748.886748:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87e00/0x48868a4e43948f5b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f2b5 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.886792:0:14314:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87e00/0x48868a4e43948f5b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2b5 expref: 12 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.886801:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87e00/0x48868a4e43948f5b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2b5 expref: 12 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.886812:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129748.886815:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129748.886818:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87a00/0x48868a4e43948f54 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ae expref: 284 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.886823:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a87e00, rc 0) 00000100:00100000:2.0:1746129748.886871:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28516:x1830949052124288:12345-192.168.204.31@tcp:101:cat.0 Request processed in 156us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129748.886876:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9838 00010000:00010000:0.0:1746129748.922792:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ae00/0x48868a4e43948f4d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2a7 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.922806:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129748.922808:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746129748.922813:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87a00/0x48868a4e43948f54 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ae expref: 284 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.922822:0:14315:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87a00/0x48868a4e43948f54 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ae expref: 284 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.922828:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87a00/0x48868a4e43948f54 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ae expref: 284 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.922836:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87e00/0x48868a4e43948f5b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2b5 expref: 12 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.922842:0:14315:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87e00/0x48868a4e43948f5b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2b5 expref: 12 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.922861:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87e00/0x48868a4e43948f5b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2b5 expref: 12 pid: 14314 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1746129748.922874:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943608 is committed 00000004:00080000:0.0:1746129748.922879:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1926 committed 00000004:00080000:0.0:1746129748.922885:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1986 committed 00000004:00080000:0.0:1746129748.922890:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1985 committed 00000004:00080000:0.0:1746129748.922892:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1984 committed 00000004:00080000:0.0:1746129748.922893:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1983 committed 00000004:00080000:0.0:1746129748.922895:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1925 committed 00000004:00080000:0.0:1746129748.922897:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1982 committed 00000004:00080000:0.0:1746129748.922898:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1924 committed 00000004:00080000:0.0:1746129748.922899:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1981 committed 00000004:00080000:0.0:1746129748.922901:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1923 committed 00000004:00080000:0.0:1746129748.922902:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1922 committed 00000004:00080000:0.0:1746129748.922903:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1921 committed 00000004:00080000:0.0:1746129748.922905:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1980 committed 00000004:00080000:0.0:1746129748.922906:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1979 committed 00000004:00080000:0.0:1746129748.922908:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1920 committed 00000004:00080000:0.0:1746129748.922909:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1919 committed 00000004:00080000:0.0:1746129748.922910:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1978 committed 00000001:00080000:0.0:1746129748.922916:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943605 is committed 00000001:00080000:0.0:1746129748.922921:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943604 is committed 00000001:00080000:0.0:1746129748.922930:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943607 is committed 00000100:00100000:0.0:1746129748.923108:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053279744:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129748.923154:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129748.923194:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053280256:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129748.923208:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129748.923221:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053280768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129748.923236:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129748.923247:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053281280:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129748.923258:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129748.923272:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746129748.923276:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053279872:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129748.923288:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129748.923297:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053280384:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129748.923308:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129748.923317:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053280896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129748.923329:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129748.923338:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c040e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053281408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129748.923349:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129748.923370:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053279744 00000100:00100000:0.0:1746129748.923375:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053279744 00000100:00100000:0.0:1746129748.923399:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053280256 00000100:00100000:0.0:1746129748.923401:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053280256 00000100:00100000:0.0:1746129748.923409:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053280768 00000100:00100000:0.0:1746129748.923411:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053280768 00000100:00100000:3.0:1746129748.923463:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053280000:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129748.923484:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129748.923497:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053280512:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129748.923510:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129748.923516:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053281024:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129748.923529:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129748.923535:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053281536:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129748.923547:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129748.923555:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1746129748.923559:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053280128:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129748.923571:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129748.923578:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053280640:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129748.923588:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129748.923595:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053281152:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129748.923606:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129748.923612:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c041880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053281664:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129748.923625:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129748.923641:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053281280 00000100:00100000:3.0:1746129748.923643:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053281280 00000100:00100000:3.0:1746129748.923654:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053279872 00000100:00100000:3.0:1746129748.923655:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053279872 00000100:00100000:3.0:1746129748.923660:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053280384 00000100:00100000:3.0:1746129748.923661:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053280384 00000100:00100000:3.0:1746129748.923666:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053280896 00000100:00100000:3.0:1746129748.923667:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053280896 00000100:00100000:3.0:1746129748.923672:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053281408 00000100:00100000:2.0:1746129748.923672:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053280000 00000100:00100000:3.0:1746129748.923673:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053281408 00000100:00100000:2.0:1746129748.923675:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053280000 00000100:00100000:3.0:1746129748.923677:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053280512 00000100:00100000:3.0:1746129748.923679:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053280512 00000100:00100000:3.0:1746129748.923683:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053281024 00000100:00100000:2.0:1746129748.923683:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053281536 00000100:00100000:3.0:1746129748.923684:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053281024 00000100:00100000:2.0:1746129748.923684:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053281536 00000100:00100000:3.0:1746129748.923689:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053280128 00000100:00100000:2.0:1746129748.923689:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053280640 00000100:00100000:3.0:1746129748.923690:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053280128 00000100:00100000:2.0:1746129748.923691:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053280640 00000100:00100000:3.0:1746129748.923695:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053281664 00000100:00100000:2.0:1746129748.923695:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053281152 00000100:00100000:2.0:1746129748.923696:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053281152 00000100:00100000:3.0:1746129748.923697:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053281664 00000100:00100000:3.0:1746129748.923704:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10772 00000100:00100000:3.0:1746129748.923715:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+84:3298:x1830949053279744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129748.923756:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10773 00000100:00100000:2.0:1746129748.923761:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+84:3298:x1830949053280256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129748.923832:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10774 00000100:00100000:3.0:1746129748.923836:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+93:3298:x1830949053280768:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129748.923846:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746129748.923862:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746129748.923864:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746129748.923865:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746129748.923867:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:2.0:1746129748.923893:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129748.923895:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129747 -> 1746129747 00002000:00010000:2.0:1746129748.923897:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129747 -> 1746129747 00002000:00010000:2.0:1746129748.923899:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129747 -> 1746129747 00002000:00010000:2.0:1746129748.923900:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746129748.923923:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+86:3298:x1830949053279744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 213us (769us total) trans 21474840271 rc 0/0 00000100:00100000:2.0:1746129748.923928:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10772 00000100:00100000:2.0:1746129748.923940:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10775 00000100:00100000:2.0:1746129748.923943:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+93:3298:x1830949053281280:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129748.923984:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746129748.923987:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129747 -> 1746129747 00002000:00010000:3.0:1746129748.923988:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129747 -> 1746129747 00002000:00010000:3.0:1746129748.923990:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129747 -> 1746129747 00002000:00010000:3.0:1746129748.923992:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:3.0:1746129748.924010:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+95:3298:x1830949053280768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 173us (772us total) trans 17179873114 rc 0/0 00000100:00100000:2.0:1746129748.924010:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+95:3298:x1830949053281280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (750us total) trans 17179873115 rc 0/0 00000100:00100000:2.0:1746129748.924015:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10775 00000100:00100000:3.0:1746129748.924017:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10774 00000100:00100000:2.0:1746129748.924025:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10776 00000100:00100000:2.0:1746129748.924029:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+85:3298:x1830949053279872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129748.924092:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129748.924095:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129747 -> 1746129747 00002000:00010000:2.0:1746129748.924096:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129747 -> 1746129747 00002000:00010000:2.0:1746129748.924098:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129747 -> 1746129747 00002000:00010000:2.0:1746129748.924099:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746129748.924115:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+86:3298:x1830949053279872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (825us total) trans 21474840272 rc 0/0 00000100:00100000:3.0:1746129748.924625:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10777 00000100:00100000:2.0:1746129748.924629:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10776 00000100:00100000:3.0:1746129748.924631:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+86:3298:x1830949053280384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129748.924704:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+86:3298:x1830949053280384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (1394us total) trans 21474840273 rc 0/0 00000100:00100000:3.0:1746129748.924709:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10777 00000100:00100000:3.0:1746129748.924718:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10778 00000100:00100000:3.0:1746129748.924722:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+93:3298:x1830949053280896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129748.924790:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129748.924792:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129747 -> 1746129747 00002000:00010000:3.0:1746129748.924794:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746129747 -> 1746129747 00002000:00010000:3.0:1746129748.924795:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129747 -> 1746129747 00002000:00010000:3.0:1746129748.924797:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2079 -> 2081 00000100:00100000:3.0:1746129748.924813:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+94:3298:x1830949053280896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (1483us total) trans 17179873116 rc 0/0 00000100:00100000:3.0:1746129748.924818:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10778 00000100:00100000:3.0:1746129748.924826:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10779 00000100:00100000:3.0:1746129748.924830:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+93:3298:x1830949053281408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129748.924868:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10780 00000100:00100000:3.0:1746129748.924873:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+85:3296:x1830949053280000:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129748.924937:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746129748.924939:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129748 -> 1746129748 00002000:00010000:3.0:1746129748.924940:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129747 -> 1746129747 00002000:00010000:3.0:1746129748.924942:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129748 -> 1746129748 00002000:00010000:3.0:1746129748.924944:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746129748.924964:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+86:3296:x1830949053280000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (1479us total) trans 21474840274 rc 0/0 00000100:00100000:3.0:1746129748.924969:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10780 00000100:00100000:3.0:1746129748.924977:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10781 00000100:00100000:3.0:1746129748.924981:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+85:3296:x1830949053280512:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129748.924990:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a6300/2, rc 0, transno 21474840272 00000100:00100000:2.0:1746129748.924995:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053279872:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129748.925003:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009206ce00/2, rc 0, transno 21474840273 00000100:00100000:2.0:1746129748.925005:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053280384:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129748.925012:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009206d180/2, rc 0, transno 17179873116 00000100:00100000:2.0:1746129748.925020:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053280896:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129748.925028:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a4700/2, rc 0, transno 21474840271 00000100:00100000:2.0:1746129748.925030:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053279744:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129748.925036:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009206df80/2, rc 0, transno 17179873114 00000100:00100000:2.0:1746129748.925038:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053280768:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129748.925044:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c043800/2, rc 0, transno 17179873115 00000100:00100000:3.0:1746129748.925046:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+86:3296:x1830949053280512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (1536us total) trans 21474840275 rc 0/0 00000100:00100000:2.0:1746129748.925047:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053281280:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129748.925051:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10781 00000100:00100000:3.0:1746129748.925059:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10782 00000100:00100000:3.0:1746129748.925063:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+93:3296:x1830949053281024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129748.925083:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746129748.925089:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053281792:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129748.925108:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129748.925139:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+85:3298:x1830949053280256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1378us (1930us total) trans 21474840270 rc 0/0 00000100:00100000:2.0:1746129748.925144:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10773 00000100:00100000:2.0:1746129748.925394:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053281792 00000100:00100000:2.0:1746129748.925398:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053281792 00000100:00100000:2.0:1746129748.925410:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10783 00000100:00100000:2.0:1746129748.925414:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+94:3296:x1830949053281536:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129748.925443:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009206ed80/2, rc 0, transno 21474840270 00000100:00100000:2.0:1746129748.925446:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053280256:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129748.925470:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10784 00000100:00100000:2.0:1746129748.925474:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+84:3296:x1830949053280640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129748.925549:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+85:3296:x1830949053280640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (1959us total) trans 21474840276 rc 0/0 00000100:00100000:2.0:1746129748.925554:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10784 00000100:00100000:2.0:1746129748.925564:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10785 00000100:00100000:2.0:1746129748.925568:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+84:3296:x1830949053280128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129748.925632:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+85:3296:x1830949053280128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (2059us total) trans 21474840277 rc 0/0 00000100:00100000:2.0:1746129748.925637:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10785 00000100:00100000:2.0:1746129748.925646:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10786 00000100:00100000:2.0:1746129748.925650:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+94:3296:x1830949053281152:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129748.925694:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a6d80/2, rc 0, transno 21474840277 00000100:00100000:3.0:1746129748.925697:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053280128:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129748.925757:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009206dc00/2, rc 0, transno 21474840276 00000100:00100000:3.0:1746129748.925760:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053280640:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129748.925767:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a4380/2, rc 0, transno 21474840274 00000100:00100000:3.0:1746129748.925769:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053280000:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129748.925774:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009206f480/2, rc 0, transno 21474840275 00000100:00100000:3.0:1746129748.925777:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053280512:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129748.925842:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:2.0:1746129748.925845:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129748 -> 1746129748 00002000:00010000:2.0:1746129748.925862:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129747 -> 1746129747 00002000:00010000:2.0:1746129748.925864:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129748 -> 1746129748 00002000:00010000:2.0:1746129748.925866:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5673 -> 5673 00000100:00100000:3.0:1746129748.925870:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+96:3298:x1830949053281408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1040us (2520us total) trans 17179873117 rc 0/0 00000100:00100000:3.0:1746129748.925876:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10779 00000100:00100000:2.0:1746129748.925883:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+95:3296:x1830949053281024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 820us (2353us total) trans 17179873118 rc 0/0 00000100:00100000:3.0:1746129748.925885:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10787 00000100:00100000:2.0:1746129748.925888:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10782 00000100:00100000:3.0:1746129748.925889:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+95:3296:x1830949053281664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129748.925895:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10788 00000100:00100000:2.0:1746129748.925899:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+94:3299:x1830949053281792:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129748.925922:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c040e00/2, rc 0, transno 17179873117 00000100:00100000:2.0:1746129748.925925:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c040e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053281408:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129748.925974:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+96:3296:x1830949053281664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (2347us total) trans 17179873119 rc 0/0 00000100:00100000:3.0:1746129748.925979:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10787 00000100:00100000:2.0:1746129748.925984:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+96:3299:x1830949053281792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (875us total) trans 17179873120 rc 0/0 00000100:00100000:2.0:1746129748.925989:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10788 00000004:00080000:2.0:1746129748.926003:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a4dc00/2, rc 0, transno 17179873120 00000100:00100000:2.0:1746129748.926007:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053281792:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129748.926070:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+95:3296:x1830949053281536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 656us (2522us total) trans 17179873121 rc 0/0 00000100:00100000:2.0:1746129748.926075:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10783 00000004:00080000:2.0:1746129748.926092:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c041880/2, rc 0, transno 17179873119 00000100:00100000:2.0:1746129748.926095:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c041880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053281664:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129748.926100:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009206e680/2, rc 0, transno 17179873118 00000100:00100000:2.0:1746129748.926102:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053281024:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129748.926106:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c042300/2, rc 0, transno 17179873121 00000100:00100000:2.0:1746129748.926108:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053281536:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129748.926164:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746129748.926166:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746129748.926168:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746129748.926169:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746129748.926171:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746129748.926190:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+95:3296:x1830949053281152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 540us (2583us total) trans 17179873122 rc 0/0 00000100:00100000:2.0:1746129748.926195:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10786 00010000:00010000:1.0:1746129748.926197:0:14315:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87e00/0x48868a4e43948f5b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2b5 expref: 10 pid: 14314 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129748.926208:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053281920:192.168.204.31@tcp:105: 00000004:00080000:2.0:1746129748.926209:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c043480/2, rc 0, transno 17179873122 00000100:00100000:2.0:1746129748.926212:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053281152:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746129748.926268:0:14315:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87a00/0x48868a4e43948f54 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ae expref: 282 pid: 1851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129748.926276:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053282048:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129748.926289:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b80300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129748.931791:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129748.932137:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052124544 00000100:00100000:2.0:1746129748.932144:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052124544 00000100:00100000:2.0:1746129748.932178:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3852 00000100:00100000:2.0:1746129748.932185:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28517:x1830949052124544:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:2.0:1746129748.932266:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28517:x1830949052124544:12345-192.168.204.31@tcp:49:cat.0 Request processed in 82us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129748.932271:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3852 00000100:00100000:1.0:1746129748.932391:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053281920:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129748.932399:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053282048:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129748.932426:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ac00/0x48868a4e43948f46 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2a7 expref: 10 pid: 14315 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746129748.932439:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ae00/0x48868a4e43948f4d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2a7 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129748.932466:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb4ae00, rc 0) 00000100:00100000:1.0:1746129748.932486:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28513:x1830949052123776:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 85869us (86871us total) trans 8589943608 rc 0/0 00000100:00100000:1.0:1746129748.932492:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9836 00000100:00100000:0.0:1746129748.932630:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129748.933275:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052124416 00000100:00100000:3.0:1746129748.933280:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052124416 00000100:00100000:3.0:1746129748.933298:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3853 00000100:00100000:3.0:1746129748.933304:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c560450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28516:x1830949052124416:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:3.0:1746129748.933352:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c560450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28516:x1830949052124416:12345-192.168.204.31@tcp:49:cat.0 Request processed in 48us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129748.933358:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3853 00000100:00100000:1.0:1746129748.934184:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129748.934583:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052124672 00000100:00100000:2.0:1746129748.934588:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052124672 00000100:00100000:2.0:1746129748.934610:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3854 00000100:00100000:2.0:1746129748.934615:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28518:x1830949052124672:12345-192.168.204.31@tcp:49:multiop.0 00000100:00100000:2.0:1746129748.934669:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28518:x1830949052124672:12345-192.168.204.31@tcp:49:multiop.0 Request processed in 53us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129748.934674:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3854 00000100:00100000:2.0:1746129748.949248:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129748.949314:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129748.949869:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052124800 00000100:00100000:3.0:1746129748.949876:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052124800 00000100:00100000:3.0:1746129748.949910:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10789 00000100:00100000:3.0:1746129748.949917:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:28518:x1830949052124800:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129748.949941:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129748.949958:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff600/0x48868a4e43948f62 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f2bc expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.949982:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00a8600/0x48868a4e43948e27 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f206 expref: 20 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129748.949990:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c12ce00/0x48868a4e43948f1c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f26f expref: 21 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129748.949996:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43948ecf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f23e expref: 33 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129748.950006:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129748.950008:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129748.950011:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff600/0x48868a4e43948f62 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [344064->1048575] (req 344064->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2bc expref: 33 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.950034:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43948ecf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f23e expref: 33 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129748.950044:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43948ecf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f23e expref: 33 pid: 3624 timeout: 795 lvb_type: 1 00000100:00100000:3.0:1746129748.950054:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a56c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053282176:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129748.950125:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c12ce00/0x48868a4e43948f1c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f26f expref: 21 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129748.950133:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c12ce00/0x48868a4e43948f1c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f26f expref: 21 pid: 4589 timeout: 795 lvb_type: 1 00000100:00100000:3.0:1746129748.950141:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a56d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053282304:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129748.950167:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00a8600/0x48868a4e43948e27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f206 expref: 20 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129748.950173:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a00a8600/0x48868a4e43948e27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f206 expref: 20 pid: 8436 timeout: 795 lvb_type: 1 00000100:00100000:3.0:1746129748.950184:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135402680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053282432:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129748.950198:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19cef00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129748.950212:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052125056 00000100:00100000:3.0:1746129748.950215:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052125056 00002000:00100000:3.0:1746129748.950237:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff880094a4c380 x1830949052125056/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:489/0 lens 488/0 e 0 to 0 dl 1746129759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129748.950246:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4c380 with x1830949052125056 ext(1048576->2097151) 00002000:00010000:3.0:1746129748.950249:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a4c380 00000100:00100000:3.0:1746129748.950263:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3976 00000100:00100000:3.0:1746129748.950268:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1963:x1830949052125056:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129748.953468:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129748.956591:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129748.956615:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052125440 00000100:00100000:2.0:1746129748.956623:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052125440 00002000:00100000:2.0:1746129748.956658:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff880094a4e680 x1830949052125440/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:489/0 lens 488/0 e 0 to 0 dl 1746129759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129748.956667:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4e680 with x1830949052125440 ext(1048576->2097151) 00002000:00010000:2.0:1746129748.956672:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a4e680 00000100:00100000:2.0:1746129748.956690:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3977 00000100:00100000:2.0:1746129748.956696:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949052125440:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129748.958091:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052125184 00000100:00100000:0.0:1746129748.958098:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052125184 00000100:00100000:0.0:1746129748.958124:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10790 00000100:00100000:0.0:1746129748.958129:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:28513:x1830949052125184:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129748.958138:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129748.958151:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9800/0x48868a4e43948f69 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f2c3 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.958173:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136a84800/0x48868a4e43948e4a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f229 expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129748.958181:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c12d000/0x48868a4e43948f15 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f292 expref: 23 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129748.958187:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e43948f00 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f261 expref: 30 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129748.958193:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129748.958194:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129748.958197:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9800/0x48868a4e43948f69 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3768320->4194303] (req 3768320->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2c3 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129748.958221:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e43948f00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f261 expref: 30 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129748.958229:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e43948f00 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f261 expref: 30 pid: 10930 timeout: 795 lvb_type: 1 00000100:00100000:0.0:1746129748.958239:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053282560:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129748.958308:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c12d000/0x48868a4e43948f15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f292 expref: 23 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129748.958315:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c12d000/0x48868a4e43948f15 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f292 expref: 23 pid: 4589 timeout: 795 lvb_type: 1 00000100:00100000:0.0:1746129748.958322:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053282688:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129748.958344:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136a84800/0x48868a4e43948e4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f229 expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129748.958351:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136a84800/0x48868a4e43948e4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f229 expref: 20 pid: 8437 timeout: 795 lvb_type: 1 00000100:00100000:0.0:1746129748.958358:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053282816:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129748.958372:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324780 going to sleep for 11 seconds 00000100:00100000:2.0:1746129748.966720:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1963:x1830949052125056:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 16443us (17397us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129748.966731:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3976 00002000:00100000:2.0:1746129748.966741:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff880094a4c380 x1830949052125056/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:489/0 lens 488/440 e 0 to 0 dl 1746129759 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129748.966750:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4c380 with x1830949052125056 ext(1048576->2097151) 00002000:00010000:2.0:1746129748.966755:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a4c380 00000100:00100000:3.0:1746129748.966869:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a56c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053282176:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129748.972791:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129748.972807:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129748.972845:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129748.972881:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129748.972896:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129748.972928:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129748.972949:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052125696 00000100:00100000:3.0:1746129748.972955:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052125696 00010000:00010000:3.0:1746129748.972985:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c12ce00/0x48868a4e43948f1c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f26f expref: 22 pid: 4589 timeout: 795 lvb_type: 1 00000100:00100000:3.0:1746129748.973002:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052125568 00000100:00100000:3.0:1746129748.973004:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052125568 00010000:00010000:3.0:1746129748.973013:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43948ecf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f23e expref: 34 pid: 3624 timeout: 795 lvb_type: 1 00000100:00100000:3.0:1746129748.973021:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052125824 00000100:00100000:3.0:1746129748.973022:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052125824 00010000:00010000:3.0:1746129748.973030:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00a8600/0x48868a4e43948e27 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f206 expref: 21 pid: 8436 timeout: 795 lvb_type: 1 00000100:00100000:3.0:1746129748.973037:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052126080 00000100:00100000:3.0:1746129748.973038:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052126080 00010000:00010000:3.0:1746129748.973046:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c12d000/0x48868a4e43948f15 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f292 expref: 22 pid: 4589 timeout: 795 lvb_type: 1 00000100:00100000:3.0:1746129748.973053:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052125952 00000100:00100000:3.0:1746129748.973054:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052125952 00010000:00010000:3.0:1746129748.973061:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e43948f00 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f261 expref: 31 pid: 10930 timeout: 795 lvb_type: 1 00000100:00100000:3.0:1746129748.973068:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052126208 00000100:00100000:3.0:1746129748.973070:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052126208 00010000:00010000:3.0:1746129748.973077:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136a84800/0x48868a4e43948e4a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f229 expref: 21 pid: 8437 timeout: 795 lvb_type: 1 00000100:00100000:3.0:1746129748.973086:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5166 00000100:00100000:3.0:1746129748.973092:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1963:x1830949052125696:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129748.973103:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129748.973120:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c12ce00/0x48868a4e43948f1c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f26f expref: 22 pid: 4589 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746129748.973133:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c12ce00/0x48868a4e43948f1c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f26f expref: 22 pid: 4589 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746129748.973154:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129748.973190:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1963:x1830949052125696:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 95us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129748.973195:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5166 00000100:00100000:3.0:1746129748.973211:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5167 00000100:00100000:3.0:1746129748.973216:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1963:x1830949052125568:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129748.973223:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129748.973230:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43948ecf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f23e expref: 34 pid: 3624 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746129748.973237:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43948ecf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f23e expref: 34 pid: 3624 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746129748.973246:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43948ecf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f23e expref: 34 pid: 3624 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746129748.973255:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129748.973269:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1963:x1830949052125568:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 53us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129748.973274:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5167 00000100:00100000:3.0:1746129748.973283:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5168 00000100:00100000:3.0:1746129748.973287:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+21:1964:x1830949052125824:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129748.973293:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129748.973299:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a00a8600/0x48868a4e43948e27 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f206 expref: 21 pid: 8436 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746129748.973306:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a00a8600/0x48868a4e43948e27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f206 expref: 21 pid: 8436 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746129748.973316:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129748.973318:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129748.973324:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff600/0x48868a4e43948f62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 344064->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2bc expref: 32 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.973330:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff600/0x48868a4e43948f62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 344064->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2bc expref: 32 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.973353:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff600/0x48868a4e43948f62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 344064->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2bc expref: 32 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129748.973363:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053282944:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129748.973399:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129748.973413:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5169 00000100:00100000:3.0:1746129748.973418:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1964:x1830949052126080:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129748.973424:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129748.973435:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c12d000/0x48868a4e43948f15 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f292 expref: 22 pid: 4589 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746129748.973445:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c12d000/0x48868a4e43948f15 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f292 expref: 22 pid: 4589 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746129748.973468:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129748.973483:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1964:x1830949052126080:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 64us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129748.973487:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5169 00000100:00100000:3.0:1746129748.973499:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5170 00000100:00100000:3.0:1746129748.973503:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1964:x1830949052125952:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129748.973509:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129748.973515:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e43948f00 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f261 expref: 31 pid: 10930 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746129748.973523:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e43948f00 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f261 expref: 31 pid: 10930 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746129748.973532:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129748.973545:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1964:x1830949052125952:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 42us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129748.973550:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5170 00000100:00100000:3.0:1746129748.973558:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5171 00000100:00100000:3.0:1746129748.973562:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+21:1964:x1830949052126208:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129748.973569:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129748.973575:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136a84800/0x48868a4e43948e4a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f229 expref: 21 pid: 8437 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746129748.973582:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136a84800/0x48868a4e43948e4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f229 expref: 21 pid: 8437 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746129748.973591:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129748.973592:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129748.973595:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9800/0x48868a4e43948f69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3768320->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2c3 expref: 21 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.973600:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9800/0x48868a4e43948f69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3768320->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2c3 expref: 21 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129748.973616:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9800/0x48868a4e43948f69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3768320->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2c3 expref: 21 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129748.973623:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095240000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053283072:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129748.973641:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ced80 going to sleep for 11 seconds 00010000:00010000:0.0:1746129748.973967:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e43948f00 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f261 expref: 30 pid: 10930 timeout: 795 lvb_type: 1 00000100:00100000:0.0:1746129748.974001:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053282560:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129748.974987:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c12ce00/0x48868a4e43948f1c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f26f expref: 21 pid: 4589 timeout: 795 lvb_type: 1 00000100:00100000:2.0:1746129748.975003:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a56d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053282304:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129748.975016:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00a8600/0x48868a4e43948e27 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f206 expref: 21 pid: 8436 timeout: 795 lvb_type: 1 00000100:00100000:2.0:1746129748.975024:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135402680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053282432:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129748.975051:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff600/0x48868a4e43948f62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 344064->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2bc expref: 32 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129748.975060:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c0ff600, rc 0) 00000100:00100000:2.0:1746129748.975087:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:28518:x1830949052124800:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 25170us (25844us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129748.975093:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10789 00010000:00010000:1.0:1746129748.976161:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c12d000/0x48868a4e43948f15 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f292 expref: 21 pid: 4589 timeout: 795 lvb_type: 1 00000100:00100000:1.0:1746129748.976172:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053282688:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129748.976182:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136a84800/0x48868a4e43948e4a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f229 expref: 21 pid: 8437 timeout: 795 lvb_type: 1 00000100:00100000:1.0:1746129748.976192:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053282816:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129748.976218:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9800/0x48868a4e43948f69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2c3 expref: 20 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129748.976225:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8e9800, rc 0) 00000100:00100000:1.0:1746129748.976247:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:28513:x1830949052125184:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 18117us (22798us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129748.976253:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10790 00000100:00100000:1.0:1746129748.976616:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949052125440:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 19919us (20030us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129748.976623:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3977 00002000:00100000:1.0:1746129748.976630:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff880094a4e680 x1830949052125440/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:489/0 lens 488/440 e 0 to 0 dl 1746129759 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129748.976638:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4e680 with x1830949052125440 ext(1048576->2097151) 00002000:00010000:1.0:1746129748.976643:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a4e680 00000100:00100000:1.0:1746129748.989159:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129748.989352:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053282944:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129748.989368:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129748.989404:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+20:1964:x1830949052125824:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 16115us (16557us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129748.989413:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5168 00000100:00100000:0.0:1746129748.989762:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052126464 00000100:00100000:0.0:1746129748.989768:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052126464 00002000:00100000:0.0:1746129748.989799:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800a00c7100 x1830949052126464/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:489/0 lens 488/0 e 0 to 0 dl 1746129759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129748.989807:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c7100 with x1830949052126464 ext(1048576->2097151) 00002000:00010000:0.0:1746129748.989811:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a00c7100 00000100:00100000:0.0:1746129748.989827:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3978 00000100:00100000:0.0:1746129748.989833:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949052126464:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129748.991038:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129748.991062:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129748.991075:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052126720 00000100:00100000:0.0:1746129748.991078:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052126720 00002000:00100000:0.0:1746129748.991095:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (344064->348159) req@ffff88012ba19c00 x1830949052126720/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:489/0 lens 488/0 e 0 to 0 dl 1746129759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129748.991103:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba19c00 with x1830949052126720 ext(344064->348159) 00002000:00010000:0.0:1746129748.991106:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba19c00 00000100:00100000:0.0:1746129748.991115:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052126976 00000100:00100000:0.0:1746129748.991116:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052126976 00002000:00100000:0.0:1746129748.991124:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3768320->3772415) req@ffff88012ba18700 x1830949052126976/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:489/0 lens 488/0 e 0 to 0 dl 1746129759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129748.991130:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba18700 with x1830949052126976 ext(3768320->3772415) 00002000:00010000:0.0:1746129748.991133:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba18700 00000100:00100000:0.0:1746129748.991140:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3979 00000100:00100000:0.0:1746129748.991144:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949052126720:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129748.991229:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949052126720:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 84us (193us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129748.991234:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3979 00002000:00100000:0.0:1746129748.991238:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (344064->348159) req@ffff88012ba19c00 x1830949052126720/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:489/0 lens 488/4536 e 0 to 0 dl 1746129759 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129748.991244:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba19c00 with x1830949052126720 ext(344064->348159) 00002000:00010000:0.0:1746129748.991247:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba19c00 00000100:00100000:0.0:1746129748.991255:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3980 00000100:00100000:0.0:1746129748.991259:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1961:x1830949052126976:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129748.991304:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1961:x1830949052126976:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 44us (240us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129748.991309:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3980 00002000:00100000:0.0:1746129748.991312:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3768320->3772415) req@ffff88012ba18700 x1830949052126976/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:489/0 lens 488/4536 e 0 to 0 dl 1746129759 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129748.991317:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba18700 with x1830949052126976 ext(3768320->3772415) 00002000:00010000:0.0:1746129748.991319:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba18700 00000100:00100000:3.0:1746129748.993233:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095240000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053283072:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129748.993250:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129748.993277:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+20:1964:x1830949052126208:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 19712us (20347us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129748.993285:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5171 00000100:00100000:2.0:1746129749.004951:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129749.005088:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052127232 00000100:00100000:1.0:1746129749.005096:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052127232 00002000:00100000:1.0:1746129749.005136:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880135d8ce00 x1830949052127232/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.005145:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8ce00 with x1830949052127232 ext(1048576->2097151) 00002000:00010000:1.0:1746129749.005150:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d8ce00 00000100:00100000:1.0:1746129749.005166:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3981 00000100:00100000:1.0:1746129749.005173:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1963:x1830949052127232:12345-192.168.204.31@tcp:3:multiop.0 00000100:00080000:2.0:1746129749.007552:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746129749.010538:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.011041:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052127360 00000100:00100000:2.0:1746129749.011050:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052127360 00000100:00100000:2.0:1746129749.011088:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10791 00000100:00100000:2.0:1746129749.011095:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:28513:x1830949052127360:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129749.011109:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129749.011122:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f5d400/0x48868a4e43948f70 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f2ca expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.011145:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f800/0x48868a4e43948e43 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f222 expref: 19 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129749.011154:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c12c400/0x48868a4e43948f2a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f28b expref: 22 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129749.011160:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a14d200/0x48868a4e43948edd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f25a expref: 31 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129749.011166:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129749.011167:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129749.011170:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f5d400/0x48868a4e43948f70 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->4288511] (req 4194304->4288511) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ca expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.011194:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a14d200/0x48868a4e43948edd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f25a expref: 31 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129749.011203:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a14d200/0x48868a4e43948edd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f25a expref: 31 pid: 3624 timeout: 795 lvb_type: 1 00000100:00100000:2.0:1746129749.011213:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053283200:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129749.011267:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c12c400/0x48868a4e43948f2a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f28b expref: 22 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129749.011275:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c12c400/0x48868a4e43948f2a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f28b expref: 22 pid: 8436 timeout: 795 lvb_type: 1 00000100:00100000:2.0:1746129749.011282:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053283328:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129749.011304:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f800/0x48868a4e43948e43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f222 expref: 19 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129749.011311:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f800/0x48868a4e43948e43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f222 expref: 19 pid: 7975 timeout: 795 lvb_type: 1 00000100:00100000:2.0:1746129749.011318:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053283456:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129749.011331:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366d80 going to sleep for 11 seconds 00000100:00080000:0.0:1746129749.011520:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129749.011610:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949052126464:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 21776us (22456us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129749.011618:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3978 00002000:00100000:1.0:1746129749.011626:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800a00c7100 x1830949052126464/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:489/0 lens 488/440 e 0 to 0 dl 1746129759 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.011634:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c7100 with x1830949052126464 ext(1048576->2097151) 00002000:00010000:1.0:1746129749.011638:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a00c7100 00000100:00100000:2.0:1746129749.013734:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.013765:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.013787:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052127488 00000100:00100000:2.0:1746129749.013791:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052127488 00000100:00100000:1.0:1746129749.014345:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1963:x1830949052127232:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 9170us (9398us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129749.014353:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3981 00002000:00100000:1.0:1746129749.014362:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880135d8ce00 x1830949052127232/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.014371:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8ce00 with x1830949052127232 ext(1048576->2097151) 00002000:00010000:1.0:1746129749.014376:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d8ce00 00000100:00100000:2.0:1746129749.014414:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10792 00000100:00100000:2.0:1746129749.014421:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:28518:x1830949052127488:12345-192.168.204.31@tcp:101:multiop.0 00000100:00100000:1.0:1746129749.014421:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129749.014432:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129749.014444:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d6c5400/0x48868a4e43948f77 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f2d1 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.014482:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f600/0x48868a4e43948e35 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f20d expref: 19 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129749.014495:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c12c800/0x48868a4e43948f07 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f276 expref: 19 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129749.014501:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fb67600/0x48868a4e43948ee4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f245 expref: 29 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129749.014506:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129749.014508:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129749.014511:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6c5400/0x48868a4e43948f77 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->1282047] (req 1048576->1282047) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2d1 expref: 29 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129749.014513:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129749.014534:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fb67600/0x48868a4e43948ee4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f245 expref: 29 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129749.014543:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fb67600/0x48868a4e43948ee4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f245 expref: 29 pid: 8436 timeout: 795 lvb_type: 1 00000100:00100000:2.0:1746129749.014556:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135402680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053283584:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129749.014605:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c12c800/0x48868a4e43948f07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f276 expref: 19 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129749.014612:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c12c800/0x48868a4e43948f07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f276 expref: 19 pid: 4589 timeout: 795 lvb_type: 1 00000100:00100000:2.0:1746129749.014620:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a56d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053283712:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129749.014639:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f600/0x48868a4e43948e35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f20d expref: 19 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129749.014646:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f600/0x48868a4e43948e35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f20d expref: 19 pid: 7975 timeout: 795 lvb_type: 1 00000100:00100000:2.0:1746129749.014651:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a56c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053283840:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129749.014662:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129749.014678:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052127616 00000100:00100000:2.0:1746129749.014680:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052127616 00010000:00010000:2.0:1746129749.014701:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f800/0x48868a4e43948e43 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f222 expref: 20 pid: 7975 timeout: 795 lvb_type: 1 00000100:00100000:2.0:1746129749.014712:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052127744 00000100:00100000:2.0:1746129749.014714:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052127744 00010000:00010000:2.0:1746129749.014721:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a14d200/0x48868a4e43948edd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f25a expref: 32 pid: 3624 timeout: 795 lvb_type: 1 00000100:00100000:2.0:1746129749.014730:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052127872 00000100:00100000:2.0:1746129749.014732:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052127872 00010000:00010000:2.0:1746129749.014739:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c12c400/0x48868a4e43948f2a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f28b expref: 23 pid: 8436 timeout: 795 lvb_type: 1 00000100:00100000:2.0:1746129749.014749:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5172 00000100:00100000:2.0:1746129749.014753:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+20:1961:x1830949052127616:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129749.014761:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129749.014775:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f800/0x48868a4e43948e43 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f222 expref: 20 pid: 7975 timeout: 795 lvb_type: 1 00010000:00010000:2.0:1746129749.014782:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f800/0x48868a4e43948e43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f222 expref: 20 pid: 7975 timeout: 795 lvb_type: 1 00010000:00010000:2.0:1746129749.014799:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129749.014813:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+20:1961:x1830949052127616:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 59us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129749.014818:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5172 00000100:00100000:2.0:1746129749.014828:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5173 00000100:00100000:2.0:1746129749.014832:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949052127744:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129749.014838:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129749.014845:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a14d200/0x48868a4e43948edd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f25a expref: 32 pid: 3624 timeout: 795 lvb_type: 1 00010000:00010000:2.0:1746129749.014872:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a14d200/0x48868a4e43948edd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f25a expref: 32 pid: 3624 timeout: 795 lvb_type: 1 00010000:00010000:2.0:1746129749.014881:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129749.014896:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949052127744:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 63us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129749.014901:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5173 00000100:00100000:2.0:1746129749.014911:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5174 00000100:00100000:2.0:1746129749.014916:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1962:x1830949052127872:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129749.014922:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129749.014928:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c12c400/0x48868a4e43948f2a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f28b expref: 23 pid: 8436 timeout: 795 lvb_type: 1 00010000:00010000:2.0:1746129749.014935:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c12c400/0x48868a4e43948f2a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f28b expref: 23 pid: 8436 timeout: 795 lvb_type: 1 00010000:00010000:2.0:1746129749.014945:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129749.014946:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129749.014951:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f5d400/0x48868a4e43948f70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ca expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.014956:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f5d400/0x48868a4e43948f70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ca expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.014975:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f5d400/0x48868a4e43948f70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ca expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129749.014983:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d634380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053283968:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129749.015011:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366840 going to sleep for 11 seconds 00010000:00010000:2.0:1746129749.015041:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a14d200/0x48868a4e43948edd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f25a expref: 31 pid: 3624 timeout: 795 lvb_type: 1 00000100:00100000:2.0:1746129749.015051:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053283200:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129749.015060:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c12c400/0x48868a4e43948f2a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f28b expref: 23 pid: 8436 timeout: 795 lvb_type: 1 00000100:00100000:2.0:1746129749.015067:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053283328:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129749.015075:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f800/0x48868a4e43948e43 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f222 expref: 19 pid: 7975 timeout: 795 lvb_type: 1 00000100:00100000:2.0:1746129749.015082:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053283456:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129749.015099:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f5d400/0x48868a4e43948f70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ca expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.015106:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f5d400, rc 0) 00000100:00100000:2.0:1746129749.015121:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:28513:x1830949052127360:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4027us (4592us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129749.015127:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10791 00000100:00080000:0.0:1746129749.016350:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746129749.018889:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135402680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053283584:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129749.023517:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.023542:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.023600:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052128256 00000100:00100000:0.0:1746129749.023607:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052128256 00010000:00010000:0.0:1746129749.023632:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb67600/0x48868a4e43948ee4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f245 expref: 30 pid: 8436 timeout: 795 lvb_type: 1 00000100:00100000:0.0:1746129749.023656:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5175 00000100:00100000:0.0:1746129749.023662:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949052128256:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129749.023674:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129749.023690:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fb67600/0x48868a4e43948ee4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f245 expref: 30 pid: 8436 timeout: 795 lvb_type: 1 00010000:00010000:0.0:1746129749.023700:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fb67600/0x48868a4e43948ee4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f245 expref: 30 pid: 8436 timeout: 795 lvb_type: 1 00010000:00010000:0.0:1746129749.023717:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fb67600/0x48868a4e43948ee4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f245 expref: 30 pid: 8436 timeout: 795 lvb_type: 1 00010000:00010000:0.0:1746129749.023729:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129749.023760:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949052128256:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 99us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129749.023766:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5175 00000100:00100000:0.0:1746129749.023796:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d634380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053283968:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129749.024112:0:20054:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746129749.024124:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052128128 00000100:00100000:1.0:1746129749.024127:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052128128 00002000:00100000:1.0:1746129749.024152:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88012ba1a300 x1830949052128128/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.024160:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba1a300 with x1830949052128128 ext(1048576->2097151) 00002000:00010000:1.0:1746129749.024164:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba1a300 00000100:00100000:1.0:1746129749.024186:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3982 00000100:00100000:1.0:1746129749.024191:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052128128:12345-192.168.204.31@tcp:3:multiop.0 00010000:00010000:0.0:1746129749.025147:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129749.025170:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052127872:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 10252us (10655us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129749.025176:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5174 00000100:00100000:0.0:1746129749.025280:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a56d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053283712:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129749.025288:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a56c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053283840:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129749.025306:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d6c5400/0x48868a4e43948f77 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->1282047] (req 1048576->1282047) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2d1 expref: 28 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.025316:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c5400, rc 0) 00000100:00100000:0.0:1746129749.025334:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:28518:x1830949052127488:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 10915us (11604us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129749.025340:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10792 00000100:00100000:0.0:1746129749.025979:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.026000:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.026029:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.026053:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.026068:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052128384 00000100:00100000:0.0:1746129749.026073:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052128384 00010000:00010000:0.0:1746129749.026095:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f600/0x48868a4e43948e35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f20d expref: 20 pid: 7975 timeout: 795 lvb_type: 1 00000100:00100000:0.0:1746129749.026107:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052128768 00000100:00100000:0.0:1746129749.026109:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052128768 00010000:00010000:0.0:1746129749.026116:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c12c800/0x48868a4e43948f07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f276 expref: 20 pid: 4589 timeout: 795 lvb_type: 1 00000100:00100000:0.0:1746129749.026127:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5176 00000100:00100000:0.0:1746129749.026132:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+20:1961:x1830949052128384:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129749.026140:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129749.026153:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f600/0x48868a4e43948e35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f20d expref: 20 pid: 7975 timeout: 795 lvb_type: 1 00010000:00010000:0.0:1746129749.026160:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f600/0x48868a4e43948e35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f20d expref: 20 pid: 7975 timeout: 795 lvb_type: 1 00010000:00010000:0.0:1746129749.026174:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f600/0x48868a4e43948e35 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f20d expref: 20 pid: 7975 timeout: 795 lvb_type: 1 00010000:00010000:0.0:1746129749.026184:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129749.026201:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+19:1961:x1830949052128384:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 69us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129749.026205:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5176 00000100:00100000:0.0:1746129749.026214:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5177 00000100:00100000:0.0:1746129749.026218:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1963:x1830949052128768:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129749.026223:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129749.026228:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c12c800/0x48868a4e43948f07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f276 expref: 20 pid: 4589 timeout: 795 lvb_type: 1 00010000:00010000:0.0:1746129749.026234:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c12c800/0x48868a4e43948f07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f276 expref: 20 pid: 4589 timeout: 795 lvb_type: 1 00010000:00010000:0.0:1746129749.026243:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c12c800/0x48868a4e43948f07 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f276 expref: 20 pid: 4589 timeout: 795 lvb_type: 1 00010000:00010000:0.0:1746129749.026250:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129749.026251:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129749.026256:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c5400/0x48868a4e43948f77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2d1 expref: 27 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.026263:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6c5400/0x48868a4e43948f77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2d1 expref: 27 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.026284:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d6c5400/0x48868a4e43948f77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2d1 expref: 27 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129749.026293:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135402680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053284096:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129749.026331:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942cc0 going to sleep for 11 seconds 00000100:00080000:0.0:1746129749.026339:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746129749.026540:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052128640 00000100:00100000:3.0:1746129749.026544:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052128640 00002000:00100000:3.0:1746129749.026563:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4284416->4288511) req@ffff88009a56c700 x1830949052128640/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.026576:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56c700 with x1830949052128640 ext(4284416->4288511) 00002000:00010000:3.0:1746129749.026579:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a56c700 00000100:00100000:3.0:1746129749.026588:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052129024 00000100:00100000:3.0:1746129749.026590:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052129024 00002000:00100000:3.0:1746129749.026598:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009a56d500 x1830949052129024/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.026603:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56d500 with x1830949052129024 ext(1048576->2097151) 00002000:00010000:3.0:1746129749.026605:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a56d500 00000100:00100000:3.0:1746129749.026612:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3983 00000100:00100000:3.0:1746129749.026616:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949052128640:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129749.026719:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949052128640:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 102us (719us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129749.026724:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3983 00002000:00100000:3.0:1746129749.026728:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4284416->4288511) req@ffff88009a56c700 x1830949052128640/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/4536 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.026734:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56c700 with x1830949052128640 ext(4284416->4288511) 00002000:00010000:3.0:1746129749.026736:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a56c700 00000100:00100000:3.0:1746129749.026748:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3984 00000100:00100000:3.0:1746129749.026751:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949052129024:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129749.030891:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135402680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053284096:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129749.030908:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129749.030942:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1963:x1830949052128768:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4722us (4911us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129749.030951:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5177 00000100:00100000:0.0:1746129749.038208:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.039016:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.039079:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052129536 00000100:00100000:2.0:1746129749.039086:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052129536 00000100:00100000:2.0:1746129749.039125:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3855 00000100:00100000:2.0:1746129749.039132:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28513:x1830949052129536:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129749.039355:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052129280 00000100:00100000:1.0:1746129749.039360:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052129280 00000100:00100000:2.0:1746129749.039366:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28513:x1830949052129536:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 234us (350us total) trans 8589943609 rc 0/0 00000100:00100000:2.0:1746129749.039372:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3855 00002000:00100000:1.0:1746129749.039382:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1277952->1282047) req@ffff880135402680 x1830949052129280/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.039391:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135402680 with x1830949052129280 ext(1277952->1282047) 00002000:00010000:1.0:1746129749.039395:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135402680 00000100:00100000:1.0:1746129749.039406:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3985 00000100:00100000:1.0:1746129749.039410:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949052129280:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129749.039533:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949052129280:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 122us (1331us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129749.039539:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3985 00002000:00100000:1.0:1746129749.039544:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1277952->1282047) req@ffff880135402680 x1830949052129280/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/4536 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.039550:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135402680 with x1830949052129280 ext(1277952->1282047) 00002000:00010000:1.0:1746129749.039553:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135402680 00000100:00080000:0.0:1746129749.040627:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746129749.045210:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949052129024:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 18448us (19147us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129749.045221:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3984 00002000:00100000:3.0:1746129749.045231:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009a56d500 x1830949052129024/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.045240:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56d500 with x1830949052129024 ext(1048576->2097151) 00002000:00010000:3.0:1746129749.045245:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a56d500 00000001:00080000:2.0:1746129749.047276:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873109 is committed 00000001:00080000:2.0:1746129749.047308:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873070 is committed 00000001:00080000:2.0:1746129749.047329:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873048 is committed 00000001:00080000:2.0:1746129749.047355:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873081 is committed 00000001:00080000:2.0:1746129749.047367:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873031 is committed 00000001:00080000:2.0:1746129749.047385:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873110 is committed 00000001:00080000:2.0:1746129749.047392:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873104 is committed 00000001:00080000:2.0:1746129749.047396:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873103 is committed 00000001:00080000:2.0:1746129749.047403:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873083 is committed 00000001:00080000:2.0:1746129749.047435:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873113 is committed 00000100:00100000:1.0:1746129749.049039:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1962:x1830949052128128:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 24837us (25518us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129749.049049:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3982 00002000:00100000:1.0:1746129749.049060:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88012ba1a300 x1830949052128128/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.049068:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba1a300 with x1830949052128128 ext(1048576->2097151) 00002000:00010000:1.0:1746129749.049073:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba1a300 00000100:00100000:0.0:1746129749.054534:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.054582:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.054611:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052129664 00000100:00100000:2.0:1746129749.054620:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052129664 00000100:00100000:2.0:1746129749.054657:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052129792 00000100:00100000:2.0:1746129749.054660:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052129792 00000100:00100000:2.0:1746129749.054675:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10793 00000100:00100000:2.0:1746129749.054682:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949052129664:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:0.0:1746129749.054693:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10794 00010000:00010000:2.0:1746129749.054698:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129749.054700:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949052129792:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129749.054707:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129749.054711:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d6c5a00/0x48868a4e43948f7e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f2d8 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.054716:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e1aa600/0x48868a4e43948f85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f2df expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129749.054749:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d637480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053284224:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129749.054749:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b024a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053284352:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129749.054972:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129749.055129:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942000 going to sleep for 11 seconds 00002000:00010000:2.0:1746129749.056558:0:3623:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime: 1746129748 -> 1746129749 00002000:00010000:2.0:1746129749.056563:0:3623:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime: 1746129747 -> 1746129749 00002000:00010000:2.0:1746129749.056565:0:3623:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime: 1746129748 -> 1746129749 00000100:00100000:2.0:1746129749.056583:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d637480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053284224:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129749.056604:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d6c5a00/0x48868a4e43948f7e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2d8 expref: 20 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129749.056615:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d6c5a00/0x48868a4e43948f7e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2d8 expref: 20 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129749.056624:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c5a00, rc 0) 00000100:00100000:2.0:1746129749.056664:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949052129664:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1981us (2137us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129749.056674:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10793 00002000:00010000:2.0:1746129749.057657:0:20441:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime: 1746129748 -> 1746129749 00002000:00010000:2.0:1746129749.057660:0:20441:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746129747 -> 1746129749 00002000:00010000:2.0:1746129749.057661:0:20441:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime: 1746129748 -> 1746129749 00000100:00100000:2.0:1746129749.057674:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b024a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053284352:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129749.057690:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e1aa600/0x48868a4e43948f85 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2df expref: 29 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129749.057699:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e1aa600/0x48868a4e43948f85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2df expref: 29 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129749.057706:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1aa600, rc 0) 00000100:00100000:2.0:1746129749.057735:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949052129792:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3036us (3152us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129749.057741:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10794 00000100:00100000:0.0:1746129749.061034:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.061077:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.061103:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129749.061128:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052130176 00000100:00100000:0.0:1746129749.061129:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129749.061135:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052130176 00000100:00100000:0.0:1746129749.061152:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:1.0:1746129749.061168:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012b027480 x1830949052130176/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746129749.061176:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052130560 00002000:00100000:1.0:1746129749.061176:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b027480 with x1830949052130176 ext(2097152->3145727) 00002000:00010000:1.0:1746129749.061180:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b027480 00000100:00100000:3.0:1746129749.061186:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052130560 00000100:00100000:1.0:1746129749.061192:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052130432 00000100:00100000:1.0:1746129749.061194:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052130432 00002000:00100000:1.0:1746129749.061200:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012b024a80 x1830949052130432/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.061204:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012b027100 x1830949052130560/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.061205:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b024a80 with x1830949052130432 ext(3145728->4194303) 00002000:00010000:1.0:1746129749.061208:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b024a80 00002000:00100000:3.0:1746129749.061211:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b027100 with x1830949052130560 ext(2097152->3145727) 00002000:00010000:3.0:1746129749.061215:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b027100 00000100:00100000:1.0:1746129749.061235:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3986 00000100:00100000:1.0:1746129749.061241:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1963:x1830949052130176:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129749.061268:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052130944 00000100:00100000:3.0:1746129749.061271:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052130944 00002000:00100000:3.0:1746129749.061283:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->3768319) req@ffff880136886a00 x1830949052130944/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.061289:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136886a00 with x1830949052130944 ext(3145728->3768319) 00002000:00010000:3.0:1746129749.061292:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136886a00 00000100:00100000:3.0:1746129749.061302:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3987 00000100:00100000:2.0:1746129749.061326:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3988 00000100:00100000:2.0:1746129749.061333:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949052130560:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129749.062343:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052129920 00000100:00100000:2.0:1746129749.062348:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052129920 00000100:00100000:2.0:1746129749.062369:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10795 00000100:00100000:2.0:1746129749.062375:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:28517:x1830949052129920:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129749.062383:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129749.062384:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3989 00000100:00100000:1.0:1746129749.062390:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1963:x1830949052130944:12345-192.168.204.31@tcp:3:cat.0 00010000:00010000:2.0:1746129749.062396:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d6c5e00/0x48868a4e43948f8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f2e6 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.062420:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f5d400/0x48868a4e43948f70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ca expref: 9 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.062426:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129749.062427:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129749.062430:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6c5e00/0x48868a4e43948f8c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2e6 expref: 20 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.062464:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f5d400/0x48868a4e43948f70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ca expref: 9 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.062474:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f5d400/0x48868a4e43948f70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ca expref: 9 pid: 8437 timeout: 795 lvb_type: 0 00000100:00100000:2.0:1746129749.062483:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d637480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053284480:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129749.062531:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129749.062588:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1963:x1830949052130432:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129749.071918:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.071988:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052131072 00000100:00100000:3.0:1746129749.071996:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052131072 00000100:00100000:2.0:1746129749.072012:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d637480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053284480:192.168.204.31@tcp:104: 00002000:00100000:3.0:1746129749.072032:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4288511) req@ffff880136886300 x1830949052131072/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746129749.072038:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d6c5e00/0x48868a4e43948f8c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2e6 expref: 20 pid: 20441 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746129749.072041:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136886300 with x1830949052131072 ext(4194304->4288511) 00010000:00010000:3.0:1746129749.072048:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f5d400/0x48868a4e43948f70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ca expref: 11 pid: 8437 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.072051:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c5e00, rc 0) 00010000:00010000:3.0:1746129749.072064:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f5d400/0x48868a4e43948f70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ca expref: 11 pid: 8437 timeout: 795 lvb_type: 0 00002000:00010000:3.0:1746129749.072070:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136886300 00000100:00100000:2.0:1746129749.072087:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:28517:x1830949052129920:12345-192.168.204.31@tcp:101:cat.0 Request processed in 9713us (11061us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129749.072094:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10795 00000100:00100000:3.0:1746129749.072452:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 563 00000100:00100000:3.0:1746129749.072461:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052131072:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129749.073001:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1964:x1830949052130560:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11665us (11894us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129749.073008:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3988 00002000:00100000:2.0:1746129749.073014:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012b027100 x1830949052130560/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.073020:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b027100 with x1830949052130560 ext(2097152->3145727) 00002000:00010000:2.0:1746129749.073023:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b027100 00000100:00100000:1.0:1746129749.080519:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1963:x1830949052130176:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19270us (19437us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129749.080528:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3986 00002000:00100000:1.0:1746129749.080538:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012b027480 x1830949052130176/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.080547:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b027480 with x1830949052130176 ext(2097152->3145727) 00010000:00010000:1.0:1746129749.080556:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f5d400/0x48868a4e43948f70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ca expref: 11 pid: 8437 timeout: 795 lvb_type: 0 00010000:00010000:1.0:1746129749.080573:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f5d400/0x48868a4e43948f70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ca expref: 11 pid: 8437 timeout: 795 lvb_type: 0 00002000:00010000:1.0:1746129749.080581:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b027480 00000100:00100000:1.0:1746129749.082534:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1963:x1830949052130944:12345-192.168.204.31@tcp:3:cat.0 Request processed in 20137us (21374us total) trans 0 rc 622592/622592 00000100:00100000:1.0:1746129749.082543:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3989 00002000:00100000:1.0:1746129749.082551:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->3768319) req@ffff880136886a00 x1830949052130944/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 622592/622592 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.082559:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136886a00 with x1830949052130944 ext(3145728->3768319) 00002000:00010000:1.0:1746129749.082563:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136886a00 00000100:00100000:2.0:1746129749.084156:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1963:x1830949052130432:12345-192.168.204.31@tcp:3:cat.0 Request processed in 22843us (23022us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129749.084164:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3987 00002000:00100000:2.0:1746129749.084172:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012b024a80 x1830949052130432/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.084179:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b024a80 with x1830949052130432 ext(3145728->4194303) 00010000:00010000:2.0:1746129749.084186:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f5d400/0x48868a4e43948f70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ca expref: 9 pid: 8437 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.084199:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f5d400/0x48868a4e43948f70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ca expref: 9 pid: 8437 timeout: 795 lvb_type: 0 00002000:00010000:2.0:1746129749.084205:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b024a80 00000100:00100000:3.0:1746129749.084476:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1961:x1830949052131072:12345-192.168.204.31@tcp:4:cat.0 Request processed in 12014us (12564us total) trans 17179873123 rc 0/0 00000100:00100000:3.0:1746129749.084483:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 563 00002000:00100000:3.0:1746129749.084488:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4288511) req@ffff880136886300 x1830949052131072/t17179873123(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/448 e 0 to 0 dl 1746129760 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.084494:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136886300 with x1830949052131072 ext(4194304->4288511) 00010000:00010000:3.0:1746129749.084499:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f5d400/0x48868a4e43948f70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ca expref: 9 pid: 8437 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746129749.084508:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f5d400/0x48868a4e43948f70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ca expref: 9 pid: 8437 timeout: 795 lvb_type: 0 00002000:00010000:3.0:1746129749.084513:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136886300 00000100:00100000:0.0:1746129749.095915:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.095973:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052131200 00000100:00100000:2.0:1746129749.095981:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052131200 00000100:00100000:2.0:1746129749.096017:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10796 00000100:00100000:2.0:1746129749.096023:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28516:x1830949052131200:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129749.096039:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129749.096055:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d6c4c00/0x48868a4e43948f93 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f2ed expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.096077:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129749.096079:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129749.096083:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6c4c00/0x48868a4e43948f93 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ed expref: 10 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.096093:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d6c4c00/0x48868a4e43948f93 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ed expref: 10 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.096101:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c4c00, rc 0) 00000100:00100000:2.0:1746129749.096145:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28516:x1830949052131200:12345-192.168.204.31@tcp:101:cat.0 Request processed in 122us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129749.096151:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10796 00000100:00100000:0.0:1746129749.097147:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.097349:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052131328 00000100:00100000:2.0:1746129749.097354:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052131328 00010000:00010000:2.0:1746129749.097379:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f5d400/0x48868a4e43948f70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ca expref: 10 pid: 8437 timeout: 795 lvb_type: 0 00000100:00100000:2.0:1746129749.097407:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5178 00000100:00100000:2.0:1746129749.097412:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949052131328:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129749.097423:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129749.097441:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f5d400/0x48868a4e43948f70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ca expref: 10 pid: 8437 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.097462:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4f5d400/0x48868a4e43948f70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ca expref: 10 pid: 8437 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.097482:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f5d400/0x48868a4e43948f70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ca expref: 10 pid: 8437 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.097505:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129749.097506:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129749.097511:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d6c5e00/0x48868a4e43948f8c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2e6 expref: 19 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.097518:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6c5e00/0x48868a4e43948f8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2e6 expref: 19 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.097524:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129749.097525:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129749.097527:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d6c4c00/0x48868a4e43948f93 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ed expref: 9 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.097532:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6c4c00/0x48868a4e43948f93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ed expref: 9 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.097556:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d6c4c00/0x48868a4e43948f93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ed expref: 9 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129749.097565:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d637480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053284608:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129749.097639:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d6c5e00/0x48868a4e43948f8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2e6 expref: 19 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129749.097652:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d637b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053284736:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129749.097669:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129749.103414:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d637480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053284608:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129749.103426:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d637b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053284736:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129749.103443:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129749.103491:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052131328:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6077us (6347us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129749.103501:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5178 00000100:00100000:0.0:1746129749.105518:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.105646:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052131584 00000100:00100000:3.0:1746129749.105653:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052131584 00002000:00100000:3.0:1746129749.105688:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880136884380 x1830949052131584/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.105696:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136884380 with x1830949052131584 ext(2097152->3145727) 00002000:00010000:3.0:1746129749.105701:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136884380 00000100:00100000:3.0:1746129749.105731:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3990 00000100:00100000:3.0:1746129749.105737:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949052131584:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129749.112965:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.113072:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052131840 00000100:00100000:2.0:1746129749.113080:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052131840 00002000:00100000:2.0:1746129749.113116:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880136885500 x1830949052131840/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.113125:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136885500 with x1830949052131840 ext(3145728->4194303) 00002000:00010000:2.0:1746129749.113130:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136885500 00000100:00100000:2.0:1746129749.113160:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3991 00000100:00100000:2.0:1746129749.113167:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052131840:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129749.116054:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949052131584:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10309us (10535us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129749.116065:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3990 00002000:00100000:3.0:1746129749.116075:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880136884380 x1830949052131584/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.116083:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136884380 with x1830949052131584 ext(2097152->3145727) 00002000:00010000:3.0:1746129749.116089:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136884380 00000100:00100000:2.0:1746129749.121964:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052131840:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8789us (9000us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129749.121974:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3991 00002000:00100000:2.0:1746129749.121984:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880136885500 x1830949052131840/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.121991:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136885500 with x1830949052131840 ext(3145728->4194303) 00002000:00010000:2.0:1746129749.121997:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136885500 00000100:00100000:0.0:1746129749.127409:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.127523:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052131968 00000100:00100000:2.0:1746129749.127531:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052131968 00000100:00100000:2.0:1746129749.128542:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10797 00000100:00100000:2.0:1746129749.128552:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:28517:x1830949052131968:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129749.128567:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129749.128582:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d6c4a00/0x48868a4e43948f9a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f2f4 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.128607:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9800/0x48868a4e43948f69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2c3 expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.128614:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129749.128615:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129749.128618:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6c4a00/0x48868a4e43948f9a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2f4 expref: 29 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.128640:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9800/0x48868a4e43948f69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2c3 expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.128649:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9800/0x48868a4e43948f69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2c3 expref: 18 pid: 8437 timeout: 795 lvb_type: 0 00000100:00100000:2.0:1746129749.128659:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d637b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053284864:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129749.129263:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129749.129977:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.130010:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.130129:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d637b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053284864:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129749.130149:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d6c4a00/0x48868a4e43948f9a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2f4 expref: 29 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.130162:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c4a00, rc 0) 00000100:00100000:2.0:1746129749.130201:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:28517:x1830949052131968:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1651us (2799us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129749.130207:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10797 00000100:00100000:2.0:1746129749.130226:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052132096 00000100:00100000:2.0:1746129749.130230:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052132096 00000100:00100000:2.0:1746129749.130247:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052132224 00000100:00100000:2.0:1746129749.130248:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052132224 00000100:00100000:2.0:1746129749.130269:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10798 00000100:00100000:2.0:1746129749.130274:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052132096:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129749.130283:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129749.130293:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d6c4e00/0x48868a4e43948fa1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f2fb expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129749.130294:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10799 00000100:00100000:1.0:1746129749.130303:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949052132224:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129749.130311:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129749.130318:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d637b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053284992:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129749.130319:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801318e0800/0x48868a4e43948fa8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f302 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129749.130343:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053285120:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129749.130354:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129749.130367:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4948840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129749.131088:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.131252:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052132352 00000100:00100000:2.0:1746129749.131256:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052132352 00002000:00100000:2.0:1746129749.131674:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3768320->4194303) req@ffff880136884700 x1830949052132352/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.131683:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136884700 with x1830949052132352 ext(3768320->4194303) 00010000:00010000:2.0:1746129749.131690:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9800/0x48868a4e43948f69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2c3 expref: 21 pid: 8437 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.131701:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9800/0x48868a4e43948f69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2c3 expref: 21 pid: 8437 timeout: 795 lvb_type: 0 00002000:00010000:2.0:1746129749.131707:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136884700 00000100:00100000:2.0:1746129749.131732:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 564 00000100:00100000:2.0:1746129749.131739:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1962:x1830949052132352:12345-192.168.204.31@tcp:4:cat.0 00002000:00010000:1.0:1746129749.132721:0:4589:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime: 1746129747 -> 1746129749 00002000:00010000:1.0:1746129749.132725:0:4589:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime: 1746129747 -> 1746129749 00002000:00010000:1.0:1746129749.132727:0:4589:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime: 1746129747 -> 1746129749 00000100:00100000:1.0:1746129749.132743:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053285120:192.168.204.31@tcp:106: 00002000:00010000:3.0:1746129749.132761:0:3623:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime: 1746129747 -> 1746129749 00002000:00010000:3.0:1746129749.132764:0:3623:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime: 1746129747 -> 1746129749 00002000:00010000:3.0:1746129749.132765:0:3623:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime: 1746129747 -> 1746129749 00010000:00010000:1.0:1746129749.132769:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801318e0800/0x48868a4e43948fa8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f302 expref: 21 pid: 4589 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129749.132777:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d637b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053284992:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129749.132779:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801318e0800/0x48868a4e43948fa8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f302 expref: 21 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129749.132792:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801318e0800, rc 0) 00010000:00010000:3.0:1746129749.132793:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d6c4e00/0x48868a4e43948fa1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2fb expref: 10 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129749.132802:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d6c4e00/0x48868a4e43948fa1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2fb expref: 10 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129749.132819:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c4e00, rc 0) 00000100:00100000:1.0:1746129749.132823:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949052132224:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2521us (2811us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129749.132829:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10799 00000100:00100000:3.0:1746129749.132842:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052132096:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2567us (2867us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129749.132864:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10798 00000100:00100000:0.0:1746129749.137300:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.137382:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052132608 00000100:00100000:3.0:1746129749.137390:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052132608 00002000:00100000:3.0:1746129749.137427:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880136886680 x1830949052132608/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.137437:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136886680 with x1830949052132608 ext(4194304->4964351) 00002000:00010000:3.0:1746129749.137441:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136886680 00000100:00100000:3.0:1746129749.137755:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3992 00000100:00100000:3.0:1746129749.137762:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052132608:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129749.144142:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1962:x1830949052132352:12345-192.168.204.31@tcp:4:cat.0 Request processed in 12394us (13045us total) trans 21474840278 rc 0/0 00000100:00100000:2.0:1746129749.144152:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 564 00002000:00100000:2.0:1746129749.144162:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3768320->4194303) req@ffff880136884700 x1830949052132352/t21474840278(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/448 e 0 to 0 dl 1746129760 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.144171:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136884700 with x1830949052132352 ext(3768320->4194303) 00010000:00010000:2.0:1746129749.144180:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9800/0x48868a4e43948f69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2c3 expref: 21 pid: 8437 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.144192:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9800/0x48868a4e43948f69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2c3 expref: 21 pid: 8437 timeout: 795 lvb_type: 0 00002000:00010000:2.0:1746129749.144198:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136884700 00000100:00100000:2.0:1746129749.144978:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052132608:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7214us (7683us total) trans 0 rc 770048/770048 00000100:00100000:2.0:1746129749.144984:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3992 00002000:00100000:2.0:1746129749.144989:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880136886680 x1830949052132608/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.144994:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136886680 with x1830949052132608 ext(4194304->4964351) 00002000:00010000:2.0:1746129749.144998:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136886680 00000100:00100000:0.0:1746129749.152762:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.152785:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.152806:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.152827:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052132736 00000100:00100000:3.0:1746129749.152834:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052132736 00000100:00100000:0.0:1746129749.152839:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.152875:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052132864 00000100:00100000:3.0:1746129749.152877:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052132864 00000100:00100000:3.0:1746129749.152886:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052133120 00000100:00100000:3.0:1746129749.152888:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052133120 00000100:00100000:3.0:1746129749.152899:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10800 00000100:00100000:3.0:1746129749.152906:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1964:x1830949052132736:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:0.0:1746129749.152915:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10801 00010000:00010000:3.0:1746129749.152919:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129749.152920:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1963:x1830949052132864:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129749.152927:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129749.152934:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8f69400/0x48868a4e43948faf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f309 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.152934:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb6fa00/0x48868a4e43948fb6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f310 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129749.152971:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095240000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053285248:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129749.152971:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053285376:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129749.153122:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10802 00000100:00100000:1.0:1746129749.153128:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1963:x1830949052133120:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129749.153135:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129749.153142:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801318e0400/0x48868a4e43948fbd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f317 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129749.153163:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053285504:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129749.154272:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19cef00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129749.155042:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052132992 00000100:00100000:2.0:1746129749.155048:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052132992 00010000:00010000:2.0:1746129749.155073:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9800/0x48868a4e43948f69 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3768320->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2c3 expref: 25 pid: 8437 timeout: 795 lvb_type: 0 00000100:00100000:2.0:1746129749.155094:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5179 00000100:00100000:2.0:1746129749.155099:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:1961:x1830949052132992:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129749.155109:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129749.155124:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9800/0x48868a4e43948f69 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3768320->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2c3 expref: 25 pid: 8437 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.155134:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9800/0x48868a4e43948f69 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3768320->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2c3 expref: 25 pid: 8437 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.155152:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129749.155153:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129749.155158:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c4a00/0x48868a4e43948f9a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2f4 expref: 28 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.155165:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6c4a00/0x48868a4e43948f9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2f4 expref: 28 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.155187:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d6c4a00/0x48868a4e43948f9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2f4 expref: 28 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129749.155196:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d637480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053285632:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129749.155222:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129749.155907:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19426c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129749.157251:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49486c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129749.164456:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095240000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053285248:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129749.164484:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8f69400/0x48868a4e43948faf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f309 expref: 10 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129749.164497:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8f69400/0x48868a4e43948faf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f309 expref: 10 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129749.164510:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8f69400, rc 0) 00000100:00100000:3.0:1746129749.164549:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1964:x1830949052132736:12345-192.168.204.31@tcp:101:cat.0 Request processed in 11642us (11791us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129749.164556:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10800 00000100:00100000:2.0:1746129749.172613:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053285376:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129749.172641:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb6fa00/0x48868a4e43948fb6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f310 expref: 25 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129749.172654:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6fa00/0x48868a4e43948fb6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f310 expref: 25 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129749.172664:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6fa00, rc 0) 00000100:00100000:2.0:1746129749.172703:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1963:x1830949052132864:12345-192.168.204.31@tcp:101:cat.0 Request processed in 19781us (19915us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129749.172711:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10801 00000100:00100000:2.0:1746129749.172815:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d637480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053285632:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129749.172825:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129749.172866:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1961:x1830949052132992:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 17747us (20006us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129749.172874:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5179 00010000:00010000:1.0:1746129749.174102:0:4589:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.31@tcp) returned -22 from glimpse AST (req@ffff8800a00c4700 x1830949053285504) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9800/0x48868a4e43948f69 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3768320->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2c3 expref: 22 pid: 8437 timeout: 795 lvb_type: 0 00010000:00010000:1.0:1746129749.174125:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9800/0x48868a4e43948f69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3768320->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2c3 expref: 22 pid: 8437 timeout: 795 lvb_type: 0 00000100:00100000:1.0:1746129749.174134:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053285504:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129749.174158:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801318e0400/0x48868a4e43948fbd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f317 expref: 21 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129749.174167:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801318e0400/0x48868a4e43948fbd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f317 expref: 21 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129749.174173:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801318e0400, rc 0) 00000100:00100000:1.0:1746129749.174199:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1963:x1830949052133120:12345-192.168.204.31@tcp:101:cat.0 Request processed in 21071us (21391us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129749.174206:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10802 00000100:00100000:2.0:1746129749.180823:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.180860:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.181151:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.181754:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.181771:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129749.182412:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052134144 00000100:00100000:1.0:1746129749.182421:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052134144 00000100:00100000:1.0:1746129749.182475:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9839 00000100:00100000:1.0:1746129749.182483:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28523:x1830949052134144:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129749.182499:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1746129749.182508:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746129749.182513:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e0000/0x48868a4e43948fc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f31e expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.182599:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1000/0x48868a4e43948fcb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.182610:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1000/0x48868a4e43948fcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.182619:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1000/0x48868a4e43948fcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.182628:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1a00/0x48868a4e43948fd2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.182637:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1a00/0x48868a4e43948fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.182641:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1a00/0x48868a4e43948fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.182722:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1e00/0x48868a4e43948fd9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.182728:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1e00/0x48868a4e43948fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.182733:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1e00/0x48868a4e43948fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:1.0:1746129749.182740:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129749.182800:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1000/0x48868a4e43948fcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.182805:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1000/0x48868a4e43948fcb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.182810:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1000/0x48868a4e43948fcb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.182814:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801318e1000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129749.182818:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1000/0x48868a4e43948fcb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.182823:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1000/0x48868a4e43948fcb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.182831:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129749.182833:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129749.182837:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1000/0x48868a4e43948fcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.182841:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1000/0x48868a4e43948fcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.182869:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1a00/0x48868a4e43948fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.182873:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1a00/0x48868a4e43948fd2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.182877:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1a00/0x48868a4e43948fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.182881:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801318e1a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129749.182883:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1a00/0x48868a4e43948fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.182887:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1a00/0x48868a4e43948fd2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.182893:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e29a000) 00010000:00010000:1.0:1746129749.182895:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129749.182897:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1a00/0x48868a4e43948fd2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.182901:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1a00/0x48868a4e43948fd2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00000100:00100000:1.0:1746129749.182922:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052133376 00000100:00100000:1.0:1746129749.182926:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052133376 00002000:00100000:1.0:1746129749.182946:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012d636300 x1830949052133376/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.182955:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d636300 with x1830949052133376 ext(2097152->3145727) 00002000:00010000:1.0:1746129749.182959:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d636300 00000100:00100000:1.0:1746129749.182969:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052133632 00000100:00100000:1.0:1746129749.182971:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052133632 00002000:00100000:1.0:1746129749.182980:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012d634e00 x1830949052133632/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.182985:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d634e00 with x1830949052133632 ext(3145728->4194303) 00002000:00010000:1.0:1746129749.182988:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d634e00 00000100:00100000:1.0:1746129749.182996:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052133888 00000100:00100000:1.0:1746129749.182998:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052133888 00002000:00100000:1.0:1746129749.183007:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012d635c00 x1830949052133888/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.183013:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d635c00 with x1830949052133888 ext(3145728->4194303) 00002000:00010000:1.0:1746129749.183016:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d635c00 00000100:00100000:1.0:1746129749.183026:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3993 00000100:00100000:1.0:1746129749.183031:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1963:x1830949052133376:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129749.183154:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.183185:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.183201:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052134272 00000100:00100000:2.0:1746129749.183204:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052134272 00000100:00100000:2.0:1746129749.183219:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052134400 00000100:00100000:2.0:1746129749.183221:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052134400 00000100:00100000:2.0:1746129749.183230:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052134528 00000100:00100000:2.0:1746129749.183232:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052134528 00000100:00100000:2.0:1746129749.183242:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10803 00000100:00100000:2.0:1746129749.183246:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1964:x1830949052134272:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129749.183253:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129749.183261:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d6c4600/0x48868a4e43948fe7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f325 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129749.183295:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d634380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053285760:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129749.183346:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129749.183359:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10804 00000100:00100000:2.0:1746129749.183364:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1964:x1830949052134400:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129749.183370:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129749.183377:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d6c5a00/0x48868a4e43948fee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f32c expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129749.183397:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053285888:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129749.183412:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129749.183517:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3994 00000100:00100000:2.0:1746129749.183522:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1963:x1830949052133632:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129749.183880:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10805 00000100:00100000:1.0:1746129749.183885:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1964:x1830949052134528:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129749.183891:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129749.183898:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801318e0c00/0x48868a4e43948ff5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f333 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.183907:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129749.183909:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129749.183916:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801318e0c00/0x48868a4e43948ff5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f333 expref: 23 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129749.183925:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801318e0c00/0x48868a4e43948ff5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f333 expref: 23 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129749.183933:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801318e0c00, rc 0) 00000100:00100000:1.0:1746129749.183964:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1964:x1830949052134528:12345-192.168.204.31@tcp:101:cat.0 Request processed in 74us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129749.183969:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10805 00000100:00100000:0.0:1746129749.183995:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3995 00000100:00100000:0.0:1746129749.184001:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1963:x1830949052133888:12345-192.168.204.31@tcp:3:cat.0 00010000:00010000:1.0:1746129749.184005:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e0000/0x48868a4e43948fc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f31e expref: 286 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.184014:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1e00/0x48868a4e43948fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f31e expref: 285 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.184020:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129749.184022:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129749.184023:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801318e1e00, rc 0) 00000100:00100000:1.0:1746129749.187323:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28523:x1830949052134144:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4831us (6497us total) trans 8589943610 rc 0/0 00000100:00100000:1.0:1746129749.187332:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9839 00000100:00100000:0.0:1746129749.188497:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.193508:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d634380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053285760:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129749.193535:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d6c4600/0x48868a4e43948fe7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f325 expref: 10 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129749.193547:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d6c4600/0x48868a4e43948fe7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f325 expref: 10 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129749.193556:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c4600, rc 0) 00000100:00100000:3.0:1746129749.193595:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1964:x1830949052134272:12345-192.168.204.31@tcp:101:cat.0 Request processed in 10348us (11821us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129749.193601:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10803 00000100:00100000:3.0:1746129749.193710:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00010000:3.0:1746129749.193740:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2081 00000100:00100000:3.0:1746129749.193745:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053285888:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129749.193758:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d6c5a00/0x48868a4e43948fee lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f32c expref: 22 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129749.193766:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c5a00/0x48868a4e43948fee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f32c expref: 22 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129749.193777:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c5a00, rc 0) 00000100:00100000:3.0:1746129749.193794:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1964:x1830949052134400:12345-192.168.204.31@tcp:101:cat.0 Request processed in 10430us (10641us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129749.193798:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10804 00000100:00100000:0.0:1746129749.193826:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052134784 00000100:00100000:0.0:1746129749.193831:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052134784 00000100:00100000:0.0:1746129749.193875:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9840 00000100:00100000:0.0:1746129749.193881:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28524:x1830949052134784:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129749.193896:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129749.193907:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f200/0x48868a4e43948ffc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f33a expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.193980:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f000/0x48868a4e43949003 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.193989:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f000/0x48868a4e43949003 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.193997:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f000/0x48868a4e43949003 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.194006:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ea00/0x48868a4e4394900a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.194011:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ea00/0x48868a4e4394900a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.194016:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ea00/0x48868a4e4394900a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.194095:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e000/0x48868a4e43949011 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.194102:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e000/0x48868a4e43949011 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.194108:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e000/0x48868a4e43949011 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:0.0:1746129749.194114:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129749.194172:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f000/0x48868a4e43949003 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.194178:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f000/0x48868a4e43949003 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.194186:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f000/0x48868a4e43949003 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.194191:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb6f000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129749.194194:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f000/0x48868a4e43949003 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.194198:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f000/0x48868a4e43949003 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.194207:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:0.0:1746129749.194209:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129749.194212:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f000/0x48868a4e43949003 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.194216:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f000/0x48868a4e43949003 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.194225:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ea00/0x48868a4e4394900a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.194229:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ea00/0x48868a4e4394900a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.194234:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ea00/0x48868a4e4394900a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.194237:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb6ea00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129749.194239:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ea00/0x48868a4e4394900a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.194243:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ea00/0x48868a4e4394900a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.194252:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009baa2a00) 00010000:00010000:0.0:1746129749.194253:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129749.194255:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ea00/0x48868a4e4394900a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.194259:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ea00/0x48868a4e4394900a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.194283:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f200/0x48868a4e43948ffc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f33a expref: 13 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.194292:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e000/0x48868a4e43949011 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f33a expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.194296:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129749.194298:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746129749.194300:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6e000, rc 0) 00000100:00100000:0.0:1746129749.194316:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28524:x1830949052134784:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 435us (5822us total) trans 8589943611 rc 0/0 00000100:00100000:0.0:1746129749.194321:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9840 00000100:00100000:2.0:1746129749.194541:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052135040 00000100:00100000:2.0:1746129749.194545:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052135040 00000100:00100000:2.0:1746129749.194563:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3856 00000100:00100000:2.0:1746129749.194567:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28523:x1830949052135040:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129749.194654:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:28523:x1830949052135040:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 85us (943us total) trans 8589943612 rc 0/0 00000100:00100000:2.0:1746129749.194659:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3856 00000100:00100000:0.0:1746129749.212492:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1963:x1830949052133888:12345-192.168.204.31@tcp:3:cat.0 Request processed in 28482us (30729us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129749.212502:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3995 00002000:00100000:0.0:1746129749.212512:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012d635c00 x1830949052133888/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129749.212520:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d635c00 with x1830949052133888 ext(3145728->4194303) 00002000:00010000:0.0:1746129749.212526:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d635c00 00000100:00100000:3.0:1746129749.244363:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949052133632:12345-192.168.204.31@tcp:3:cat.0 Request processed in 60834us (63205us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129749.244374:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3994 00002000:00100000:3.0:1746129749.244391:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012d634e00 x1830949052133632/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.244399:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d634e00 with x1830949052133632 ext(3145728->4194303) 00002000:00010000:3.0:1746129749.244404:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d634e00 00000100:00100000:2.0:1746129749.251886:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1963:x1830949052133376:12345-192.168.204.31@tcp:3:cat.0 Request processed in 68846us (71030us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129749.251898:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3993 00002000:00100000:2.0:1746129749.251909:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012d636300 x1830949052133376/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.251917:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d636300 with x1830949052133376 ext(2097152->3145727) 00002000:00010000:2.0:1746129749.251922:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d636300 00000100:00100000:0.0:1746129749.269491:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.269593:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052135296 00000100:00100000:2.0:1746129749.269601:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052135296 00002000:00100000:2.0:1746129749.269638:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88012b8e5180 x1830949052135296/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.269647:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e5180 with x1830949052135296 ext(4194304->4964351) 00002000:00010000:2.0:1746129749.269652:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8e5180 00000100:00100000:2.0:1746129749.269671:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3996 00000100:00100000:2.0:1746129749.269677:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1963:x1830949052135296:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129749.284168:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1963:x1830949052135296:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14484us (14677us total) trans 0 rc 770048/770048 00000100:00100000:3.0:1746129749.284178:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3996 00002000:00100000:3.0:1746129749.284187:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88012b8e5180 x1830949052135296/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.284195:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e5180 with x1830949052135296 ext(4194304->4964351) 00002000:00010000:3.0:1746129749.284200:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8e5180 00000100:00100000:2.0:1746129749.295020:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.295044:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052135552 00000100:00100000:2.0:1746129749.295051:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052135552 00000100:00100000:2.0:1746129749.295080:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3857 00000100:00100000:2.0:1746129749.295086:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:28517:x1830949052135552:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129749.295241:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:28517:x1830949052135552:12345-192.168.204.31@tcp:35:cat.0 Request processed in 155us (226us total) trans 8589943613 rc 0/0 00000100:00100000:2.0:1746129749.295250:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3857 00000001:00080000:2.0:1746129749.315388:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840259 is committed 00000001:00080000:2.0:1746129749.315399:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840257 is committed 00000001:00080000:2.0:1746129749.315416:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840172 is committed 00000001:00080000:2.0:1746129749.315422:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840261 is committed 00000001:00080000:2.0:1746129749.315427:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840258 is committed 00000001:00080000:2.0:1746129749.315435:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840241 is committed 00000001:00080000:2.0:1746129749.315455:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840201 is committed 00000001:00080000:2.0:1746129749.315472:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840278 is committed 00000001:00080000:2.0:1746129749.315477:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840277 is committed 00000001:00080000:2.0:1746129749.315510:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840242 is committed 00000100:00100000:0.0:1746129749.320237:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.320319:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052135808 00000100:00100000:2.0:1746129749.320327:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052135808 00000100:00100000:2.0:1746129749.320360:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9841 00000100:00100000:2.0:1746129749.320367:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28529:x1830949052135808:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129749.320387:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129749.320401:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6fe00/0x48868a4e4394901f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f341 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.320495:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6ea00/0x48868a4e43949026 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129749.320506:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6ea00/0x48868a4e43949026 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129749.320516:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6ea00/0x48868a4e43949026 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129749.320526:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6e200/0x48868a4e4394902d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129749.320531:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6e200/0x48868a4e4394902d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129749.320536:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6e200/0x48868a4e4394902d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129749.320612:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6e400/0x48868a4e43949034 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129749.320619:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6e400/0x48868a4e43949034 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129749.320624:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6e400/0x48868a4e43949034 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129749.320631:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129749.320693:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6ea00/0x48868a4e43949026 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129749.320699:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6ea00/0x48868a4e43949026 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129749.320705:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6ea00/0x48868a4e43949026 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129749.320710:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ba6ea00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129749.320713:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6ea00/0x48868a4e43949026 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129749.320718:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6ea00/0x48868a4e43949026 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129749.320727:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129749.320730:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129749.320732:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6ea00/0x48868a4e43949026 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129749.320737:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6ea00/0x48868a4e43949026 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129749.320762:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6e200/0x48868a4e4394902d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129749.320767:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6e200/0x48868a4e4394902d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129749.320771:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6e200/0x48868a4e4394902d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129749.320775:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ba6e200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129749.320777:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6e200/0x48868a4e4394902d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129749.320781:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6e200/0x48868a4e4394902d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129749.320786:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094266800) 00010000:00010000:2.0:1746129749.320788:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129749.320790:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6e200/0x48868a4e4394902d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129749.320794:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6e200/0x48868a4e4394902d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129749.320823:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6fe00/0x48868a4e4394901f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f341 expref: 15 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.320836:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6e400/0x48868a4e43949034 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f341 expref: 14 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.320842:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129749.320844:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129749.320868:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba6e400, rc 0) 00000100:00100000:2.0:1746129749.320910:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28529:x1830949052135808:12345-192.168.204.31@tcp:101:cat.0 Request processed in 543us (681us total) trans 8589943614 rc 0/0 00000100:00100000:2.0:1746129749.320915:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9841 00000100:00100000:0.0:1746129749.325107:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.325816:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052135936 00000100:00100000:2.0:1746129749.325824:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052135936 00000100:00100000:1.0:1746129749.326567:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.326626:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052136192 00000100:00100000:3.0:1746129749.326631:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052136192 00000100:00100000:2.0:1746129749.326646:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 560 00000100:00100000:3.0:1746129749.326653:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3858 00000100:00100000:2.0:1746129749.326654:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1964:x1830949052135936:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129749.326658:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28529:x1830949052136192:12345-192.168.204.31@tcp:35:cat.0 00010000:00010000:2.0:1746129749.326666:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129749.326686:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6e400/0x48868a4e43949034 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f341 expref: 15 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.326700:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129749.326703:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129749.326734:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1964:x1830949052135936:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 81us (1635us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129749.326739:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 560 00000100:00100000:3.0:1746129749.326799:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28529:x1830949052136192:12345-192.168.204.31@tcp:35:cat.0 Request processed in 141us (234us total) trans 8589943615 rc 0/0 00000100:00100000:3.0:1746129749.326805:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3858 00000100:00100000:0.0:1746129749.329563:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.330354:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052136320 00000100:00100000:3.0:1746129749.330362:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052136320 00000100:00100000:3.0:1746129749.330412:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10806 00000100:00100000:3.0:1746129749.330420:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1961:x1830949052136320:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129749.330436:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129749.330459:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135b62600/0x48868a4e43949042 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f348 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129749.330500:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053286016:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129749.330576:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129749.330620:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.331001:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052136448 00000100:00100000:2.0:1746129749.331005:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052136448 00000100:00100000:2.0:1746129749.331026:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10807 00000100:00100000:2.0:1746129749.331031:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1962:x1830949052136448:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129749.331039:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129749.331048:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba6e600/0x48868a4e43949049 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f34f expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129749.331074:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053286144:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129749.331678:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129749.333690:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053286016:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129749.333715:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135b62600/0x48868a4e43949042 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f348 expref: 10 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129749.333728:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135b62600/0x48868a4e43949042 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f348 expref: 10 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129749.333736:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b62600, rc 0) 00000100:00100000:2.0:1746129749.333771:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1961:x1830949052136320:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3352us (4214us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129749.333778:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10806 00000100:00100000:2.0:1746129749.334372:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053286144:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129749.334390:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba6e600/0x48868a4e43949049 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f34f expref: 8 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129749.334399:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba6e600/0x48868a4e43949049 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f34f expref: 8 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129749.334406:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba6e600, rc 0) 00000100:00100000:2.0:1746129749.337336:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1962:x1830949052136448:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6294us (6705us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129749.337346:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10807 00000100:00100000:0.0:1746129749.343016:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.343096:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052136576 00000100:00100000:3.0:1746129749.343105:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052136576 00000100:00100000:3.0:1746129749.343157:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10808 00000100:00100000:3.0:1746129749.343165:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28529:x1830949052136576:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129749.343182:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129749.343257:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135b63000/0x48868a4e43949050 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f356 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.343284:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff600/0x48868a4e43948f62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 344064->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2bc expref: 19 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.343291:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129749.343292:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129749.343295:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b63000/0x48868a4e43949050 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f356 expref: 10 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.343325:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff600/0x48868a4e43948f62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 344064->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2bc expref: 19 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.343335:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff600/0x48868a4e43948f62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 344064->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2bc expref: 19 pid: 3623 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746129749.343345:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053286272:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129749.344044:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129749.344249:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053286272:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129749.344263:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135b63000/0x48868a4e43949050 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f356 expref: 10 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.344273:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b63000, rc 0) 00000100:00100000:3.0:1746129749.344309:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28529:x1830949052136576:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1145us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129749.344315:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10808 00000100:00100000:0.0:1746129749.352490:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.352586:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052136704 00000100:00100000:3.0:1746129749.352594:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052136704 00002000:00100000:3.0:1746129749.352630:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (344064->1048575) req@ffff88012b8e4e00 x1830949052136704/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.352638:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e4e00 with x1830949052136704 ext(344064->1048575) 00010000:00010000:3.0:1746129749.352646:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff600/0x48868a4e43948f62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 344064->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2bc expref: 20 pid: 3623 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746129749.352662:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff600/0x48868a4e43948f62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 344064->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2bc expref: 20 pid: 3623 timeout: 795 lvb_type: 0 00002000:00010000:3.0:1746129749.352668:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b8e4e00 00000100:00100000:3.0:1746129749.352693:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 565 00000100:00100000:3.0:1746129749.352700:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949052136704:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129749.372866:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949052136704:12345-192.168.204.31@tcp:4:cat.0 Request processed in 20143us (20359us total) trans 17179873124 rc 0/0 00000100:00100000:3.0:1746129749.372877:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 565 00002000:00100000:3.0:1746129749.372886:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (344064->1048575) req@ffff88012b8e4e00 x1830949052136704/t17179873124(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/448 e 0 to 0 dl 1746129760 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.372895:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e4e00 with x1830949052136704 ext(344064->1048575) 00010000:00010000:3.0:1746129749.372904:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff600/0x48868a4e43948f62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 344064->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2bc expref: 22 pid: 3623 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746129749.372918:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff600/0x48868a4e43948f62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 344064->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2bc expref: 22 pid: 3623 timeout: 795 lvb_type: 0 00002000:00010000:3.0:1746129749.372925:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b8e4e00 00000100:00100000:0.0:1746129749.379068:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.379123:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052136832 00000100:00100000:3.0:1746129749.379130:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052136832 00000100:00100000:3.0:1746129749.379170:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10809 00000100:00100000:3.0:1746129749.379175:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:28524:x1830949052136832:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129749.379187:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129749.379201:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130efbe00/0x48868a4e43949057 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f35d expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.379226:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c4a00/0x48868a4e43948f9a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2f4 expref: 12 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.379234:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801318e0c00/0x48868a4e43948ff5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f333 expref: 8 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129749.379241:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129749.379242:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129749.379245:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130efbe00/0x48868a4e43949057 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2486272->3145727] (req 2486272->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f35d expref: 8 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.379267:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801318e0c00/0x48868a4e43948ff5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f333 expref: 8 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129749.379276:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801318e0c00/0x48868a4e43948ff5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f333 expref: 8 pid: 4589 timeout: 795 lvb_type: 1 00000100:00100000:3.0:1746129749.379286:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053286400:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129749.379365:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d6c4a00/0x48868a4e43948f9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2f4 expref: 12 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.379372:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d6c4a00/0x48868a4e43948f9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2f4 expref: 12 pid: 3623 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746129749.379378:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095242300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053286528:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129749.379392:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129749.384295:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.384494:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052136960 00000100:00100000:2.0:1746129749.384502:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052136960 00010000:00010000:2.0:1746129749.384628:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff600/0x48868a4e43948f62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 344064->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2bc expref: 22 pid: 3623 timeout: 795 lvb_type: 0 00000100:00100000:2.0:1746129749.384665:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5180 00000100:00100000:2.0:1746129749.384672:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1964:x1830949052136960:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129749.384683:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129749.384703:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff600/0x48868a4e43948f62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 344064->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2bc expref: 22 pid: 3623 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.384714:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff600/0x48868a4e43948f62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 344064->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2bc expref: 22 pid: 3623 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.384732:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff600/0x48868a4e43948f62 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 344064->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2bc expref: 22 pid: 3623 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746129749.384892:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053286400:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129749.384900:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095242300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053286528:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129749.384921:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130efbe00/0x48868a4e43949057 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2486272->3145727] (req 2486272->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f35d expref: 8 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.384923:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129749.384925:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129749.384932:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135b63000/0x48868a4e43949050 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f356 expref: 9 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.384933:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130efbe00, rc 0) 00010000:00010000:2.0:1746129749.384940:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b63000/0x48868a4e43949050 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f356 expref: 9 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.384970:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135b63000/0x48868a4e43949050 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f356 expref: 9 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129749.384977:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28524:x1830949052136832:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5801us (5916us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129749.384982:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053286656:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129749.384984:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10809 00000100:00100000:2.0:1746129749.385043:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129749.385891:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.386137:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052137088 00000100:00100000:2.0:1746129749.386141:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052137088 00010000:00010000:2.0:1746129749.386159:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801318e0c00/0x48868a4e43948ff5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f333 expref: 8 pid: 4589 timeout: 795 lvb_type: 1 00000100:00100000:2.0:1746129749.386187:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5181 00000100:00100000:2.0:1746129749.386193:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1962:x1830949052137088:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129749.386202:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129749.386217:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801318e0c00/0x48868a4e43948ff5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f333 expref: 8 pid: 4589 timeout: 795 lvb_type: 1 00010000:00010000:2.0:1746129749.386227:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801318e0c00/0x48868a4e43948ff5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f333 expref: 8 pid: 4589 timeout: 795 lvb_type: 1 00010000:00010000:2.0:1746129749.386240:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801318e0c00/0x48868a4e43948ff5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f333 expref: 8 pid: 4589 timeout: 795 lvb_type: 1 00010000:00010000:2.0:1746129749.386249:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129749.386268:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1962:x1830949052137088:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 76us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129749.386276:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5181 00000100:00100000:0.0:1746129749.387682:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.387754:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052137216 00000100:00100000:2.0:1746129749.387759:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052137216 00010000:00010000:2.0:1746129749.387776:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6c4a00/0x48868a4e43948f9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2f4 expref: 13 pid: 3623 timeout: 795 lvb_type: 0 00000100:00100000:2.0:1746129749.387796:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5182 00000100:00100000:2.0:1746129749.387801:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1963:x1830949052137216:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129749.387811:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129749.387825:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d6c4a00/0x48868a4e43948f9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2f4 expref: 13 pid: 3623 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.387834:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d6c4a00/0x48868a4e43948f9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2f4 expref: 13 pid: 3623 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.388005:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c4a00/0x48868a4e43948f9a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2f4 expref: 13 pid: 3623 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.388016:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129749.388018:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129749.388023:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130efbe00/0x48868a4e43949057 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f35d expref: 6 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.388030:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130efbe00/0x48868a4e43949057 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f35d expref: 6 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.388056:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130efbe00/0x48868a4e43949057 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f35d expref: 6 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129749.388067:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053286784:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129749.388252:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366480 going to sleep for 11 seconds 00000100:00100000:2.0:1746129749.388623:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053286656:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129749.388637:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129749.388658:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1964:x1830949052136960:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3986us (4370us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129749.388665:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5180 00000100:00100000:2.0:1746129749.391606:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.391668:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053286784:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129749.391685:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129749.391732:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+12:1963:x1830949052137216:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3929us (4052us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129749.391737:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052137600 00000100:00100000:0.0:1746129749.391740:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5182 00000100:00100000:3.0:1746129749.391743:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052137600 00002000:00100000:3.0:1746129749.391772:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2486272->2490367) req@ffff88009468ed80 x1830949052137600/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.391779:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468ed80 with x1830949052137600 ext(2486272->2490367) 00002000:00010000:3.0:1746129749.391783:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009468ed80 00000100:00100000:3.0:1746129749.391796:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3997 00000100:00100000:3.0:1746129749.391802:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1964:x1830949052137600:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129749.391973:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1964:x1830949052137600:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 171us (373us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129749.391979:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3997 00002000:00100000:3.0:1746129749.391983:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2486272->2490367) req@ffff88009468ed80 x1830949052137600/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/4536 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.391989:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468ed80 with x1830949052137600 ext(2486272->2490367) 00002000:00010000:3.0:1746129749.391992:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009468ed80 00000100:00100000:0.0:1746129749.393845:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.394734:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052137728 00000100:00100000:3.0:1746129749.394741:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052137728 00002000:00100000:3.0:1746129749.394774:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800a02fdf80 x1830949052137728/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.394783:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02fdf80 with x1830949052137728 ext(0->1048575) 00002000:00010000:3.0:1746129749.394787:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a02fdf80 00000100:00100000:3.0:1746129749.395006:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3998 00000100:00100000:3.0:1746129749.395013:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052137728:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129749.401214:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.401299:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052137856 00000100:00100000:3.0:1746129749.401307:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052137856 00000100:00100000:3.0:1746129749.401341:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10810 00000100:00100000:3.0:1746129749.401348:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28524:x1830949052137856:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129749.401363:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129749.401377:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130efba00/0x48868a4e4394905e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f364 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.401402:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d6c5e00/0x48868a4e43948f8c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2e6 expref: 20 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.401410:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d6c4c00/0x48868a4e43948f93 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ed expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.401416:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129749.401417:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129749.401420:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130efba00/0x48868a4e4394905e lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->3354623] (req 3145728->3354623) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f364 expref: 13 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.401462:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d6c4c00/0x48868a4e43948f93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ed expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.401472:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d6c4c00/0x48868a4e43948f93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ed expref: 13 pid: 20441 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746129749.401482:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095242300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053286912:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129749.402355:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d6c5e00/0x48868a4e43948f8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2e6 expref: 20 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.402365:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d6c5e00/0x48868a4e43948f8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2e6 expref: 20 pid: 20441 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746129749.402374:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053287040:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129749.402417:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129749.404507:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095242300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053286912:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129749.404844:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949052137728:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 9830us (11001us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129749.404880:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3998 00002000:00100000:3.0:1746129749.404889:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800a02fdf80 x1830949052137728/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.404896:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02fdf80 with x1830949052137728 ext(0->1048575) 00002000:00010000:3.0:1746129749.404900:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a02fdf80 00000100:00100000:3.0:1746129749.407254:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053287040:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129749.407281:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130efba00/0x48868a4e4394905e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->3354623] (req 3145728->3354623) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f364 expref: 11 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.407297:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130efba00, rc 0) 00000100:00100000:3.0:1746129749.407337:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28524:x1830949052137856:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5989us (6130us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129749.407344:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10810 00000100:00100000:0.0:1746129749.408284:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.408324:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.408506:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052137984 00000100:00100000:2.0:1746129749.408513:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052137984 00010000:00010000:2.0:1746129749.408538:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6c4c00/0x48868a4e43948f93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ed expref: 11 pid: 20441 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746129749.408547:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052138112 00000100:00100000:3.0:1746129749.408552:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052138112 00000100:00100000:2.0:1746129749.408560:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5183 00010000:00010000:3.0:1746129749.408565:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6c5e00/0x48868a4e43948f8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2e6 expref: 21 pid: 20441 timeout: 795 lvb_type: 0 00000100:00100000:2.0:1746129749.408566:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949052137984:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129749.408576:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129749.408580:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5184 00000100:00100000:3.0:1746129749.408586:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052138112:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129749.408592:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129749.408604:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d6c5e00/0x48868a4e43948f8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2e6 expref: 21 pid: 20441 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.408605:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d6c4c00/0x48868a4e43948f93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ed expref: 11 pid: 20441 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746129749.408614:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d6c5e00/0x48868a4e43948f8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2e6 expref: 21 pid: 20441 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.408623:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d6c4c00/0x48868a4e43948f93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ed expref: 11 pid: 20441 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746129749.408643:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d6c5e00/0x48868a4e43948f8c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2e6 expref: 21 pid: 20441 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.408648:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d6c4c00/0x48868a4e43948f93 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ed expref: 11 pid: 20441 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.408664:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129749.408666:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129749.408672:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130efba00/0x48868a4e4394905e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f364 expref: 10 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.408679:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130efba00/0x48868a4e4394905e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f364 expref: 10 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.408750:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129749.408766:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130efba00/0x48868a4e4394905e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f364 expref: 10 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129749.408777:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053287168:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129749.408788:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949052138112:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 201us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129749.408793:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5184 00000100:00100000:2.0:1746129749.408827:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129749.413539:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053287168:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129749.413557:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129749.413595:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949052137984:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5028us (5313us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129749.413605:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5183 00000100:00100000:0.0:1746129749.416373:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.416547:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052138368 00000100:00100000:3.0:1746129749.416554:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052138368 00002000:00100000:3.0:1746129749.416590:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3350528->3354623) req@ffff8800a02fed80 x1830949052138368/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.416598:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02fed80 with x1830949052138368 ext(3350528->3354623) 00002000:00010000:3.0:1746129749.416603:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a02fed80 00000100:00100000:3.0:1746129749.416619:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3999 00000100:00100000:3.0:1746129749.416626:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949052138368:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129749.416765:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949052138368:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 139us (396us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129749.416771:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3999 00002000:00100000:3.0:1746129749.416776:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3350528->3354623) req@ffff8800a02fed80 x1830949052138368/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/4536 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.416781:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02fed80 with x1830949052138368 ext(3350528->3354623) 00002000:00010000:3.0:1746129749.416784:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a02fed80 00000100:00100000:2.0:1746129749.417178:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.417207:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052138496 00000100:00100000:3.0:1746129749.417211:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052138496 00000100:00100000:3.0:1746129749.417229:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10811 00000100:00100000:3.0:1746129749.417234:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:28529:x1830949052138496:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129749.417242:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129749.417257:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131848000/0x48868a4e43949065 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f36b expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.417281:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c5400/0x48868a4e43948f77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2d1 expref: 11 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.417286:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129749.417288:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129749.417291:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131848000/0x48868a4e43949065 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f36b expref: 8 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.417312:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d6c5400/0x48868a4e43948f77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2d1 expref: 11 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.417322:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d6c5400/0x48868a4e43948f77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2d1 expref: 11 pid: 3623 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746129749.417332:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053287296:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129749.418948:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129749.419209:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.420480:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052138752 00000100:00100000:3.0:1746129749.420488:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052138752 00000100:00100000:3.0:1746129749.420537:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3859 00000100:00100000:3.0:1746129749.420544:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c561450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28524:x1830949052138752:12345-192.168.204.31@tcp:35:multiop.0 00000001:00080000:3.0:1746129749.420770:0:14317:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589943616 00000100:00100000:3.0:1746129749.420892:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c561450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28524:x1830949052138752:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 347us (1684us total) trans 8589943617 rc 0/0 00000100:00100000:3.0:1746129749.420898:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3859 00000020:00080000:3.0:1746129749.420901:0:14317:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1746129749.421680:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053287296:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129749.421701:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131848000/0x48868a4e43949065 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f36b expref: 8 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.421715:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131848000, rc 0) 00000100:00100000:3.0:1746129749.421748:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28529:x1830949052138496:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4513us (4570us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129749.421754:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10811 00000100:00100000:0.0:1746129749.422221:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.422740:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052138880 00000100:00100000:2.0:1746129749.422746:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052138880 00002000:00100000:2.0:1746129749.422775:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1282047) req@ffff8800a02fe680 x1830949052138880/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.422783:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02fe680 with x1830949052138880 ext(1048576->1282047) 00010000:00010000:2.0:1746129749.422790:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c5400/0x48868a4e43948f77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2d1 expref: 12 pid: 3623 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.422803:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d6c5400/0x48868a4e43948f77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2d1 expref: 12 pid: 3623 timeout: 795 lvb_type: 0 00002000:00010000:2.0:1746129749.422808:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a02fe680 00000100:00100000:2.0:1746129749.422838:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 566 00000100:00100000:2.0:1746129749.422845:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+12:1961:x1830949052138880:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129749.428295:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129749.429560:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052139136 00000100:00100000:1.0:1746129749.429570:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052139136 00000100:00100000:1.0:1746129749.429612:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9842 00000100:00100000:1.0:1746129749.429619:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:28532:x1830949052139136:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129749.429638:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129749.429652:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e0a00/0x48868a4e4394906c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f372 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129749.429667:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949052138880:12345-192.168.204.31@tcp:4:cat.0 Request processed in 6821us (7444us total) trans 21474840279 rc 0/0 00000100:00100000:2.0:1746129749.429675:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 566 00002000:00100000:2.0:1746129749.429683:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1282047) req@ffff8800a02fe680 x1830949052138880/t21474840279(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/448 e 0 to 0 dl 1746129760 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.429690:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02fe680 with x1830949052138880 ext(1048576->1282047) 00010000:00010000:2.0:1746129749.429697:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c5400/0x48868a4e43948f77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2d1 expref: 14 pid: 3623 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.429709:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d6c5400/0x48868a4e43948f77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2d1 expref: 14 pid: 3623 timeout: 795 lvb_type: 0 00002000:00010000:2.0:1746129749.429715:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a02fe680 00010000:00010000:1.0:1746129749.430026:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e0200/0x48868a4e43949073 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.430036:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e0200/0x48868a4e43949073 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.430045:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e0200/0x48868a4e43949073 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.430055:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1a00/0x48868a4e4394907a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.430060:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1a00/0x48868a4e4394907a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.430065:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1a00/0x48868a4e4394907a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.430138:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1400/0x48868a4e43949081 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.430145:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1400/0x48868a4e43949081 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.430151:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1400/0x48868a4e43949081 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:1.0:1746129749.430158:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129749.430210:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e0200/0x48868a4e43949073 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.430220:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e0200/0x48868a4e43949073 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.430225:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e0200/0x48868a4e43949073 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.430230:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801318e0200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129749.430233:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e0200/0x48868a4e43949073 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.430239:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e0200/0x48868a4e43949073 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.430248:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129749.430250:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129749.430253:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e0200/0x48868a4e43949073 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.430258:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e0200/0x48868a4e43949073 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.430660:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1a00/0x48868a4e4394907a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.430665:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1a00/0x48868a4e4394907a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.430669:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1a00/0x48868a4e4394907a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.430673:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801318e1a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129749.430675:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1a00/0x48868a4e4394907a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.430683:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1a00/0x48868a4e4394907a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.430689:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e29ae00) 00010000:00010000:1.0:1746129749.430691:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129749.430693:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1a00/0x48868a4e4394907a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.430698:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1a00/0x48868a4e4394907a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129749.430730:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e0a00/0x48868a4e4394906c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f372 expref: 290 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.430739:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1400/0x48868a4e43949081 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f372 expref: 289 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.430743:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129749.430745:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129749.430746:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801318e1400, rc 0) 00000100:00100000:1.0:1746129749.430785:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:28532:x1830949052139136:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1166us (2497us total) trans 8589943618 rc 0/0 00000100:00100000:1.0:1746129749.430791:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9842 00000100:00100000:0.0:1746129749.434262:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.434325:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052139264 00000100:00100000:3.0:1746129749.434333:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052139264 00010000:00010000:3.0:1746129749.434363:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6c5400/0x48868a4e43948f77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2d1 expref: 14 pid: 3623 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746129749.434403:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5185 00000100:00100000:3.0:1746129749.434411:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1963:x1830949052139264:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129749.434423:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129749.434451:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d6c5400/0x48868a4e43948f77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2d1 expref: 14 pid: 3623 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746129749.434463:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d6c5400/0x48868a4e43948f77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2d1 expref: 14 pid: 3623 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746129749.434483:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c5400/0x48868a4e43948f77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2d1 expref: 14 pid: 3623 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746129749.434509:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129749.434511:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129749.434518:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131848000/0x48868a4e43949065 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f36b expref: 7 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.434525:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131848000/0x48868a4e43949065 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f36b expref: 7 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.434554:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131848000/0x48868a4e43949065 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f36b expref: 7 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129749.434564:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053287424:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129749.434632:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129749.437421:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.437465:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.437495:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.437523:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.437538:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.437560:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052139904 00000100:00100000:0.0:1746129749.437566:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052139904 00000100:00100000:0.0:1746129749.437601:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 561 00000100:00100000:0.0:1746129749.437608:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:1961:x1830949052139904:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129749.437620:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129749.437639:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1400/0x48868a4e43949081 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f372 expref: 289 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.437658:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129749.437661:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129749.437694:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:1961:x1830949052139904:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 86us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129749.437700:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 561 00000100:00100000:3.0:1746129749.438078:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052139392 00000100:00100000:3.0:1746129749.438083:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052139392 00000100:00100000:3.0:1746129749.438102:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052139520 00000100:00100000:3.0:1746129749.438104:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052139520 00000100:00100000:3.0:1746129749.438114:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052139648 00000100:00100000:3.0:1746129749.438116:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052139648 00000100:00100000:3.0:1746129749.438125:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052139776 00000100:00100000:3.0:1746129749.438127:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052139776 00000100:00100000:3.0:1746129749.438138:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10812 00000100:00100000:3.0:1746129749.438143:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949052139392:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129749.438155:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129749.438166:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131849e00/0x48868a4e4394908f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f379 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.438181:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129749.438183:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129749.438189:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131849e00/0x48868a4e4394908f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f379 expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129749.438206:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131849e00/0x48868a4e4394908f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f379 expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129749.438214:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131849e00, rc 0) 00000100:00100000:3.0:1746129749.438236:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949052139392:12345-192.168.204.31@tcp:101:cat.0 Request processed in 92us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129749.438241:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10812 00000100:00100000:3.0:1746129749.438255:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10813 00000100:00100000:3.0:1746129749.438260:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949052139520:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129749.438265:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129749.438273:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131849400/0x48868a4e43949096 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f380 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.438282:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129749.438283:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129749.438287:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131849400/0x48868a4e43949096 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f380 expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129749.438295:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131849400/0x48868a4e43949096 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f380 expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129749.438301:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131849400, rc 0) 00000100:00100000:3.0:1746129749.438317:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1964:x1830949052139520:12345-192.168.204.31@tcp:101:cat.0 Request processed in 57us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129749.438321:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10813 00000100:00100000:3.0:1746129749.438330:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10814 00000100:00100000:3.0:1746129749.438334:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949052139648:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129749.438339:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129749.438344:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131849600/0x48868a4e4394909d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f387 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129749.438372:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095240000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053287552:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129749.438420:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129749.438436:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10815 00000100:00100000:3.0:1746129749.438453:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949052139776:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129749.438458:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129749.438465:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135b62600/0x48868a4e439490a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f38e expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129749.438485:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095242300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053287680:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129749.438504:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803540 going to sleep for 11 seconds 00000100:00100000:3.0:1746129749.438525:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053287424:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129749.438535:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129749.438548:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1963:x1830949052139264:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4139us (4297us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129749.438555:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5185 00000100:00100000:1.0:1746129749.439056:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.439263:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052140032 00000100:00100000:0.0:1746129749.439267:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052140032 00000100:00100000:0.0:1746129749.439296:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10816 00000100:00100000:0.0:1746129749.439301:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:28523:x1830949052140032:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129749.439309:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129749.439315:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e439490ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f395 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.439328:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135b63000/0x48868a4e43949050 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f356 expref: 9 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.439335:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131849e00/0x48868a4e4394908f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f379 expref: 24 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129749.439341:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129749.439342:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129749.439345:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e439490ab lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [90112->999423] (req 90112->999423) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f395 expref: 24 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.439361:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131849e00/0x48868a4e4394908f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f379 expref: 24 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129749.439371:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131849e00/0x48868a4e4394908f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f379 expref: 24 pid: 8437 timeout: 795 lvb_type: 1 00000100:00100000:0.0:1746129749.439379:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053287808:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129749.440266:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135b63000/0x48868a4e43949050 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f356 expref: 9 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.440275:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135b63000/0x48868a4e43949050 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f356 expref: 9 pid: 3623 timeout: 795 lvb_type: 0 00000100:00100000:0.0:1746129749.440283:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053287936:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129749.440314:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942d80 going to sleep for 11 seconds 00002000:00010000:3.0:1746129749.440957:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime: 1746129749 -> 1746129750 00002000:00010000:3.0:1746129749.440961:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime: 1746129749 -> 1746129750 00002000:00010000:3.0:1746129749.440963:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime: 1746129749 -> 1746129750 00000100:00100000:3.0:1746129749.440980:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095240000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053287552:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129749.440997:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131849600/0x48868a4e4394909d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f387 expref: 24 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129749.441006:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131849600/0x48868a4e4394909d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f387 expref: 24 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129749.441015:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131849600, rc 0) 00000100:00100000:3.0:1746129749.441307:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949052139648:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2970us (3809us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129749.441314:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10814 00000100:00100000:1.0:1746129749.442374:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00010000:3.0:1746129749.442478:0:1140:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime: 1746129749 -> 1746129750 00002000:00010000:3.0:1746129749.442481:0:1140:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746129749 -> 1746129750 00002000:00010000:3.0:1746129749.442482:0:1140:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime: 1746129749 -> 1746129750 00000100:00100000:3.0:1746129749.442496:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095242300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053287680:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129749.442515:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135b62600/0x48868a4e439490a4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f38e expref: 15 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129749.442525:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135b62600/0x48868a4e439490a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f38e expref: 15 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129749.442533:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b62600, rc 0) 00000100:00100000:3.0:1746129749.443077:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1964:x1830949052139776:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4384us (5312us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129749.443085:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10815 00000100:00100000:3.0:1746129749.443114:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052140288 00000100:00100000:3.0:1746129749.443118:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052140288 00002000:00100000:3.0:1746129749.443141:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800a00c4000 x1830949052140288/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.443149:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c4000 with x1830949052140288 ext(1048576->2097151) 00002000:00010000:3.0:1746129749.443153:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a00c4000 00000100:00100000:3.0:1746129749.443172:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4000 00000100:00100000:3.0:1746129749.443178:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1961:x1830949052140288:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129749.444739:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053287808:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129749.444749:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053287936:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129749.444769:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e439490ab lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [90112->999423] (req 90112->999423) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f395 expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.444786:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6f600, rc 0) 00000100:00100000:0.0:1746129749.444824:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:28523:x1830949052140032:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5522us (5768us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129749.444831:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10816 00000100:00100000:2.0:1746129749.444922:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.444978:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.445170:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052140416 00000100:00100000:0.0:1746129749.445175:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052140416 00010000:00010000:0.0:1746129749.445190:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131849e00/0x48868a4e4394908f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f379 expref: 22 pid: 8437 timeout: 795 lvb_type: 1 00000100:00100000:0.0:1746129749.445205:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052140544 00000100:00100000:0.0:1746129749.445206:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052140544 00010000:00010000:0.0:1746129749.445212:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135b63000/0x48868a4e43949050 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f356 expref: 10 pid: 3623 timeout: 795 lvb_type: 0 00000100:00100000:0.0:1746129749.445222:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5186 00000100:00100000:0.0:1746129749.445227:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949052140416:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129749.445235:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129749.445249:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131849e00/0x48868a4e4394908f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f379 expref: 22 pid: 8437 timeout: 795 lvb_type: 1 00010000:00010000:0.0:1746129749.445256:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131849e00/0x48868a4e4394908f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f379 expref: 22 pid: 8437 timeout: 795 lvb_type: 1 00010000:00010000:0.0:1746129749.445270:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131849e00/0x48868a4e4394908f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f379 expref: 22 pid: 8437 timeout: 795 lvb_type: 1 00010000:00010000:0.0:1746129749.445283:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129749.446873:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949052140416:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1638us (1944us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129749.446883:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5186 00000100:00100000:0.0:1746129749.446904:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5187 00000100:00100000:0.0:1746129749.446911:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1963:x1830949052140544:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129749.446922:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129749.446937:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135b63000/0x48868a4e43949050 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f356 expref: 10 pid: 3623 timeout: 795 lvb_type: 0 00010000:00010000:0.0:1746129749.446947:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135b63000/0x48868a4e43949050 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f356 expref: 10 pid: 3623 timeout: 795 lvb_type: 0 00010000:00010000:0.0:1746129749.446963:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135b63000/0x48868a4e43949050 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f356 expref: 10 pid: 3623 timeout: 795 lvb_type: 0 00010000:00010000:0.0:1746129749.446973:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129749.446975:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129749.446980:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e439490ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->999423) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f395 expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.446986:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e439490ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->999423) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f395 expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.447011:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e439490ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->999423) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f395 expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129749.447022:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053288064:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129749.448841:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129749.448923:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.448945:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052140672 00000100:00100000:0.0:1746129749.448950:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052140672 00000100:00100000:0.0:1746129749.448976:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10817 00000100:00100000:0.0:1746129749.448981:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:28532:x1830949052140672:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129749.448994:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129749.449005:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fa00/0x48868a4e439490b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f39c expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.449024:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e439490ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 90112->999423) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f395 expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.449030:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129749.449032:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129749.449034:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fa00/0x48868a4e439490b2 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f39c expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.449053:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e439490ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 90112->999423) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f395 expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.449062:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e439490ab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 90112->999423) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f395 expref: 22 pid: 4589 timeout: 795 lvb_type: 0 00000100:00100000:0.0:1746129749.449070:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053288192:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129749.449111:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19429c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129749.456383:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053288064:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129749.456401:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129749.456451:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1963:x1830949052140544:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 9540us (11472us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129749.456461:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5187 00000100:00100000:3.0:1746129749.457168:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1961:x1830949052140288:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 13987us (14794us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129749.457175:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4000 00002000:00100000:3.0:1746129749.457182:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800a00c4000 x1830949052140288/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.457191:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c4000 with x1830949052140288 ext(1048576->2097151) 00002000:00010000:3.0:1746129749.457195:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a00c4000 00000100:00100000:0.0:1746129749.457528:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053288192:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129749.457544:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fa00/0x48868a4e439490b2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f39c expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.457557:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6fa00, rc 0) 00000100:00100000:0.0:1746129749.457589:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:28532:x1830949052140672:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8607us (8667us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129749.457595:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10817 00000100:00100000:2.0:1746129749.467592:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.467683:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052140928 00000100:00100000:3.0:1746129749.467692:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052140928 00002000:00100000:3.0:1746129749.467727:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (90112->94207) req@ffff8800a55a5180 x1830949052140928/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.467735:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a5180 with x1830949052140928 ext(90112->94207) 00010000:00010000:3.0:1746129749.467743:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e439490ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->999423) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f395 expref: 22 pid: 4589 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746129749.467754:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e439490ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->999423) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f395 expref: 22 pid: 4589 timeout: 795 lvb_type: 0 00002000:00010000:3.0:1746129749.467760:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a55a5180 00000100:00100000:3.0:1746129749.467789:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 567 00000100:00100000:3.0:1746129749.467796:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052140928:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129749.467965:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052140928:12345-192.168.204.31@tcp:3:cat.0 Request processed in 169us (380us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129749.467971:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 567 00002000:00100000:3.0:1746129749.467976:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (90112->94207) req@ffff8800a55a5180 x1830949052140928/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/4536 e 0 to 0 dl 1746129760 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.467982:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a5180 with x1830949052140928 ext(90112->94207) 00010000:00010000:3.0:1746129749.467986:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e439490ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->999423) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f395 expref: 22 pid: 4589 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746129749.467994:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e439490ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->999423) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f395 expref: 22 pid: 4589 timeout: 795 lvb_type: 0 00002000:00010000:3.0:1746129749.467999:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a55a5180 00000100:00100000:0.0:1746129749.468492:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.468519:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.468539:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.468570:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129749.468584:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052141440 00000100:00100000:1.0:1746129749.468588:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052141440 00002000:00100000:1.0:1746129749.468608:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3354624->4194303) req@ffff8800a02fd880 x1830949052141440/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.468615:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02fd880 with x1830949052141440 ext(3354624->4194303) 00002000:00010000:1.0:1746129749.468619:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a02fd880 00000100:00100000:3.0:1746129749.468623:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052141696 00000100:00100000:3.0:1746129749.468626:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052141696 00000100:00100000:1.0:1746129749.468631:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052141312 00000100:00100000:1.0:1746129749.468633:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052141312 00002000:00100000:3.0:1746129749.468641:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3805183) req@ffff8800a02fd180 x1830949052141696/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 504/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.468643:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a02ffb80 x1830949052141312/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.468648:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02fd180 with x1830949052141696 ext(2097152->3805183) 00002000:00100000:1.0:1746129749.468649:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02ffb80 with x1830949052141312 ext(2097152->3145727) 00002000:00010000:3.0:1746129749.468651:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a02fd180 00002000:00010000:1.0:1746129749.468651:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a02ffb80 00000100:00100000:1.0:1746129749.468661:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052141824 00000100:00100000:1.0:1746129749.468663:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052141824 00002000:00100000:1.0:1746129749.468672:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3805184->4194303) req@ffff8800a02fc000 x1830949052141824/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.468677:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02fc000 with x1830949052141824 ext(3805184->4194303) 00002000:00010000:1.0:1746129749.468680:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a02fc000 00000100:00100000:3.0:1746129749.468722:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4001 00000100:00100000:3.0:1746129749.468728:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949052141440:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129749.469704:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4002 00000100:00100000:3.0:1746129749.469712:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949052141312:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129749.470788:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4003 00000100:00100000:3.0:1746129749.470795:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1964:x1830949052141696:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129749.473677:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4004 00000100:00100000:2.0:1746129749.473690:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949052141824:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129749.485717:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129749.485774:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052142208 00000100:00100000:1.0:1746129749.485781:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052142208 00002000:00100000:1.0:1746129749.485813:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (995328->999423) req@ffff8800a02fd500 x1830949052142208/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.485821:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02fd500 with x1830949052142208 ext(995328->999423) 00010000:00010000:1.0:1746129749.485828:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e439490ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->999423) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f395 expref: 22 pid: 4589 timeout: 795 lvb_type: 0 00010000:00010000:1.0:1746129749.485839:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e439490ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->999423) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f395 expref: 22 pid: 4589 timeout: 795 lvb_type: 0 00002000:00010000:1.0:1746129749.485957:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a02fd500 00000100:00100000:3.0:1746129749.486567:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949052141440:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17836us (18073us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746129749.486575:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4001 00002000:00100000:3.0:1746129749.486582:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3354624->4194303) req@ffff8800a02fd880 x1830949052141440/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.486590:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02fd880 with x1830949052141440 ext(3354624->4194303) 00002000:00010000:3.0:1746129749.486593:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a02fd880 00000100:00100000:3.0:1746129749.486610:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 568 00000100:00100000:3.0:1746129749.486618:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052142208:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129749.486733:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052142208:12345-192.168.204.31@tcp:3:cat.0 Request processed in 116us (1023us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129749.486739:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 568 00002000:00100000:3.0:1746129749.486743:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e8:0x0] (995328->999423) req@ffff8800a02fd500 x1830949052142208/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/4536 e 0 to 0 dl 1746129760 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.486750:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02fd500 with x1830949052142208 ext(995328->999423) 00010000:00010000:3.0:1746129749.486755:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e439490ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->999423) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f395 expref: 22 pid: 4589 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746129749.486765:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e439490ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->999423) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f395 expref: 22 pid: 4589 timeout: 795 lvb_type: 0 00002000:00010000:3.0:1746129749.486775:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a02fd500 00000100:00100000:3.0:1746129749.497626:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1964:x1830949052141312:12345-192.168.204.31@tcp:3:cat.0 Request processed in 27904us (29074us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129749.497637:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4002 00002000:00100000:3.0:1746129749.497647:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a02ffb80 x1830949052141312/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.497655:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02ffb80 with x1830949052141312 ext(2097152->3145727) 00002000:00010000:3.0:1746129749.497660:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a02ffb80 00000100:00100000:3.0:1746129749.507745:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949052141696:12345-192.168.204.31@tcp:3:cat.0 Request processed in 36941us (39215us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129749.507756:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4003 00002000:00100000:3.0:1746129749.507766:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3805183) req@ffff8800a02fd180 x1830949052141696/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 504/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.507775:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02fd180 with x1830949052141696 ext(2097152->3805183) 00002000:00010000:3.0:1746129749.507781:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a02fd180 00000100:00100000:2.0:1746129749.508428:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1964:x1830949052141824:12345-192.168.204.31@tcp:3:cat.0 Request processed in 34740us (39855us total) trans 0 rc 389120/389120 00000100:00100000:2.0:1746129749.508435:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4004 00002000:00100000:2.0:1746129749.508449:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3805184->4194303) req@ffff8800a02fc000 x1830949052141824/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 389120/389120 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.508457:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02fc000 with x1830949052141824 ext(3805184->4194303) 00002000:00010000:2.0:1746129749.508461:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a02fc000 00000100:00100000:0.0:1746129749.514496:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.514592:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052142464 00000100:00100000:2.0:1746129749.514599:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052142464 00002000:00100000:2.0:1746129749.514632:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (90112->999423) req@ffff880136319f80 x1830949052142464/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.514640:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136319f80 with x1830949052142464 ext(90112->999423) 00010000:00010000:2.0:1746129749.514647:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e439490ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->999423) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f395 expref: 22 pid: 4589 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.514658:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e439490ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->999423) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f395 expref: 22 pid: 4589 timeout: 795 lvb_type: 0 00002000:00010000:2.0:1746129749.514664:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136319f80 00000100:00100000:2.0:1746129749.514755:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 569 00000100:00100000:2.0:1746129749.514761:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949052142464:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129749.524780:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129749.525121:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052142592 00000100:00100000:1.0:1746129749.525129:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052142592 00000100:00100000:1.0:1746129749.525171:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10818 00000100:00100000:1.0:1746129749.525177:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052142592:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129749.525654:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129749.525671:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801318e0800/0x48868a4e439490b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f3a3 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129749.525717:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053288320:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129749.526956:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4948840 going to sleep for 11 seconds 00002000:00010000:1.0:1746129749.534188:0:4589:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime: 1746129749 -> 1746129750 00002000:00010000:1.0:1746129749.534195:0:4589:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime: 1746129749 -> 1746129750 00002000:00010000:1.0:1746129749.534196:0:4589:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime: 1746129749 -> 1746129750 00000100:00100000:1.0:1746129749.534212:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053288320:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129749.534240:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801318e0800/0x48868a4e439490b9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3a3 expref: 10 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129749.534252:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801318e0800/0x48868a4e439490b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3a3 expref: 10 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129749.534278:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801318e0800, rc 0) 00000100:00100000:1.0:1746129749.534325:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052142592:12345-192.168.204.31@tcp:101:cat.0 Request processed in 9147us (9552us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129749.534332:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10818 00000100:00100000:3.0:1746129749.538176:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949052142464:12345-192.168.204.31@tcp:4:cat.0 Request processed in 23407us (23679us total) trans 17179873125 rc 0/0 00000100:00100000:3.0:1746129749.538188:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 569 00002000:00100000:3.0:1746129749.538197:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (90112->999423) req@ffff880136319f80 x1830949052142464/t17179873125(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/448 e 0 to 0 dl 1746129760 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.538205:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136319f80 with x1830949052142464 ext(90112->999423) 00010000:00010000:3.0:1746129749.538212:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e439490ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->999423) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f395 expref: 24 pid: 4589 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746129749.538225:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e439490ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->999423) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f395 expref: 24 pid: 4589 timeout: 795 lvb_type: 0 00002000:00010000:3.0:1746129749.538231:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136319f80 00000100:00100000:0.0:1746129749.546517:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129749.546561:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.546608:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052142720 00000100:00100000:2.0:1746129749.546615:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052142720 00010000:00010000:2.0:1746129749.546643:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e439490ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->999423) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f395 expref: 24 pid: 4589 timeout: 795 lvb_type: 0 00000100:00100000:2.0:1746129749.546669:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5188 00000100:00100000:2.0:1746129749.546676:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949052142720:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129749.546688:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129749.546705:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e439490ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 90112->999423) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f395 expref: 24 pid: 4589 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.546720:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e439490ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 90112->999423) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f395 expref: 24 pid: 4589 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.546740:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e439490ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 90112->999423) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f395 expref: 24 pid: 4589 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.546768:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129749.546770:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129749.546777:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fa00/0x48868a4e439490b2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f39c expref: 23 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.546783:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fa00/0x48868a4e439490b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f39c expref: 23 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.546810:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fa00/0x48868a4e439490b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f39c expref: 23 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129749.546820:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053288448:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129749.546911:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129749.546956:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052142976 00000100:00100000:0.0:1746129749.546959:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052142976 00000100:00100000:0.0:1746129749.546991:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9843 00000100:00100000:0.0:1746129749.546997:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28537:x1830949052142976:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129749.547012:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129749.547023:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c09c400/0x48868a4e439490c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f3aa expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.547102:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c09cc00/0x48868a4e439490c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.547115:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c09cc00/0x48868a4e439490c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.547123:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c09cc00/0x48868a4e439490c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.547133:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c09c800/0x48868a4e439490ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.547137:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c09c800/0x48868a4e439490ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.547142:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c09c800/0x48868a4e439490ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.547227:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c09d600/0x48868a4e439490d5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.547235:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c09d600/0x48868a4e439490d5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.547241:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c09d600/0x48868a4e439490d5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:0.0:1746129749.547247:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129749.547309:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c09cc00/0x48868a4e439490c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.547314:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c09cc00/0x48868a4e439490c7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.547319:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c09cc00/0x48868a4e439490c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.547327:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c09cc00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129749.547330:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c09cc00/0x48868a4e439490c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.547336:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c09cc00/0x48868a4e439490c7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.547342:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:0.0:1746129749.547344:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129749.547346:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c09cc00/0x48868a4e439490c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.547350:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c09cc00/0x48868a4e439490c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.547360:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c09c800/0x48868a4e439490ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.547365:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c09c800/0x48868a4e439490ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.547369:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c09c800/0x48868a4e439490ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.547372:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c09c800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129749.547374:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c09c800/0x48868a4e439490ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.547378:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c09c800/0x48868a4e439490ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.547383:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093a1d300) 00010000:00010000:0.0:1746129749.547385:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129749.547387:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c09c800/0x48868a4e439490ce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.547391:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c09c800/0x48868a4e439490ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129749.547418:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c09c400/0x48868a4e439490c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3aa expref: 19 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.547427:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c09d600/0x48868a4e439490d5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3aa expref: 18 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.547432:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129749.547433:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746129749.547446:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c09d600, rc 0) 00000100:00100000:0.0:1746129749.547479:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28537:x1830949052142976:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 481us (918us total) trans 8589943619 rc 0/0 00000100:00100000:0.0:1746129749.547485:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9843 00000100:00100000:1.0:1746129749.547875:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.547938:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052143360 00000100:00100000:3.0:1746129749.547943:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052143360 00002000:00100000:3.0:1746129749.547965:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff8800a00c4700 x1830949052143360/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.547973:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c4700 with x1830949052143360 ext(4194304->4964351) 00002000:00010000:3.0:1746129749.547977:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a00c4700 00000100:00100000:3.0:1746129749.547996:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4005 00000100:00100000:3.0:1746129749.548001:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1964:x1830949052143360:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129749.550389:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053288448:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129749.550407:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129749.550434:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949052142720:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3758us (3923us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129749.550452:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5188 00000100:00100000:0.0:1746129749.554574:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.554990:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052143616 00000100:00100000:3.0:1746129749.554999:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052143616 00000100:00100000:3.0:1746129749.555032:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3860 00000100:00100000:3.0:1746129749.555040:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28537:x1830949052143616:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129749.555230:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:28537:x1830949052143616:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 189us (663us total) trans 8589943620 rc 0/0 00000100:00100000:3.0:1746129749.555236:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3860 00000100:00100000:1.0:1746129749.560086:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.560629:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.561404:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052143744 00000100:00100000:2.0:1746129749.561411:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052143744 00000100:00100000:0.0:1746129749.561511:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.561751:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052144128 00000100:00100000:3.0:1746129749.561755:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052144128 00002000:00100000:3.0:1746129749.561781:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012ba19500 x1830949052144128/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.561789:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba19500 with x1830949052144128 ext(0->1048575) 00002000:00010000:3.0:1746129749.561794:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba19500 00000100:00100000:0.0:1746129749.561866:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052144256 00000100:00100000:0.0:1746129749.561869:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052144256 00002000:00100000:0.0:1746129749.561885:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012ba1b800 x1830949052144256/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129749.561891:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba1b800 with x1830949052144256 ext(1048576->2097151) 00002000:00010000:0.0:1746129749.561894:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba1b800 00000100:00100000:0.0:1746129749.561907:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4006 00000100:00100000:0.0:1746129749.561917:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949052144128:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129749.562222:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4007 00000100:00100000:3.0:1746129749.562228:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949052144256:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129749.562779:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 562 00000100:00100000:2.0:1746129749.562786:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949052143744:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129749.562795:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129749.562814:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c09d600/0x48868a4e439490d5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3aa expref: 19 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.562837:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129749.562840:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129749.562888:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052143744:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 103us (2809us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129749.562894:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 562 00000100:00100000:2.0:1746129749.563819:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1964:x1830949052143360:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15815us (15942us total) trans 0 rc 770048/770048 00000100:00100000:2.0:1746129749.563825:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4005 00002000:00100000:2.0:1746129749.563833:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff8800a00c4700 x1830949052143360/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.563841:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c4700 with x1830949052143360 ext(4194304->4964351) 00002000:00010000:2.0:1746129749.563864:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a00c4700 00000100:00100000:3.0:1746129749.572282:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949052144256:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10044us (10761us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129749.572294:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4007 00002000:00100000:3.0:1746129749.572308:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012ba1b800 x1830949052144256/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.572317:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba1b800 with x1830949052144256 ext(1048576->2097151) 00002000:00010000:3.0:1746129749.572323:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba1b800 00000100:00100000:0.0:1746129749.578026:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129749.578191:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052144384 00000100:00100000:1.0:1746129749.578199:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052144384 00000100:00100000:1.0:1746129749.578246:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10819 00000100:00100000:1.0:1746129749.578253:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052144384:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129749.578269:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129749.578283:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439490e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f3b1 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.578302:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129749.578303:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129749.578309:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439490e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3b1 expref: 10 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129749.578322:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439490e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3b1 expref: 10 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129749.578330:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff2400, rc 0) 00000100:00100000:1.0:1746129749.578364:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949052144384:12345-192.168.204.31@tcp:101:cat.0 Request processed in 111us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129749.578370:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10819 00000100:00100000:2.0:1746129749.580996:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949052144128:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19075us (20359us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129749.581007:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4006 00002000:00100000:2.0:1746129749.581017:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012ba19500 x1830949052144128/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.581027:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba19500 with x1830949052144128 ext(0->1048575) 00002000:00010000:2.0:1746129749.581031:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba19500 00000100:00100000:0.0:1746129749.596430:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.596484:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.596513:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052144512 00000100:00100000:3.0:1746129749.596522:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052144512 00000100:00100000:1.0:1746129749.596528:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052144640 00000100:00100000:1.0:1746129749.596531:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052144640 00000100:00100000:1.0:1746129749.596567:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10820 00000100:00100000:3.0:1746129749.596571:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10821 00000100:00100000:1.0:1746129749.596574:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1962:x1830949052144640:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:3.0:1746129749.596576:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949052144512:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129749.596588:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129749.596588:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129749.596601:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130efbc00/0x48868a4e439490ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f3b8 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.596601:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2000/0x48868a4e439490f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f3bf expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129749.596640:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053288576:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129749.596650:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095242300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053288704:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129749.596716:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4948840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129749.597485:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129749.599481:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095242300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053288704:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129749.599506:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130efbc00/0x48868a4e439490ea lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3b8 expref: 24 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129749.599518:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130efbc00/0x48868a4e439490ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3b8 expref: 24 pid: 1140 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129749.599602:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053288576:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129749.599624:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2000/0x48868a4e439490f1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3bf expref: 15 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129749.599631:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2000/0x48868a4e439490f1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3bf expref: 15 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129749.600238:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130efbc00, rc 0) 00010000:00010000:1.0:1746129749.600810:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff2000, rc 0) 00000100:00100000:3.0:1746129749.601868:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949052144512:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5285us (5438us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129749.601876:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10821 00000100:00100000:1.0:1746129749.601979:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1962:x1830949052144640:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5405us (5494us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129749.601985:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10820 00000100:00100000:0.0:1746129749.610218:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129749.610298:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052144768 00000100:00100000:1.0:1746129749.610306:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052144768 00000100:00100000:1.0:1746129749.610393:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10822 00000100:00100000:1.0:1746129749.610402:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:28532:x1830949052144768:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129749.610418:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129749.610432:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3000/0x48868a4e439490f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f3c6 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.610475:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130efba00/0x48868a4e4394905e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f364 expref: 9 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.610591:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129749.610596:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129749.610600:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3000/0x48868a4e439490f8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3c6 expref: 24 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.610626:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130efba00/0x48868a4e4394905e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f364 expref: 9 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.610645:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130efba00/0x48868a4e4394905e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f364 expref: 9 pid: 3623 timeout: 795 lvb_type: 0 00000100:00100000:1.0:1746129749.610657:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053288832:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129749.610734:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4948840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129749.612720:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053288832:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129749.612742:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3000/0x48868a4e439490f8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3c6 expref: 24 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.612755:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff3000, rc 0) 00000100:00100000:0.0:1746129749.612821:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129749.612933:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:28532:x1830949052144768:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2531us (2719us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129749.612940:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10822 00000100:00100000:3.0:1746129749.612993:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052144896 00000100:00100000:3.0:1746129749.612998:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052144896 00002000:00100000:3.0:1746129749.613257:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3371007) req@ffff880094a4d180 x1830949052144896/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.613266:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4d180 with x1830949052144896 ext(3145728->3371007) 00010000:00010000:3.0:1746129749.613272:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130efba00/0x48868a4e4394905e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f364 expref: 10 pid: 3623 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746129749.613288:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130efba00/0x48868a4e4394905e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f364 expref: 10 pid: 3623 timeout: 795 lvb_type: 0 00002000:00010000:3.0:1746129749.613294:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094a4d180 00000100:00100000:3.0:1746129749.613404:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 570 00000100:00100000:3.0:1746129749.613411:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1963:x1830949052144896:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129749.617625:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1963:x1830949052144896:12345-192.168.204.31@tcp:4:cat.0 Request processed in 4206us (4797us total) trans 17179873126 rc 0/0 00000100:00100000:3.0:1746129749.617635:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 570 00002000:00100000:3.0:1746129749.617644:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3371007) req@ffff880094a4d180 x1830949052144896/t17179873126(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/448 e 0 to 0 dl 1746129760 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.617657:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4d180 with x1830949052144896 ext(3145728->3371007) 00010000:00010000:3.0:1746129749.617666:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130efba00/0x48868a4e4394905e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f364 expref: 12 pid: 3623 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746129749.617679:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130efba00/0x48868a4e4394905e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f364 expref: 12 pid: 3623 timeout: 795 lvb_type: 0 00002000:00010000:3.0:1746129749.617685:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094a4d180 00000100:00100000:0.0:1746129749.622569:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129749.622703:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052145024 00000100:00100000:1.0:1746129749.622711:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052145024 00010000:00010000:1.0:1746129749.622743:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130efba00/0x48868a4e4394905e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f364 expref: 12 pid: 3623 timeout: 795 lvb_type: 0 00000100:00100000:1.0:1746129749.622780:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5189 00000100:00100000:1.0:1746129749.622787:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1963:x1830949052145024:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129749.622800:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129749.622819:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130efba00/0x48868a4e4394905e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f364 expref: 12 pid: 3623 timeout: 795 lvb_type: 0 00010000:00010000:1.0:1746129749.622829:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130efba00/0x48868a4e4394905e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f364 expref: 12 pid: 3623 timeout: 795 lvb_type: 0 00010000:00010000:1.0:1746129749.622872:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130efba00/0x48868a4e4394905e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f364 expref: 12 pid: 3623 timeout: 795 lvb_type: 0 00010000:00010000:1.0:1746129749.622890:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129749.622892:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129749.622898:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3000/0x48868a4e439490f8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3c6 expref: 23 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.622905:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3000/0x48868a4e439490f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3c6 expref: 23 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.622930:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3000/0x48868a4e439490f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3c6 expref: 23 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129749.622940:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053288960:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129749.623015:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4948840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129749.626150:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053288960:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129749.626167:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129749.626203:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1963:x1830949052145024:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3416us (3641us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129749.626211:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5189 00000100:00100000:2.0:1746129749.629448:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.629551:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052145280 00000100:00100000:3.0:1746129749.629562:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052145280 00002000:00100000:3.0:1746129749.629600:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800936dd180 x1830949052145280/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.629610:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dd180 with x1830949052145280 ext(2097152->3145727) 00002000:00010000:3.0:1746129749.629614:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dd180 00000100:00100000:3.0:1746129749.629630:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4008 00000100:00100000:3.0:1746129749.629636:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052145280:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129749.637475:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052145280:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7830us (8035us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129749.637486:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4008 00002000:00100000:3.0:1746129749.637496:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800936dd180 x1830949052145280/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.637505:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dd180 with x1830949052145280 ext(2097152->3145727) 00002000:00010000:3.0:1746129749.637511:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dd180 00000100:00100000:0.0:1746129749.641129:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129749.641288:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052145408 00000100:00100000:1.0:1746129749.641296:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052145408 00000100:00100000:1.0:1746129749.641343:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10823 00000100:00100000:1.0:1746129749.641350:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:28532:x1830949052145408:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129749.641364:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129749.641378:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3200/0x48868a4e439490ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f3cd expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.641401:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130efbe00/0x48868a4e43949057 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f35d expref: 7 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.641407:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129749.641409:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129749.641412:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3200/0x48868a4e439490ff lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3cd expref: 15 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.641446:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130efbe00/0x48868a4e43949057 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f35d expref: 7 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.641457:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130efbe00/0x48868a4e43949057 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f35d expref: 7 pid: 3623 timeout: 795 lvb_type: 0 00000100:00100000:1.0:1746129749.641473:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053289088:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129749.641548:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4948840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129749.643330:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053289088:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129749.643355:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3200/0x48868a4e439490ff lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3cd expref: 15 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.643367:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff3200, rc 0) 00000100:00100000:1.0:1746129749.643834:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:28532:x1830949052145408:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2482us (2710us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129749.643841:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10823 00000100:00100000:0.0:1746129749.645308:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.645638:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052145536 00000100:00100000:3.0:1746129749.645644:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052145536 00002000:00100000:3.0:1746129749.645676:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2486272->3145727) req@ffff880136885180 x1830949052145536/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.645684:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136885180 with x1830949052145536 ext(2486272->3145727) 00010000:00010000:3.0:1746129749.645691:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130efbe00/0x48868a4e43949057 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f35d expref: 8 pid: 3623 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746129749.645701:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130efbe00/0x48868a4e43949057 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f35d expref: 8 pid: 3623 timeout: 795 lvb_type: 0 00002000:00010000:3.0:1746129749.645706:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136885180 00000100:00100000:3.0:1746129749.646327:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 571 00000100:00100000:3.0:1746129749.646334:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1961:x1830949052145536:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129749.656838:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053289216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746129749.656898:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129749.656994:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053289216 00000100:00100000:0.0:1746129749.657001:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053289216 00000100:00100000:0.0:1746129749.657036:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1746129749.657043:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1830949053289216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746129749.657061:0:8438:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 299565056 pending 3407872 free 3853516800 avail 3835691008 00000100:00100000:0.0:1746129749.657103:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1830949053289216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129749.657110:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:0.0:1746129749.657125:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746129749.657183:0:3299:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840277 gen 2 00000004:00080000:2.0:1746129749.657188:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adad180, transno 21474840175 00000004:00080000:2.0:1746129749.657194:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adac380, transno 21474840176 00000004:00080000:2.0:1746129749.657196:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adad500, transno 21474840177 00000004:00080000:2.0:1746129749.657198:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adadc00, transno 21474840178 00000004:00080000:2.0:1746129749.657199:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adad880, transno 21474840179 00000004:00080000:2.0:1746129749.657201:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adac700, transno 21474840180 00000004:00080000:2.0:1746129749.657204:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adaed80, transno 21474840181 00000004:00080000:2.0:1746129749.657205:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adace00, transno 21474840182 00000004:00080000:2.0:1746129749.657207:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55a7800, transno 21474840183 00000004:00080000:2.0:1746129749.657209:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009be65500, transno 21474840184 00000004:00080000:2.0:1746129749.657211:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55a5f80, transno 21474840185 00000004:00080000:2.0:1746129749.657213:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8793480, transno 21474840186 00000004:00080000:2.0:1746129749.657215:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8792a00, transno 21474840187 00000004:00080000:2.0:1746129749.657217:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009be64000, transno 21474840188 00000004:00080000:2.0:1746129749.657218:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55a4e00, transno 21474840189 00000004:00080000:2.0:1746129749.657220:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009be67100, transno 21474840190 00000004:00080000:2.0:1746129749.657222:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b026680, transno 21474840204 00000004:00080000:2.0:1746129749.657226:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b027800, transno 21474840205 00000004:00080000:2.0:1746129749.657227:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009328aa00, transno 21474840206 00000004:00080000:2.0:1746129749.657229:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b026a00, transno 21474840207 00000004:00080000:2.0:1746129749.657230:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009328b800, transno 21474840208 00000004:00080000:2.0:1746129749.657232:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b024e00, transno 21474840209 00000004:00080000:2.0:1746129749.657234:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093289500, transno 21474840210 00000004:00080000:2.0:1746129749.657236:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b024380, transno 21474840211 00000004:00080000:2.0:1746129749.657238:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8790380, transno 21474840215 00000004:00080000:2.0:1746129749.657240:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8793b80, transno 21474840216 00000004:00080000:2.0:1746129749.657242:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009468d880, transno 21474840217 00000004:00080000:2.0:1746129749.657244:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423df80, transno 21474840218 00000004:00080000:2.0:1746129749.657246:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009468c000, transno 21474840219 00000004:00080000:2.0:1746129749.657248:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009468e680, transno 21474840220 00000004:00080000:2.0:1746129749.657250:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423e300, transno 21474840221 00000004:00080000:2.0:1746129749.657251:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423d880, transno 21474840222 00000004:00080000:2.0:1746129749.657254:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a504f100, transno 21474840223 00000004:00080000:2.0:1746129749.657256:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136885c00, transno 21474840224 00000004:00080000:2.0:1746129749.657257:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a504f800, transno 21474840225 00000004:00080000:2.0:1746129749.657260:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c1c4000, transno 21474840226 00000004:00080000:2.0:1746129749.657262:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a504ce00, transno 21474840227 00000004:00080000:2.0:1746129749.657264:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c1c4e00, transno 21474840228 00000004:00080000:2.0:1746129749.657265:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009206f100, transno 21474840229 00000004:00080000:2.0:1746129749.657267:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136887800, transno 21474840230 00000004:00080000:2.0:1746129749.657269:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba3b100, transno 21474840232 00000004:00080000:2.0:1746129749.657271:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba38000, transno 21474840233 00000004:00080000:2.0:1746129749.657273:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba39180, transno 21474840234 00000004:00080000:2.0:1746129749.657274:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba38380, transno 21474840235 00000004:00080000:2.0:1746129749.657276:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba3a680, transno 21474840236 00000004:00080000:2.0:1746129749.657278:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba38a80, transno 21474840237 00000004:00080000:2.0:1746129749.657280:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba39880, transno 21474840238 00000004:00080000:2.0:1746129749.657283:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba3b480, transno 21474840239 00000004:00080000:2.0:1746129749.657285:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d634000, transno 21474840243 00000004:00080000:2.0:1746129749.657286:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00ea00, transno 21474840244 00000004:00080000:2.0:1746129749.657288:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba85c00, transno 21474840245 00000004:00080000:2.0:1746129749.657290:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00f100, transno 21474840246 00000004:00080000:2.0:1746129749.657292:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba87480, transno 21474840247 00000004:00080000:2.0:1746129749.657294:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00ca80, transno 21474840248 00000004:00080000:2.0:1746129749.657295:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba84380, transno 21474840249 00000004:00080000:2.0:1746129749.657297:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00d880, transno 21474840250 00000004:00080000:2.0:1746129749.657299:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba3b800, transno 21474840251 00000004:00080000:2.0:1746129749.657301:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c042d80, transno 21474840252 00000004:00080000:2.0:1746129749.657303:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba38700, transno 21474840253 00000004:00080000:2.0:1746129749.657305:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5491180, transno 21474840254 00000004:00080000:2.0:1746129749.657307:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b024000, transno 21474840255 00000004:00080000:2.0:1746129749.657309:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba3ad80, transno 21474840256 00000004:00080000:2.0:1746129749.657310:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba3bb80, transno 21474840257 00000004:00080000:2.0:1746129749.657312:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c040380, transno 21474840258 00000004:00080000:2.0:1746129749.657314:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013631bb80, transno 21474840262 00000004:00080000:2.0:1746129749.657316:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136319180, transno 21474840263 00000004:00080000:2.0:1746129749.657318:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136318a80, transno 21474840264 00000004:00080000:2.0:1746129749.657320:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b024700, transno 21474840265 00000004:00080000:2.0:1746129749.657323:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136319500, transno 21474840266 00000004:00080000:2.0:1746129749.657325:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04d880, transno 21474840267 00000004:00080000:2.0:1746129749.657327:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136319880, transno 21474840268 00000004:00080000:2.0:1746129749.657328:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04f100, transno 21474840269 00000004:00080000:2.0:1746129749.657330:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009206ed80, transno 21474840270 00000004:00080000:2.0:1746129749.657332:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55a4700, transno 21474840271 00000004:00080000:2.0:1746129749.657334:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55a6300, transno 21474840272 00000004:00080000:2.0:1746129749.657336:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009206ce00, transno 21474840273 00000004:00080000:2.0:1746129749.657338:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55a4380, transno 21474840274 00000004:00080000:2.0:1746129749.657340:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009206f480, transno 21474840275 00000004:00080000:2.0:1746129749.657342:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009206dc00, transno 21474840276 00000004:00080000:2.0:1746129749.657344:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55a6d80, transno 21474840277 00000100:00100000:2.0:1746129749.657352:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053289216:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1746129749.657776:0:14357:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 80 done 00000100:00100000:3.0:1746129749.659603:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052145536:12345-192.168.204.31@tcp:4:cat.0 Request processed in 13261us (14290us total) trans 21474840280 rc 0/0 00000100:00100000:3.0:1746129749.659612:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 571 00002000:00100000:3.0:1746129749.659622:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2486272->3145727) req@ffff880136885180 x1830949052145536/t21474840280(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/448 e 0 to 0 dl 1746129760 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.659630:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136885180 with x1830949052145536 ext(2486272->3145727) 00010000:00010000:3.0:1746129749.659639:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130efbe00/0x48868a4e43949057 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f35d expref: 10 pid: 3623 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746129749.659651:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130efbe00/0x48868a4e43949057 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f35d expref: 10 pid: 3623 timeout: 795 lvb_type: 0 00002000:00010000:3.0:1746129749.659657:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136885180 00000100:00100000:0.0:1746129749.668824:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129749.668933:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052145664 00000100:00100000:1.0:1746129749.668940:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052145664 00010000:00010000:1.0:1746129749.668967:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130efbe00/0x48868a4e43949057 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f35d expref: 10 pid: 3623 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746129749.669367:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746129749.669391:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5190 00000100:00100000:1.0:1746129749.669400:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1963:x1830949052145664:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129749.669410:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129749.669427:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053289344:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1746129749.669427:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130efbe00/0x48868a4e43949057 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2486272->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f35d expref: 10 pid: 3623 timeout: 795 lvb_type: 0 00010000:00010000:1.0:1746129749.669454:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130efbe00/0x48868a4e43949057 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2486272->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f35d expref: 10 pid: 3623 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746129749.669474:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746129749.669478:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130efbe00/0x48868a4e43949057 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2486272->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f35d expref: 10 pid: 3623 timeout: 795 lvb_type: 0 00010000:00010000:1.0:1746129749.670078:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129749.670081:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129749.670087:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3200/0x48868a4e439490ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3cd expref: 14 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.670096:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3200/0x48868a4e439490ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3cd expref: 14 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.670120:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3200/0x48868a4e439490ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3cd expref: 14 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129749.670125:0:4345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053289344 00000100:00100000:1.0:1746129749.670128:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053289472:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129749.670130:0:4345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053289344 00000100:00100000:2.0:1746129749.670171:0:4345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1746129749.670177:0:4345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3297:x1830949053289344:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746129749.670178:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4948840 going to sleep for 11 seconds 00002000:00000024:2.0:1746129749.670192:0:4345:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 318177280 pending 6815744 free 3852468224 avail 3850371072 00000100:00100000:2.0:1746129749.670224:0:4345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3297:x1830949053289344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129749.670231:0:4345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:2.0:1746129749.670255:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746129749.670317:0:3297:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873113 gen 2 00000004:00080000:3.0:1746129749.670322:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131461880, transno 17179873010 00000004:00080000:3.0:1746129749.670327:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131460000, transno 17179873011 00000004:00080000:3.0:1746129749.670329:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131461500, transno 17179873012 00000004:00080000:3.0:1746129749.670332:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131461f80, transno 17179873013 00000004:00080000:3.0:1746129749.670334:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131462300, transno 17179873014 00000004:00080000:3.0:1746129749.670336:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131460700, transno 17179873015 00000004:00080000:3.0:1746129749.670338:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131461c00, transno 17179873016 00000004:00080000:3.0:1746129749.670340:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f6d8e00, transno 17179873017 00000004:00080000:3.0:1746129749.670342:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131463b80, transno 17179873018 00000004:00080000:3.0:1746129749.670344:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d8df80, transno 17179873019 00000004:00080000:3.0:1746129749.670345:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d8e300, transno 17179873020 00000004:00080000:3.0:1746129749.670347:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d8dc00, transno 17179873021 00000004:00080000:3.0:1746129749.670349:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d8ea00, transno 17179873022 00000004:00080000:3.0:1746129749.670351:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d8f480, transno 17179873023 00000004:00080000:3.0:1746129749.670353:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d8ca80, transno 17179873024 00000004:00080000:3.0:1746129749.670355:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d8fb80, transno 17179873025 00000004:00080000:3.0:1746129749.670357:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d8ed80, transno 17179873026 00000004:00080000:3.0:1746129749.670359:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04c000, transno 17179873027 00000004:00080000:3.0:1746129749.670361:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a504d880, transno 17179873037 00000004:00080000:3.0:1746129749.670363:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04f480, transno 17179873038 00000004:00080000:3.0:1746129749.670365:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a504c000, transno 17179873039 00000004:00080000:3.0:1746129749.670367:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04ea00, transno 17179873040 00000004:00080000:3.0:1746129749.670368:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a504c380, transno 17179873041 00000004:00080000:3.0:1746129749.670370:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04c380, transno 17179873042 00000004:00080000:3.0:1746129749.670372:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130505f80, transno 17179873043 00000004:00080000:3.0:1746129749.670374:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a504fb80, transno 17179873044 00000004:00080000:3.0:1746129749.670376:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8790a80, transno 17179873045 00000004:00080000:3.0:1746129749.670378:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd46680, transno 17179873049 00000004:00080000:3.0:1746129749.670380:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd45f80, transno 17179873050 00000004:00080000:3.0:1746129749.670382:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd47b80, transno 17179873051 00000004:00080000:3.0:1746129749.670383:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd45500, transno 17179873052 00000004:00080000:3.0:1746129749.670385:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd44000, transno 17179873053 00000004:00080000:3.0:1746129749.670386:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd45180, transno 17179873054 00000004:00080000:3.0:1746129749.670388:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd44e00, transno 17179873055 00000004:00080000:3.0:1746129749.670389:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd45c00, transno 17179873056 00000004:00080000:3.0:1746129749.670391:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd47800, transno 17179873057 00000004:00080000:3.0:1746129749.670393:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284f100, transno 17179873058 00000004:00080000:3.0:1746129749.670395:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284fb80, transno 17179873059 00000004:00080000:3.0:1746129749.670396:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284c380, transno 17179873060 00000004:00080000:3.0:1746129749.670398:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284d180, transno 17179873061 00000004:00080000:3.0:1746129749.670400:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284ca80, transno 17179873062 00000004:00080000:3.0:1746129749.670401:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284e300, transno 17179873063 00000004:00080000:3.0:1746129749.670403:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284c700, transno 17179873064 00000004:00080000:3.0:1746129749.670405:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284df80, transno 17179873065 00000004:00080000:3.0:1746129749.670406:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284d500, transno 17179873066 00000004:00080000:3.0:1746129749.670408:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba38e00, transno 17179873072 00000004:00080000:3.0:1746129749.670410:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d4380, transno 17179873073 00000004:00080000:3.0:1746129749.670411:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d4e00, transno 17179873074 00000004:00080000:3.0:1746129749.670413:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba39f80, transno 17179873075 00000004:00080000:3.0:1746129749.670414:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d4700, transno 17179873076 00000004:00080000:3.0:1746129749.670416:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba39c00, transno 17179873077 00000004:00080000:3.0:1746129749.670418:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d5880, transno 17179873078 00000004:00080000:3.0:1746129749.670420:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba39500, transno 17179873079 00000004:00080000:3.0:1746129749.670422:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d5c00, transno 17179873080 00000004:00080000:3.0:1746129749.670424:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00c380, transno 17179873084 00000004:00080000:3.0:1746129749.670426:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00fb80, transno 17179873085 00000004:00080000:3.0:1746129749.670428:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00d180, transno 17179873086 00000004:00080000:3.0:1746129749.670430:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c137b80, transno 17179873087 00000004:00080000:3.0:1746129749.670432:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009207d180, transno 17179873088 00000004:00080000:3.0:1746129749.670448:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00ce00, transno 17179873089 00000004:00080000:3.0:1746129749.670450:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00c000, transno 17179873090 00000004:00080000:3.0:1746129749.670452:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00e680, transno 17179873091 00000004:00080000:3.0:1746129749.670453:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00d500, transno 17179873092 00000004:00080000:3.0:1746129749.670455:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936dc380, transno 17179873093 00000004:00080000:3.0:1746129749.670457:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009207e300, transno 17179873094 00000004:00080000:3.0:1746129749.670459:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936dc000, transno 17179873095 00000004:00080000:3.0:1746129749.670460:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009207dc00, transno 17179873096 00000004:00080000:3.0:1746129749.670462:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936dc700, transno 17179873097 00000004:00080000:3.0:1746129749.670463:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009207e680, transno 17179873098 00000004:00080000:3.0:1746129749.670465:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009207c380, transno 17179873099 00000004:00080000:3.0:1746129749.670467:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936dd880, transno 17179873100 00000004:00080000:3.0:1746129749.670469:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009207d500, transno 17179873101 00000004:00080000:3.0:1746129749.670471:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c5c00, transno 17179873105 00000004:00080000:3.0:1746129749.670473:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c6a00, transno 17179873106 00000004:00080000:3.0:1746129749.670475:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c5180, transno 17179873107 00000004:00080000:3.0:1746129749.670477:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c5f80, transno 17179873108 00000004:00080000:3.0:1746129749.670479:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c6d80, transno 17179873109 00000004:00080000:3.0:1746129749.670480:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c6680, transno 17179873110 00000004:00080000:3.0:1746129749.670482:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c5880, transno 17179873111 00000004:00080000:3.0:1746129749.670483:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c5500, transno 17179873112 00000004:00080000:3.0:1746129749.670485:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c6300, transno 17179873113 00000100:00100000:3.0:1746129749.670491:0:3297:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009206df80 x1830949053280768/t17179873114(17179873114) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746129764 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000100:00100000:3.0:1746129749.670503:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053289344:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1746129749.673664:0:14359:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 79 in progress, 0 in flight, 11 done 00000100:00100000:1.0:1746129749.673669:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053289472:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129749.673683:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129749.673732:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1963:x1830949052145664:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4332us (4912us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129749.673741:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5190 00000004:00080000:2.0:1746129749.673991:0:14359:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 9 in progress, 0 in flight, 70 done 00000100:00100000:0.0:1746129749.681475:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.681512:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.681547:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.681583:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052145920 00000100:00100000:0.0:1746129749.681590:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052145920 00002000:00100000:0.0:1746129749.681631:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880136887800 x1830949052145920/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129749.681640:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136887800 with x1830949052145920 ext(2097152->3145727) 00002000:00010000:0.0:1746129749.681646:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136887800 00000100:00100000:0.0:1746129749.681660:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052146176 00000100:00100000:0.0:1746129749.681662:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052146176 00002000:00100000:0.0:1746129749.681671:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880136885880 x1830949052146176/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129749.681678:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136885880 with x1830949052146176 ext(3145728->4194303) 00002000:00010000:0.0:1746129749.681680:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136885880 00000100:00100000:0.0:1746129749.681701:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052146432 00000100:00100000:0.0:1746129749.681704:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052146432 00002000:00100000:0.0:1746129749.681715:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880136887100 x1830949052146432/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129749.681721:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136887100 with x1830949052146432 ext(3145728->4194303) 00002000:00010000:0.0:1746129749.681723:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136887100 00000100:00100000:0.0:1746129749.681740:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4009 00000100:00100000:0.0:1746129749.681747:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1962:x1830949052145920:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129749.681750:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4010 00000100:00100000:1.0:1746129749.681758:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1962:x1830949052146176:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129749.681800:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4011 00000100:00100000:0.0:1746129749.681822:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052146432:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129749.685677:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ea7f7eb-2f74-477e-bfed-16dc08365411:3297:1830949053289600:0@lo:400:kworker.0 00000100:00100000:2.0:1746129749.685677:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3298:1830949053289728:0@lo:400:kworker.0 00000100:00100000:3.0:1746129749.685723:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129749.685726:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129749.685749:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746129749.685753:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3298:1830949053289856:0@lo:400:kworker.0 00000100:00100000:3.0:1746129749.685763:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746129749.685766:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129749.685768:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3297:1830949053289984:0@lo:400:kworker.0 00000100:00100000:3.0:1746129749.685783:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129749.685789:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053289728 00000100:00100000:2.0:1746129749.685793:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053289728 00000100:00100000:3.0:1746129749.685802:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053289856 00000100:00100000:3.0:1746129749.685805:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053289856 00000100:00100000:2.0:1746129749.685821:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053289984 00000100:00100000:2.0:1746129749.685823:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053289984 00000100:00100000:3.0:1746129749.685826:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1746129749.685831:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1830949053289728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746129749.685833:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1746129749.685837:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1830949053289856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746129749.685876:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1830949053289856:12345-0@lo:400:kworker.0 Request processed in 38us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129749.685877:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1830949053289728:12345-0@lo:400:kworker.0 Request processed in 46us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129749.685881:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1746129749.685884:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1746129749.685894:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1746129749.685898:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1830949053289984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746129749.685915:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1830949053289984:12345-0@lo:400:kworker.0 Request processed in 17us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129749.685919:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1746129749.685939:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3297:1830949053289984:0@lo:400:kworker.0 00000100:00100000:1.0:1746129749.685940:0:14312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053289600 00000100:00100000:1.0:1746129749.685943:0:14312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053289600 00000100:00100000:1.0:1746129749.685960:0:14312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1746129749.685968:0:14312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008edfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ea7f7eb-2f74-477e-bfed-16dc08365411+18:3297:x1830949053289600:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1746129749.686149:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746129749.686163:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3298:1830949053289856:0@lo:400:kworker.0 00000100:00100000:2.0:1746129749.686170:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3298:1830949053289728:0@lo:400:kworker.0 00000100:00100000:1.0:1746129749.686215:0:14312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008edfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ea7f7eb-2f74-477e-bfed-16dc08365411+18:3297:x1830949053289600:12345-0@lo:400:kworker.0 Request processed in 250us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129749.686220:0:14312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1746129749.686261:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ea7f7eb-2f74-477e-bfed-16dc08365411:3297:1830949053289600:0@lo:400:kworker.0 00000100:00100000:2.0:1746129749.695125:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052146432:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13309us (13568us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129749.695137:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4011 00002000:00100000:2.0:1746129749.695147:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880136887100 x1830949052146432/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.695156:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136887100 with x1830949052146432 ext(3145728->4194303) 00002000:00010000:2.0:1746129749.695161:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136887100 00000100:00100000:2.0:1746129749.698771:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949052145920:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17015us (17294us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129749.698782:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4009 00002000:00100000:2.0:1746129749.698791:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880136887800 x1830949052145920/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.698799:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136887800 with x1830949052145920 ext(2097152->3145727) 00002000:00010000:2.0:1746129749.698803:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136887800 00000100:00100000:1.0:1746129749.704137:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949052146176:12345-192.168.204.31@tcp:3:cat.0 Request processed in 22371us (22614us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129749.704146:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4010 00002000:00100000:1.0:1746129749.704155:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880136885880 x1830949052146176/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.704164:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136885880 with x1830949052146176 ext(3145728->4194303) 00002000:00010000:1.0:1746129749.704169:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136885880 00000100:00100000:0.0:1746129749.711802:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129749.712006:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052146688 00000100:00100000:1.0:1746129749.712014:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052146688 00002000:00100000:1.0:1746129749.712052:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009423e300 x1830949052146688/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.712061:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423e300 with x1830949052146688 ext(4194304->4964351) 00002000:00010000:1.0:1746129749.712066:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009423e300 00000100:00100000:1.0:1746129749.712097:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4012 00000100:00100000:1.0:1746129749.712104:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949052146688:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129749.720919:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949052146688:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8806us (9116us total) trans 0 rc 770048/770048 00000100:00100000:2.0:1746129749.720930:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4012 00002000:00100000:2.0:1746129749.720941:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009423e300 x1830949052146688/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.720956:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423e300 with x1830949052146688 ext(4194304->4964351) 00002000:00010000:2.0:1746129749.720961:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009423e300 00000100:00100000:0.0:1746129749.728492:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.728562:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052146944 00000100:00100000:3.0:1746129749.728570:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052146944 00000100:00100000:3.0:1746129749.728607:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3861 00000100:00100000:3.0:1746129749.728614:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:28532:x1830949052146944:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:3.0:1746129749.729773:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:28532:x1830949052146944:12345-192.168.204.31@tcp:35:cat.0 Request processed in 1155us (1284us total) trans 8589943621 rc 0/0 00000100:00100000:3.0:1746129749.729782:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3861 00000100:00100000:0.0:1746129749.739835:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.739956:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052147200 00000100:00100000:2.0:1746129749.739965:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052147200 00000100:00100000:2.0:1746129749.740008:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9844 00000100:00100000:2.0:1746129749.740015:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:28543:x1830949052147200:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129749.740035:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129749.740049:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949106 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f3d4 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.740268:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e4394910d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.740280:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e4394910d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.740288:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e4394910d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.740300:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e43949114 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.740305:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e43949114 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.740309:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e43949114 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.740417:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed400/0x48868a4e4394911b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.740429:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed400/0x48868a4e4394911b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.740445:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed400/0x48868a4e4394911b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129749.740454:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129749.740578:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e4394910d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.740732:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e4394910d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.740737:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e4394910d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.740743:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801310ed600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129749.740745:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e4394910d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.740754:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e4394910d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.740763:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129749.740765:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129749.740768:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e4394910d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.740773:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e4394910d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.740796:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e43949114 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.740804:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e43949114 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.740807:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e43949114 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.740810:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801310ede00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129749.740812:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e43949114 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.740816:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e43949114 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.740821:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094266900) 00010000:00010000:2.0:1746129749.740823:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129749.740825:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e43949114 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.740829:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e43949114 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.740884:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949106 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3d4 expref: 292 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.740895:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed400/0x48868a4e4394911b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3d4 expref: 291 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.740900:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129749.740902:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129749.740904:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310ed400, rc 0) 00000100:00100000:2.0:1746129749.741338:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:28543:x1830949052147200:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1322us (1508us total) trans 8589943622 rc 0/0 00000100:00100000:2.0:1746129749.741345:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9844 00000100:00100000:0.0:1746129749.747884:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.747933:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.747952:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052147584 00000100:00100000:3.0:1746129749.747960:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052147584 00000100:00100000:3.0:1746129749.747994:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3862 00000100:00100000:3.0:1746129749.748000:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:28543:x1830949052147584:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129749.748064:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052147328 00000100:00100000:1.0:1746129749.748069:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052147328 00000100:00100000:1.0:1746129749.748098:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 563 00000100:00100000:1.0:1746129749.748104:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:1964:x1830949052147328:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129749.748112:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129749.748130:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed400/0x48868a4e4394911b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3d4 expref: 293 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.748145:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129749.748149:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129749.748179:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:1964:x1830949052147328:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 75us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129749.748184:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 563 00000100:00100000:3.0:1746129749.748376:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:28543:x1830949052147584:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 375us (535us total) trans 8589943623 rc 0/0 00000100:00100000:3.0:1746129749.748381:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3862 00000100:00100000:0.0:1746129749.785244:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.789893:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052147840 00000100:00100000:2.0:1746129749.789905:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052147840 00000100:00100000:2.0:1746129749.789969:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9845 00000100:00100000:2.0:1746129749.789977:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28546:x1830949052147840:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129749.790000:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129749.790016:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ecc00/0x48868a4e43949129 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f3db expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.790120:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed400/0x48868a4e43949130 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.790131:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed400/0x48868a4e43949130 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.790140:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed400/0x48868a4e43949130 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.790151:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949137 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.790156:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949137 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.790161:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949137 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.790246:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e4394913e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.790254:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e4394913e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.790260:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e4394913e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129749.790267:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129749.790331:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed400/0x48868a4e43949130 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.790337:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed400/0x48868a4e43949130 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.790342:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed400/0x48868a4e43949130 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.790346:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801310ed400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129749.790349:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed400/0x48868a4e43949130 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.790354:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed400/0x48868a4e43949130 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.790363:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129749.790365:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129749.790368:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed400/0x48868a4e43949130 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.790372:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed400/0x48868a4e43949130 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.790400:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949137 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.790405:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949137 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.790413:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949137 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.790418:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801310eda00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129749.790420:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949137 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.790423:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949137 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.790429:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094266900) 00010000:00010000:2.0:1746129749.790471:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129749.790473:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949137 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.790478:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949137 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.790509:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ecc00/0x48868a4e43949129 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3db expref: 21 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.790518:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e4394913e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3db expref: 20 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.790524:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129749.790525:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129749.790527:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310ede00, rc 0) 00000100:00100000:2.0:1746129749.790580:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:28546:x1830949052147840:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 604us (5343us total) trans 8589943624 rc 0/0 00000100:00100000:2.0:1746129749.790585:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9845 00000100:00100000:0.0:1746129749.793503:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.793622:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052147968 00000100:00100000:0.0:1746129749.793629:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052147968 00000100:00100000:0.0:1746129749.793672:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10824 00000100:00100000:0.0:1746129749.793678:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:28543:x1830949052147968:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129749.793692:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129749.793704:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e3f000/0x48868a4e4394914c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f3e2 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.793725:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3000/0x48868a4e439490f8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3c6 expref: 25 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.793732:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129749.793733:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129749.793736:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e3f000/0x48868a4e4394914c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2514944->2945023] (req 2514944->2945023) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3e2 expref: 25 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.793759:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3000/0x48868a4e439490f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3c6 expref: 25 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.793768:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3000/0x48868a4e439490f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3c6 expref: 25 pid: 4589 timeout: 795 lvb_type: 0 00000100:00100000:0.0:1746129749.793777:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053290112:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129749.793835:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19429c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129749.813829:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.813886:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.813908:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052148352 00000100:00100000:2.0:1746129749.813914:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052148352 00000100:00100000:2.0:1746129749.813981:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9846 00000100:00100000:2.0:1746129749.813988:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:28549:x1830949052148352:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:1.0:1746129749.814000:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053290112:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129749.814008:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129749.814021:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949153 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f3e9 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.814022:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e3f000/0x48868a4e4394914c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2514944->2945023] (req 2514944->2945023) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3e2 expref: 25 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.814033:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e3f000, rc 0) 00000100:00100000:1.0:1746129749.814078:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:28543:x1830949052147968:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 20400us (20583us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129749.814085:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10824 00010000:00010000:2.0:1746129749.814106:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ecc00/0x48868a4e4394915a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.814115:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ecc00/0x48868a4e4394915a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.814124:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ecc00/0x48868a4e4394915a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.814134:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949161 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.814139:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949161 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.814144:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949161 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.814235:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed400/0x48868a4e43949168 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.814244:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed400/0x48868a4e43949168 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.814249:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed400/0x48868a4e43949168 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129749.814257:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129749.814322:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ecc00/0x48868a4e4394915a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.814327:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ecc00/0x48868a4e4394915a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.814332:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ecc00/0x48868a4e4394915a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.814337:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801310ecc00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129749.814340:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ecc00/0x48868a4e4394915a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.814345:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ecc00/0x48868a4e4394915a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.814353:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129749.814355:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129749.814358:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ecc00/0x48868a4e4394915a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.814362:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ecc00/0x48868a4e4394915a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.814387:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949161 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.814392:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949161 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.814397:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949161 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.814404:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801310eda00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129749.814406:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949161 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.814410:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949161 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.814416:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094266800) 00010000:00010000:2.0:1746129749.814418:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129749.814420:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949161 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.814424:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949161 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129749.814469:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949153 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3e9 expref: 23 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.814478:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed400/0x48868a4e43949168 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3e9 expref: 22 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.814483:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129749.814485:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129749.814487:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310ed400, rc 0) 00000100:00100000:2.0:1746129749.814507:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:28549:x1830949052148352:12345-192.168.204.31@tcp:101:cat.0 Request processed in 520us (622us total) trans 8589943625 rc 0/0 00000100:00100000:2.0:1746129749.814512:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9846 00000100:00100000:3.0:1746129749.814792:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052148096 00000100:00100000:3.0:1746129749.814797:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052148096 00000100:00100000:3.0:1746129749.814835:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 564 00000100:00100000:3.0:1746129749.814841:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052148096:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129749.814874:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129749.814884:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e4394913e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3db expref: 22 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.814900:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129749.814902:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129749.814922:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1962:x1830949052148096:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 82us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129749.814928:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 564 00000100:00100000:0.0:1746129749.828666:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129749.828788:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052148480 00000100:00100000:1.0:1746129749.828798:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052148480 00010000:00010000:1.0:1746129749.828834:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3000/0x48868a4e439490f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3c6 expref: 25 pid: 4589 timeout: 795 lvb_type: 0 00000100:00100000:0.0:1746129749.829043:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129749.829987:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052148608 00000100:00100000:1.0:1746129749.829993:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052148608 00000100:00100000:0.0:1746129749.830004:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5191 00000100:00100000:0.0:1746129749.830013:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949052148480:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129749.830023:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 565 00010000:00010000:0.0:1746129749.830025:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129749.830028:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1963:x1830949052148608:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129749.830038:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129749.830045:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3000/0x48868a4e439490f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3c6 expref: 25 pid: 4589 timeout: 795 lvb_type: 0 00010000:00010000:1.0:1746129749.830056:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed400/0x48868a4e43949168 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3e9 expref: 21 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.830056:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3000/0x48868a4e439490f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3c6 expref: 25 pid: 4589 timeout: 795 lvb_type: 0 00010000:00010000:0.0:1746129749.830069:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3000/0x48868a4e439490f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3c6 expref: 25 pid: 4589 timeout: 795 lvb_type: 0 00010000:00010000:0.0:1746129749.830083:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129749.830085:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129749.830085:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129749.830089:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129749.830091:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130e3f000/0x48868a4e4394914c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->2945023) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3e2 expref: 24 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.830097:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e3f000/0x48868a4e4394914c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->2945023) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3e2 expref: 24 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129749.830122:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1963:x1830949052148608:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 94us (1127us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129749.830122:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130e3f000/0x48868a4e4394914c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->2945023) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3e2 expref: 24 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129749.830128:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 565 00000100:00100000:0.0:1746129749.830131:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053290240:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129749.830181:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19429c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129749.832655:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.833321:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053290240:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129749.833337:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129749.833370:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949052148480:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3358us (4711us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129749.833379:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5191 00000100:00100000:2.0:1746129749.833669:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052148864 00000100:00100000:2.0:1746129749.833674:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052148864 00000100:00100000:2.0:1746129749.834639:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3863 00000100:00100000:2.0:1746129749.834650:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:28549:x1830949052148864:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129749.834888:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:28549:x1830949052148864:12345-192.168.204.31@tcp:35:cat.0 Request processed in 241us (2237us total) trans 8589943626 rc 0/0 00000100:00100000:2.0:1746129749.834894:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3863 00000100:00100000:0.0:1746129749.837482:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.837555:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052149120 00000100:00100000:2.0:1746129749.837562:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052149120 00002000:00100000:2.0:1746129749.837598:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2514944->2519039) req@ffff88009b00c380 x1830949052149120/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.837607:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00c380 with x1830949052149120 ext(2514944->2519039) 00002000:00010000:2.0:1746129749.837611:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00c380 00000100:00100000:2.0:1746129749.837628:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4013 00000100:00100000:2.0:1746129749.837635:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052149120:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129749.838190:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052149120:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 553us (712us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129749.838196:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4013 00002000:00100000:2.0:1746129749.838202:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2514944->2519039) req@ffff88009b00c380 x1830949052149120/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/4536 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.838209:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00c380 with x1830949052149120 ext(2514944->2519039) 00002000:00010000:2.0:1746129749.838212:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00c380 00000100:00100000:0.0:1746129749.845341:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.845517:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052149376 00000100:00100000:2.0:1746129749.845525:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052149376 00002000:00100000:2.0:1746129749.845559:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2940928->2945023) req@ffff88009b00d180 x1830949052149376/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.845574:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00d180 with x1830949052149376 ext(2940928->2945023) 00002000:00010000:2.0:1746129749.845579:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00d180 00000100:00100000:2.0:1746129749.845594:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4014 00000100:00100000:2.0:1746129749.845600:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052149376:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129749.846754:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052149376:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 1150us (1420us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129749.846764:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4014 00002000:00100000:2.0:1746129749.846770:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2940928->2945023) req@ffff88009b00d180 x1830949052149376/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/4536 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.846778:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00d180 with x1830949052149376 ext(2940928->2945023) 00002000:00010000:2.0:1746129749.846781:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00d180 00000100:00100000:0.0:1746129749.851121:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.852546:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052149632 00000100:00100000:2.0:1746129749.852557:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052149632 00000100:00100000:2.0:1746129749.852607:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9847 00000100:00100000:2.0:1746129749.852614:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:28552:x1830949052149632:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129749.852634:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129749.852650:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949176 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f3f0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.852741:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ecc00/0x48868a4e4394917d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129749.852753:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ecc00/0x48868a4e4394917d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129749.852762:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ecc00/0x48868a4e4394917d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129749.852775:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949184 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129749.852780:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949184 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129749.852784:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949184 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129749.852897:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e4394918b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129749.852905:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e4394918b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129749.852911:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e4394918b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:2.0:1746129749.852918:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129749.852988:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ecc00/0x48868a4e4394917d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129749.852994:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ecc00/0x48868a4e4394917d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129749.852999:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ecc00/0x48868a4e4394917d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129749.853004:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801310ecc00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129749.853007:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ecc00/0x48868a4e4394917d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129749.853012:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ecc00/0x48868a4e4394917d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129749.853022:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129749.853024:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129749.853027:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ecc00/0x48868a4e4394917d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129749.853032:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ecc00/0x48868a4e4394917d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129749.853068:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949184 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129749.853073:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949184 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129749.853077:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949184 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129749.853081:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801310ed600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129749.853083:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949184 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129749.853087:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949184 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129749.853092:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880130e02700) 00010000:00010000:2.0:1746129749.853094:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129749.853096:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949184 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129749.853100:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949184 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129749.853135:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949176 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3f0 expref: 294 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.853149:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e4394918b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3f0 expref: 293 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.853154:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129749.853156:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129749.853158:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310ede00, rc 0) 00000100:00100000:2.0:1746129749.853200:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:28552:x1830949052149632:12345-192.168.204.31@tcp:101:cat.0 Request processed in 586us (2088us total) trans 8589943627 rc 0/0 00000100:00100000:2.0:1746129749.853206:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9847 00000100:00100000:0.0:1746129749.856078:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.856129:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.856195:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052149760 00000100:00100000:3.0:1746129749.856202:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052149760 00000100:00100000:1.0:1746129749.856202:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052149888 00000100:00100000:1.0:1746129749.856206:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052149888 00000100:00100000:3.0:1746129749.856237:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10825 00000100:00100000:3.0:1746129749.856244:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052149760:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129749.856265:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129749.856279:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095344000/0x48868a4e43949199 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f3f7 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129749.856455:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053290368:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129749.856539:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10826 00000100:00100000:1.0:1746129749.856547:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1961:x1830949052149888:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129749.856555:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129749.856564:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b7f6e00/0x48868a4e439491a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f3fe expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.856576:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129749.856578:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129749.856584:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b7f6e00/0x48868a4e439491a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3fe expref: 10 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129749.856597:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b7f6e00/0x48868a4e439491a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3fe expref: 10 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129749.856605:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b7f6e00, rc 0) 00000100:00100000:1.0:1746129749.856625:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052149888:12345-192.168.204.31@tcp:101:cat.0 Request processed in 80us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129749.856631:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10826 00000100:00100000:0.0:1746129749.856897:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.856999:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129749.857134:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052150016 00000100:00100000:1.0:1746129749.857138:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052150016 00000100:00100000:1.0:1746129749.857161:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 566 00000100:00100000:1.0:1746129749.857165:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:1964:x1830949052150016:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129749.857174:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129749.857187:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e4394918b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3f0 expref: 293 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.857200:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129749.857204:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129749.857220:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:1964:x1830949052150016:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 54us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129749.857225:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 566 00000100:00100000:0.0:1746129749.858231:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129749.858776:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052150144 00000100:00100000:1.0:1746129749.858781:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052150144 00000100:00100000:1.0:1746129749.858815:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10827 00000100:00100000:1.0:1746129749.858821:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28546:x1830949052150144:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129749.858830:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129749.858841:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b7f6200/0x48868a4e439491a7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f405 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.858885:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3200/0x48868a4e439490ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3cd expref: 14 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.858892:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b7f6e00/0x48868a4e439491a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3fe expref: 11 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129749.858898:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129749.858900:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129749.858903:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b7f6200/0x48868a4e439491a7 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2781184->3145727] (req 2781184->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f405 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.858923:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b7f6e00/0x48868a4e439491a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3fe expref: 11 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129749.858933:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b7f6e00/0x48868a4e439491a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3fe expref: 11 pid: 4589 timeout: 795 lvb_type: 1 00000100:00100000:1.0:1746129749.858943:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053290496:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129749.859000:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3200/0x48868a4e439490ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3cd expref: 14 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.859007:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3200/0x48868a4e439490ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3cd expref: 14 pid: 4589 timeout: 795 lvb_type: 0 00000100:00100000:1.0:1746129749.859013:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053290624:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129749.859028:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4948540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129749.862333:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.862352:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052150272 00000100:00100000:0.0:1746129749.862358:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052150272 00000100:00100000:0.0:1746129749.862387:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10828 00000100:00100000:0.0:1746129749.862394:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1963:x1830949052150272:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129749.862407:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129749.862420:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093724a00/0x48868a4e439491ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f40c expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.862449:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129749.862459:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093724a00/0x48868a4e439491ae lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f40c expref: 16 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129749.862468:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093724a00/0x48868a4e439491ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f40c expref: 16 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129749.862490:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093724a00, rc 0) 00000100:00100000:0.0:1746129749.862525:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1963:x1830949052150272:12345-192.168.204.31@tcp:101:cat.0 Request processed in 131us (199us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129749.862531:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10828 00000100:00100000:3.0:1746129749.862555:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053290368:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129749.862576:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095344000/0x48868a4e43949199 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3f7 expref: 12 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129749.862585:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095344000/0x48868a4e43949199 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3f7 expref: 12 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129749.862597:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095344000, rc 0) 00000100:00100000:3.0:1746129749.862615:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052149760:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6372us (6544us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129749.862620:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10825 00000100:00100000:3.0:1746129749.862656:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053290624:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129749.867177:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.867225:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129749.867768:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052150400 00000100:00100000:1.0:1746129749.867776:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052150400 00010000:00010000:1.0:1746129749.867812:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3200/0x48868a4e439490ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3cd expref: 15 pid: 4589 timeout: 795 lvb_type: 0 00000100:00100000:1.0:1746129749.867838:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052150528 00000100:00100000:1.0:1746129749.867840:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052150528 00010000:00010000:1.0:1746129749.867866:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b7f6e00/0x48868a4e439491a0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3fe expref: 12 pid: 4589 timeout: 795 lvb_type: 1 00000100:00100000:1.0:1746129749.867880:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5192 00000100:00100000:1.0:1746129749.867886:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949052150400:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129749.867897:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129749.867915:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3200/0x48868a4e439490ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3cd expref: 15 pid: 4589 timeout: 795 lvb_type: 0 00010000:00010000:1.0:1746129749.867925:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3200/0x48868a4e439490ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3cd expref: 15 pid: 4589 timeout: 795 lvb_type: 0 00010000:00010000:1.0:1746129749.867944:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3200/0x48868a4e439490ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3cd expref: 15 pid: 4589 timeout: 795 lvb_type: 0 00010000:00010000:1.0:1746129749.867960:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129749.868041:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5193 00000100:00100000:0.0:1746129749.868048:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1963:x1830949052150528:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129749.868055:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129749.868064:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b7f6e00/0x48868a4e439491a0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3fe expref: 12 pid: 4589 timeout: 795 lvb_type: 1 00010000:00010000:0.0:1746129749.868073:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b7f6e00/0x48868a4e439491a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3fe expref: 12 pid: 4589 timeout: 795 lvb_type: 1 00010000:00010000:0.0:1746129749.868084:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129749.868086:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129749.868098:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b7f6200/0x48868a4e439491a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2781184->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f405 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.868105:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b7f6200/0x48868a4e439491a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2781184->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f405 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.868132:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b7f6200/0x48868a4e439491a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2781184->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f405 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129749.868143:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053290752:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129749.868421:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b7f6e00/0x48868a4e439491a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3fe expref: 12 pid: 4589 timeout: 795 lvb_type: 1 00000100:00100000:3.0:1746129749.868441:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053290496:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129749.868462:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b7f6200/0x48868a4e439491a7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2781184->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f405 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.868475:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b7f6200, rc 0) 00000100:00100000:1.0:1746129749.868517:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949052150400:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 631us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129749.868523:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5192 00000100:00100000:3.0:1746129749.868701:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28546:x1830949052150144:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 9876us (10468us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129749.868707:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10827 00000100:00100000:1.0:1746129749.869447:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19429c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129749.873075:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.873144:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.873221:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052150784 00000100:00100000:0.0:1746129749.873228:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052150784 00000100:00100000:3.0:1746129749.873444:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052151040 00000100:00100000:3.0:1746129749.873448:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052151040 00002000:00100000:3.0:1746129749.873477:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2781184->2785279) req@ffff88012ba39f80 x1830949052151040/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.873485:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba39f80 with x1830949052151040 ext(2781184->2785279) 00002000:00010000:3.0:1746129749.873490:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba39f80 00000100:00100000:3.0:1746129749.873521:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4015 00000100:00100000:3.0:1746129749.873528:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1963:x1830949052151040:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129749.873625:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053290752:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129749.873677:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1963:x1830949052151040:12345-192.168.204.31@tcp:3:cat.0 Request processed in 149us (532us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129749.873684:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4015 00002000:00100000:3.0:1746129749.873689:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2781184->2785279) req@ffff88012ba39f80 x1830949052151040/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/4536 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.873695:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba39f80 with x1830949052151040 ext(2781184->2785279) 00002000:00010000:3.0:1746129749.873698:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba39f80 00000100:00100000:2.0:1746129749.873709:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129749.873829:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129749.873869:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1963:x1830949052150528:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5821us (6643us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129749.873877:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5193 00002000:00100000:0.0:1746129749.874111:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012ba38e00 x1830949052150784/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129749.874119:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba38e00 with x1830949052150784 ext(0->1048575) 00002000:00010000:0.0:1746129749.874122:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba38e00 00000100:00100000:3.0:1746129749.874474:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052151296 00000100:00100000:3.0:1746129749.874481:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052151296 00002000:00100000:3.0:1746129749.874494:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800936dd880 x1830949052151296/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 504/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.874506:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dd880 with x1830949052151296 ext(2097152->3145727) 00002000:00010000:3.0:1746129749.874509:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dd880 00000100:00100000:3.0:1746129749.874523:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4016 00000100:00100000:3.0:1746129749.874528:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052150784:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129749.875090:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4017 00000100:00100000:2.0:1746129749.875102:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1964:x1830949052151296:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129749.878060:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.878137:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052151424 00000100:00100000:3.0:1746129749.878145:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052151424 00000100:00100000:3.0:1746129749.878178:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10829 00000100:00100000:3.0:1746129749.878186:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28546:x1830949052151424:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129749.878200:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129749.878214:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095345800/0x48868a4e439491b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f413 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.878237:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130e3f000/0x48868a4e4394914c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->2945023) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3e2 expref: 25 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.878243:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129749.878245:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129749.878248:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095345800/0x48868a4e439491b5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->3280895] (req 3145728->3280895) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f413 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.878272:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130e3f000/0x48868a4e4394914c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->2945023) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3e2 expref: 25 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.878282:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130e3f000/0x48868a4e4394914c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->2945023) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3e2 expref: 25 pid: 4589 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746129749.878296:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053290880:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129749.880483:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129749.881483:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1964:x1830949052151296:12345-192.168.204.31@tcp:3:cat.0 Request processed in 6380us (7769us total) trans 0 rc 618496/618496 00000100:00100000:2.0:1746129749.881492:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4017 00002000:00100000:2.0:1746129749.881502:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800936dd880 x1830949052151296/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 504/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 618496/618496 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.881511:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dd880 with x1830949052151296 ext(2097152->3145727) 00010000:00010000:2.0:1746129749.881521:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130e3f000/0x48868a4e4394914c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3e2 expref: 24 pid: 4589 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.881533:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130e3f000/0x48868a4e4394914c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3e2 expref: 24 pid: 4589 timeout: 795 lvb_type: 0 00002000:00010000:2.0:1746129749.881544:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936dd880 00000100:00100000:2.0:1746129749.883737:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053290880:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129749.883764:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095345800/0x48868a4e439491b5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->3280895] (req 3145728->3280895) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f413 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.883778:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095345800, rc 0) 00000100:00100000:2.0:1746129749.883825:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28546:x1830949052151424:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5639us (5771us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129749.883832:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10829 00000100:00100000:0.0:1746129749.883999:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.884121:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949052150784:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9591us (11052us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129749.884122:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052151552 00000100:00100000:3.0:1746129749.884128:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4016 00000100:00100000:2.0:1746129749.884128:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052151552 00002000:00100000:3.0:1746129749.884135:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012ba38e00 x1830949052150784/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.884143:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba38e00 with x1830949052150784 ext(0->1048575) 00002000:00010000:3.0:1746129749.884148:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba38e00 00002000:00100000:2.0:1746129749.884153:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (2514944->2945023) req@ffff88012ba39500 x1830949052151552/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.884161:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba39500 with x1830949052151552 ext(2514944->2945023) 00010000:00010000:2.0:1746129749.884166:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130e3f000/0x48868a4e4394914c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3e2 expref: 24 pid: 4589 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.884175:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130e3f000/0x48868a4e4394914c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3e2 expref: 24 pid: 4589 timeout: 795 lvb_type: 0 00002000:00010000:2.0:1746129749.884181:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ba39500 00000100:00100000:2.0:1746129749.884202:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 572 00000100:00100000:2.0:1746129749.884207:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1964:x1830949052151552:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129749.884537:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.884583:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052151680 00000100:00100000:2.0:1746129749.884587:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052151680 00000100:00100000:2.0:1746129749.884644:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10830 00000100:00100000:2.0:1746129749.884650:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:28552:x1830949052151680:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129749.884659:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129749.884672:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e439491bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f41a expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.884689:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b7f6200/0x48868a4e439491a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2781184->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f405 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.884697:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129749.884698:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129749.884701:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e439491bc lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f41a expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.884725:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b7f6200/0x48868a4e439491a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2781184->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f405 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.884734:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b7f6200/0x48868a4e439491a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2781184->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f405 expref: 9 pid: 8437 timeout: 795 lvb_type: 0 00000100:00100000:2.0:1746129749.884744:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053291008:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129749.884800:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129749.886270:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053291008:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129749.886291:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e439491bc lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f41a expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129749.886302:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8695a00, rc 0) 00000100:00100000:3.0:1746129749.886344:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:28552:x1830949052151680:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1693us (1807us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129749.886351:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10830 00000100:00100000:0.0:1746129749.887174:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129749.888328:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052151808 00000100:00100000:3.0:1746129749.888335:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052151808 00002000:00100000:3.0:1746129749.888367:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2781184->3145727) req@ffff88012ba38000 x1830949052151808/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.888376:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba38000 with x1830949052151808 ext(2781184->3145727) 00010000:00010000:3.0:1746129749.888383:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b7f6200/0x48868a4e439491a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2781184->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f405 expref: 10 pid: 8437 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746129749.888394:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b7f6200/0x48868a4e439491a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2781184->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f405 expref: 10 pid: 8437 timeout: 795 lvb_type: 0 00002000:00010000:3.0:1746129749.888400:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba38000 00000100:00100000:3.0:1746129749.890951:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 573 00000100:00100000:3.0:1746129749.890963:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052151808:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129749.891296:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1964:x1830949052151552:12345-192.168.204.31@tcp:4:cat.0 Request processed in 7086us (7295us total) trans 17179873127 rc 0/0 00000100:00100000:0.0:1746129749.891303:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 572 00002000:00100000:0.0:1746129749.891311:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (2514944->2945023) req@ffff88012ba39500 x1830949052151552/t17179873127(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/448 e 0 to 0 dl 1746129760 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129749.891319:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba39500 with x1830949052151552 ext(2514944->2945023) 00010000:00010000:0.0:1746129749.891328:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130e3f000/0x48868a4e4394914c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3e2 expref: 26 pid: 4589 timeout: 795 lvb_type: 0 00010000:00010000:0.0:1746129749.891340:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130e3f000/0x48868a4e4394914c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3e2 expref: 26 pid: 4589 timeout: 795 lvb_type: 0 00002000:00010000:0.0:1746129749.891345:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ba39500 00000100:00100000:0.0:1746129749.898149:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.898563:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052151936 00000100:00100000:2.0:1746129749.898571:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052151936 00000100:00100000:0.0:1746129749.898618:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.898621:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10831 00000100:00100000:2.0:1746129749.898629:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28549:x1830949052151936:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129749.898643:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129749.898644:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052152064 00000100:00100000:0.0:1746129749.898647:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052152064 00010000:00010000:2.0:1746129749.898657:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4c5ba00/0x48868a4e439491c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f421 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.898663:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130e3f000/0x48868a4e4394914c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2514944->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3e2 expref: 26 pid: 4589 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.898677:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1746129749.898678:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5194 00010000:00010000:2.0:1746129749.898679:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1746129749.898682:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949052152064:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129749.898683:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4c5ba00/0x48868a4e439491c3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f421 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.898689:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129749.898693:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4c5ba00/0x48868a4e439491c3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f421 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.898701:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c5ba00, rc 0) 00010000:00010000:0.0:1746129749.898704:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130e3f000/0x48868a4e4394914c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2514944->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3e2 expref: 26 pid: 4589 timeout: 795 lvb_type: 0 00010000:00010000:0.0:1746129749.898712:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130e3f000/0x48868a4e4394914c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2514944->2945023) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3e2 expref: 26 pid: 4589 timeout: 795 lvb_type: 0 00010000:00010000:0.0:1746129749.898727:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e3f000/0x48868a4e4394914c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2514944->2945023) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3e2 expref: 26 pid: 4589 timeout: 795 lvb_type: 0 00000100:00100000:2.0:1746129749.898735:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28549:x1830949052151936:12345-192.168.204.31@tcp:101:cat.0 Request processed in 108us (889us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129749.898740:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746129749.898741:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10831 00010000:00010000:0.0:1746129749.898741:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129749.898746:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095345800/0x48868a4e439491b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f413 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.898753:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095345800/0x48868a4e439491b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f413 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.898759:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129749.898760:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129749.898763:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4c5ba00/0x48868a4e439491c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f421 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.898772:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4c5ba00/0x48868a4e439491c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f421 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.898793:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4c5ba00/0x48868a4e439491c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f421 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129749.898802:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053291136:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129749.898865:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095345800/0x48868a4e439491b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f413 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129749.898873:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053291264:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129749.898894:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129749.900204:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949052151808:12345-192.168.204.31@tcp:4:cat.0 Request processed in 9241us (13028us total) trans 21474840281 rc 0/0 00000100:00100000:2.0:1746129749.900212:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 573 00002000:00100000:2.0:1746129749.900220:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2781184->3145727) req@ffff88012ba38000 x1830949052151808/t21474840281(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/448 e 0 to 0 dl 1746129760 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.900228:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba38000 with x1830949052151808 ext(2781184->3145727) 00010000:00010000:2.0:1746129749.900235:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b7f6200/0x48868a4e439491a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2781184->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f405 expref: 12 pid: 8437 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746129749.900245:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b7f6200/0x48868a4e439491a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2781184->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f405 expref: 12 pid: 8437 timeout: 795 lvb_type: 0 00002000:00010000:2.0:1746129749.900252:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba38000 00000100:00100000:1.0:1746129749.900794:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053291136:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129749.902683:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053291264:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129749.902701:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129749.902730:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949052152064:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4046us (4112us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129749.902738:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5194 00000100:00100000:0.0:1746129749.904747:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.904790:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.904817:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052152320 00000100:00100000:2.0:1746129749.904824:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052152320 00002000:00100000:2.0:1746129749.904888:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012ba39880 x1830949052152320/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.904897:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba39880 with x1830949052152320 ext(2097152->3145727) 00002000:00010000:2.0:1746129749.904902:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba39880 00000100:00100000:2.0:1746129749.904928:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052152576 00000100:00100000:2.0:1746129749.904931:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052152576 00002000:00100000:2.0:1746129749.904942:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3276800->3280895) req@ffff88012ba3b480 x1830949052152576/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.904950:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3b480 with x1830949052152576 ext(3276800->3280895) 00002000:00010000:2.0:1746129749.904953:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba3b480 00000100:00100000:2.0:1746129749.904971:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4018 00000100:00100000:2.0:1746129749.904978:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052152320:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129749.905067:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4019 00000100:00100000:3.0:1746129749.905074:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052152576:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129749.905169:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052152576:12345-192.168.204.31@tcp:3:cat.0 Request processed in 96us (379us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129749.905175:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4019 00002000:00100000:3.0:1746129749.905179:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3276800->3280895) req@ffff88012ba3b480 x1830949052152576/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/4536 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.905185:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3b480 with x1830949052152576 ext(3276800->3280895) 00002000:00010000:3.0:1746129749.905188:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba3b480 00000100:00100000:2.0:1746129749.906380:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.906900:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129749.907608:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052152704 00000100:00100000:1.0:1746129749.907616:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052152704 00010000:00010000:1.0:1746129749.907643:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b7f6200/0x48868a4e439491a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2781184->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f405 expref: 12 pid: 8437 timeout: 795 lvb_type: 0 00000100:00100000:1.0:1746129749.907666:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5195 00000100:00100000:1.0:1746129749.907672:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949052152704:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129749.907682:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129749.907700:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b7f6200/0x48868a4e439491a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2781184->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f405 expref: 12 pid: 8437 timeout: 795 lvb_type: 0 00010000:00010000:1.0:1746129749.907711:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b7f6200/0x48868a4e439491a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2781184->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f405 expref: 12 pid: 8437 timeout: 795 lvb_type: 0 00010000:00010000:1.0:1746129749.907729:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b7f6200/0x48868a4e439491a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2781184->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f405 expref: 12 pid: 8437 timeout: 795 lvb_type: 0 00010000:00010000:1.0:1746129749.907751:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129749.907753:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129749.907759:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e439491bc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f41a expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.907766:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e439491bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f41a expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.907793:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e439491bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f41a expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129749.907803:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053291392:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129749.907865:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49486c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129749.908093:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052152960 00000100:00100000:3.0:1746129749.908096:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052152960 00000100:00100000:3.0:1746129749.908127:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3864 00000100:00100000:3.0:1746129749.908133:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:28546:x1830949052152960:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129749.908272:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:28546:x1830949052152960:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 139us (1372us total) trans 8589943628 rc 0/0 00000100:00100000:3.0:1746129749.908291:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3864 00000100:00100000:0.0:1746129749.914687:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129749.914789:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053291392:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129749.914807:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129749.914843:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052152704:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7170us (8465us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129749.914873:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5195 00000100:00100000:3.0:1746129749.915040:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052153216 00000100:00100000:3.0:1746129749.915046:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052153216 00002000:00100000:3.0:1746129749.915074:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012ba3b800 x1830949052153216/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.915081:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3b800 with x1830949052153216 ext(2097152->3145727) 00002000:00010000:3.0:1746129749.915086:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba3b800 00000100:00100000:3.0:1746129749.915100:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4020 00000100:00100000:3.0:1746129749.915106:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949052153216:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129749.915811:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949052152320:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10832us (11069us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129749.915819:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4018 00002000:00100000:2.0:1746129749.915825:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012ba39880 x1830949052152320/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.915835:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba39880 with x1830949052152320 ext(2097152->3145727) 00002000:00010000:2.0:1746129749.915839:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba39880 00000100:00100000:0.0:1746129749.920450:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129749.920589:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052153344 00000100:00100000:1.0:1746129749.920597:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052153344 00000100:00100000:1.0:1746129749.920694:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10832 00000100:00100000:1.0:1746129749.920702:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28549:x1830949052153344:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129749.920717:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129749.920731:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8c27c00/0x48868a4e439491ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f428 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.920753:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129749.920755:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129749.920761:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8c27c00/0x48868a4e439491ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f428 expref: 12 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.920774:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8c27c00/0x48868a4e439491ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f428 expref: 12 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.920782:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8c27c00, rc 0) 00000100:00100000:1.0:1746129749.920975:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28549:x1830949052153344:12345-192.168.204.31@tcp:101:cat.0 Request processed in 273us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129749.920980:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10832 00000100:00100000:3.0:1746129749.921964:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949052153216:12345-192.168.204.31@tcp:3:cat.0 Request processed in 6857us (7283us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129749.921972:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4020 00002000:00100000:3.0:1746129749.921979:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012ba3b800 x1830949052153216/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.921987:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3b800 with x1830949052153216 ext(2097152->3145727) 00002000:00010000:3.0:1746129749.921991:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba3b800 00000100:00100000:0.0:1746129749.925966:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129749.926273:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052153472 00000100:00100000:1.0:1746129749.926281:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052153472 00000100:00100000:1.0:1746129749.926908:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10833 00000100:00100000:1.0:1746129749.926915:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:28552:x1830949052153472:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129749.926929:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129749.926942:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e439491d1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f42f expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.926965:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095345800/0x48868a4e439491b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f413 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.926971:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129749.926973:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129749.926975:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e439491d1 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f42f expref: 26 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.926997:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095345800/0x48868a4e439491b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f413 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.927010:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095345800/0x48868a4e439491b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f413 expref: 12 pid: 8437 timeout: 795 lvb_type: 0 00000100:00100000:1.0:1746129749.927020:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053291520:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129749.927093:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49486c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129749.932324:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.932360:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.932381:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.932423:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.932479:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053291520:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129749.932502:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e439491d1 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f42f expref: 26 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129749.932521:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8c27200, rc 0) 00000100:00100000:0.0:1746129749.932555:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:28552:x1830949052153472:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5641us (6595us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129749.932562:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10833 00000100:00100000:1.0:1746129749.932795:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052153856 00000100:00100000:1.0:1746129749.932801:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052153856 00002000:00100000:1.0:1746129749.932830:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012ba3bb80 x1830949052153856/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.932838:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3bb80 with x1830949052153856 ext(2097152->3145727) 00002000:00010000:1.0:1746129749.932842:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba3bb80 00000100:00100000:1.0:1746129749.932872:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052153984 00000100:00100000:1.0:1746129749.932874:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052153984 00002000:00100000:1.0:1746129749.932884:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012ba38a80 x1830949052153984/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.932889:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba38a80 with x1830949052153984 ext(3145728->4194303) 00002000:00010000:1.0:1746129749.932892:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba38a80 00000100:00100000:1.0:1746129749.932901:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052154240 00000100:00100000:1.0:1746129749.932903:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052154240 00002000:00100000:1.0:1746129749.932912:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3280896->4194303) req@ffff88012ba3a680 x1830949052154240/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.932917:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3a680 with x1830949052154240 ext(3280896->4194303) 00010000:00010000:1.0:1746129749.932921:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095345800/0x48868a4e439491b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f413 expref: 13 pid: 8437 timeout: 795 lvb_type: 0 00010000:00010000:1.0:1746129749.932937:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095345800/0x48868a4e439491b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f413 expref: 13 pid: 8437 timeout: 795 lvb_type: 0 00002000:00010000:1.0:1746129749.932942:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ba3a680 00000100:00100000:1.0:1746129749.932949:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052154368 00000100:00100000:1.0:1746129749.932950:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052154368 00002000:00100000:1.0:1746129749.932957:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3280895) req@ffff88009206f100 x1830949052154368/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.932962:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206f100 with x1830949052154368 ext(3145728->3280895) 00010000:00010000:1.0:1746129749.932965:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095345800/0x48868a4e439491b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f413 expref: 14 pid: 8437 timeout: 795 lvb_type: 0 00010000:00010000:1.0:1746129749.932971:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095345800/0x48868a4e439491b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f413 expref: 14 pid: 8437 timeout: 795 lvb_type: 0 00002000:00010000:1.0:1746129749.932975:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009206f100 00000100:00100000:1.0:1746129749.932982:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 574 00000100:00100000:1.0:1746129749.932987:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949052154240:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129749.934022:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 575 00000100:00100000:1.0:1746129749.934031:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949052154368:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129749.934175:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4021 00000100:00100000:1.0:1746129749.934180:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949052153856:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129749.935217:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4022 00000100:00100000:1.0:1746129749.935225:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949052153984:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129749.950309:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052154368:12345-192.168.204.31@tcp:4:cat.0 Request processed in 16271us (17876us total) trans 17179873128 rc 0/0 00000100:00100000:1.0:1746129749.950319:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 575 00002000:00100000:1.0:1746129749.950329:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3280895) req@ffff88009206f100 x1830949052154368/t17179873128(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/448 e 0 to 0 dl 1746129760 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.950338:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206f100 with x1830949052154368 ext(3145728->3280895) 00010000:00010000:1.0:1746129749.950346:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095345800/0x48868a4e439491b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f413 expref: 16 pid: 8437 timeout: 795 lvb_type: 0 00010000:00010000:1.0:1746129749.950703:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095345800/0x48868a4e439491b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f413 expref: 16 pid: 8437 timeout: 796 lvb_type: 0 00002000:00010000:1.0:1746129749.950711:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009206f100 00000100:00100000:0.0:1746129749.950884:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1961:x1830949052154240:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17894us (18500us total) trans 0 rc 913408/913408 00000100:00100000:0.0:1746129749.950893:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 574 00002000:00100000:0.0:1746129749.950899:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3280896->4194303) req@ffff88012ba3a680 x1830949052154240/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:H/200/0 rc 913408/913408 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129749.950911:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3a680 with x1830949052154240 ext(3280896->4194303) 00010000:00010000:0.0:1746129749.950917:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095345800/0x48868a4e439491b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f413 expref: 15 pid: 8437 timeout: 796 lvb_type: 0 00010000:00010000:0.0:1746129749.950926:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095345800/0x48868a4e439491b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f413 expref: 15 pid: 8437 timeout: 796 lvb_type: 0 00002000:00010000:0.0:1746129749.950932:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ba3a680 00000100:00100000:1.0:1746129749.953605:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949052153856:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19418us (21282us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129749.953613:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4021 00002000:00100000:1.0:1746129749.953620:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012ba3bb80 x1830949052153856/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.953626:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3bb80 with x1830949052153856 ext(2097152->3145727) 00002000:00010000:1.0:1746129749.953630:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba3bb80 00000100:00100000:1.0:1746129749.955375:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949052153984:12345-192.168.204.31@tcp:3:cat.0 Request processed in 20147us (23010us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129749.955383:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4022 00002000:00100000:1.0:1746129749.955389:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012ba38a80 x1830949052153984/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.955396:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba38a80 with x1830949052153984 ext(3145728->4194303) 00002000:00010000:1.0:1746129749.955399:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba38a80 00000100:00100000:0.0:1746129749.961941:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.961997:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129749.962061:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052154624 00000100:00100000:2.0:1746129749.962069:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052154624 00000100:00100000:1.0:1746129749.962069:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052154496 00000100:00100000:1.0:1746129749.962073:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052154496 00010000:00010000:1.0:1746129749.962099:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095345800/0x48868a4e439491b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f413 expref: 16 pid: 8437 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746129749.962117:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10834 00000100:00100000:2.0:1746129749.962125:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28549:x1830949052154624:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:1.0:1746129749.962130:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5196 00000100:00100000:1.0:1746129749.962136:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052154496:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129749.962139:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129749.962147:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129749.962152:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4c5bc00/0x48868a4e439491d8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f436 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.962164:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095345800/0x48868a4e439491b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f413 expref: 17 pid: 8437 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746129749.962170:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129749.962174:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4c5bc00/0x48868a4e439491d8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f436 expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.962192:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095345800/0x48868a4e439491b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f413 expref: 17 pid: 8437 timeout: 796 lvb_type: 0 00010000:00010000:1.0:1746129749.962210:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095345800/0x48868a4e439491b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f413 expref: 17 pid: 8437 timeout: 796 lvb_type: 0 00010000:00010000:1.0:1746129749.962227:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129749.962228:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129749.962233:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e439491d1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f42f expref: 25 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.962241:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e439491d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f42f expref: 25 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.962248:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129749.962249:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129749.962252:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4c5bc00/0x48868a4e439491d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f436 expref: 16 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.962258:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4c5bc00/0x48868a4e439491d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f436 expref: 16 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129749.962283:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4c5bc00/0x48868a4e439491d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f436 expref: 16 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129749.962294:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053291648:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129749.962362:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e439491d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f42f expref: 25 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129749.962369:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053291776:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129749.962386:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49486c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746129749.963218:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4c5bc00/0x48868a4e439491d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f436 expref: 16 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129749.963228:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c5bc00, rc 0) 00000100:00100000:2.0:1746129749.963299:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28549:x1830949052154624:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1173us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129749.963305:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10834 00000100:00100000:0.0:1746129749.968966:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129749.969055:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053291648:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129749.969064:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053291776:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129749.969080:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129749.969110:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949052154496:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6974us (7264us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129749.969118:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5196 00000100:00100000:2.0:1746129749.969196:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052154880 00000100:00100000:2.0:1746129749.969201:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052154880 00002000:00100000:2.0:1746129749.969231:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009206f480 x1830949052154880/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.969239:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206f480 with x1830949052154880 ext(3145728->4194303) 00002000:00010000:2.0:1746129749.969242:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009206f480 00000100:00100000:2.0:1746129749.969255:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4023 00000100:00100000:2.0:1746129749.969261:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949052154880:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129749.970559:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129749.970976:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052155264 00000100:00100000:1.0:1746129749.970982:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052155264 00002000:00100000:1.0:1746129749.971015:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009206dc00 x1830949052155264/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.971024:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206dc00 with x1830949052155264 ext(3145728->4194303) 00002000:00010000:1.0:1746129749.971027:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009206dc00 00000100:00100000:1.0:1746129749.971043:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4024 00000100:00100000:1.0:1746129749.971049:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1964:x1830949052155264:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129749.971282:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.971304:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052155392 00000100:00100000:0.0:1746129749.971307:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052155392 00002000:00100000:0.0:1746129749.971321:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8800a55a7800 x1830949052155392/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129749.971327:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a7800 with x1830949052155392 ext(3145728->4194303) 00002000:00010000:0.0:1746129749.971331:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a55a7800 00000100:00100000:0.0:1746129749.971772:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4025 00000100:00100000:0.0:1746129749.971777:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1963:x1830949052155392:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129749.974951:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949052154880:12345-192.168.204.31@tcp:3:cat.0 Request processed in 5680us (5981us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129749.974962:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4023 00002000:00100000:2.0:1746129749.974972:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009206f480 x1830949052154880/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129749.974981:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206f480 with x1830949052154880 ext(3145728->4194303) 00002000:00010000:2.0:1746129749.974986:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009206f480 00000100:00100000:0.0:1746129749.979924:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1964:x1830949052155264:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8866us (9359us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129749.979936:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4024 00002000:00100000:0.0:1746129749.979946:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009206dc00 x1830949052155264/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129749.979955:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206dc00 with x1830949052155264 ext(3145728->4194303) 00002000:00010000:0.0:1746129749.979960:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009206dc00 00000100:00100000:3.0:1746129749.984178:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1963:x1830949052155392:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12392us (12888us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129749.984188:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4025 00002000:00100000:3.0:1746129749.984199:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8800a55a7800 x1830949052155392/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129749.984207:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a7800 with x1830949052155392 ext(3145728->4194303) 00002000:00010000:3.0:1746129749.984212:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a55a7800 00000100:00100000:0.0:1746129749.992147:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129749.992195:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129749.992464:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052155776 00000100:00100000:1.0:1746129749.992472:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052155776 00002000:00100000:1.0:1746129749.992512:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff8800a55a5f80 x1830949052155776/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.992521:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a5f80 with x1830949052155776 ext(4194304->4964351) 00002000:00010000:1.0:1746129749.992526:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a55a5f80 00000100:00100000:1.0:1746129749.992550:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052155904 00000100:00100000:1.0:1746129749.992552:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052155904 00002000:00100000:1.0:1746129749.992563:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff8800a55a4e00 x1830949052155904/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/0 e 0 to 0 dl 1746129760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129749.992569:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a4e00 with x1830949052155904 ext(4194304->4964351) 00002000:00010000:1.0:1746129749.992572:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a55a4e00 00000100:00100000:1.0:1746129749.992581:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4026 00000100:00100000:1.0:1746129749.992586:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1963:x1830949052155776:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129749.992698:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4027 00000100:00100000:2.0:1746129749.992706:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949052155904:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129750.003790:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949052155904:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11076us (11585us total) trans 0 rc 770048/770048 00000100:00100000:2.0:1746129750.003801:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4027 00002000:00100000:2.0:1746129750.003812:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff8800a55a4e00 x1830949052155904/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129750.003820:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a4e00 with x1830949052155904 ext(4194304->4964351) 00002000:00010000:2.0:1746129750.003826:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a55a4e00 00000100:00100000:1.0:1746129750.005401:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1963:x1830949052155776:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12809us (13257us total) trans 0 rc 770048/770048 00000100:00100000:1.0:1746129750.005411:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4026 00002000:00100000:1.0:1746129750.005418:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff8800a55a5f80 x1830949052155776/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:490/0 lens 488/440 e 0 to 0 dl 1746129760 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129750.005439:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a5f80 with x1830949052155776 ext(4194304->4964351) 00002000:00010000:1.0:1746129750.005444:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a55a5f80 00000100:00100000:0.0:1746129750.009960:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129750.010048:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052156160 00000100:00100000:2.0:1746129750.010056:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052156160 00000100:00100000:2.0:1746129750.010100:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3865 00000100:00100000:2.0:1746129750.010106:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c561850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:28552:x1830949052156160:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129750.010290:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c561850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:28552:x1830949052156160:12345-192.168.204.31@tcp:35:cat.0 Request processed in 183us (335us total) trans 8589943629 rc 0/0 00000100:00100000:2.0:1746129750.010298:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3865 00000100:00100000:0.0:1746129750.016802:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129750.016895:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052156288 00000100:00100000:2.0:1746129750.016902:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052156288 00000100:00080000:0.0:1746129750.016997:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746129750.017074:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9848 00000100:00100000:2.0:1746129750.017084:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+6:28556:x1830949052156288:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129750.017107:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129750.017122:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0ff600/0x48868a4e439491df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f43d expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.017174:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c800/0x48868a4e439491e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.017184:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c800/0x48868a4e439491e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.017195:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c800/0x48868a4e439491e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.017205:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c400/0x48868a4e439491ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.017210:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c400/0x48868a4e439491ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.017215:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c400/0x48868a4e439491ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.017301:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12d000/0x48868a4e439491f4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.017310:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43948ef9 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f268 expref: 292 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.017317:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12d000/0x48868a4e439491f4 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.017339:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43948ef9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f268 expref: 292 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.017349:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43948ef9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f268 expref: 292 pid: 1851 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746129750.017359:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936de300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053291904:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129750.017912:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129750.020783:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936de300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053291904:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129750.020804:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12d000/0x48868a4e439491f4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129750.023686:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129750.023902:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052156544 00000100:00100000:2.0:1746129750.023909:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052156544 00000100:00100000:2.0:1746129750.023947:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3866 00000100:00100000:2.0:1746129750.023953:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:7659:x1830949052156544:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746129750.024952:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:7659:x1830949052156544:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 996us (1271us total) trans 8589943630 rc 0/0 00000100:00100000:2.0:1746129750.024959:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3866 00010000:00010000:2.0:1746129750.025118:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129750.027898:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129750.027983:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052156672 00000100:00100000:1.0:1746129750.027991:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052156672 00010000:00010000:1.0:1746129750.028021:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43948ef9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f268 expref: 294 pid: 1851 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746129750.028053:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5197 00000100:00100000:1.0:1746129750.028059:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:1962:x1830949052156672:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129750.028072:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129750.028076:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43948ef9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f268 expref: 294 pid: 1851 timeout: 796 lvb_type: 0 00010000:00010000:1.0:1746129750.028085:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43948ef9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f268 expref: 294 pid: 1851 timeout: 796 lvb_type: 0 00010000:00010000:1.0:1746129750.028104:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43948ef9 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f268 expref: 294 pid: 1851 timeout: 796 lvb_type: 0 00010000:00010000:1.0:1746129750.028132:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129750.028136:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12d000/0x48868a4e439491f4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129750.028143:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12d000/0x48868a4e439491f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129750.028149:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12d000/0x48868a4e439491f4 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129750.028222:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129750.028256:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12d000/0x48868a4e439491f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.028262:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12d000/0x48868a4e439491f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129750.028296:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:2.0:1746129750.028301:0:14315:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129750.028313:0:14315:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12d000/0x48868a4e439491f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.028322:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12d000/0x48868a4e439491f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00000100:00100000:1.0:1746129750.028322:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:1962:x1830949052156672:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 262us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129750.028328:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5197 00010000:00010000:2.0:1746129750.028329:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c800/0x48868a4e439491e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.028334:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c800/0x48868a4e439491e6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.028339:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c800/0x48868a4e439491e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.028343:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c12c800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129750.028347:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c800/0x48868a4e439491e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.028352:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c800/0x48868a4e439491e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.028359:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129750.028361:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129750.028364:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c800/0x48868a4e439491e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.028368:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c800/0x48868a4e439491e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.028377:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c400/0x48868a4e439491ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.028381:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c400/0x48868a4e439491ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.028385:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c400/0x48868a4e439491ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.028388:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c12c400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129750.028390:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c400/0x48868a4e439491ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.028394:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c400/0x48868a4e439491ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.028398:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880130e02700) 00010000:00010000:2.0:1746129750.028399:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129750.028401:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c400/0x48868a4e439491ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.028405:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c400/0x48868a4e439491ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.028440:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0ff600/0x48868a4e439491df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f43d expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.028451:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12d000/0x48868a4e439491f4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f43d expref: 7 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.028456:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129750.028458:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129750.028459:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c12d000, rc 0) 00000100:00100000:2.0:1746129750.028496:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+7:28556:x1830949052156288:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 11414us (11701us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129750.028502:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9848 00000100:00100000:0.0:1746129750.030481:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129750.030650:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129750.030714:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052156800 00000100:00100000:3.0:1746129750.030720:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052156800 00000100:00100000:3.0:1746129750.030748:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052156928 00000100:00100000:3.0:1746129750.030749:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052156928 00000100:00100000:3.0:1746129750.031635:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10835 00000100:00100000:3.0:1746129750.031644:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+7:1961:x1830949052156800:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129750.031661:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129750.031677:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095344200/0x48868a4e439491fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f444 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129750.031695:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129750.031697:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129750.031704:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095344200/0x48868a4e439491fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f444 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129750.031718:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095344200/0x48868a4e439491fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f444 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129750.031727:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095344200, rc 0) 00000100:00100000:3.0:1746129750.031765:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949052156800:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 123us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129750.031771:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10835 00000100:00100000:3.0:1746129750.031789:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10836 00000100:00100000:3.0:1746129750.031794:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+7:1961:x1830949052156928:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129750.031800:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129750.031808:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095345a00/0x48868a4e43949202 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f44b expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129750.031818:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129750.031820:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129750.031824:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095345a00/0x48868a4e43949202 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f44b expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129750.031833:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095345a00/0x48868a4e43949202 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f44b expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129750.031840:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095345a00, rc 0) 00000100:00100000:3.0:1746129750.031869:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949052156928:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 75us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129750.031874:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10836 00000100:00100000:1.0:1746129750.032794:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129750.032863:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129750.033115:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052157056 00000100:00100000:0.0:1746129750.033121:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052157056 00000100:00100000:0.0:1746129750.033141:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052157184 00000100:00100000:0.0:1746129750.033142:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052157184 00000100:00100000:1.0:1746129750.033149:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10837 00000100:00100000:1.0:1746129750.033156:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949052157056:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129750.033164:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129750.033169:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10838 00010000:00010000:1.0:1746129750.033173:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135caac00/0x48868a4e43949209 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f452 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129750.033173:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949052157184:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129750.033178:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129750.033185:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129750.033185:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c1f600/0x48868a4e43949210 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f459 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.033187:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129750.033193:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135caac00/0x48868a4e43949209 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f452 expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129750.033193:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129750.033194:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129750.033198:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c1f600/0x48868a4e43949210 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f459 expref: 9 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129750.033202:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135caac00/0x48868a4e43949209 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f452 expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129750.033206:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c1f600/0x48868a4e43949210 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f459 expref: 9 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129750.033209:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135caac00, rc 0) 00010000:00010000:0.0:1746129750.033212:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c1f600, rc 0) 00000100:00100000:1.0:1746129750.033228:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949052157056:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 74us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129750.033228:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949052157184:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 55us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129750.033233:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10837 00000100:00100000:0.0:1746129750.033235:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10838 00000100:00100000:0.0:1746129750.034844:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129750.035027:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052157440 00000100:00100000:2.0:1746129750.035032:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052157440 00000100:00100000:2.0:1746129750.035069:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9849 00000100:00100000:2.0:1746129750.035076:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+7:28556:x1830949052157440:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129750.035089:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129750.035100:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12d400/0x48868a4e43949217 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f460 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.035288:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c200/0x48868a4e4394921e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.035300:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12d000/0x48868a4e439491f4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f43d expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.035306:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c200/0x48868a4e4394921e lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.035329:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12d000/0x48868a4e439491f4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f43d expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.035339:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12d000/0x48868a4e439491f4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f43d expref: 8 pid: 14315 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746129750.035349:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936de300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053292032:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129750.035434:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366480 going to sleep for 11 seconds 00000100:00100000:2.0:1746129750.036929:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936de300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053292032:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129750.036929:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129750.036944:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c200/0x48868a4e4394921e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:1.0:1746129750.037216:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052157568 00000100:00100000:1.0:1746129750.037221:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052157568 00010000:00010000:1.0:1746129750.037241:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12d000/0x48868a4e439491f4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f43d expref: 9 pid: 14315 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746129750.037292:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5198 00000100:00100000:1.0:1746129750.037298:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949052157568:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129750.037307:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129750.037311:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12d000/0x48868a4e439491f4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f43d expref: 9 pid: 14315 timeout: 796 lvb_type: 0 00010000:00010000:1.0:1746129750.037319:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12d000/0x48868a4e439491f4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f43d expref: 9 pid: 14315 timeout: 796 lvb_type: 0 00010000:00010000:1.0:1746129750.037334:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12d000/0x48868a4e439491f4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f43d expref: 9 pid: 14315 timeout: 796 lvb_type: 0 00010000:00010000:1.0:1746129750.037346:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129750.037350:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c200/0x48868a4e4394921e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129750.037393:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c200/0x48868a4e4394921e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129750.037399:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c200/0x48868a4e4394921e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129750.037421:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129750.037443:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c200/0x48868a4e4394921e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.037448:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c200/0x48868a4e4394921e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129750.037461:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000100:00100000:1.0:1746129750.037520:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949052157568:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 222us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129750.037525:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5198 00010000:00010000:2.0:1746129750.037558:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12d400/0x48868a4e43949217 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f460 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.037569:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c200/0x48868a4e4394921e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f460 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.037574:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129750.037576:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129750.037577:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c12c200, rc 0) 00000100:00100000:2.0:1746129750.037607:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28556:x1830949052157440:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 2531us (2767us total) trans 8589943631 rc 0/0 00000100:00100000:2.0:1746129750.037612:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9849 00000100:00100000:0.0:1746129750.039250:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129750.039398:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052157824 00000100:00100000:2.0:1746129750.039402:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052157824 00000100:00100000:2.0:1746129750.039801:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9850 00000100:00100000:2.0:1746129750.039808:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28556:x1830949052157824:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129750.039826:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129750.039828:0:14315:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746129750.039843:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c200/0x48868a4e4394921e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f460 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.039893:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129750.039896:0:14315:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129750.039905:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c000/0x48868a4e4394922c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f467 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.039969:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12ca00/0x48868a4e43949233 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.039979:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12ca00/0x48868a4e43949233 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.039986:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12ca00/0x48868a4e43949233 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129750.039993:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129750.040070:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12c000/0x48868a4e4394922c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f467 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.040081:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12ca00/0x48868a4e43949233 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f467 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.040086:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129750.040088:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129750.040089:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c12ca00, rc 0) 00000100:00100000:2.0:1746129750.040123:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:28556:x1830949052157824:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 316us (876us total) trans 8589943632 rc 0/0 00000100:00100000:2.0:1746129750.040128:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9850 00000100:00100000:0.0:1746129750.041356:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129750.041438:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052157952 00000100:00100000:3.0:1746129750.041443:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052157952 00000100:00100000:3.0:1746129750.041524:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9851 00000100:00100000:3.0:1746129750.041532:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6141239f-0c60-480d-830c-e22ba61457b0+9:28556:x1830949052157952:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129750.041544:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129750.041554:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095344000/0x48868a4e43949241 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f46e expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129750.041586:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095344000/0x48868a4e43949241 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f46e expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129750.041596:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095344000/0x48868a4e43949241 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f46e expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129750.041610:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129750.041613:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129750.041615:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095344000, rc 0) 00000100:00100000:3.0:1746129750.041988:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6141239f-0c60-480d-830c-e22ba61457b0+10:28556:x1830949052157952:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 456us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129750.041993:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9851 00000100:00100000:0.0:1746129750.045508:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129750.045547:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129750.045636:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129750.045882:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052158080 00000100:00100000:0.0:1746129750.045888:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129750.045890:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052158080 00000100:00100000:0.0:1746129750.045902:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052158208 00000100:00100000:0.0:1746129750.045904:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052158208 00000100:00100000:3.0:1746129750.045915:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052158336 00000100:00100000:3.0:1746129750.045917:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052158336 00000100:00100000:2.0:1746129750.045917:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052158464 00000100:00100000:2.0:1746129750.045922:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052158464 00000100:00100000:3.0:1746129750.045987:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10839 00000100:00100000:3.0:1746129750.045994:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949052158080:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:3.0:1746129750.046029:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e43949248 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129750.046029:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10840 00000100:00100000:2.0:1746129750.046041:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10841 00010000:00010000:3.0:1746129750.046045:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fa00/0x48868a4e439490b2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f39c expref: 25 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129750.046047:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10842 00000100:00100000:2.0:1746129750.046048:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949052158336:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:3.0:1746129750.046053:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095344200/0x48868a4e439491fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f444 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129750.046053:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052158464:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:3.0:1746129750.046059:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439490e3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3b1 expref: 14 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129750.046065:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129750.046066:0:4589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c12c600/0x48868a4e4394924f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129750.046067:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129750.046069:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e43949248 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.046075:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6fe00/0x48868a4e43948e2e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f214 expref: 10 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129750.046082:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c12cc00/0x48868a4e43948f23 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f27d expref: 11 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129750.046088:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fb66600/0x48868a4e43948ed6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f24c expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129750.046092:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439490e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3b1 expref: 14 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129750.046093:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129750.046095:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129750.046096:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c12c600/0x48868a4e4394924f lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129750.046106:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439490e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3b1 expref: 14 pid: 4589 timeout: 796 lvb_type: 1 00000100:00100000:0.0:1746129750.046106:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052158208:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:2.0:1746129750.046111:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fb66600/0x48868a4e43948ed6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f24c expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129750.046117:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053292160:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129750.046119:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fb66600/0x48868a4e43948ed6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f24c expref: 14 pid: 8436 timeout: 796 lvb_type: 1 00010000:00010000:0.0:1746129750.046119:0:1140:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136a87400/0x48868a4e43949256 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129750.046127:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053292288:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129750.046160:0:20441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135caa200/0x48868a4e4394925d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.046169:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f400/0x48868a4e43948e3c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f21b expref: 10 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129750.046175:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c12d200/0x48868a4e43948f0e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f284 expref: 14 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129750.046176:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095344200/0x48868a4e439491fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f444 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129750.046181:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a14c600/0x48868a4e43948eeb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f253 expref: 25 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129750.046183:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095344200/0x48868a4e439491fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f444 expref: 10 pid: 8437 timeout: 796 lvb_type: 1 00010000:00010000:1.0:1746129750.046186:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129750.046188:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746129750.046190:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053292416:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129750.046190:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135caa200/0x48868a4e4394925d lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.046202:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a14c600/0x48868a4e43948eeb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f253 expref: 25 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129750.046209:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a14c600/0x48868a4e43948eeb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f253 expref: 25 pid: 1140 timeout: 796 lvb_type: 1 00000100:00100000:1.0:1746129750.046215:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053292544:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129750.046273:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131848000/0x48868a4e43949065 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f36b expref: 11 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129750.046279:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095345a00/0x48868a4e43949202 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f44b expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129750.046285:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131849400/0x48868a4e43949096 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f380 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129750.046289:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129750.046290:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129750.046291:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136a87400/0x48868a4e43949256 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129750.046304:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131849400/0x48868a4e43949096 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f380 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129750.046310:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131849400/0x48868a4e43949096 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f380 expref: 14 pid: 8437 timeout: 796 lvb_type: 1 00000100:00100000:0.0:1746129750.046316:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053292672:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129750.046352:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c12cc00/0x48868a4e43948f23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f27d expref: 11 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129750.046356:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fa00/0x48868a4e439490b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f39c expref: 25 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.046361:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c12cc00/0x48868a4e43948f23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f27d expref: 11 pid: 4589 timeout: 796 lvb_type: 1 00010000:00010000:3.0:1746129750.046363:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fa00/0x48868a4e439490b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f39c expref: 25 pid: 4589 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746129750.046368:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053292800:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129750.046369:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053292928:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129750.046389:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803840 going to sleep for 11 seconds 00010000:00010000:2.0:1746129750.046391:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb6fe00/0x48868a4e43948e2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f214 expref: 10 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129750.046398:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cb6fe00/0x48868a4e43948e2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f214 expref: 10 pid: 7975 timeout: 796 lvb_type: 1 00000100:00100000:2.0:1746129750.046405:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053293056:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129750.046419:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801363666c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746129750.046483:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c12d200/0x48868a4e43948f0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f284 expref: 14 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129750.046494:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c12d200/0x48868a4e43948f0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f284 expref: 14 pid: 4589 timeout: 796 lvb_type: 1 00000100:00100000:1.0:1746129750.046500:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053293184:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129750.046519:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f400/0x48868a4e43948e3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f21b expref: 10 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129750.046526:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f400/0x48868a4e43948e3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f21b expref: 10 pid: 7975 timeout: 796 lvb_type: 1 00000100:00100000:1.0:1746129750.046533:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053293312:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129750.046544:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4948540 going to sleep for 11 seconds 00010000:00010000:0.0:1746129750.046633:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095345a00/0x48868a4e43949202 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f44b expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129750.046641:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095345a00/0x48868a4e43949202 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f44b expref: 10 pid: 8437 timeout: 796 lvb_type: 1 00000100:00100000:0.0:1746129750.046649:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053293440:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129750.046669:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131848000/0x48868a4e43949065 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f36b expref: 11 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129750.046676:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131848000/0x48868a4e43949065 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f36b expref: 11 pid: 3623 timeout: 796 lvb_type: 0 00000100:00100000:0.0:1746129750.046683:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053293568:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129750.046695:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129750.046714:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129750.046777:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129750.046930:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052158592 00000100:00100000:1.0:1746129750.046933:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052158592 00000100:00100000:1.0:1746129750.046959:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052158720 00000100:00100000:1.0:1746129750.046961:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052158720 00000100:00100000:1.0:1746129750.046974:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10843 00000100:00100000:1.0:1746129750.046979:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052158592:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:1.0:1746129750.046994:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43949264 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.047003:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e439491d1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f42f expref: 25 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.047010:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135caac00/0x48868a4e43949209 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f452 expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129750.047017:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4c5bc00/0x48868a4e439491d8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f436 expref: 14 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.047023:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4c5ba00/0x48868a4e439491c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f421 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.047028:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129750.047029:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129750.047032:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43949264 lrc: 7/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.047046:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4c5ba00/0x48868a4e439491c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f421 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.047054:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4c5ba00/0x48868a4e439491c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f421 expref: 14 pid: 8437 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746129750.047061:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053293696:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129750.047099:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4c5bc00/0x48868a4e439491d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f436 expref: 14 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.047107:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4c5bc00/0x48868a4e439491d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f436 expref: 14 pid: 4589 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746129750.047114:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053293824:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129750.047135:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135caac00/0x48868a4e43949209 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f452 expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129750.047141:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135caac00/0x48868a4e43949209 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f452 expref: 11 pid: 20441 timeout: 796 lvb_type: 1 00000100:00100000:1.0:1746129750.047147:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053293952:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129750.047165:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e439491d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f42f expref: 25 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.047172:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e439491d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f42f expref: 25 pid: 4589 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746129750.047179:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053294080:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129750.047195:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4948600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129750.047370:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10844 00000100:00100000:3.0:1746129750.047376:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052158720:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:3.0:1746129750.047392:0:3623:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f08f600/0x48868a4e4394926b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129750.047405:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e439491bc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f41a expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129750.047412:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c1f600/0x48868a4e43949210 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f459 expref: 11 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129750.047418:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8c27c00/0x48868a4e439491ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f428 expref: 11 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129750.047443:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129750.047445:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129750.047447:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f08f600/0x48868a4e4394926b lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129750.047462:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8c27c00/0x48868a4e439491ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f428 expref: 11 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129750.047468:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8c27c00/0x48868a4e439491ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f428 expref: 11 pid: 4589 timeout: 796 lvb_type: 0 00000100:00100000:3.0:1746129750.047475:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053294208:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129750.047498:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c1f600/0x48868a4e43949210 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f459 expref: 11 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129750.047504:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c1f600/0x48868a4e43949210 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f459 expref: 11 pid: 1140 timeout: 796 lvb_type: 1 00000100:00100000:3.0:1746129750.047516:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093289500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053294336:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129750.047535:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e439491bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f41a expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129750.047542:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e439491bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f41a expref: 14 pid: 8437 timeout: 796 lvb_type: 0 00000100:00100000:3.0:1746129750.047549:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053294464:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129750.047567:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129750.049408:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053292416:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129750.049471:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053293568:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129750.061732:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053293440:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129750.061772:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053292672:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129750.061794:0:1140:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136a87400/0x48868a4e43949256 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129750.061833:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053293696:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129750.061875:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053292288:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129750.061876:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053293824:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129750.061883:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053292800:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129750.061889:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053293056:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129750.061899:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053293952:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129750.061907:0:4589:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c12c600/0x48868a4e4394924f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129750.061920:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053294080:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129750.061959:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053292544:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129750.061970:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053293184:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129750.061976:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053293312:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129750.061977:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053292160:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129750.061983:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053292928:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129750.062002:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e43949248 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.062237:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43949264 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129750.062237:0:20441:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135caa200/0x48868a4e4394925d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129750.062545:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129750.062601:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129750.062612:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129750.062635:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129750.062647:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129750.062653:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052158976 00000100:00100000:2.0:1746129750.062658:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052158976 00000100:00100000:1.0:1746129750.062678:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129750.062682:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fb66600/0x48868a4e43948ed6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f24c expref: 15 pid: 8436 timeout: 796 lvb_type: 1 00000100:00100000:2.0:1746129750.062702:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052159232 00000100:00100000:2.0:1746129750.062704:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052159232 00010000:00010000:2.0:1746129750.062712:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6fe00/0x48868a4e43948e2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f214 expref: 12 pid: 7975 timeout: 796 lvb_type: 1 00000100:00100000:2.0:1746129750.062719:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052159104 00000100:00100000:0.0:1746129750.062719:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052160512 00000100:00100000:2.0:1746129750.062721:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052159104 00000100:00100000:0.0:1746129750.062721:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052160512 00010000:00010000:2.0:1746129750.062728:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fa00/0x48868a4e439490b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f39c expref: 26 pid: 4589 timeout: 796 lvb_type: 0 00010000:00010000:0.0:1746129750.062730:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c12cc00/0x48868a4e43948f23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f27d expref: 12 pid: 4589 timeout: 796 lvb_type: 1 00000100:00100000:2.0:1746129750.062736:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052160640 00000100:00100000:2.0:1746129750.062737:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052160640 00000100:00100000:0.0:1746129750.062740:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052160768 00000100:00100000:0.0:1746129750.062741:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052160768 00010000:00010000:2.0:1746129750.062743:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c1f600/0x48868a4e43949210 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f459 expref: 13 pid: 1140 timeout: 796 lvb_type: 1 00010000:00010000:0.0:1746129750.062746:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8c27c00/0x48868a4e439491ca lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f428 expref: 13 pid: 4589 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746129750.062752:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5199 00000100:00100000:2.0:1746129750.062758:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949052158976:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129750.062768:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129750.062776:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053294208:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129750.062782:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093289500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053294336:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129750.062786:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fb66600/0x48868a4e43948ed6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f24c expref: 15 pid: 8436 timeout: 796 lvb_type: 1 00000100:00100000:3.0:1746129750.062788:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053294464:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129750.062794:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fb66600/0x48868a4e43948ed6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f24c expref: 15 pid: 8436 timeout: 796 lvb_type: 1 00010000:00010000:3.0:1746129750.062801:0:3623:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f08f600/0x48868a4e4394926b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.062811:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fb66600/0x48868a4e43948ed6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f24c expref: 15 pid: 8436 timeout: 796 lvb_type: 1 00010000:00010000:2.0:1746129750.062829:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129750.062878:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1964:x1830949052158976:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 119us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129750.063337:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5200 00000100:00100000:0.0:1746129750.063343:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+13:1964:x1830949052159232:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129750.063350:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129750.063358:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cb6fe00/0x48868a4e43948e2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f214 expref: 13 pid: 7975 timeout: 796 lvb_type: 1 00010000:00010000:0.0:1746129750.063365:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cb6fe00/0x48868a4e43948e2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f214 expref: 13 pid: 7975 timeout: 796 lvb_type: 1 00010000:00010000:0.0:1746129750.063376:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6fe00/0x48868a4e43948e2e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f214 expref: 13 pid: 7975 timeout: 796 lvb_type: 1 00000100:00100000:2.0:1746129750.063387:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5199 00010000:00010000:0.0:1746129750.063388:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129750.063404:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+12:1964:x1830949052159232:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 61us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129750.063405:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5201 00000100:00100000:0.0:1746129750.063409:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5200 00000100:00100000:2.0:1746129750.063410:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1964:x1830949052159104:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129750.063416:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129750.063416:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5202 00000100:00100000:0.0:1746129750.063419:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1964:x1830949052160512:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129750.063425:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129750.063437:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fa00/0x48868a4e439490b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f39c expref: 26 pid: 4589 timeout: 796 lvb_type: 0 00010000:00010000:0.0:1746129750.063442:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c12cc00/0x48868a4e43948f23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f27d expref: 13 pid: 4589 timeout: 796 lvb_type: 1 00010000:00010000:2.0:1746129750.063445:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fa00/0x48868a4e439490b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f39c expref: 26 pid: 4589 timeout: 796 lvb_type: 0 00010000:00010000:0.0:1746129750.063449:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c12cc00/0x48868a4e43948f23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f27d expref: 13 pid: 4589 timeout: 796 lvb_type: 1 00010000:00010000:2.0:1746129750.063455:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fa00/0x48868a4e439490b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f39c expref: 26 pid: 4589 timeout: 796 lvb_type: 0 00010000:00010000:0.0:1746129750.063457:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c12cc00/0x48868a4e43948f23 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f27d expref: 13 pid: 4589 timeout: 796 lvb_type: 1 00010000:00010000:2.0:1746129750.063463:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129750.063463:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129750.063465:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129750.063468:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c12c600/0x48868a4e4394924f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129750.063474:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c12c600/0x48868a4e4394924f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129750.063489:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129750.063738:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1964:x1830949052159104:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 327us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129750.063743:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5201 00000100:00100000:2.0:1746129750.063753:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5203 00000100:00100000:2.0:1746129750.063757:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052160640:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129750.063763:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129750.063770:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c1f600/0x48868a4e43949210 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f459 expref: 11 pid: 1140 timeout: 796 lvb_type: 1 00010000:00010000:2.0:1746129750.063778:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c1f600/0x48868a4e43949210 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f459 expref: 11 pid: 1140 timeout: 796 lvb_type: 1 00010000:00010000:2.0:1746129750.063786:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c1f600/0x48868a4e43949210 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f459 expref: 11 pid: 1140 timeout: 796 lvb_type: 1 00010000:00010000:2.0:1746129750.063793:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129750.063823:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1964:x1830949052160512:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 402us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129750.063829:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5202 00000100:00100000:0.0:1746129750.063839:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5204 00000100:00100000:0.0:1746129750.063843:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1963:x1830949052160768:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129750.063862:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129750.063869:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8c27c00/0x48868a4e439491ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f428 expref: 11 pid: 4589 timeout: 796 lvb_type: 0 00010000:00010000:0.0:1746129750.063876:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8c27c00/0x48868a4e439491ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f428 expref: 11 pid: 4589 timeout: 796 lvb_type: 0 00010000:00010000:0.0:1746129750.063885:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8c27c00/0x48868a4e439491ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f428 expref: 11 pid: 4589 timeout: 796 lvb_type: 0 00010000:00010000:0.0:1746129750.063892:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129750.063905:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1963:x1830949052160768:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 62us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129750.063910:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5204 00010000:00010000:0.0:1746129750.063925:0:4589:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c12c600/0x48868a4e4394924f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129750.063931:0:4589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c12c600/0x48868a4e4394924f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129750.063946:0:4589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c12c600/0x48868a4e4394924f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129750.064218:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129750.064234:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052159360 00000100:00100000:3.0:1746129750.064237:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052159360 00010000:00010000:3.0:1746129750.064251:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439490e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3b1 expref: 15 pid: 4589 timeout: 796 lvb_type: 1 00000100:00100000:3.0:1746129750.064271:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5205 00000100:00100000:3.0:1746129750.064276:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949052159360:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129750.064283:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129750.064291:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439490e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3b1 expref: 15 pid: 4589 timeout: 796 lvb_type: 1 00010000:00010000:3.0:1746129750.064299:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439490e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3b1 expref: 15 pid: 4589 timeout: 796 lvb_type: 1 00010000:00010000:3.0:1746129750.064309:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439490e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f3b1 expref: 15 pid: 4589 timeout: 796 lvb_type: 1 00010000:00010000:3.0:1746129750.064320:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129750.064333:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052159360:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 57us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129750.064338:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5205 00000100:00100000:3.0:1746129750.064385:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129750.064394:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052159616 00000100:00100000:3.0:1746129750.064396:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052159616 00010000:00010000:3.0:1746129750.064405:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c12d200/0x48868a4e43948f0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f284 expref: 14 pid: 4589 timeout: 796 lvb_type: 1 00000100:00100000:3.0:1746129750.064415:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5206 00000100:00100000:3.0:1746129750.064419:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052159616:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129750.064425:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129750.064489:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c12d200/0x48868a4e43948f0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f284 expref: 14 pid: 4589 timeout: 796 lvb_type: 1 00010000:00010000:3.0:1746129750.064497:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c12d200/0x48868a4e43948f0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f284 expref: 14 pid: 4589 timeout: 796 lvb_type: 1 00010000:00010000:0.0:1746129750.064557:0:4589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c12c600/0x48868a4e4394924f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129750.064565:0:4589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c12c600/0x48868a4e4394924f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129750.064570:0:4589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c12c600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129750.064573:0:4589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c12c600/0x48868a4e4394924f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129750.064585:0:4589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c12c600/0x48868a4e4394924f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129750.064594:0:4589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c12c600/0x48868a4e4394924f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129750.064599:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c12c600/0x48868a4e4394924f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129750.064635:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949052158336:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 18587us (18999us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129750.064641:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10841 00000100:00100000:0.0:1746129750.064770:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129750.064832:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+9:1964:x1830949052160640:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1073us (2182us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129750.064837:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5203 00000100:00100000:2.0:1746129750.066180:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052159872 00000100:00100000:0.0:1746129750.066181:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129750.066185:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052159872 00000100:00100000:0.0:1746129750.066191:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129750.066200:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095345a00/0x48868a4e43949202 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f44b expref: 9 pid: 8437 timeout: 796 lvb_type: 1 00000100:00100000:0.0:1746129750.066200:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129750.066208:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129750.066211:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052160128 00000100:00100000:2.0:1746129750.066213:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052160128 00010000:00010000:2.0:1746129750.066220:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4c5ba00/0x48868a4e439491c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f421 expref: 15 pid: 8437 timeout: 796 lvb_type: 0 00000100:00100000:0.0:1746129750.066220:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129750.066227:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052160896 00000100:00100000:2.0:1746129750.066229:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052160896 00000100:00100000:0.0:1746129750.066229:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129750.066236:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e439491bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f41a expref: 14 pid: 8437 timeout: 796 lvb_type: 0 00000100:00100000:0.0:1746129750.066239:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129750.066243:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052160384 00000100:00100000:2.0:1746129750.066244:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052160384 00000100:00100000:0.0:1746129750.066248:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129750.066251:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135caac00/0x48868a4e43949209 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f452 expref: 12 pid: 20441 timeout: 796 lvb_type: 1 00000100:00100000:2.0:1746129750.066258:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052158848 00000100:00100000:2.0:1746129750.066260:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052158848 00010000:00010000:2.0:1746129750.066266:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095344200/0x48868a4e439491fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f444 expref: 13 pid: 8437 timeout: 796 lvb_type: 1 00000100:00100000:2.0:1746129750.066272:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052159488 00000100:00100000:2.0:1746129750.066273:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052159488 00010000:00010000:2.0:1746129750.066279:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a14c600/0x48868a4e43948eeb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f253 expref: 25 pid: 1140 timeout: 796 lvb_type: 1 00000100:00100000:2.0:1746129750.066285:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052159744 00000100:00100000:2.0:1746129750.066286:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052159744 00000100:00100000:0.0:1746129750.066289:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129750.066291:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f400/0x48868a4e43948e3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f21b expref: 14 pid: 7975 timeout: 796 lvb_type: 1 00000100:00100000:2.0:1746129750.066298:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052160000 00000100:00100000:2.0:1746129750.066299:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052160000 00010000:00010000:2.0:1746129750.066306:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131849400/0x48868a4e43949096 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f380 expref: 15 pid: 8437 timeout: 796 lvb_type: 1 00000100:00100000:2.0:1746129750.066313:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052160256 00000100:00100000:2.0:1746129750.066314:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052160256 00010000:00010000:2.0:1746129750.066320:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131848000/0x48868a4e43949065 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f36b expref: 10 pid: 3623 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746129750.066327:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052161024 00000100:00100000:2.0:1746129750.066329:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052161024 00010000:00010000:2.0:1746129750.066335:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e439491d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f42f expref: 26 pid: 4589 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746129750.066345:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5207 00000100:00100000:2.0:1746129750.066350:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052159872:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129750.066358:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129750.066369:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095345a00/0x48868a4e43949202 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f44b expref: 9 pid: 8437 timeout: 796 lvb_type: 1 00000100:00100000:1.0:1746129750.066373:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5208 00010000:00010000:2.0:1746129750.066375:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095345a00/0x48868a4e43949202 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f44b expref: 9 pid: 8437 timeout: 796 lvb_type: 1 00000100:00100000:1.0:1746129750.066380:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949052160128:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129750.066386:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129750.066388:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095345a00/0x48868a4e43949202 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f44b expref: 9 pid: 8437 timeout: 796 lvb_type: 1 00010000:00010000:1.0:1746129750.066397:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4c5ba00/0x48868a4e439491c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f421 expref: 15 pid: 8437 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746129750.066399:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129750.066403:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4c5ba00/0x48868a4e439491c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f421 expref: 15 pid: 8437 timeout: 796 lvb_type: 0 00010000:00010000:1.0:1746129750.066413:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4c5ba00/0x48868a4e439491c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f421 expref: 15 pid: 8437 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746129750.066415:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052159872:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 65us (1645us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129750.066420:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5207 00010000:00010000:1.0:1746129750.066424:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129750.066444:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052160128:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 65us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129750.066446:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5209 00000100:00100000:2.0:1746129750.066450:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1963:x1830949052160896:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129750.066452:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5208 00010000:00010000:2.0:1746129750.066457:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129750.066461:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5210 00010000:00010000:2.0:1746129750.066464:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e439491bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f41a expref: 15 pid: 8437 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746129750.066465:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+14:1962:x1830949052160384:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129750.066469:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129750.066472:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e439491bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f41a expref: 15 pid: 8437 timeout: 796 lvb_type: 0 00010000:00010000:1.0:1746129750.066475:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135caac00/0x48868a4e43949209 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f452 expref: 14 pid: 20441 timeout: 796 lvb_type: 1 00010000:00010000:1.0:1746129750.066481:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135caac00/0x48868a4e43949209 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f452 expref: 14 pid: 20441 timeout: 796 lvb_type: 1 00010000:00010000:2.0:1746129750.066482:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8695a00/0x48868a4e439491bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f41a expref: 15 pid: 8437 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746129750.066489:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129750.066489:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135caac00/0x48868a4e43949209 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f452 expref: 14 pid: 20441 timeout: 796 lvb_type: 1 00010000:00010000:2.0:1746129750.066491:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129750.066494:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f08f600/0x48868a4e4394926b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.066495:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129750.066501:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f08f600/0x48868a4e4394926b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129750.066503:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949052160384:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 38us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129750.066507:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5210 00000100:00100000:1.0:1746129750.066516:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5211 00010000:00010000:2.0:1746129750.066518:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129750.066519:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949052158848:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129750.066524:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129750.066526:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1963:x1830949052160896:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 76us (334us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129750.066529:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095344200/0x48868a4e439491fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f444 expref: 12 pid: 8437 timeout: 796 lvb_type: 1 00000100:00100000:2.0:1746129750.066530:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5209 00010000:00010000:1.0:1746129750.066536:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095344200/0x48868a4e439491fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f444 expref: 12 pid: 8437 timeout: 796 lvb_type: 1 00000100:00100000:2.0:1746129750.066539:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5212 00000100:00100000:2.0:1746129750.066542:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8e0e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949052159488:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129750.066547:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129750.066549:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095344200/0x48868a4e439491fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f444 expref: 12 pid: 8437 timeout: 796 lvb_type: 1 00010000:00010000:1.0:1746129750.066557:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129750.066558:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129750.066560:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e43949248 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.066571:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e43949248 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.066584:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129750.066595:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052158848:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 75us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129750.066600:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5211 00000100:00100000:1.0:1746129750.066609:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5213 00000100:00100000:1.0:1746129750.066613:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052159744:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129750.066618:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129750.066740:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c12d200/0x48868a4e43948f0e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f284 expref: 13 pid: 4589 timeout: 796 lvb_type: 1 00010000:00010000:2.0:1746129750.066741:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a14c600/0x48868a4e43948eeb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f253 expref: 26 pid: 1140 timeout: 796 lvb_type: 1 00010000:00010000:2.0:1746129750.066749:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a14c600/0x48868a4e43948eeb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f253 expref: 26 pid: 1140 timeout: 796 lvb_type: 1 00010000:00010000:2.0:1746129750.066760:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a14c600/0x48868a4e43948eeb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f253 expref: 26 pid: 1140 timeout: 796 lvb_type: 1 00010000:00010000:1.0:1746129750.066762:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f400/0x48868a4e43948e3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f21b expref: 10 pid: 7975 timeout: 796 lvb_type: 1 00010000:00010000:1.0:1746129750.066769:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f400/0x48868a4e43948e3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f21b expref: 10 pid: 7975 timeout: 796 lvb_type: 1 00010000:00010000:2.0:1746129750.066773:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129750.066777:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f400/0x48868a4e43948e3c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f21b expref: 10 pid: 7975 timeout: 796 lvb_type: 1 00000100:00100000:2.0:1746129750.066784:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8e0e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949052159488:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 241us (563us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129750.066787:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129750.066788:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746129750.066789:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5212 00010000:00010000:1.0:1746129750.066791:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135caa200/0x48868a4e4394925d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.066796:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135caa200/0x48868a4e4394925d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129750.066798:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5214 00000100:00100000:2.0:1746129750.066802:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949052160000:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129750.066807:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129750.066813:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131849400/0x48868a4e43949096 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f380 expref: 13 pid: 8437 timeout: 796 lvb_type: 1 00010000:00010000:1.0:1746129750.066817:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129750.066820:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131849400/0x48868a4e43949096 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f380 expref: 13 pid: 8437 timeout: 796 lvb_type: 1 00000100:00100000:1.0:1746129750.066827:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052159744:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 214us (598us total) trans 0 rc 0/0 00010000:00010000:2.0:1746129750.066828:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131849400/0x48868a4e43949096 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f380 expref: 13 pid: 8437 timeout: 796 lvb_type: 1 00000100:00100000:1.0:1746129750.066832:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5213 00010000:00010000:2.0:1746129750.066836:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129750.066841:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5215 00000100:00100000:2.0:1746129750.066843:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+12:1962:x1830949052160000:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 42us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129750.066845:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949052160256:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129750.066860:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5214 00010000:00010000:1.0:1746129750.066862:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129750.066869:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131848000/0x48868a4e43949065 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f36b expref: 10 pid: 3623 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746129750.066870:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5216 00000100:00100000:2.0:1746129750.066874:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052161024:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129750.066876:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131848000/0x48868a4e43949065 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f36b expref: 10 pid: 3623 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746129750.066879:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129750.066886:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131848000/0x48868a4e43949065 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f36b expref: 10 pid: 3623 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746129750.066890:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e439491d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f42f expref: 24 pid: 4589 timeout: 796 lvb_type: 0 00010000:00010000:1.0:1746129750.066893:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129750.066894:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129750.066897:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e439491d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f42f expref: 24 pid: 4589 timeout: 796 lvb_type: 0 00010000:00010000:1.0:1746129750.066897:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136a87400/0x48868a4e43949256 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.066902:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136a87400/0x48868a4e43949256 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.066905:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e439491d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f42f expref: 24 pid: 4589 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746129750.066912:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129750.066913:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129750.066920:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949052161024:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 46us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129750.066921:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052160256:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 76us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129750.066925:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5216 00000100:00100000:1.0:1746129750.066927:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5215 00010000:00010000:1.0:1746129750.066940:0:1140:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136a87400/0x48868a4e43949256 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.066946:0:1140:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136a87400/0x48868a4e43949256 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.066957:0:3623:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f08f600/0x48868a4e4394926b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.066961:0:1140:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136a87400/0x48868a4e43949256 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.066963:0:3623:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f08f600/0x48868a4e4394926b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.066967:0:1140:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136a87400/0x48868a4e43949256 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.066973:0:3623:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f08f600/0x48868a4e4394926b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.066973:0:1140:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136a87400/0x48868a4e43949256 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.066978:0:3623:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f08f600/0x48868a4e4394926b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.066978:0:1140:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136a87400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129750.066981:0:1140:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136a87400/0x48868a4e43949256 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.066983:0:3623:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f08f600/0x48868a4e4394926b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.066987:0:3623:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f08f600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129750.066990:0:3623:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f08f600/0x48868a4e4394926b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.066991:0:1140:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136a87400/0x48868a4e43949256 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.066996:0:3623:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f08f600/0x48868a4e4394926b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.066998:0:1140:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136a87400/0x48868a4e43949256 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.067002:0:3623:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f08f600/0x48868a4e4394926b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.067003:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136a87400/0x48868a4e43949256 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.067007:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f08f600/0x48868a4e4394926b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129750.067029:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+7:1962:x1830949052158720:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 19654us (20252us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129750.067029:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+7:1962:x1830949052158208:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 20996us (21483us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129750.067035:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10844 00010000:00010000:0.0:1746129750.067064:0:20441:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135caa200/0x48868a4e4394925d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129750.067069:0:20441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135caa200/0x48868a4e4394925d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129750.067081:0:20441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135caa200/0x48868a4e4394925d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129750.067087:0:20441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135caa200/0x48868a4e4394925d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129750.067093:0:20441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135caa200/0x48868a4e4394925d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129750.067098:0:20441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135caa200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129750.067100:0:20441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135caa200/0x48868a4e4394925d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129750.067105:0:20441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135caa200/0x48868a4e4394925d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129750.067113:0:20441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135caa200/0x48868a4e4394925d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129750.067119:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135caa200/0x48868a4e4394925d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129750.067139:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052158464:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 21086us (21250us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129750.067309:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129750.067326:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052159616:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2905us (2939us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129750.067331:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5206 00000100:00100000:1.0:1746129750.067446:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10840 00010000:00010000:1.0:1746129750.067463:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e43949248 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.067470:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e43949248 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.067482:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e43949248 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.067487:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e43949248 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.067492:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e43949248 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.067501:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8694600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129750.067503:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e43949248 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.067508:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e43949248 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.067516:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e43949248 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.067522:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8694600/0x48868a4e43949248 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129750.067548:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949052158080:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 21555us (22049us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129750.067553:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10839 00000100:00100000:0.0:1746129750.067591:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10842 00000100:00100000:0.0:1746129750.068539:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129750.069218:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052161152 00000100:00100000:3.0:1746129750.069224:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052161152 00010000:00010000:3.0:1746129750.069246:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4c5bc00/0x48868a4e439491d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f436 expref: 12 pid: 4589 timeout: 796 lvb_type: 0 00000100:00100000:3.0:1746129750.069342:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5217 00000100:00100000:3.0:1746129750.069348:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052161152:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129750.069358:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129750.069372:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4c5bc00/0x48868a4e439491d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f436 expref: 12 pid: 4589 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746129750.069381:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4c5bc00/0x48868a4e439491d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f436 expref: 12 pid: 4589 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746129750.069397:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4c5bc00/0x48868a4e439491d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f436 expref: 12 pid: 4589 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746129750.069407:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129750.069409:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129750.069413:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43949264 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129750.069419:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43949264 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129750.069452:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129750.069553:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43949264 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.069561:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43949264 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.069576:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43949264 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.069582:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43949264 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.069588:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43949264 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.069593:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a14d600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129750.069596:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43949264 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.069601:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43949264 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.069610:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43949264 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129750.069615:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a14d600/0x48868a4e43949264 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129750.069715:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052161152:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 365us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129750.069721:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5217 00000100:00100000:1.0:1746129750.070010:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+6:1962:x1830949052158592:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 23029us (23293us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129750.070017:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10843 00000100:00100000:0.0:1746129750.071604:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129750.071897:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052161408 00000100:00100000:3.0:1746129750.071903:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052161408 00000100:00100000:3.0:1746129750.072045:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9852 00000100:00100000:3.0:1746129750.072053:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6141239f-0c60-480d-830c-e22ba61457b0+10:28556:x1830949052161408:12345-192.168.204.31@tcp:36:mirror_io.0 00010000:00010000:3.0:1746129750.072087:0:14313:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129750.072104:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095344000/0x48868a4e43949241 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f46e expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129750.072120:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129750.072123:0:14313:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129750.072143:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b2d600/0x48868a4e43949272 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129750.072153:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ae00/0x48868a4e43948f4d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2a7 expref: 21 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129750.072159:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87a00/0x48868a4e43948f54 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ae expref: 292 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129750.072164:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87e00/0x48868a4e43948f5b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2b5 expref: 21 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129750.072169:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1e00/0x48868a4e43948fd9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f31e expref: 292 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129750.072174:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e000/0x48868a4e43949011 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f33a expref: 21 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129750.072179:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094b2d600/0x48868a4e43949272 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129750.072200:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e000/0x48868a4e43949011 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f33a expref: 21 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129750.072208:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e000/0x48868a4e43949011 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f33a expref: 21 pid: 14315 timeout: 796 lvb_type: 0 00000100:00100000:3.0:1746129750.072221:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053294592:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129750.072293:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1e00/0x48868a4e43948fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f31e expref: 292 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129750.072300:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1e00/0x48868a4e43948fd9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f31e expref: 292 pid: 14315 timeout: 796 lvb_type: 0 00000100:00100000:3.0:1746129750.072306:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093289500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053294720:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129750.072330:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87e00/0x48868a4e43948f5b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2b5 expref: 21 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129750.072335:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87e00/0x48868a4e43948f5b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2b5 expref: 21 pid: 14314 timeout: 796 lvb_type: 0 00000100:00100000:3.0:1746129750.072340:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053294848:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129750.072357:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87a00/0x48868a4e43948f54 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ae expref: 292 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129750.072363:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87a00/0x48868a4e43948f54 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ae expref: 292 pid: 1851 timeout: 796 lvb_type: 0 00000100:00100000:3.0:1746129750.072369:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053294976:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129750.072385:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ae00/0x48868a4e43948f4d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2a7 expref: 21 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129750.072394:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ae00/0x48868a4e43948f4d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2a7 expref: 21 pid: 14315 timeout: 796 lvb_type: 0 00000100:00100000:3.0:1746129750.072400:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053295104:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129750.072411:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129750.077173:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053294592:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129750.077186:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093289500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053294720:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129750.077193:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053294848:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129750.077204:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053294976:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129750.077325:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129750.077394:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053295104:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129750.077459:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129750.077519:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129750.077597:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129750.077610:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052161536 00000100:00100000:2.0:1746129750.077615:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052161536 00010000:00010000:2.0:1746129750.077638:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e000/0x48868a4e43949011 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f33a expref: 22 pid: 14315 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746129750.077659:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052161792 00000100:00100000:2.0:1746129750.077661:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052161792 00010000:00010000:2.0:1746129750.077668:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87e00/0x48868a4e43948f5b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2b5 expref: 23 pid: 14314 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746129750.077688:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052162048 00000100:00100000:2.0:1746129750.077689:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052162048 00010000:00010000:2.0:1746129750.077695:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ae00/0x48868a4e43948f4d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2a7 expref: 24 pid: 14315 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746129750.077711:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5218 00000100:00100000:2.0:1746129750.077716:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1963:x1830949052161536:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129750.077720:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094b2d600/0x48868a4e43949272 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129750.077727:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129750.077731:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e000/0x48868a4e43949011 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f33a expref: 24 pid: 14315 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746129750.077739:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e000/0x48868a4e43949011 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f33a expref: 24 pid: 14315 timeout: 796 lvb_type: 0 00000100:00100000:0.0:1746129750.077815:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129750.077829:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e000/0x48868a4e43949011 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f33a expref: 24 pid: 14315 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746129750.077841:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129750.077845:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094b2d600/0x48868a4e43949272 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129750.077874:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129750.077877:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052161664 00000100:00100000:1.0:1746129750.077879:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052161664 00010000:00010000:1.0:1746129750.077892:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1e00/0x48868a4e43948fd9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f31e expref: 293 pid: 14315 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746129750.077901:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052161920 00000100:00100000:1.0:1746129750.077902:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052161920 00000100:00100000:2.0:1746129750.077905:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1963:x1830949052161536:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 189us (582us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129750.077908:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87a00/0x48868a4e43948f54 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ae expref: 294 pid: 1851 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746129750.077911:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5218 00000100:00100000:1.0:1746129750.077916:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5219 00000100:00100000:1.0:1746129750.077920:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8e0d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1963:x1830949052161792:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129750.077922:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5220 00000100:00100000:2.0:1746129750.077926:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1963:x1830949052162048:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129750.077926:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129750.077929:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87e00/0x48868a4e43948f5b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2b5 expref: 22 pid: 14314 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746129750.077930:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129750.077933:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ae00/0x48868a4e43948f4d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2a7 expref: 22 pid: 14315 timeout: 796 lvb_type: 0 00010000:00010000:1.0:1746129750.077935:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87e00/0x48868a4e43948f5b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2b5 expref: 22 pid: 14314 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746129750.077945:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ae00/0x48868a4e43948f4d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2a7 expref: 22 pid: 14315 timeout: 796 lvb_type: 0 00010000:00010000:1.0:1746129750.077945:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87e00/0x48868a4e43948f5b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2b5 expref: 22 pid: 14314 timeout: 796 lvb_type: 0 00010000:00010000:1.0:1746129750.077953:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129750.077954:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ae00/0x48868a4e43948f4d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2a7 expref: 21 pid: 14315 timeout: 796 lvb_type: 0 00010000:00010000:1.0:1746129750.077956:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094b2d600/0x48868a4e43949272 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129750.077960:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129750.077961:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129750.077963:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094b2d600/0x48868a4e43949272 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129750.077967:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129750.077972:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8e0d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1963:x1830949052161792:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 52us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129750.077975:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1963:x1830949052162048:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 49us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129750.077977:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5219 00000100:00100000:2.0:1746129750.077979:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5220 00000100:00100000:2.0:1746129750.077986:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5221 00000100:00100000:2.0:1746129750.077989:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:1963:x1830949052161664:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129750.077994:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129750.077996:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1e00/0x48868a4e43948fd9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f31e expref: 294 pid: 14315 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746129750.078002:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5222 00010000:00010000:2.0:1746129750.078003:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1e00/0x48868a4e43948fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f31e expref: 294 pid: 14315 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746129750.078006:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:1963:x1830949052161920:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129750.078010:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129750.078012:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801318e1e00/0x48868a4e43948fd9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f31e expref: 294 pid: 14315 timeout: 796 lvb_type: 0 00010000:00010000:1.0:1746129750.078013:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87a00/0x48868a4e43948f54 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ae expref: 294 pid: 1851 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746129750.078018:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129750.078021:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094b2d600/0x48868a4e43949272 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129750.078025:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129750.078032:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87a00/0x48868a4e43948f54 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ae expref: 293 pid: 1851 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746129750.078036:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:1963:x1830949052161664:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 47us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129750.078041:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5221 00010000:00010000:1.0:1746129750.078041:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a87a00/0x48868a4e43948f54 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f2ae expref: 293 pid: 1851 timeout: 796 lvb_type: 0 00010000:00010000:1.0:1746129750.078046:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129750.078049:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094b2d600/0x48868a4e43949272 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129750.078054:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b2d600/0x48868a4e43949272 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129750.078059:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094b2d600/0x48868a4e43949272 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129750.078260:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129750.078267:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094b2d600/0x48868a4e43949272 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129750.078273:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094b2d600/0x48868a4e43949272 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:1.0:1746129750.078286:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:1963:x1830949052161920:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 280us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129750.078291:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5222 00000040:00080000:3.0:1746129750.078831:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2805, 88 off233688 00000004:00080000:3.0:1746129750.078838:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 696136989969ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129750.078898:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2741, 88 off228136 00000004:00080000:3.0:1746129750.078902:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 696137053911ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129750.078918:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2742, 88 off228224 00000004:00080000:3.0:1746129750.078922:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 696137073651ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129750.078929:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2806, 88 off233776 00000004:00080000:3.0:1746129750.078932:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 696137083811ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129750.078938:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2807, 88 off233864 00000004:00080000:3.0:1746129750.078940:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 696137092196ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129750.078947:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2743, 88 off228312 00000004:00080000:3.0:1746129750.078949:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 696137100971ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129750.078955:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2744, 88 off228400 00000004:00080000:3.0:1746129750.078957:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 696137108946ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129750.079289:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2745, 88 off228488 00000004:00080000:3.0:1746129750.079294:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 696137446179ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129750.079307:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2808, 88 off233952 00000004:00080000:3.0:1746129750.079310:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 696137461656ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129750.079763:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2746, 88 off228576 00000004:00080000:3.0:1746129750.079773:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 696137925313ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129750.079800:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2809, 88 off234040 00000004:00080000:3.0:1746129750.079803:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 696137954751ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129750.079809:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2747, 88 off228664 00000004:00080000:3.0:1746129750.079811:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 696137963128ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129750.079819:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2810, 88 off234128 00000004:00080000:3.0:1746129750.079821:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 696137973206ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129750.079827:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2811, 88 off234216 00000004:00080000:3.0:1746129750.079829:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 696137980906ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129750.079834:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2812, 88 off234304 00000004:00080000:3.0:1746129750.079836:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 696137988051ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129750.079841:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2813, 88 off234392 00000004:00080000:3.0:1746129750.079843:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 696137994821ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129750.079862:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2748, 88 off228752 00000004:00080000:3.0:1746129750.079865:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 696138017001ns, next at 641623252291ns, rc = 0 00000004:00010000:2.0:1746129750.094763:0:14313:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012d634380 reply state ffff8800940bdc00 transno 8589943633 ns: mdt-lustre-MDT0000_UUID lock: ffff880094b2d600/0x48868a4e43949272 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:2.0:1746129750.094773:0:14313:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746129750.094871:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6141239f-0c60-480d-830c-e22ba61457b0+11:28556:x1830949052161408:12345-192.168.204.31@tcp:36:mirror_io.0 Request processed in 22815us (23268us total) trans 8589943633 rc 0/0 00000100:00100000:2.0:1746129750.094878:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9852 00000001:00080000:0.0:1746129750.094949:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943619 is committed 00000001:00080000:0.0:1746129750.094956:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943618 is committed 00000001:00080000:0.0:1746129750.094963:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943632 is committed 00000001:00080000:0.0:1746129750.094969:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943630 is committed 00000001:00080000:0.0:1746129750.094975:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943626 is committed 00000001:00080000:0.0:1746129750.095003:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943633 is committed 00000004:00080000:0.0:1746129750.095006:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1934 committed 00000004:00080000:0.0:1746129750.095011:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1995 committed 00000004:00080000:0.0:1746129750.095022:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1994 committed 00000004:00080000:0.0:1746129750.095023:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1993 committed 00000004:00080000:0.0:1746129750.095025:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1992 committed 00000004:00080000:0.0:1746129750.095026:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1933 committed 00000004:00080000:0.0:1746129750.095027:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1991 committed 00000004:00080000:0.0:1746129750.095028:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1932 committed 00000004:00080000:0.0:1746129750.095030:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1990 committed 00000004:00080000:0.0:1746129750.095031:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1931 committed 00000004:00080000:0.0:1746129750.095033:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1930 committed 00000004:00080000:0.0:1746129750.095034:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1929 committed 00000004:00080000:0.0:1746129750.095036:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1989 committed 00000004:00080000:0.0:1746129750.095037:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1988 committed 00000004:00080000:0.0:1746129750.095038:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1928 committed 00000004:00080000:0.0:1746129750.095040:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1927 committed 00000004:00080000:0.0:1746129750.095041:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1987 committed 00000001:00080000:0.0:1746129750.095045:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943628 is committed 00000100:00100000:3.0:1746129750.095199:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053295232:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129750.095237:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129750.095259:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053295744:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129750.095272:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129750.095285:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746129750.095289:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053295616:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129750.095301:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129750.095310:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053296128:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129750.095321:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129750.095335:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053295488:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129750.095347:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129750.095358:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053296000:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129750.095369:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129750.095379:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746129750.095382:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053295360:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129750.095393:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129750.095402:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053295872:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129750.095414:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129750.095444:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053295232 00000100:00100000:3.0:1746129750.095449:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053295232 00000100:00100000:3.0:1746129750.095468:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053295744 00000100:00100000:3.0:1746129750.095470:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053295744 00000100:00100000:3.0:1746129750.095479:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053295616 00000100:00100000:3.0:1746129750.095481:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053295616 00000100:00100000:3.0:1746129750.095488:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053296128 00000100:00100000:3.0:1746129750.095490:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053296128 00000100:00100000:3.0:1746129750.095498:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053295488 00000100:00100000:3.0:1746129750.095500:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053295488 00000100:00100000:3.0:1746129750.095506:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10845 00000100:00100000:3.0:1746129750.095511:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3297:x1830949053295232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129750.095657:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:3297:x1830949053295232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 146us (420us total) trans 17179873129 rc 0/0 00000100:00100000:3.0:1746129750.095662:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10845 00000100:00100000:3.0:1746129750.095671:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053296000 00000100:00100000:3.0:1746129750.095673:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053296000 00000100:00100000:3.0:1746129750.095679:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053295360 00000100:00100000:3.0:1746129750.095681:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053295360 00000100:00100000:3.0:1746129750.095686:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053295872 00000100:00100000:3.0:1746129750.095687:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053295872 00000100:00100000:3.0:1746129750.095693:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10846 00000100:00100000:3.0:1746129750.095696:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3297:x1830949053295744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129750.095763:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3297:x1830949053295744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (489us total) trans 17179873130 rc 0/0 00000100:00100000:3.0:1746129750.095768:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10846 00000100:00100000:3.0:1746129750.095777:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10847 00000100:00100000:3.0:1746129750.095781:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3297:x1830949053295616:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129750.095838:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129750.095840:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746129750.095842:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746129750.095844:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746129750.095845:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746129750.095882:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3297:x1830949053295616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (580us total) trans 17179873131 rc 0/0 00000100:00100000:3.0:1746129750.095887:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10847 00000100:00100000:3.0:1746129750.095896:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10848 00000100:00100000:3.0:1746129750.095900:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3297:x1830949053296128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129750.095967:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3297:x1830949053296128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (644us total) trans 17179873132 rc 0/0 00000100:00100000:3.0:1746129750.095972:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10848 00000100:00100000:3.0:1746129750.095980:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10849 00000100:00100000:3.0:1746129750.095984:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3299:x1830949053295488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129750.096054:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3299:x1830949053295488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (705us total) trans 17179873133 rc 0/0 00000100:00100000:3.0:1746129750.096059:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10849 00000100:00100000:3.0:1746129750.096068:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10850 00000100:00100000:3.0:1746129750.096071:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3299:x1830949053296000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129750.096132:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3299:x1830949053296000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (762us total) trans 17179873134 rc 0/0 00000100:00100000:3.0:1746129750.096137:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10850 00000100:00100000:3.0:1746129750.096145:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10851 00000100:00100000:3.0:1746129750.096149:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3299:x1830949053295360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129750.096218:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3299:x1830949053295360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (823us total) trans 17179873135 rc 0/0 00000100:00100000:3.0:1746129750.096223:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10851 00000100:00100000:3.0:1746129750.096231:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10852 00000100:00100000:3.0:1746129750.096235:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3299:x1830949053295872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129750.096297:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3299:x1830949053295872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (882us total) trans 17179873136 rc 0/0 00000100:00100000:3.0:1746129750.096303:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10852 00000004:00080000:3.0:1746129750.096338:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009328aa00/2, rc 0, transno 17179873135 00000100:00100000:3.0:1746129750.096345:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053295360:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129750.096352:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8e5880/2, rc 0, transno 17179873136 00000100:00100000:3.0:1746129750.096355:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053295872:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129750.096360:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009328b800/2, rc 0, transno 17179873133 00000100:00100000:3.0:1746129750.096362:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053295488:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129750.096367:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8e7b80/2, rc 0, transno 17179873134 00000100:00100000:3.0:1746129750.096369:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053296000:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129750.096382:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093289500/2, rc 0, transno 17179873131 00000100:00100000:3.0:1746129750.096384:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053295616:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129750.096390:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8e7480/2, rc 0, transno 17179873132 00000100:00100000:3.0:1746129750.096392:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053296128:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129750.096397:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093288e00/2, rc 0, transno 17179873129 00000100:00100000:3.0:1746129750.096399:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053295232:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129750.096405:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093288000/2, rc 0, transno 17179873130 00000100:00100000:3.0:1746129750.096407:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053295744:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129750.096454:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053296256:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129750.096473:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129750.096489:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053296256 00000100:00100000:3.0:1746129750.096492:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053296256 00000100:00100000:3.0:1746129750.096503:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10853 00000100:00100000:3.0:1746129750.096507:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3297:x1830949053296256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129750.096577:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3297:x1830949053296256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (103us total) trans 17179873137 rc 0/0 00000100:00100000:3.0:1746129750.096582:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10853 00010000:00010000:2.0:1746129750.096682:0:3283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b2d600/0x48868a4e43949272 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129750.096691:0:3283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094b2d600/0x48868a4e43949272 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129750.096697:0:3283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094b2d600/0x48868a4e43949272 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129750.096703:0:3283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094b2d600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129750.096707:0:3283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094b2d600/0x48868a4e43949272 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129750.096716:0:3283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094b2d600/0x48868a4e43949272 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129750.096730:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129750.096733:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129750.096736:0:3283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094b2d600/0x48868a4e43949272 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129750.096741:0:3283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b2d600/0x48868a4e43949272 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00000100:00100000:2.0:1746129750.096755:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053296640:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129750.096774:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129750.096785:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053297152:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129750.096788:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053296640 00000100:00100000:0.0:1746129750.096791:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053296640 00000100:00100000:2.0:1746129750.096796:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129750.096816:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053297152 00000100:00100000:2.0:1746129750.096818:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746129750.096818:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053297152 00000100:00100000:2.0:1746129750.096822:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053296768:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129750.096827:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10854 00000100:00100000:0.0:1746129750.096831:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3296:x1830949053296640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129750.096836:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129750.096843:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053297280:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129750.096870:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129750.096885:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053296384:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129750.096898:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129750.096907:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053296896:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129750.096919:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129750.096928:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746129750.096931:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053296512:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129750.096943:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129750.096948:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3296:x1830949053296640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 117us (173us total) trans 21474840282 rc 0/0 00000100:00100000:2.0:1746129750.096949:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053297024:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129750.096953:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10854 00000100:00100000:2.0:1746129750.096960:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129750.096961:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053296768 00000100:00100000:0.0:1746129750.096963:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053296768 00000100:00100000:0.0:1746129750.096969:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053297280 00000100:00100000:2.0:1746129750.096971:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053296384 00000100:00100000:0.0:1746129750.096971:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053297280 00000100:00100000:2.0:1746129750.096973:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053296384 00000100:00100000:0.0:1746129750.096975:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053296896 00000100:00100000:0.0:1746129750.096976:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053296896 00000100:00100000:2.0:1746129750.096981:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053297024 00000100:00100000:0.0:1746129750.096981:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053296512 00000100:00100000:0.0:1746129750.096982:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053296512 00000100:00100000:2.0:1746129750.096983:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053297024 00000100:00100000:0.0:1746129750.096988:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10855 00000100:00100000:2.0:1746129750.096991:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10856 00000100:00100000:0.0:1746129750.096992:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3296:x1830949053297152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129750.096994:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3296:x1830949053296768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129750.097013:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10857 00000100:00100000:2.0:1746129750.097017:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3296:x1830949053297280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129750.097070:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3296:x1830949053297152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (272us total) trans 21474840283 rc 0/0 00000100:00100000:0.0:1746129750.097074:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10855 00000100:00100000:0.0:1746129750.097082:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10858 00000100:00100000:2.0:1746129750.097083:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949053297280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (212us total) trans 21474840284 rc 0/0 00000100:00100000:0.0:1746129750.097086:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3298:x1830949053296384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129750.097088:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10857 00000100:00100000:2.0:1746129750.097094:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10859 00000100:00100000:2.0:1746129750.097098:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3298:x1830949053296896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129750.097141:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10860 00000100:00100000:2.0:1746129750.097145:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3298:x1830949053296512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129750.097160:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3298:x1830949053296384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (261us total) trans 21474840285 rc 0/0 00000100:00100000:0.0:1746129750.097165:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10858 00000100:00100000:0.0:1746129750.097173:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10861 00000100:00100000:0.0:1746129750.097177:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3298:x1830949053297024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129750.097244:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3298:x1830949053297024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (282us total) trans 21474840287 rc 0/0 00000100:00100000:0.0:1746129750.097249:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10861 00000004:00080000:0.0:1746129750.097269:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c6a00/2, rc 0, transno 21474840284 00000100:00100000:0.0:1746129750.097272:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053297280:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129750.097279:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c6d80/2, rc 0, transno 21474840282 00000100:00100000:0.0:1746129750.097281:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053296640:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129750.097286:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c5880/2, rc 0, transno 21474840283 00000100:00100000:0.0:1746129750.097288:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053297152:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129750.097613:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fbeed80/2, rc 0, transno 17179873137 00000100:00100000:3.0:1746129750.097617:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053296256:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129750.097747:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3298:x1830949053296512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 600us (802us total) trans 21474840288 rc 0/0 00000100:00100000:2.0:1746129750.097751:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10860 00000100:00100000:2.0:1746129750.097818:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3296:x1830949053296768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 823us (981us total) trans 21474840289 rc 0/0 00000100:00100000:2.0:1746129750.097822:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10856 00000004:00080000:1.0:1746129750.097827:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c5f80/2, rc 0, transno 21474840289 00000100:00100000:1.0:1746129750.097831:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053296768:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129750.097836:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c6680/2, rc 0, transno 21474840288 00000100:00100000:2.0:1746129750.097839:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053296512:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129750.097845:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c5500/2, rc 0, transno 21474840287 00000100:00100000:2.0:1746129750.097861:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053297024:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129750.097868:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c6300/2, rc 0, transno 21474840285 00000100:00100000:2.0:1746129750.097870:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053296384:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129750.097898:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746129750.097900:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746129750.097902:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746129750.097903:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746129750.097905:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746129750.097921:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3298:x1830949053296896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 823us (1001us total) trans 21474840286 rc 0/0 00000100:00100000:2.0:1746129750.097926:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10859 00000004:00080000:0.0:1746129750.097932:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c5180/2, rc 0, transno 21474840286 00000100:00100000:0.0:1746129750.097935:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053296896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129750.099487:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129750.100052:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052162176 00000100:00100000:2.0:1746129750.100185:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052162176 00000100:00100000:2.0:1746129750.100419:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9853 00000100:00100000:2.0:1746129750.100440:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6141239f-0c60-480d-830c-e22ba61457b0+7:28556:x1830949052162176:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129750.100458:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129750.100472:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095345e00/0x48868a4e43949279 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f475 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.100515:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095345e00/0x48868a4e43949279 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f475 expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.100526:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095345e00/0x48868a4e43949279 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f475 expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.100538:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129750.100541:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129750.100543:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095345e00, rc 0) 00000100:00100000:2.0:1746129750.100586:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6141239f-0c60-480d-830c-e22ba61457b0+8:28556:x1830949052162176:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 160us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129750.100591:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9853 00000100:00100000:0.0:1746129750.102551:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129750.102675:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052162304 00000100:00100000:2.0:1746129750.102682:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052162304 00000100:00100000:2.0:1746129750.102807:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9854 00000100:00100000:2.0:1746129750.102813:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28556:x1830949052162304:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129750.102826:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129750.102837:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095344000/0x48868a4e43949280 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f47c expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.102914:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43949287 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.102924:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43949287 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.102932:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43949287 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129750.102952:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:2.0:1746129750.102956:0:14315:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129750.102967:0:14315:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43949287 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129750.102984:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095344000/0x48868a4e43949280 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f47c expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.102996:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43949287 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f47c expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129750.103001:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129750.103003:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129750.103005:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095344200, rc 0) 00000100:00100000:2.0:1746129750.103045:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:28556:x1830949052162304:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 232us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129750.103050:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9854 00000100:00100000:0.0:1746129750.104482:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129750.104541:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129750.104693:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052162432 00000100:00100000:2.0:1746129750.104699:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052162432 00000100:00100000:2.0:1746129750.104721:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052162560 00000100:00100000:2.0:1746129750.104723:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052162560 00000100:00100000:2.0:1746129750.104739:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10862 00000100:00100000:2.0:1746129750.104745:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+6:1963:x1830949052162432:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129750.104756:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129750.104768:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff000/0x48868a4e4394928e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f483 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129750.104785:0:1140:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e8:0x0] initial LVB size: 1048576, mtime: 0x6813d356, atime: 0x6813d355, ctime: 0x6813d356, blocks: 0x807 00010000:00010000:2.0:1746129750.104798:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129750.104799:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129750.104807:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff000/0x48868a4e4394928e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f483 expref: 7 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129750.104819:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff000/0x48868a4e4394928e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f483 expref: 7 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129750.104827:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c0ff000, rc 0) 00000100:00100000:3.0:1746129750.105012:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10863 00000100:00100000:3.0:1746129750.105019:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+6:1964:x1830949052162560:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129750.105026:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129750.105036:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094b2da00/0x48868a4e43949295 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f48a expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129750.105048:0:1877:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e6:0x0] initial LVB size: 2097152, mtime: 0x6813d355, atime: 0x6813d353, ctime: 0x6813d355, blocks: 0x821 00010000:00010000:3.0:1746129750.105056:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129750.105058:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129750.105062:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094b2da00/0x48868a4e43949295 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f48a expref: 7 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129750.105075:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094b2da00/0x48868a4e43949295 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f48a expref: 7 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129750.105082:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094b2da00, rc 0) 00000100:00100000:2.0:1746129750.105142:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+7:1963:x1830949052162432:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 396us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129750.105148:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10862 00000100:00100000:3.0:1746129750.105394:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+7:1964:x1830949052162560:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 375us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129750.105399:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10863 00000100:00100000:2.0:1746129750.105683:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129750.105702:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129750.105713:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052162688 00000100:00100000:2.0:1746129750.105716:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052162688 00000100:00100000:2.0:1746129750.105729:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052162816 00000100:00100000:2.0:1746129750.105730:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052162816 00000100:00100000:2.0:1746129750.105739:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10864 00000100:00100000:2.0:1746129750.105744:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+7:1963:x1830949052162688:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129750.105749:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129750.105757:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a148800/0x48868a4e4394929c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f491 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129750.105767:0:3623:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e7:0x0] initial LVB size: 2097152, mtime: 0x6813d353, atime: 0x6813d353, ctime: 0x6813d353, blocks: 0x81f 00010000:00010000:2.0:1746129750.105774:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129750.105776:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129750.105780:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a148800/0x48868a4e4394929c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f491 expref: 8 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129750.105789:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a148800/0x48868a4e4394929c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f491 expref: 8 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129750.105795:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a148800, rc 0) 00000100:00100000:2.0:1746129750.105813:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:1963:x1830949052162688:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 69us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129750.105818:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10864 00000100:00100000:2.0:1746129750.105830:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10865 00000100:00100000:2.0:1746129750.105834:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+7:1963:x1830949052162816:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129750.105927:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129750.105935:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a149600/0x48868a4e439492a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f498 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129750.105946:0:3623:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3ea:0x0] initial LVB size: 2097152, mtime: 0x6813d353, atime: 0x6813d353, ctime: 0x6813d353, blocks: 0x821 00010000:00010000:2.0:1746129750.105953:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129750.105954:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129750.105957:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a149600/0x48868a4e439492a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f498 expref: 8 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129750.105966:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a149600/0x48868a4e439492a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f498 expref: 8 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129750.105972:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a149600, rc 0) 00000100:00100000:2.0:1746129750.105987:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:1963:x1830949052162816:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 152us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129750.105992:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10865 00000100:00100000:2.0:1746129750.106015:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129750.106226:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129750.106251:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052163072 00000100:00100000:2.0:1746129750.106253:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052163072 00000100:00100000:0.0:1746129750.106257:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052162944 00000100:00100000:0.0:1746129750.106260:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052162944 00000100:00100000:2.0:1746129750.106276:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10866 00000100:00100000:2.0:1746129750.106281:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+8:1963:x1830949052163072:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129750.106287:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129750.106294:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095345800/0x48868a4e439492aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f4a6 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129750.106387:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10867 00000100:00100000:0.0:1746129750.106392:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+8:1963:x1830949052162944:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129750.106398:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1746129750.106410:0:1140:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e8:0x0] initial LVB size: 4194304, mtime: 0x6813d356, atime: 0x6813d356, ctime: 0x6813d356, blocks: 0x1029 00010000:00010000:2.0:1746129750.106419:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129750.106420:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129750.106432:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095345800/0x48868a4e439492aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4a6 expref: 9 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129750.106443:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095345800/0x48868a4e439492aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4a6 expref: 9 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129750.106450:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095345800, rc 0) 00000100:00100000:2.0:1746129750.106468:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+9:1963:x1830949052163072:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 187us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129750.106473:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10866 00010000:00010000:0.0:1746129750.106518:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c12d600/0x48868a4e439492b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f49f expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129750.106530:0:1877:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3eb:0x0] initial LVB size: 4960928, mtime: 0x6813d356, atime: 0x6813d356, ctime: 0x6813d356, blocks: 0x1629 00010000:00010000:0.0:1746129750.106538:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129750.106539:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129750.106543:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c12d600/0x48868a4e439492b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f49f expref: 9 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129750.106550:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c12d600/0x48868a4e439492b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f49f expref: 9 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129750.106556:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c12d600, rc 0) 00000100:00100000:0.0:1746129750.106571:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+9:1963:x1830949052162944:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 179us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129750.106577:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10867 00010000:00010000:2.0:1746129751.027054:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129751.122511:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129751.122594:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052163328 00000100:00100000:1.0:1746129751.122602:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052163328 00000100:00080000:0.0:1746129751.122693:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129751.122740:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4028 00000100:00100000:1.0:1746129751.122749:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052163328:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:1.0:1746129751.122780:0:21601:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a14da00/0x48868a4e439492b8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.122790:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129751.122792:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129751.122796:0:21601:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a14da00/0x48868a4e439492b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.122806:0:21601:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a14da00/0x48868a4e439492b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129751.129918:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.130643:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.130662:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.130686:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.130718:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.130739:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052163584 00000100:00100000:0.0:1746129751.130746:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052163584 00000100:00100000:0.0:1746129751.130788:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052163840 00000100:00100000:0.0:1746129751.130791:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052163840 00000100:00100000:0.0:1746129751.130802:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052164096 00000100:00100000:0.0:1746129751.130804:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052164096 00000100:00100000:0.0:1746129751.130814:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052164352 00000100:00100000:0.0:1746129751.130816:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052164352 00000100:00100000:0.0:1746129751.130824:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052164608 00000100:00100000:0.0:1746129751.130826:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052164608 00000100:00100000:0.0:1746129751.130837:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4029 00000100:00100000:0.0:1746129751.130844:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949052163584:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:0.0:1746129751.130895:0:25617:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012ba78800/0x48868a4e439492bf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129751.130907:0:25617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129751.130909:0:25617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129751.130912:0:25617:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba78800/0x48868a4e439492bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129751.130923:0:25617:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba78800/0x48868a4e439492bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129751.132056:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4030 00000100:00100000:0.0:1746129751.132065:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6141239f-0c60-480d-830c-e22ba61457b0+12:1963:x1830949052163840:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:0.0:1746129751.132085:0:21602:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a8f0ca00/0x48868a4e439492c6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129751.132094:0:21602:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129751.132096:0:21602:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129751.132099:0:21602:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8f0ca00/0x48868a4e439492c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129751.132107:0:21602:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8f0ca00/0x48868a4e439492c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129751.134086:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4031 00000100:00100000:0.0:1746129751.134097:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6141239f-0c60-480d-830c-e22ba61457b0+12:1963:x1830949052164096:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:0.0:1746129751.134125:0:21600:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a8f0de00/0x48868a4e439492cd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129751.134136:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129751.134138:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129751.134141:0:21600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8f0de00/0x48868a4e439492cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129751.134151:0:21600:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8f0de00/0x48868a4e439492cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129751.135301:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4032 00000100:00100000:2.0:1746129751.135310:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6141239f-0c60-480d-830c-e22ba61457b0+12:1963:x1830949052164352:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:2.0:1746129751.135331:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095344000/0x48868a4e439492d4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.135338:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129751.135340:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129751.135342:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095344000/0x48868a4e439492d4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.135351:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095344000/0x48868a4e439492d4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129751.136449:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4033 00000100:00100000:2.0:1746129751.136457:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6141239f-0c60-480d-830c-e22ba61457b0+13:1963:x1830949052164608:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:2.0:1746129751.136478:0:21599:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a149800/0x48868a4e439492db lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.136486:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129751.136488:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129751.136491:0:21599:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a149800/0x48868a4e439492db lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.136498:0:21599:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a149800/0x48868a4e439492db lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746129751.137026:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746129751.140525:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.140561:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129751.141217:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052164864 00000100:00100000:1.0:1746129751.141225:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052164864 00000100:00100000:3.0:1746129751.141262:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052165120 00000100:00100000:3.0:1746129751.141267:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052165120 00000100:00100000:1.0:1746129751.141270:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4034 00000100:00100000:1.0:1746129751.141276:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6141239f-0c60-480d-830c-e22ba61457b0+15:1963:x1830949052164864:12345-192.168.204.31@tcp:3:mirror_io.0 00000100:00100000:3.0:1746129751.141291:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4035 00000100:00100000:3.0:1746129751.141296:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6141239f-0c60-480d-830c-e22ba61457b0+15:1963:x1830949052165120:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:1.0:1746129751.141305:0:8440:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a14ca00/0x48868a4e439492e2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.141312:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094b2ce00/0x48868a4e439492e9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.141318:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129751.141319:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129751.141320:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129751.141321:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129751.141325:0:8440:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a14ca00/0x48868a4e439492e2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.141328:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094b2ce00/0x48868a4e439492e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.141335:0:8440:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a14ca00/0x48868a4e439492e2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.141336:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094b2ce00/0x48868a4e439492e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.157372:0:21601:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a14da00/0x48868a4e439492b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.157387:0:21601:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a14da00/0x48868a4e439492b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.157398:0:21601:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a14da00/0x48868a4e439492b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.157403:0:21601:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a14da00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129751.157417:0:21601:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a14da00/0x48868a4e439492b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.157432:0:21601:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a14da00/0x48868a4e439492b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.157447:0:21601:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a14da00/0x48868a4e439492b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.157451:0:21601:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a14da00/0x48868a4e439492b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129751.157546:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052163328:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 34795us (35038us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129751.157555:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4028 00010000:00010000:0.0:1746129751.163867:0:25617:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012ba78800/0x48868a4e439492bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129751.163881:0:25617:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba78800/0x48868a4e439492bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129751.163888:0:25617:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ba78800/0x48868a4e439492bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129751.163894:0:25617:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ba78800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129751.163898:0:25617:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ba78800/0x48868a4e439492bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129751.163905:0:25617:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ba78800/0x48868a4e439492bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129751.163920:0:25617:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ba78800/0x48868a4e439492bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129751.163932:0:25617:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba78800/0x48868a4e439492bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129751.164032:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6141239f-0c60-480d-830c-e22ba61457b0+15:1963:x1830949052163584:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 33184us (34118us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129751.164041:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4029 00010000:00010000:2.0:1746129751.175346:0:21602:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a8f0ca00/0x48868a4e439492c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.175359:0:21602:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8f0ca00/0x48868a4e439492c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.175366:0:21602:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8f0ca00/0x48868a4e439492c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.175372:0:21602:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8f0ca00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129751.175375:0:21602:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8f0ca00/0x48868a4e439492c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.175381:0:21602:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8f0ca00/0x48868a4e439492c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.175396:0:21602:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8f0ca00/0x48868a4e439492c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.175418:0:21602:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8f0ca00/0x48868a4e439492c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129751.175506:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6141239f-0c60-480d-830c-e22ba61457b0+13:1963:x1830949052163840:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 43439us (44860us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129751.175514:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4030 00010000:00010000:2.0:1746129751.179663:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095344000/0x48868a4e439492d4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.179676:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095344000/0x48868a4e439492d4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.179683:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095344000/0x48868a4e439492d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.179688:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095344000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129751.179692:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095344000/0x48868a4e439492d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.179699:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095344000/0x48868a4e439492d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.179714:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095344000/0x48868a4e439492d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.179720:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095344000/0x48868a4e439492d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129751.179789:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6141239f-0c60-480d-830c-e22ba61457b0+13:1963:x1830949052164352:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 44478us (49098us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129751.179797:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4032 00010000:00010000:1.0:1746129751.184925:0:21600:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a8f0de00/0x48868a4e439492cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.184938:0:21600:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8f0de00/0x48868a4e439492cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.184945:0:21600:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a8f0de00/0x48868a4e439492cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.184955:0:21600:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8f0de00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129751.184958:0:21600:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a8f0de00/0x48868a4e439492cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.184964:0:21600:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a8f0de00/0x48868a4e439492cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.184977:0:21600:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a8f0de00/0x48868a4e439492cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.184982:0:21600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8f0de00/0x48868a4e439492cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129751.185043:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949052164096:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 50946us (54376us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129751.185051:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4031 00010000:00010000:2.0:1746129751.190731:0:21599:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a149800/0x48868a4e439492db lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.190744:0:21599:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a149800/0x48868a4e439492db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.190751:0:21599:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a149800/0x48868a4e439492db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.190757:0:21599:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a149800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129751.190760:0:21599:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a149800/0x48868a4e439492db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.190766:0:21599:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a149800/0x48868a4e439492db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.190781:0:21599:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a149800/0x48868a4e439492db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.190786:0:21599:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a149800/0x48868a4e439492db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129751.192743:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949052164608:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 56279us (62016us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129751.192755:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4033 00010000:00010000:1.0:1746129751.197837:0:8440:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a14ca00/0x48868a4e439492e2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.197863:0:8440:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a14ca00/0x48868a4e439492e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.197871:0:8440:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a14ca00/0x48868a4e439492e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.197877:0:8440:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a14ca00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129751.197881:0:8440:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a14ca00/0x48868a4e439492e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.197888:0:8440:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a14ca00/0x48868a4e439492e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.197903:0:8440:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a14ca00/0x48868a4e439492e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.197909:0:8440:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a14ca00/0x48868a4e439492e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129751.197996:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6141239f-0c60-480d-830c-e22ba61457b0+9:1963:x1830949052164864:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 56716us (57473us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129751.198003:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4034 00010000:00010000:3.0:1746129751.204169:0:8441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094b2ce00/0x48868a4e439492e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.204183:0:8441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094b2ce00/0x48868a4e439492e9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.204190:0:8441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094b2ce00/0x48868a4e439492e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.204197:0:8441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094b2ce00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129751.204200:0:8441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094b2ce00/0x48868a4e439492e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.204207:0:8441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094b2ce00/0x48868a4e439492e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.204227:0:8441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094b2ce00/0x48868a4e439492e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.204233:0:8441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094b2ce00/0x48868a4e439492e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129751.204320:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:1963:x1830949052165120:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 63019us (63753us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129751.204329:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4035 00000100:00100000:0.0:1746129751.213038:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129751.213119:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052165248 00000100:00100000:1.0:1746129751.213128:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052165248 00000100:00100000:1.0:1746129751.213381:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 567 00000100:00100000:1.0:1746129751.213389:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:28556:x1830949052165248:12345-192.168.204.31@tcp:103:mirror_io.0 00010000:00010000:1.0:1746129751.213401:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129751.213430:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c12ca00/0x48868a4e43949233 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f467 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.213458:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129751.213462:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129751.213495:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28556:x1830949052165248:12345-192.168.204.31@tcp:103:mirror_io.0 Request processed in 107us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129751.213501:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 567 00000100:00100000:0.0:1746129751.215137:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.215240:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052165504 00000100:00100000:2.0:1746129751.215245:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052165504 00000100:00100000:2.0:1746129751.215278:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3867 00000100:00100000:2.0:1746129751.215283:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+8:28556:x1830949052165504:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:2.0:1746129751.215905:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:28556:x1830949052165504:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 619us (770us total) trans 8589943634 rc 0/0 00000100:00100000:2.0:1746129751.215911:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3867 00000100:00100000:1.0:1746129751.217209:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.217295:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052165760 00000100:00100000:2.0:1746129751.217300:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052165760 00000100:00100000:2.0:1746129751.217331:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3868 00000100:00100000:2.0:1746129751.217337:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:28556:x1830949052165760:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:2.0:1746129751.217482:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6141239f-0c60-480d-830c-e22ba61457b0+10:28556:x1830949052165760:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 144us (275us total) trans 8589943635 rc 0/0 00000100:00100000:2.0:1746129751.217488:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3868 00000100:00100000:0.0:1746129751.246191:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.246662:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052166016 00000100:00100000:2.0:1746129751.246670:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052166016 00000100:00080000:0.0:1746129751.246929:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746129751.247129:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9855 00000100:00100000:2.0:1746129751.247138:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:28565:x1830949052166016:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129751.247158:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129751.247173:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0e000/0x48868a4e439492f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f4ad expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.247258:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a540e400/0x48868a4e439492f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.247271:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a540e400/0x48868a4e439492f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.247281:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a540e400/0x48868a4e439492f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.247292:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009378d200/0x48868a4e439492fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.247297:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009378d200/0x48868a4e439492fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.247301:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009378d200/0x48868a4e439492fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.247379:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009378da00/0x48868a4e43949305 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.247385:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009378da00/0x48868a4e43949305 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.247390:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009378da00/0x48868a4e43949305 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:2.0:1746129751.247396:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129751.247480:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a540e400/0x48868a4e439492f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.247486:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a540e400/0x48868a4e439492f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.247491:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a540e400/0x48868a4e439492f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.247498:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a540e400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129751.247501:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a540e400/0x48868a4e439492f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.247506:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a540e400/0x48868a4e439492f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.247513:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129751.247516:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129751.247518:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a540e400/0x48868a4e439492f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.247522:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a540e400/0x48868a4e439492f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.247988:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009378d200/0x48868a4e439492fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.247994:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009378d200/0x48868a4e439492fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.247998:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009378d200/0x48868a4e439492fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.248002:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009378d200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129751.248005:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009378d200/0x48868a4e439492fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.248009:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009378d200/0x48868a4e439492fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.248016:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e2d8a00) 00010000:00010000:2.0:1746129751.248018:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129751.248021:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009378d200/0x48868a4e439492fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.248025:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009378d200/0x48868a4e439492fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.248055:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0e000/0x48868a4e439492f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4ad expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.248078:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009378da00/0x48868a4e43949305 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4ad expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.248083:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129751.248085:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129751.248086:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009378da00, rc 0) 00000100:00100000:2.0:1746129751.248141:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28565:x1830949052166016:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1004us (1956us total) trans 8589943636 rc 0/0 00000100:00100000:2.0:1746129751.248146:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9855 00000100:00100000:0.0:1746129751.249807:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.251090:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052166272 00000100:00100000:2.0:1746129751.251098:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052166272 00000100:00100000:2.0:1746129751.251149:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9856 00000100:00100000:2.0:1746129751.251155:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+281:28569:x1830949052166272:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129751.251173:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129751.251186:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009378de00/0x48868a4e43949313 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f4b4 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.251271:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009378dc00/0x48868a4e4394931a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.251280:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009378dc00/0x48868a4e4394931a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.251288:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009378dc00/0x48868a4e4394931a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.251298:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949321 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.251302:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949321 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.251307:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949321 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.251379:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef3a00/0x48868a4e43949328 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.251384:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef3a00/0x48868a4e43949328 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.251389:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef3a00/0x48868a4e43949328 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:2.0:1746129751.251395:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000100:00080000:1.0:1746129751.251516:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746129751.252244:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009378dc00/0x48868a4e4394931a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.252250:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009378dc00/0x48868a4e4394931a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.252258:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009378dc00/0x48868a4e4394931a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.252262:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009378dc00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129751.252265:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009378dc00/0x48868a4e4394931a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.252271:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009378dc00/0x48868a4e4394931a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.252279:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129751.252281:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129751.252283:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009378dc00/0x48868a4e4394931a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.252288:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009378dc00/0x48868a4e4394931a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.252297:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949321 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.252301:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949321 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.252305:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949321 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.252308:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a0fe00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129751.252310:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949321 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.252313:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949321 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.252317:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e2d8900) 00010000:00010000:2.0:1746129751.252318:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129751.252320:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949321 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.252323:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949321 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.252355:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009378de00/0x48868a4e43949313 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4b4 expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.252363:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef3a00/0x48868a4e43949328 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4b4 expref: 283 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.252368:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129751.252370:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129751.252372:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ef3a00, rc 0) 00000100:00100000:2.0:1746129751.252432:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28569:x1830949052166272:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1276us (2628us total) trans 8589943637 rc 0/0 00000100:00100000:2.0:1746129751.252438:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9856 00000100:00100000:0.0:1746129751.254715:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.255251:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129751.255814:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052166400 00000100:00100000:1.0:1746129751.255821:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052166400 00000100:00100000:1.0:1746129751.255868:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052166528 00000100:00100000:1.0:1746129751.255870:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052166528 00000100:00100000:0.0:1746129751.255988:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129751.256388:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052166656 00000100:00100000:1.0:1746129751.256391:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052166656 00000100:00100000:1.0:1746129751.256418:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10868 00000100:00100000:1.0:1746129751.256424:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1963:x1830949052166400:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129751.256439:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129751.256454:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f400/0x48868a4e43949336 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f4bb expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.256472:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129751.256474:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129751.256481:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f400/0x48868a4e43949336 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4bb expref: 12 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129751.256494:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f400/0x48868a4e43949336 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4bb expref: 12 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129751.256504:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d6f400, rc 0) 00000100:00100000:1.0:1746129751.256539:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1963:x1830949052166400:12345-192.168.204.31@tcp:101:cat.0 Request processed in 115us (1832us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129751.256544:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10868 00000100:00100000:1.0:1746129751.256558:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10869 00000100:00100000:1.0:1746129751.256562:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1963:x1830949052166528:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129751.256570:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129751.256578:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6ea00/0x48868a4e4394933d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f4c2 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.256587:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129751.256588:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129751.256592:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6ea00/0x48868a4e4394933d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4c2 expref: 11 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129751.256602:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6ea00/0x48868a4e4394933d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4c2 expref: 11 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129751.256608:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d6ea00, rc 0) 00000100:00100000:1.0:1746129751.256624:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1963:x1830949052166528:12345-192.168.204.31@tcp:101:cat.0 Request processed in 61us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129751.256628:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10869 00000100:00100000:1.0:1746129751.256637:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10870 00000100:00100000:1.0:1746129751.256641:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1963:x1830949052166656:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129751.256646:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129751.256651:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f000/0x48868a4e43949344 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f4c9 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.256659:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129751.256661:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129751.256664:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f000/0x48868a4e43949344 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4c9 expref: 11 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129751.256672:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f000/0x48868a4e43949344 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4c9 expref: 11 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129751.256678:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d6f000, rc 0) 00000100:00100000:1.0:1746129751.256691:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1963:x1830949052166656:12345-192.168.204.31@tcp:101:cat.0 Request processed in 50us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129751.256695:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10870 00000100:00080000:1.0:1746129751.256708:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746129751.256710:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746129751.260071:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.260089:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052166784 00000100:00100000:3.0:1746129751.260095:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052166784 00000100:00100000:3.0:1746129751.260121:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10871 00000100:00100000:3.0:1746129751.260127:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1963:x1830949052166784:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129751.260143:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129751.260155:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094b2ce00/0x48868a4e4394934b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f4d0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.260173:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129751.260175:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129751.260182:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094b2ce00/0x48868a4e4394934b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4d0 expref: 13 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129751.260194:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094b2ce00/0x48868a4e4394934b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4d0 expref: 13 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129751.260209:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094b2ce00, rc 0) 00000100:00100000:3.0:1746129751.260240:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1963:x1830949052166784:12345-192.168.204.31@tcp:101:cat.0 Request processed in 113us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129751.260246:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10871 00000100:00100000:3.0:1746129751.260274:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.260285:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052166912 00000100:00100000:3.0:1746129751.260287:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052166912 00000100:00100000:3.0:1746129751.260299:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10872 00000100:00100000:3.0:1746129751.260303:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1963:x1830949052166912:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129751.260309:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129751.260315:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094b2d400/0x48868a4e43949352 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f4d7 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.260323:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129751.260325:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129751.260329:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094b2d400/0x48868a4e43949352 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4d7 expref: 14 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129751.260336:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094b2d400/0x48868a4e43949352 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4d7 expref: 14 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129751.260342:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094b2d400, rc 0) 00000100:00100000:3.0:1746129751.260356:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1963:x1830949052166912:12345-192.168.204.31@tcp:101:cat.0 Request processed in 53us (82us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129751.260361:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10872 00000100:00100000:3.0:1746129751.260430:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.260442:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052167040 00000100:00100000:3.0:1746129751.260445:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052167040 00000100:00100000:3.0:1746129751.260458:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10873 00000100:00100000:3.0:1746129751.260462:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1963:x1830949052167040:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129751.260468:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129751.260476:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094b2d600/0x48868a4e43949359 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f4de expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.260492:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129751.260493:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129751.260497:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094b2d600/0x48868a4e43949359 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4de expref: 12 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129751.260505:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094b2d600/0x48868a4e43949359 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4de expref: 12 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129751.260512:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094b2d600, rc 0) 00000100:00100000:3.0:1746129751.260527:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1963:x1830949052167040:12345-192.168.204.31@tcp:101:cat.0 Request processed in 64us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129751.260531:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10873 00000100:00100000:3.0:1746129751.260579:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.260597:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052167296 00000100:00100000:3.0:1746129751.260600:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052167296 00000100:00100000:3.0:1746129751.260616:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9857 00000100:00100000:3.0:1746129751.260620:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28565:x1830949052167296:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129751.260630:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129751.260632:0:14313:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746129751.260647:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009378da00/0x48868a4e43949305 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4ad expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129751.260656:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129751.260662:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129751.260665:0:14313:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129751.260668:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052167424 00010000:00010000:3.0:1746129751.260672:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283800/0x48868a4e43949360 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f4e5 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129751.260672:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052167424 00000100:00100000:0.0:1746129751.260693:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10874 00000100:00100000:0.0:1746129751.260698:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949052167424:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129751.260705:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129751.260706:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238c00/0x48868a4e43949367 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129751.260713:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4000/0x48868a4e4394936e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f4ec expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.260716:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095345e00/0x48868a4e43949279 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f475 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.260722:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43949287 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f47c expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.260728:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef3a00/0x48868a4e43949328 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4b4 expref: 282 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129751.260730:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129751.260732:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238c00/0x48868a4e43949367 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129751.260732:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129751.260736:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4000/0x48868a4e4394936e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4ec expref: 24 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129751.260746:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4000/0x48868a4e4394936e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4ec expref: 24 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129751.260753:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef3a00/0x48868a4e43949328 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4b4 expref: 282 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129751.260753:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b22c4000, rc 0) 00010000:00010000:3.0:1746129751.260763:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef3a00/0x48868a4e43949328 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4b4 expref: 282 pid: 14313 timeout: 797 lvb_type: 0 00000100:00100000:3.0:1746129751.260772:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053297408:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129751.260772:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052167424:12345-192.168.204.31@tcp:101:cat.0 Request processed in 73us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129751.260777:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10874 00010000:00010000:3.0:1746129751.260822:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43949287 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f47c expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.260828:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43949287 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f47c expref: 9 pid: 14315 timeout: 797 lvb_type: 0 00000100:00080000:0.0:1746129751.260831:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746129751.260834:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b026680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053297536:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129751.260883:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095345e00/0x48868a4e43949279 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f475 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.260889:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095345e00/0x48868a4e43949279 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f475 expref: 9 pid: 14313 timeout: 797 lvb_type: 0 00000100:00100000:3.0:1746129751.260895:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b024700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053297664:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129751.260935:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129751.267191:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.267239:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.267268:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.267288:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.267313:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052167552 00000100:00100000:0.0:1746129751.267319:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052167552 00000100:00100000:0.0:1746129751.267356:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052167808 00000100:00100000:0.0:1746129751.267358:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052167808 00000100:00100000:0.0:1746129751.267368:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052167680 00000100:00100000:0.0:1746129751.267370:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052167680 00000100:00100000:0.0:1746129751.267380:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10875 00000100:00100000:0.0:1746129751.267387:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949052167552:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129751.267403:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129751.267426:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5200/0x48868a4e43949375 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f4f3 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129751.267443:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129751.267445:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129751.267452:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5200/0x48868a4e43949375 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4f3 expref: 14 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129751.267464:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5200/0x48868a4e43949375 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4f3 expref: 14 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129751.267474:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b22c5200, rc 0) 00000100:00100000:0.0:1746129751.267506:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1962:x1830949052167552:12345-192.168.204.31@tcp:101:cat.0 Request processed in 120us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129751.267511:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10875 00000100:00100000:0.0:1746129751.267523:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10876 00000100:00100000:0.0:1746129751.267527:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052167808:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129751.267533:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129751.267541:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4600/0x48868a4e4394937c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f501 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129751.267550:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129751.267551:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129751.267555:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4600/0x48868a4e4394937c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f501 expref: 25 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129751.267563:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4600/0x48868a4e4394937c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f501 expref: 25 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129751.267568:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b22c4600, rc 0) 00000100:00100000:0.0:1746129751.267581:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949052167808:12345-192.168.204.31@tcp:101:cat.0 Request processed in 53us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129751.267585:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10876 00000100:00100000:0.0:1746129751.267594:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10877 00000100:00100000:0.0:1746129751.267597:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949052167680:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129751.267608:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129751.267615:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4c00/0x48868a4e43949383 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f4fa expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129751.267623:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129751.267625:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129751.267628:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4c00/0x48868a4e43949383 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4fa expref: 14 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129751.267635:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4c00/0x48868a4e43949383 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4fa expref: 14 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129751.267641:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b22c4c00, rc 0) 00000100:00100000:0.0:1746129751.267654:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1962:x1830949052167680:12345-192.168.204.31@tcp:101:cat.0 Request processed in 56us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129751.267658:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10877 00000100:00080000:0.0:1746129751.267673:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746129751.267912:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052168064 00000100:00100000:2.0:1746129751.267916:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052168064 00000100:00100000:2.0:1746129751.267936:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9858 00000100:00100000:2.0:1746129751.267941:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28566:x1830949052168064:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129751.267953:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129751.267962:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef2a00/0x48868a4e4394938a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f50f expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.268034:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949391 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129751.268044:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949391 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129751.268051:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949391 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:2.0:1746129751.270124:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.270203:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053297408:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129751.270269:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052168320 00000100:00100000:3.0:1746129751.270273:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052168320 00000100:00100000:3.0:1746129751.270303:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9859 00000100:00100000:3.0:1746129751.270310:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28571:x1830949052168320:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129751.270323:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129751.270334:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013558be00/0x48868a4e43949398 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f516 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.270374:0:14314:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238c00/0x48868a4e43949367 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.270381:0:14314:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013558be00/0x48868a4e43949398 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f516 expref: 11 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.270396:0:14314:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238c00/0x48868a4e43949367 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.270416:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013558be00/0x48868a4e43949398 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f516 expref: 11 pid: 14314 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129751.271330:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.271348:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.271651:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052168576 00000100:00100000:2.0:1746129751.271656:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052168576 00010000:00010000:2.0:1746129751.271677:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43949287 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f47c expref: 10 pid: 14315 timeout: 797 lvb_type: 0 00000100:00100000:2.0:1746129751.271695:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5223 00000100:00100000:2.0:1746129751.271701:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949052168576:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129751.271709:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129751.271714:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43949287 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f47c expref: 10 pid: 14315 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746129751.271723:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43949287 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f47c expref: 10 pid: 14315 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746129751.271739:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129751.271743:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949391 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129751.271750:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238c00/0x48868a4e43949367 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.271755:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949391 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129751.271758:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238c00/0x48868a4e43949367 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.271766:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129751.271799:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949052168576:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 97us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129751.271805:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5223 00010000:00010000:2.0:1746129751.271834:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095344200/0x48868a4e43949287 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f47c expref: 9 pid: 14315 timeout: 797 lvb_type: 0 00010000:00010000:3.0:1746129751.271877:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129751.271880:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129751.271882:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238c00/0x48868a4e43949367 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.271887:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013558be00, rc 0) 00000100:00100000:3.0:1746129751.271905:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28571:x1830949052168320:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1596us (1787us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129751.271910:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9859 00000100:00100000:3.0:1746129751.271930:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052168192 00000100:00100000:3.0:1746129751.271933:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052168192 00000100:00100000:3.0:1746129751.272275:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10878 00000100:00100000:3.0:1746129751.272280:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949052168192:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129751.272291:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129751.272300:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013558b000/0x48868a4e4394939f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f508 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.272312:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129751.272314:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129751.272319:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013558b000/0x48868a4e4394939f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f508 expref: 26 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129751.272334:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013558b000/0x48868a4e4394939f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f508 expref: 26 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129751.272341:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013558b000, rc 0) 00000100:00100000:3.0:1746129751.272353:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949052168192:12345-192.168.204.31@tcp:101:cat.0 Request processed in 73us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129751.272357:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10878 00000100:00100000:2.0:1746129751.273013:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b026680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053297536:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129751.273029:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b024700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053297664:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129751.273047:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238c00/0x48868a4e43949367 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 00000100:00100000:0.0:1746129751.273155:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.273181:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.273214:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.273260:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052168704 00000100:00100000:2.0:1746129751.273264:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052168704 00010000:00010000:2.0:1746129751.273276:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095345e00/0x48868a4e43949279 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f475 expref: 9 pid: 14313 timeout: 797 lvb_type: 0 00000100:00100000:2.0:1746129751.273290:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052168448 00000100:00100000:2.0:1746129751.273291:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052168448 00010000:00010000:2.0:1746129751.273298:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef3a00/0x48868a4e43949328 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4b4 expref: 285 pid: 14313 timeout: 797 lvb_type: 0 00000100:00100000:2.0:1746129751.273310:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5224 00000100:00100000:2.0:1746129751.273316:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+9:1964:x1830949052168704:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129751.273322:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129751.273326:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095345e00/0x48868a4e43949279 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f475 expref: 9 pid: 14313 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746129751.273335:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095345e00/0x48868a4e43949279 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f475 expref: 9 pid: 14313 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746129751.273346:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095345e00/0x48868a4e43949279 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f475 expref: 9 pid: 14313 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746129751.273366:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129751.273369:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949391 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129751.273374:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238c00/0x48868a4e43949367 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.273377:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949391 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129751.273381:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238c00/0x48868a4e43949367 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.273385:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129751.273401:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+8:1964:x1830949052168704:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 85us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129751.273418:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5224 00000100:00100000:2.0:1746129751.273428:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5225 00000100:00100000:2.0:1746129751.273432:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8e0d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:1962:x1830949052168448:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129751.273438:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129751.273442:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef3a00/0x48868a4e43949328 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4b4 expref: 285 pid: 14313 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746129751.273453:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef3a00/0x48868a4e43949328 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4b4 expref: 285 pid: 14313 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746129751.273462:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef3a00/0x48868a4e43949328 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4b4 expref: 285 pid: 14313 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746129751.273469:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129751.273472:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949391 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129751.273477:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949391 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129751.273482:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949391 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129751.273487:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238c00/0x48868a4e43949367 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.273492:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238c00/0x48868a4e43949367 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.273496:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238c00/0x48868a4e43949367 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.273502:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88013558be00/0x48868a4e43949398 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f516 expref: 10 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.273517:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129751.273532:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8e0d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:1962:x1830949052168448:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 98us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129751.273540:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5225 00010000:00010000:2.0:1746129751.273573:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949391 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129751.273579:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949391 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129751.273593:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129751.273700:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef2a00/0x48868a4e4394938a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f50f expref: 285 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.273711:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949391 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f50f expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.273716:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129751.273718:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129751.273719:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a0fe00, rc 0) 00000100:00100000:2.0:1746129751.273740:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28566:x1830949052168064:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5799us (6557us total) trans 8589943638 rc 0/0 00000100:00100000:2.0:1746129751.273744:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9858 00010000:00010000:2.0:1746129751.273826:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238c00/0x48868a4e43949367 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.273832:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238c00/0x48868a4e43949367 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 00000040:00080000:2.0:1746129751.274298:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2814, 88 off234480 00000004:00080000:2.0:1746129751.274305:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 697332456710ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129751.274340:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2749, 88 off228840 00000004:00080000:2.0:1746129751.274344:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 697332496391ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129751.274364:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2750, 88 off228928 00000004:00080000:2.0:1746129751.274367:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 697332519125ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129751.274373:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2815, 88 off234568 00000004:00080000:2.0:1746129751.274375:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 697332527481ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129751.274381:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2816, 88 off234656 00000004:00080000:2.0:1746129751.274383:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 697332535275ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129751.274389:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2751, 88 off229016 00000004:00080000:2.0:1746129751.274391:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 697332543643ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129751.274397:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2752, 88 off229104 00000004:00080000:2.0:1746129751.274399:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 697332551505ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129751.274416:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2753, 88 off229192 00000004:00080000:2.0:1746129751.274419:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 697332571700ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129751.274427:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2817, 88 off234744 00000004:00080000:2.0:1746129751.274429:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 697332581285ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129751.274435:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2754, 88 off229280 00000004:00080000:2.0:1746129751.274437:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 697332588838ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129751.274442:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2818, 88 off234832 00000004:00080000:2.0:1746129751.274444:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 697332595876ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129751.274472:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2756, 88 off229464 00000004:00080000:2.0:1746129751.274475:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 697332627081ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129751.274483:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2819, 88 off234920 00000004:00080000:2.0:1746129751.274485:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 697332637235ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129751.274491:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2820, 88 off235008 00000004:00080000:2.0:1746129751.274493:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 697332645580ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129751.274500:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2821, 88 off235096 00000004:00080000:2.0:1746129751.274502:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 697332654439ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129751.274508:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2822, 88 off235184 00000004:00080000:2.0:1746129751.274511:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 697332662768ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129751.274517:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2757, 88 off229552 00000004:00080000:2.0:1746129751.274519:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 697332670785ns, next at 641623252291ns, rc = 0 00000100:00100000:2.0:1746129751.274841:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052168832 00000100:00100000:2.0:1746129751.274869:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052168832 00000100:00100000:2.0:1746129751.274891:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10879 00000100:00100000:2.0:1746129751.274897:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949052168832:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129751.274908:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129751.274918:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f96fe00/0x48868a4e439493ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f51d expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.274932:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129751.274934:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129751.274940:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f96fe00/0x48868a4e439493ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f51d expref: 15 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129751.274951:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f96fe00/0x48868a4e439493ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f51d expref: 15 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129751.274958:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f96fe00, rc 0) 00000100:00100000:2.0:1746129751.274978:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949052168832:12345-192.168.204.31@tcp:101:cat.0 Request processed in 81us (1795us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129751.274982:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10879 00000100:00100000:2.0:1746129751.281940:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.282075:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052168960 00000100:00100000:3.0:1746129751.282082:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052168960 00000100:00100000:3.0:1746129751.282114:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9860 00000100:00100000:3.0:1746129751.282120:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28569:x1830949052168960:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129751.282139:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129751.282153:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013558b400/0x48868a4e439493b4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f524 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.282197:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013558b400/0x48868a4e439493b4 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f524 expref: 285 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.282206:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013558b400/0x48868a4e439493b4 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f524 expref: 285 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.282215:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129751.282218:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129751.282220:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88013558be00/0x48868a4e43949398 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f516 expref: 11 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.282230:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013558b400, rc 0) 00000100:00100000:3.0:1746129751.282268:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28569:x1830949052168960:12345-192.168.204.31@tcp:101:cat.0 Request processed in 147us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129751.282273:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9860 00000001:00080000:1.0:1746129751.311155:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943639 is committed 00000004:00080000:1.0:1746129751.311165:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1942 committed 00000004:00080000:1.0:1746129751.311172:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2004 committed 00000004:00080000:1.0:1746129751.311177:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2003 committed 00000004:00080000:1.0:1746129751.311178:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2002 committed 00000004:00080000:1.0:1746129751.311180:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2001 committed 00000004:00080000:1.0:1746129751.311181:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1941 committed 00000004:00080000:1.0:1746129751.311182:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2000 committed 00000004:00080000:1.0:1746129751.311184:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1940 committed 00000004:00080000:1.0:1746129751.311185:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1999 committed 00000004:00080000:1.0:1746129751.311186:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1939 committed 00000004:00080000:1.0:1746129751.311188:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1938 committed 00000004:00080000:1.0:1746129751.311189:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1937 committed 00000004:00080000:1.0:1746129751.311191:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1998 committed 00000004:00080000:1.0:1746129751.311192:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1997 committed 00000004:00080000:1.0:1746129751.311193:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1936 committed 00000004:00080000:1.0:1746129751.311195:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1935 committed 00000004:00080000:1.0:1746129751.311196:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1996 committed 00000001:00080000:1.0:1746129751.311201:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943638 is committed 00000001:00080000:1.0:1746129751.311207:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943635 is committed 00000100:00100000:1.0:1746129751.311345:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053297792:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129751.311395:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129751.311438:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053298304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129751.311454:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129751.311470:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746129751.311475:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053297920:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129751.311488:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129751.311497:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053298432:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129751.311510:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129751.311524:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053298048:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129751.311536:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129751.311546:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053298560:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129751.311558:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129751.311568:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746129751.311572:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053298176:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129751.311584:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129751.311593:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053298688:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129751.311604:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129751.311621:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053297792 00000100:00100000:1.0:1746129751.311626:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053297792 00000100:00100000:1.0:1746129751.311657:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053298304 00000100:00100000:1.0:1746129751.311659:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053298304 00000100:00100000:1.0:1746129751.311668:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053297920 00000100:00100000:1.0:1746129751.311669:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053297920 00000100:00100000:1.0:1746129751.311677:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053298432 00000100:00100000:1.0:1746129751.311679:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053298432 00000100:00100000:1.0:1746129751.311685:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053298048 00000100:00100000:1.0:1746129751.311687:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053298048 00000100:00100000:1.0:1746129751.311692:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053298560 00000100:00100000:1.0:1746129751.311693:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053298560 00000100:00100000:1.0:1746129751.311698:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053298176 00000100:00100000:1.0:1746129751.311699:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053298176 00000100:00100000:1.0:1746129751.311704:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053298688 00000100:00100000:1.0:1746129751.311705:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053298688 00000100:00100000:1.0:1746129751.311713:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10880 00000100:00100000:1.0:1746129751.311719:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3298:x1830949053297792:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129751.311886:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129751.311890:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129749 -> 1746129749 00002000:00010000:1.0:1746129751.311892:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129747 -> 1746129747 00002000:00010000:1.0:1746129751.311894:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129749 -> 1746129749 00002000:00010000:1.0:1746129751.311895:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129751.311920:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949053297792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 201us (524us total) trans 21474840290 rc 0/0 00000100:00100000:1.0:1746129751.311925:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10880 00000100:00100000:1.0:1746129751.311937:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10881 00000100:00100000:1.0:1746129751.311941:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3298:x1830949053298304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129751.312004:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746129751.312006:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746129751.312008:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746129751.312009:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746129751.312010:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129751.312027:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949053298304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (571us total) trans 21474840291 rc 0/0 00000100:00100000:1.0:1746129751.312031:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10881 00000100:00100000:1.0:1746129751.312044:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10882 00000100:00100000:1.0:1746129751.312047:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3298:x1830949053297920:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129751.312119:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129751.312122:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129747 -> 1746129747 00002000:00010000:1.0:1746129751.312124:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129747 -> 1746129747 00002000:00010000:1.0:1746129751.312125:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129747 -> 1746129747 00002000:00010000:1.0:1746129751.312127:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746129751.312143:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949053297920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (654us total) trans 21474840292 rc 0/0 00000100:00100000:1.0:1746129751.312147:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10882 00000100:00100000:1.0:1746129751.312156:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10883 00000100:00100000:1.0:1746129751.312160:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3298:x1830949053298432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129751.312223:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949053298432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (712us total) trans 21474840293 rc 0/0 00000100:00100000:1.0:1746129751.312228:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10883 00000100:00100000:1.0:1746129751.312237:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10884 00000100:00100000:1.0:1746129751.312240:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3296:x1830949053298048:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129751.312298:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746129751.312300:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129750 -> 1746129750 00002000:00010000:1.0:1746129751.312302:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129750 -> 1746129750 00002000:00010000:1.0:1746129751.312303:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129750 -> 1746129750 00002000:00010000:1.0:1746129751.312305:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746129751.312324:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3296:x1830949053298048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (787us total) trans 21474840294 rc 0/0 00000100:00100000:1.0:1746129751.312329:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10884 00000100:00100000:1.0:1746129751.312337:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10885 00000100:00100000:1.0:1746129751.312341:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3296:x1830949053298560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129751.312420:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3296:x1830949053298560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (860us total) trans 21474840295 rc 0/0 00000100:00100000:1.0:1746129751.312425:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10885 00000100:00100000:1.0:1746129751.312434:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10886 00000100:00100000:1.0:1746129751.312438:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3296:x1830949053298176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129751.312507:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3296:x1830949053298176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (922us total) trans 21474840296 rc 0/0 00000100:00100000:1.0:1746129751.312512:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10886 00000100:00100000:1.0:1746129751.312519:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10887 00000100:00100000:1.0:1746129751.312523:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3296:x1830949053298688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129751.312586:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3296:x1830949053298688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (980us total) trans 21474840297 rc 0/0 00000100:00100000:1.0:1746129751.312591:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10887 00000100:00080000:1.0:1746129751.312613:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1746129751.312641:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c7b80/2, rc 0, transno 21474840296 00000100:00100000:1.0:1746129751.312646:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053298176:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129751.312653:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d634a80/2, rc 0, transno 21474840297 00000100:00100000:1.0:1746129751.312656:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053298688:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129751.312661:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c7800/2, rc 0, transno 21474840294 00000100:00100000:1.0:1746129751.312664:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053298048:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129751.312668:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d637b80/2, rc 0, transno 21474840295 00000100:00100000:1.0:1746129751.312670:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053298560:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129751.312683:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c4380/2, rc 0, transno 21474840292 00000100:00100000:1.0:1746129751.312686:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053297920:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129751.312691:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d635f80/2, rc 0, transno 21474840293 00000100:00100000:1.0:1746129751.312694:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053298432:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129751.312699:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c7480/2, rc 0, transno 21474840290 00000100:00100000:1.0:1746129751.312702:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053297792:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129751.312707:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d634000/2, rc 0, transno 21474840291 00000100:00100000:1.0:1746129751.312709:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053298304:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746129751.312800:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238c00/0x48868a4e43949367 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4e5 expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.312809:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129751.312812:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746129751.312815:0:14313:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88013558be00/0x48868a4e43949398 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f516 expref: 10 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.312823:0:14313:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013558be00/0x48868a4e43949398 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f516 expref: 10 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.312829:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013558be00/0x48868a4e43949398 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f516 expref: 10 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.312834:0:14313:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88013558b400/0x48868a4e439493b4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f524 expref: 282 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.312839:0:14313:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013558b400/0x48868a4e439493b4 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f524 expref: 282 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.312844:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013558b400/0x48868a4e439493b4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f524 expref: 282 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.312884:0:14313:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013558b400/0x48868a4e439493b4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f524 expref: 282 pid: 14315 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129751.312892:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b024000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053298816:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129751.312938:0:14313:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013558be00/0x48868a4e43949398 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f516 expref: 10 pid: 14314 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129751.312943:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b024380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053298944:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129751.312955:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129751.313223:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053299456:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129751.313243:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129751.313257:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053299968:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129751.313268:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129751.313276:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746129751.313279:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053299328:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129751.313289:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129751.313296:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053299840:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129751.313305:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129751.313318:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053299456 00000100:00100000:3.0:1746129751.313321:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053299456 00000100:00100000:3.0:1746129751.313338:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053299968 00000100:00100000:3.0:1746129751.313340:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053299968 00000100:00100000:3.0:1746129751.313346:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053299328 00000100:00100000:3.0:1746129751.313347:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053299328 00000100:00100000:3.0:1746129751.313353:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053299840 00000100:00100000:3.0:1746129751.313354:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053299840 00000100:00100000:3.0:1746129751.313362:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10888 00000100:00100000:3.0:1746129751.313365:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3297:x1830949053299456:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129751.313455:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129751.313457:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746129751.313459:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746129751.313460:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746129751.313462:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746129751.313478:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3297:x1830949053299456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 113us (235us total) trans 17179873138 rc 0/0 00000100:00100000:3.0:1746129751.313482:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10888 00000100:00100000:3.0:1746129751.313493:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10889 00000100:00100000:3.0:1746129751.313496:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3297:x1830949053299968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129751.313551:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3297:x1830949053299968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (282us total) trans 17179873139 rc 0/0 00000100:00100000:3.0:1746129751.313555:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10889 00000100:00100000:3.0:1746129751.313562:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10890 00000100:00100000:3.0:1746129751.313565:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3297:x1830949053299328:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129751.313614:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:3.0:1746129751.313616:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129750 -> 1746129750 00002000:00010000:3.0:1746129751.313617:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129750 -> 1746129750 00002000:00010000:3.0:1746129751.313619:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129750 -> 1746129750 00002000:00010000:3.0:1746129751.313620:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5673 -> 5673 00000100:00100000:3.0:1746129751.313632:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3297:x1830949053299328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (342us total) trans 17179873140 rc 0/0 00000100:00100000:3.0:1746129751.313636:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10890 00000100:00100000:3.0:1746129751.313642:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10891 00000100:00100000:3.0:1746129751.313646:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3297:x1830949053299840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129751.313694:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3297:x1830949053299840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (388us total) trans 17179873141 rc 0/0 00000100:00100000:3.0:1746129751.313698:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10891 00000100:00080000:3.0:1746129751.313710:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1746129751.313721:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d6a00/2, rc 0, transno 17179873140 00000100:00100000:3.0:1746129751.313726:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053299328:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129751.313731:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135d8f480/2, rc 0, transno 17179873141 00000100:00100000:3.0:1746129751.313733:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053299840:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129751.313738:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba1b480/2, rc 0, transno 17179873138 00000100:00100000:3.0:1746129751.313741:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053299456:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129751.313745:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135d8ca80/2, rc 0, transno 17179873139 00000100:00100000:3.0:1746129751.313748:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053299968:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129751.313756:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053299200:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129751.313771:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129751.313781:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053299712:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129751.313793:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129751.313800:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746129751.313803:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053299072:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129751.313813:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129751.313819:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053299584:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129751.313827:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129751.313839:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053299200 00000100:00100000:3.0:1746129751.313840:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053299200 00000100:00100000:3.0:1746129751.313867:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053299712 00000100:00100000:3.0:1746129751.313869:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053299712 00000100:00100000:3.0:1746129751.313876:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053299072 00000100:00100000:3.0:1746129751.313877:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053299072 00000100:00100000:3.0:1746129751.313882:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053299584 00000100:00100000:3.0:1746129751.313883:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053299584 00000100:00100000:3.0:1746129751.313888:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10892 00000100:00100000:3.0:1746129751.313891:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3299:x1830949053299200:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129751.313945:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129751.313948:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129747 -> 1746129747 00002000:00010000:3.0:1746129751.313949:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746129747 -> 1746129747 00002000:00010000:3.0:1746129751.313951:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129747 -> 1746129747 00002000:00010000:3.0:1746129751.313952:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746129751.313970:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3299:x1830949053299200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (198us total) trans 17179873142 rc 0/0 00000100:00100000:3.0:1746129751.313974:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10892 00000100:00100000:3.0:1746129751.313981:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10893 00000100:00100000:3.0:1746129751.313985:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a341850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3299:x1830949053299712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129751.314039:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a341850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3299:x1830949053299712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (245us total) trans 17179873143 rc 0/0 00000100:00100000:3.0:1746129751.314043:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10893 00000100:00100000:3.0:1746129751.314119:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10894 00000100:00100000:3.0:1746129751.314122:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3299:x1830949053299072:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129751.314170:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746129751.314172:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129750 -> 1746129750 00002000:00010000:3.0:1746129751.314173:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129749 -> 1746129749 00002000:00010000:3.0:1746129751.314175:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129750 -> 1746129750 00002000:00010000:3.0:1746129751.314177:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:3.0:1746129751.314189:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3299:x1830949053299072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (375us total) trans 17179873144 rc 0/0 00000100:00100000:3.0:1746129751.314194:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10894 00000100:00100000:3.0:1746129751.314200:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10895 00000100:00100000:3.0:1746129751.314203:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3299:x1830949053299584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129751.314254:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3299:x1830949053299584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (426us total) trans 17179873145 rc 0/0 00000100:00100000:3.0:1746129751.314258:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10895 00000004:00080000:3.0:1746129751.314278:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130507480/2, rc 0, transno 17179873144 00000100:00100000:3.0:1746129751.314281:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053299072:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129751.314287:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135d8dc00/2, rc 0, transno 17179873145 00000100:00100000:3.0:1746129751.314289:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053299584:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129751.314294:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d5880/2, rc 0, transno 17179873142 00000100:00100000:3.0:1746129751.314296:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053299200:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129751.314301:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135d8ea00/2, rc 0, transno 17179873143 00000100:00100000:3.0:1746129751.314303:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053299712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129751.314454:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053300096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129751.314474:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129751.314527:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053300096 00000100:00100000:2.0:1746129751.314531:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053300096 00000100:00100000:2.0:1746129751.314546:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10896 00000100:00100000:2.0:1746129751.314551:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3298:x1830949053300096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129751.314630:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3298:x1830949053300096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (155us total) trans 17179873146 rc 0/0 00000100:00100000:2.0:1746129751.314636:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10896 00000004:00080000:0.0:1746129751.314686:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135d8fb80/2, rc 0, transno 17179873146 00000100:00100000:0.0:1746129751.314690:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053300096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129751.317444:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.317496:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.317565:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052169088 00000100:00100000:2.0:1746129751.317571:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052169088 00000100:00100000:2.0:1746129751.317601:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052169216 00000100:00100000:2.0:1746129751.317603:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052169216 00000100:00100000:2.0:1746129751.317616:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3869 00000100:00100000:2.0:1746129751.317623:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28571:x1830949052169088:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:2.0:1746129751.317710:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28571:x1830949052169088:12345-192.168.204.31@tcp:49:cat.0 Request processed in 87us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129751.317716:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3869 00000100:00100000:2.0:1746129751.317727:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3870 00000100:00100000:2.0:1746129751.317732:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c563c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28569:x1830949052169216:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:2.0:1746129751.317762:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c563c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28569:x1830949052169216:12345-192.168.204.31@tcp:49:cat.0 Request processed in 30us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129751.317767:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3870 00000100:00100000:3.0:1746129751.317914:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b024000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053298816:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129751.317922:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b024380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053298944:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129751.317951:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283800/0x48868a4e43949360 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4e5 expref: 10 pid: 14313 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746129751.317967:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238c00/0x48868a4e43949367 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4e5 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.317987:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a238c00, rc 0) 00000100:00100000:3.0:1746129751.318007:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28565:x1830949052167296:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 57387us (57428us total) trans 8589943639 rc 0/0 00000100:00100000:3.0:1746129751.318013:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9857 00000100:00100000:0.0:1746129751.318741:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.321191:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052169344 00000100:00100000:3.0:1746129751.321201:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052169344 00000100:00100000:3.0:1746129751.321398:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9861 00000100:00100000:3.0:1746129751.321416:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28566:x1830949052169344:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129751.321431:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129751.321446:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013558a200/0x48868a4e439493bb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f52b expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.321490:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013558a200/0x48868a4e439493bb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f52b expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.321500:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013558a200/0x48868a4e439493bb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f52b expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.321512:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129751.321514:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129751.321517:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013558a200, rc 0) 00000100:00100000:3.0:1746129751.322709:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28566:x1830949052169344:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1300us (3964us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129751.322716:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9861 00000100:00100000:0.0:1746129751.322928:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129751.323178:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052169472 00000100:00100000:1.0:1746129751.323183:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052169472 00000100:00100000:1.0:1746129751.323208:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10897 00000100:00100000:1.0:1746129751.323213:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28565:x1830949052169472:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129751.323223:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129751.323232:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135586a00/0x48868a4e439493c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f532 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.323251:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095345800/0x48868a4e439492aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4a6 expref: 8 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129751.323258:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f96fe00/0x48868a4e439493ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f51d expref: 14 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129751.323264:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094b2d600/0x48868a4e43949359 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4de expref: 13 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129751.323269:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129751.323271:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129751.323274:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135586a00/0x48868a4e439493c2 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3887104->4046847] (req 3887104->4046847) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f532 expref: 13 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.323301:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094b2d600/0x48868a4e43949359 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4de expref: 13 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129751.323311:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094b2d600/0x48868a4e43949359 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4de expref: 13 pid: 7975 timeout: 797 lvb_type: 1 00000100:00100000:1.0:1746129751.323321:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053300224:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129751.323371:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f96fe00/0x48868a4e439493ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f51d expref: 14 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129751.323378:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f96fe00/0x48868a4e439493ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f51d expref: 14 pid: 7975 timeout: 797 lvb_type: 1 00000100:00100000:1.0:1746129751.323385:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053300352:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129751.323415:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095345800/0x48868a4e439492aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4a6 expref: 8 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129751.323429:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095345800/0x48868a4e439492aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4a6 expref: 8 pid: 1140 timeout: 797 lvb_type: 1 00000100:00100000:1.0:1746129751.323436:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053300480:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129751.323452:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129751.327599:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.330258:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129751.330338:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052169728 00000100:00100000:1.0:1746129751.330346:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052169728 00000100:00100000:1.0:1746129751.330445:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 568 00000100:00100000:1.0:1746129751.330452:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:1964:x1830949052169728:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129751.330462:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129751.330482:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013558a200/0x48868a4e439493bb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f52b expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.330497:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129751.330500:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129751.330637:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052169600 00000100:00100000:2.0:1746129751.330642:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052169600 00000100:00100000:2.0:1746129751.330666:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10898 00000100:00100000:2.0:1746129751.330671:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:28566:x1830949052169600:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129751.330683:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129751.330693:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439493c9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f539 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.330715:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129751.330719:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135586a00/0x48868a4e439493c2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3887104->4046847] (req 3887104->4046847) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f532 expref: 13 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.330724:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129751.330727:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439493c9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3592192->3911679] (req 3592192->3911679) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f539 expref: 16 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.330752:0:4589:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135586a00/0x48868a4e439493c2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3887104->4046847] (req 3887104->4046847) gid 0 flags: 0x60000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f532 expref: 13 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.330761:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439493c9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3592192->3911679] (req 3592192->3911679) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f539 expref: 16 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.330767:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f96f800, rc 0) 00000100:00100000:1.0:1746129751.331308:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:1964:x1830949052169728:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 856us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129751.331314:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 568 00000100:00100000:2.0:1746129751.331492:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:28566:x1830949052169600:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 819us (3900us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129751.331497:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10898 00000100:00100000:0.0:1746129751.331942:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.331954:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.331966:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.331982:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.332004:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.332017:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.332036:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129751.332192:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052170368 00000100:00100000:1.0:1746129751.332196:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052170368 00002000:00100000:1.0:1746129751.332223:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009284f100 x1830949052170368/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129751.332232:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284f100 with x1830949052170368 ext(0->1048575) 00002000:00010000:1.0:1746129751.332235:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284f100 00000100:00100000:1.0:1746129751.332246:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052170624 00000100:00100000:1.0:1746129751.332249:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052170624 00002000:00100000:1.0:1746129751.332259:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009284fb80 x1830949052170624/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129751.332265:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284fb80 with x1830949052170624 ext(1048576->2097151) 00002000:00010000:1.0:1746129751.332267:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009284fb80 00000100:00100000:1.0:1746129751.332275:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052170880 00000100:00100000:1.0:1746129751.332277:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052170880 00002000:00100000:1.0:1746129751.332286:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009284c380 x1830949052170880/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129751.332296:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284c380 with x1830949052170880 ext(1048576->2097151) 00002000:00010000:1.0:1746129751.332298:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009284c380 00000100:00100000:1.0:1746129751.332305:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052171136 00000100:00100000:1.0:1746129751.332306:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052171136 00002000:00100000:1.0:1746129751.332314:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009284d180 x1830949052171136/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129751.332319:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284d180 with x1830949052171136 ext(1048576->2097151) 00002000:00010000:1.0:1746129751.332321:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284d180 00000100:00100000:1.0:1746129751.332330:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4036 00000100:00100000:1.0:1746129751.332334:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949052170368:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129751.333310:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4037 00000100:00100000:1.0:1746129751.333317:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949052170624:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129751.334380:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4038 00000100:00100000:1.0:1746129751.334387:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052170880:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129751.335073:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4039 00000100:00100000:0.0:1746129751.335082:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052171136:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129751.336435:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052169856 00000100:00100000:2.0:1746129751.336442:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052169856 00010000:00010000:2.0:1746129751.336468:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094b2d600/0x48868a4e43949359 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4de expref: 17 pid: 7975 timeout: 797 lvb_type: 1 00000100:00100000:2.0:1746129751.336499:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052170112 00000100:00100000:2.0:1746129751.336502:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052170112 00010000:00010000:2.0:1746129751.336512:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095345800/0x48868a4e439492aa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4a6 expref: 9 pid: 1140 timeout: 797 lvb_type: 1 00000100:00100000:2.0:1746129751.336528:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052169984 00000100:00100000:2.0:1746129751.336530:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052169984 00010000:00010000:2.0:1746129751.336539:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f96fe00/0x48868a4e439493ad lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f51d expref: 16 pid: 7975 timeout: 797 lvb_type: 1 00000100:00100000:2.0:1746129751.336552:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5226 00000100:00100000:2.0:1746129751.336557:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949052169856:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129751.336567:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129751.336582:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094b2d600/0x48868a4e43949359 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4de expref: 17 pid: 7975 timeout: 797 lvb_type: 1 00010000:00010000:2.0:1746129751.336591:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094b2d600/0x48868a4e43949359 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4de expref: 17 pid: 7975 timeout: 797 lvb_type: 1 00010000:00010000:2.0:1746129751.336610:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129751.336633:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949052169856:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 76us (4691us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129751.336639:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5226 00000100:00100000:2.0:1746129751.336652:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5227 00000100:00100000:2.0:1746129751.336656:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:1964:x1830949052170112:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129751.336662:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129751.336669:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095345800/0x48868a4e439492aa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4a6 expref: 9 pid: 1140 timeout: 797 lvb_type: 1 00010000:00010000:2.0:1746129751.336679:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095345800/0x48868a4e439492aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4a6 expref: 9 pid: 1140 timeout: 797 lvb_type: 1 00010000:00010000:2.0:1746129751.336689:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129751.336701:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:1964:x1830949052170112:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 45us (4746us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129751.336705:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5227 00000100:00100000:2.0:1746129751.336714:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5228 00000100:00100000:2.0:1746129751.336717:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1964:x1830949052169984:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129751.336722:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129751.336728:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f96fe00/0x48868a4e439493ad lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f51d expref: 16 pid: 7975 timeout: 797 lvb_type: 1 00010000:00010000:2.0:1746129751.336736:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f96fe00/0x48868a4e439493ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f51d expref: 16 pid: 7975 timeout: 797 lvb_type: 1 00010000:00010000:2.0:1746129751.336746:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129751.336748:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129751.336754:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135586a00/0x48868a4e439493c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3887104->4046847) gid 0 flags: 0x60080000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f532 expref: 16 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.336761:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135586a00/0x48868a4e439493c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3887104->4046847) gid 0 flags: 0x60080000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f532 expref: 16 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.336786:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135586a00/0x48868a4e439493c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3887104->4046847) gid 0 flags: 0x60000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f532 expref: 16 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.336796:0:7108:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135586a00/0x48868a4e439493c2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3887104->4046847) gid 0 flags: 0x70000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f532 expref: 16 pid: 1877 timeout: 797 lvb_type: 0 00000100:00100000:2.0:1746129751.336806:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053300736:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129751.336862:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013065e600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129751.337950:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.337980:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.337994:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.338015:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.338031:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052171392 00000100:00100000:2.0:1746129751.338035:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052171392 00002000:00100000:2.0:1746129751.338061:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880135d8df80 x1830949052171392/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.338069:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8df80 with x1830949052171392 ext(0->1048575) 00002000:00010000:2.0:1746129751.338072:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135d8df80 00000100:00100000:2.0:1746129751.338082:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052171648 00000100:00100000:2.0:1746129751.338084:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052171648 00002000:00100000:2.0:1746129751.338093:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff880135d8e300 x1830949052171648/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.338099:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8e300 with x1830949052171648 ext(1048576->2097151) 00002000:00010000:2.0:1746129751.338102:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d8e300 00000100:00100000:2.0:1746129751.338111:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052171904 00000100:00100000:2.0:1746129751.338113:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052171904 00002000:00100000:2.0:1746129751.338121:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800a00c5c00 x1830949052171904/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.338131:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c5c00 with x1830949052171904 ext(1048576->2097151) 00002000:00010000:2.0:1746129751.338134:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a00c5c00 00000100:00100000:2.0:1746129751.338141:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052172160 00000100:00100000:2.0:1746129751.338143:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052172160 00002000:00100000:2.0:1746129751.338150:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff8800a02ff800 x1830949052172160/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.338156:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02ff800 with x1830949052172160 ext(1048576->2097151) 00002000:00010000:2.0:1746129751.338158:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a02ff800 00000100:00100000:2.0:1746129751.338164:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4040 00000100:00100000:2.0:1746129751.338169:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949052171392:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129751.339171:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4041 00000100:00100000:3.0:1746129751.339180:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949052171648:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129751.340253:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4042 00000100:00100000:3.0:1746129751.340261:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949052171904:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129751.340724:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4043 00000100:00100000:0.0:1746129751.340732:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949052172160:12345-192.168.204.31@tcp:3:cat.0 00010000:00010000:1.0:1746129751.341070:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094b2d600/0x48868a4e43949359 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4de expref: 16 pid: 7975 timeout: 797 lvb_type: 1 00000100:00100000:1.0:1746129751.341083:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba38380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053300224:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129751.341092:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f96fe00/0x48868a4e439493ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f51d expref: 19 pid: 7975 timeout: 797 lvb_type: 1 00000100:00100000:1.0:1746129751.341099:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053300352:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129751.341108:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095345800/0x48868a4e439492aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4a6 expref: 8 pid: 1140 timeout: 797 lvb_type: 1 00000100:00100000:1.0:1746129751.341116:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053300480:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129751.341137:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135586a00/0x48868a4e439493c2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3887104->4046847) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f532 expref: 15 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:1.0:1746129751.341143:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135586a00/0x48868a4e439493c2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3887104->4046847) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f532 expref: 15 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:1.0:1746129751.341154:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135586a00, rc 0) 00000100:00100000:1.0:1746129751.341177:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28565:x1830949052169472:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 17964us (18251us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129751.341183:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10897 00000100:00100000:3.0:1746129751.345672:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053300736:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129751.345691:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129751.345717:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1964:x1830949052169984:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8997us (13748us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129751.345727:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5228 00000100:00100000:0.0:1746129751.350067:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129751.350218:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052170368:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 17881us (18233us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129751.350229:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4036 00002000:00100000:1.0:1746129751.350238:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009284f100 x1830949052170368/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/440 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129751.350246:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284f100 with x1830949052170368 ext(0->1048575) 00002000:00010000:1.0:1746129751.350251:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284f100 00000100:00100000:2.0:1746129751.350587:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052172416 00000100:00100000:2.0:1746129751.350593:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052172416 00002000:00100000:2.0:1746129751.350700:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (4042752->4046847) req@ffff88009284ca80 x1830949052172416/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.350707:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284ca80 with x1830949052172416 ext(4042752->4046847) 00010000:00010000:2.0:1746129751.350713:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135586a00/0x48868a4e439493c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3887104->4046847) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f532 expref: 16 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746129751.350726:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135586a00/0x48868a4e439493c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3887104->4046847) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f532 expref: 16 pid: 1877 timeout: 797 lvb_type: 0 00002000:00010000:2.0:1746129751.350731:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009284ca80 00000100:00100000:2.0:1746129751.350754:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 576 00000100:00100000:2.0:1746129751.350761:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1961:x1830949052172416:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129751.350902:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1961:x1830949052172416:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 141us (841us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129751.350907:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 576 00002000:00100000:2.0:1746129751.350911:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (4042752->4046847) req@ffff88009284ca80 x1830949052172416/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/4536 e 0 to 0 dl 1746129762 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.350917:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284ca80 with x1830949052172416 ext(4042752->4046847) 00010000:00010000:2.0:1746129751.350921:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135586a00/0x48868a4e439493c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3887104->4046847) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f532 expref: 16 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746129751.350928:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135586a00/0x48868a4e439493c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3887104->4046847) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f532 expref: 16 pid: 1877 timeout: 797 lvb_type: 0 00002000:00010000:2.0:1746129751.350933:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009284ca80 00000100:00100000:1.0:1746129751.357122:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052170624:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 23796us (25107us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129751.357134:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4037 00002000:00100000:1.0:1746129751.357145:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009284fb80 x1830949052170624/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/440 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129751.357155:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284fb80 with x1830949052170624 ext(1048576->2097151) 00002000:00010000:1.0:1746129751.357161:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009284fb80 00000100:00100000:1.0:1746129751.359706:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052171136:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 24616us (27658us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129751.359716:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4039 00002000:00100000:1.0:1746129751.359726:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009284d180 x1830949052171136/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/440 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129751.359736:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284d180 with x1830949052171136 ext(1048576->2097151) 00002000:00010000:1.0:1746129751.359741:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284d180 00000100:00100000:2.0:1746129751.366146:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949052171392:12345-192.168.204.31@tcp:3:cat.0 Request processed in 27967us (28190us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129751.366157:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4040 00002000:00100000:2.0:1746129751.366166:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880135d8df80 x1830949052171392/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/440 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.366174:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8df80 with x1830949052171392 ext(0->1048575) 00002000:00010000:2.0:1746129751.366179:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135d8df80 00000100:00100000:3.0:1746129751.370923:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949052171648:12345-192.168.204.31@tcp:3:cat.0 Request processed in 31736us (32933us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129751.370933:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4041 00002000:00100000:3.0:1746129751.370944:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff880135d8e300 x1830949052171648/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/440 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129751.370953:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8e300 with x1830949052171648 ext(1048576->2097151) 00002000:00010000:3.0:1746129751.370958:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d8e300 00000100:00100000:3.0:1746129751.381343:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949052171904:12345-192.168.204.31@tcp:3:cat.0 Request processed in 41076us (43339us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129751.381459:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4042 00002000:00100000:3.0:1746129751.381487:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800a00c5c00 x1830949052171904/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/440 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129751.381497:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c5c00 with x1830949052171904 ext(1048576->2097151) 00002000:00010000:3.0:1746129751.381502:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a00c5c00 00000100:00100000:2.0:1746129751.385180:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949052172160:12345-192.168.204.31@tcp:3:cat.0 Request processed in 44438us (47153us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129751.385191:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4043 00002000:00100000:2.0:1746129751.385200:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff8800a02ff800 x1830949052172160/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/440 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.385210:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02ff800 with x1830949052172160 ext(1048576->2097151) 00002000:00010000:2.0:1746129751.385215:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a02ff800 00000100:00100000:0.0:1746129751.389052:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.389119:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.389168:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052172672 00000100:00100000:2.0:1746129751.389176:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052172672 00002000:00100000:2.0:1746129751.389213:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3887104->4046847) req@ffff88009284c700 x1830949052172672/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.389222:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284c700 with x1830949052172672 ext(3887104->4046847) 00010000:00010000:2.0:1746129751.389230:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135586a00/0x48868a4e439493c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3887104->4046847) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f532 expref: 14 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746129751.389242:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135586a00/0x48868a4e439493c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3887104->4046847) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f532 expref: 14 pid: 1877 timeout: 797 lvb_type: 0 00002000:00010000:2.0:1746129751.389249:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009284c700 00000100:00100000:2.0:1746129751.389266:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 577 00000100:00100000:3.0:1746129751.389269:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052172928 00000100:00100000:3.0:1746129751.389273:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052172928 00000100:00100000:2.0:1746129751.389273:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1963:x1830949052172672:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:3.0:1746129751.389295:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3871 00000100:00100000:3.0:1746129751.389299:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28565:x1830949052172928:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129751.389624:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28565:x1830949052172928:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 322us (578us total) trans 8589943640 rc 0/0 00000100:00100000:3.0:1746129751.389629:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3871 00000100:00100000:1.0:1746129751.392685:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052170880:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 58291us (60659us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129751.392695:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4038 00002000:00100000:1.0:1746129751.392704:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009284c380 x1830949052170880/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/440 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129751.392712:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284c380 with x1830949052170880 ext(1048576->2097151) 00002000:00010000:1.0:1746129751.392717:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009284c380 00000100:00100000:2.0:1746129751.394115:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129751.394131:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052173184 00000100:00100000:1.0:1746129751.394138:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052173184 00002000:00100000:1.0:1746129751.394166:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a02ff480 x1830949052173184/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129751.394175:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02ff480 with x1830949052173184 ext(2097152->3145727) 00002000:00010000:1.0:1746129751.394179:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a02ff480 00000100:00100000:1.0:1746129751.394210:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4044 00000100:00100000:1.0:1746129751.394218:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949052173184:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129751.398172:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1963:x1830949052172672:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 8891us (9043us total) trans 21474840298 rc 0/0 00000100:00100000:2.0:1746129751.398182:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 577 00002000:00100000:2.0:1746129751.398192:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3887104->4046847) req@ffff88009284c700 x1830949052172672/t21474840298(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/448 e 0 to 0 dl 1746129762 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.398201:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284c700 with x1830949052172672 ext(3887104->4046847) 00010000:00010000:2.0:1746129751.398211:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135586a00/0x48868a4e439493c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3887104->4046847) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f532 expref: 14 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746129751.398226:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135586a00/0x48868a4e439493c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3887104->4046847) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f532 expref: 14 pid: 1877 timeout: 797 lvb_type: 0 00002000:00010000:2.0:1746129751.398232:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009284c700 00000100:00100000:1.0:1746129751.403900:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949052173184:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9673us (9778us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129751.403910:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4044 00002000:00100000:1.0:1746129751.403920:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a02ff480 x1830949052173184/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/440 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129751.403928:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02ff480 with x1830949052173184 ext(2097152->3145727) 00002000:00010000:1.0:1746129751.403933:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a02ff480 00000100:00100000:0.0:1746129751.404921:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.407570:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052173312 00000100:00100000:3.0:1746129751.407581:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052173312 00010000:00010000:3.0:1746129751.407616:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135586a00/0x48868a4e439493c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3887104->4046847) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f532 expref: 14 pid: 1877 timeout: 797 lvb_type: 0 00000100:00100000:3.0:1746129751.407657:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5229 00000100:00100000:3.0:1746129751.407664:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1964:x1830949052173312:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129751.407675:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746129751.407691:0:7108:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129750 -> 1746129752 00002000:00010000:3.0:1746129751.407694:0:7108:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129750 -> 1746129752 00010000:00010000:3.0:1746129751.407699:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135586a00/0x48868a4e439493c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3887104->4046847) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f532 expref: 14 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:3.0:1746129751.407709:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135586a00/0x48868a4e439493c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3887104->4046847) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f532 expref: 14 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:3.0:1746129751.407728:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135586a00/0x48868a4e439493c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3887104->4046847) gid 0 flags: 0x44801000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f532 expref: 14 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:3.0:1746129751.407754:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129751.407756:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129751.407763:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439493c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->3911679) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f539 expref: 14 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.407770:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439493c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->3911679) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f539 expref: 14 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.407799:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439493c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->3911679) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f539 expref: 14 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129751.407810:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053300864:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129751.407908:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129751.408455:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.408822:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.408939:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052173696 00000100:00100000:2.0:1746129751.408943:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052173696 00002000:00100000:2.0:1746129751.408973:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009284f800 x1830949052173696/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.408982:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284f800 with x1830949052173696 ext(2097152->3145727) 00002000:00010000:2.0:1746129751.408986:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284f800 00000100:00100000:1.0:1746129751.409593:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052173568 00000100:00100000:1.0:1746129751.409597:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052173568 00000100:00100000:1.0:1746129751.409628:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10899 00000100:00100000:1.0:1746129751.409634:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:28569:x1830949052173568:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129751.409645:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129751.409656:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4f5c600/0x48868a4e439493d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f540 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.409675:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439493c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3592192->3911679) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f539 expref: 16 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.409680:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129751.409682:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129751.409685:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f5c600/0x48868a4e439493d0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f540 expref: 16 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.409705:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439493c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3592192->3911679) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f539 expref: 16 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.409715:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439493c9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3592192->3911679) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f539 expref: 16 pid: 4589 timeout: 797 lvb_type: 0 00000100:00100000:1.0:1746129751.409724:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053300992:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129751.409771:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26000 going to sleep for 11 seconds 00000100:00100000:2.0:1746129751.409832:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4045 00000100:00100000:2.0:1746129751.409839:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949052173696:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129751.411305:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.411414:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052173952 00000100:00100000:2.0:1746129751.411420:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052173952 00002000:00100000:2.0:1746129751.411444:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3592192->3596287) req@ffff88012ba3aa00 x1830949052173952/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.411451:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3aa00 with x1830949052173952 ext(3592192->3596287) 00010000:00010000:2.0:1746129751.411457:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439493c9 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3592192->3911679) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f539 expref: 17 pid: 4589 timeout: 797 lvb_type: 0 00000100:00100000:3.0:1746129751.411527:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053300864:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129751.411544:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129751.411568:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1964:x1830949052173312:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3905us (6648us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129751.411576:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5229 00010000:00010000:2.0:1746129751.411595:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439493c9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->3911679) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f539 expref: 17 pid: 4589 timeout: 797 lvb_type: 0 00002000:00010000:2.0:1746129751.411602:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba3aa00 00000100:00100000:2.0:1746129751.411615:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 578 00000100:00100000:2.0:1746129751.411621:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949052173952:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129751.411717:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949052173952:12345-192.168.204.31@tcp:3:cat.0 Request processed in 96us (416us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129751.411722:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 578 00002000:00100000:2.0:1746129751.411726:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3592192->3596287) req@ffff88012ba3aa00 x1830949052173952/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/4536 e 0 to 0 dl 1746129762 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.411732:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3aa00 with x1830949052173952 ext(3592192->3596287) 00010000:00010000:2.0:1746129751.411736:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439493c9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->3911679) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f539 expref: 17 pid: 4589 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746129751.411743:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439493c9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->3911679) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f539 expref: 17 pid: 4589 timeout: 797 lvb_type: 0 00002000:00010000:2.0:1746129751.411749:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba3aa00 00000100:00100000:2.0:1746129751.413932:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053300992:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129751.413956:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f5c600/0x48868a4e439493d0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f540 expref: 16 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.413970:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f5c600, rc 0) 00000100:00100000:2.0:1746129751.414017:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:28569:x1830949052173568:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4382us (5561us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129751.414024:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10899 00000100:00100000:2.0:1746129751.416664:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949052173696:12345-192.168.204.31@tcp:3:cat.0 Request processed in 6818us (7835us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129751.416677:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4045 00002000:00100000:2.0:1746129751.416685:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009284f800 x1830949052173696/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/440 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.416693:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284f800 with x1830949052173696 ext(2097152->3145727) 00002000:00010000:2.0:1746129751.416698:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284f800 00000100:00100000:0.0:1746129751.418112:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.418192:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052174208 00000100:00100000:2.0:1746129751.418199:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052174208 00002000:00100000:2.0:1746129751.418230:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3907584->3911679) req@ffff88009284d880 x1830949052174208/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.418239:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284d880 with x1830949052174208 ext(3907584->3911679) 00010000:00010000:2.0:1746129751.418245:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439493c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->3911679) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f539 expref: 16 pid: 4589 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746129751.418258:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439493c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->3911679) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f539 expref: 16 pid: 4589 timeout: 797 lvb_type: 0 00002000:00010000:2.0:1746129751.418265:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009284d880 00000100:00100000:2.0:1746129751.418292:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 579 00000100:00100000:2.0:1746129751.418299:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1963:x1830949052174208:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129751.418444:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1963:x1830949052174208:12345-192.168.204.31@tcp:3:cat.0 Request processed in 145us (337us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129751.418450:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 579 00002000:00100000:2.0:1746129751.418455:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3907584->3911679) req@ffff88009284d880 x1830949052174208/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/4536 e 0 to 0 dl 1746129762 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.418468:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284d880 with x1830949052174208 ext(3907584->3911679) 00010000:00010000:2.0:1746129751.418472:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439493c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->3911679) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f539 expref: 16 pid: 4589 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746129751.418482:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439493c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->3911679) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f539 expref: 16 pid: 4589 timeout: 797 lvb_type: 0 00002000:00010000:2.0:1746129751.418487:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009284d880 00000100:00100000:0.0:1746129751.420487:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.420532:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052174336 00000100:00100000:2.0:1746129751.420538:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052174336 00000100:00100000:2.0:1746129751.420577:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10900 00000100:00100000:2.0:1746129751.420585:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28571:x1830949052174336:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129751.420598:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129751.420612:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0054600/0x48868a4e439493d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f547 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.420630:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129751.420636:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0054600/0x48868a4e439493d7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f547 expref: 14 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.420646:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0054600/0x48868a4e439493d7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f547 expref: 14 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.420654:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0054600, rc 0) 00000100:00100000:2.0:1746129751.420694:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28571:x1830949052174336:12345-192.168.204.31@tcp:101:cat.0 Request processed in 109us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129751.420702:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10900 00000100:00100000:0.0:1746129751.421283:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.421331:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052174592 00000100:00100000:3.0:1746129751.421334:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052174592 00002000:00100000:3.0:1746129751.421358:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3592192->3911679) req@ffff88009284dc00 x1830949052174592/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129751.421366:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284dc00 with x1830949052174592 ext(3592192->3911679) 00010000:00010000:3.0:1746129751.421376:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439493c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3592192->3911679) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f539 expref: 16 pid: 4589 timeout: 797 lvb_type: 0 00010000:00010000:3.0:1746129751.421389:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439493c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3592192->3911679) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f539 expref: 16 pid: 4589 timeout: 797 lvb_type: 0 00002000:00010000:3.0:1746129751.421410:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009284dc00 00000100:00100000:3.0:1746129751.421430:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 580 00000100:00100000:3.0:1746129751.421436:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1963:x1830949052174592:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129751.426145:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1963:x1830949052174592:12345-192.168.204.31@tcp:4:cat.0 Request processed in 4702us (4855us total) trans 21474840299 rc 0/0 00000100:00100000:3.0:1746129751.426154:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 580 00002000:00100000:3.0:1746129751.426162:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3592192->3911679) req@ffff88009284dc00 x1830949052174592/t21474840299(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/448 e 0 to 0 dl 1746129762 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129751.426169:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284dc00 with x1830949052174592 ext(3592192->3911679) 00010000:00010000:3.0:1746129751.426175:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439493c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3592192->3911679) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f539 expref: 18 pid: 4589 timeout: 797 lvb_type: 0 00010000:00010000:3.0:1746129751.426185:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439493c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3592192->3911679) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f539 expref: 18 pid: 4589 timeout: 797 lvb_type: 0 00002000:00010000:3.0:1746129751.426189:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009284dc00 00000100:00100000:0.0:1746129751.428553:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.428743:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052174720 00000100:00100000:3.0:1746129751.428750:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052174720 00010000:00010000:3.0:1746129751.428777:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439493c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3592192->3911679) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f539 expref: 18 pid: 4589 timeout: 797 lvb_type: 0 00000100:00100000:3.0:1746129751.428811:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5230 00000100:00100000:3.0:1746129751.428818:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1962:x1830949052174720:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129751.428832:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129751.429108:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439493c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3592192->3911679) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f539 expref: 18 pid: 4589 timeout: 797 lvb_type: 0 00010000:00010000:3.0:1746129751.429119:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439493c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3592192->3911679) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f539 expref: 18 pid: 4589 timeout: 797 lvb_type: 0 00010000:00010000:3.0:1746129751.429137:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439493c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3592192->3911679) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f539 expref: 18 pid: 4589 timeout: 797 lvb_type: 0 00010000:00010000:3.0:1746129751.429160:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129751.429162:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129751.429167:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f5c600/0x48868a4e439493d0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f540 expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.429175:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f5c600/0x48868a4e439493d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f540 expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.429182:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129751.429183:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129751.429186:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0054600/0x48868a4e439493d7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f547 expref: 13 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.429192:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0054600/0x48868a4e439493d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f547 expref: 13 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.429218:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0054600/0x48868a4e439493d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f547 expref: 13 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129751.429234:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053301120:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129751.429309:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4f5c600/0x48868a4e439493d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f540 expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129751.429317:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053301248:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129751.429331:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129751.438976:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.439070:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053301120:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129751.439081:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053301248:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129751.439099:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129751.439186:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052175104 00000100:00100000:2.0:1746129751.439191:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052175104 00002000:00100000:2.0:1746129751.439221:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009fd46680 x1830949052175104/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.439230:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd46680 with x1830949052175104 ext(2097152->3145727) 00002000:00010000:2.0:1746129751.439234:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd46680 00000100:00100000:2.0:1746129751.439248:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4046 00000100:00100000:2.0:1746129751.439254:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1962:x1830949052175104:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129751.440000:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.440042:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1962:x1830949052174720:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 11225us (11493us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129751.440051:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5230 00000100:00100000:3.0:1746129751.440088:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052175232 00000100:00100000:3.0:1746129751.440091:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052175232 00002000:00100000:3.0:1746129751.440296:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009fd45f80 x1830949052175232/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129751.440308:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd45f80 with x1830949052175232 ext(3145728->4194303) 00002000:00010000:3.0:1746129751.440311:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd45f80 00000100:00100000:3.0:1746129751.440329:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4047 00000100:00100000:3.0:1746129751.440334:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1962:x1830949052175232:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129751.440573:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.441140:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052175488 00000100:00100000:2.0:1746129751.441145:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052175488 00002000:00100000:2.0:1746129751.441163:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012ba38380 x1830949052175488/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.441170:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba38380 with x1830949052175488 ext(3145728->4194303) 00002000:00010000:2.0:1746129751.441173:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba38380 00000100:00100000:2.0:1746129751.441193:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4048 00000100:00100000:2.0:1746129751.441197:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949052175488:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129751.459559:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.459591:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.459618:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052175872 00000100:00100000:0.0:1746129751.459622:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.459628:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052175872 00002000:00100000:2.0:1746129751.459662:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009fd47b80 x1830949052175872/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.459672:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd47b80 with x1830949052175872 ext(3145728->4194303) 00002000:00010000:2.0:1746129751.459676:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd47b80 00000100:00100000:2.0:1746129751.459692:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052176128 00000100:00100000:2.0:1746129751.459696:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052176128 00002000:00100000:2.0:1746129751.459708:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009fd45500 x1830949052176128/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.459715:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd45500 with x1830949052176128 ext(3145728->4194303) 00002000:00010000:2.0:1746129751.459718:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd45500 00000100:00100000:2.0:1746129751.459734:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052176000 00000100:00100000:2.0:1746129751.459737:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052176000 00002000:00100000:2.0:1746129751.459748:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009fd44000 x1830949052176000/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.459754:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd44000 with x1830949052176000 ext(2097152->3145727) 00002000:00010000:2.0:1746129751.459756:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd44000 00000100:00100000:2.0:1746129751.459768:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4049 00000100:00100000:2.0:1746129751.459776:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949052175872:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129751.460321:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4050 00000100:00100000:3.0:1746129751.460328:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949052176128:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129751.460914:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4051 00000100:00100000:2.0:1746129751.460920:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052176000:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129751.478866:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949052175488:12345-192.168.204.31@tcp:3:cat.0 Request processed in 37647us (38272us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129751.478879:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4048 00002000:00100000:3.0:1746129751.478889:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012ba38380 x1830949052175488/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/440 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129751.478897:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba38380 with x1830949052175488 ext(3145728->4194303) 00002000:00010000:3.0:1746129751.478903:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba38380 00000100:00100000:1.0:1746129751.481083:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949052175232:12345-192.168.204.31@tcp:3:cat.0 Request processed in 40741us (41076us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129751.481093:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4047 00002000:00100000:1.0:1746129751.481101:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009fd45f80 x1830949052175232/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/440 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129751.481108:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd45f80 with x1830949052175232 ext(3145728->4194303) 00002000:00010000:1.0:1746129751.481113:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd45f80 00000100:00100000:3.0:1746129751.481665:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949052175104:12345-192.168.204.31@tcp:3:cat.0 Request processed in 42410us (42697us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129751.481672:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4046 00002000:00100000:3.0:1746129751.481677:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009fd46680 x1830949052175104/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/440 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129751.481683:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd46680 with x1830949052175104 ext(2097152->3145727) 00002000:00010000:3.0:1746129751.481685:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd46680 00000100:00100000:2.0:1746129751.491000:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949052175872:12345-192.168.204.31@tcp:3:cat.0 Request processed in 31217us (31440us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129751.491010:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4049 00002000:00100000:2.0:1746129751.491019:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009fd47b80 x1830949052175872/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/440 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.491027:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd47b80 with x1830949052175872 ext(3145728->4194303) 00002000:00010000:2.0:1746129751.491032:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd47b80 00000100:00100000:3.0:1746129751.497128:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052176128:12345-192.168.204.31@tcp:3:cat.0 Request processed in 36792us (37527us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129751.497139:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4050 00002000:00100000:3.0:1746129751.497149:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009fd45500 x1830949052176128/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/440 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129751.497157:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd45500 with x1830949052176128 ext(3145728->4194303) 00002000:00010000:3.0:1746129751.497162:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd45500 00000100:00100000:0.0:1746129751.499174:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.499225:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052176512 00000100:00100000:3.0:1746129751.499232:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052176512 00002000:00100000:3.0:1746129751.499264:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009fd45180 x1830949052176512/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129751.499273:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd45180 with x1830949052176512 ext(4194304->4964351) 00002000:00010000:3.0:1746129751.499277:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd45180 00000100:00100000:3.0:1746129751.500282:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4052 00000100:00100000:3.0:1746129751.500290:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949052176512:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129751.507651:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052176000:12345-192.168.204.31@tcp:3:cat.0 Request processed in 46718us (48016us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129751.507667:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4051 00002000:00100000:2.0:1746129751.507680:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009fd44000 x1830949052176000/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/440 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.507689:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd44000 with x1830949052176000 ext(2097152->3145727) 00002000:00010000:2.0:1746129751.507694:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd44000 00000100:00100000:3.0:1746129751.513950:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949052176512:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13653us (14774us total) trans 0 rc 770048/770048 00000100:00100000:3.0:1746129751.513961:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4052 00002000:00100000:3.0:1746129751.513970:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009fd45180 x1830949052176512/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/440 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129751.513978:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd45180 with x1830949052176512 ext(4194304->4964351) 00002000:00010000:3.0:1746129751.513983:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd45180 00000100:00100000:0.0:1746129751.531790:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.531839:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.531874:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052176896 00000100:00100000:3.0:1746129751.531882:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052176896 00000100:00100000:3.0:1746129751.531926:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3872 00000100:00100000:3.0:1746129751.531933:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28569:x1830949052176896:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:3.0:1746129751.532120:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28569:x1830949052176896:12345-192.168.204.31@tcp:35:cat.0 Request processed in 187us (337us total) trans 8589943641 rc 0/0 00000100:00100000:3.0:1746129751.532126:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3872 00000100:00100000:2.0:1746129751.532189:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052177024 00000100:00100000:2.0:1746129751.532192:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052177024 00002000:00100000:2.0:1746129751.532237:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009fd45c00 x1830949052177024/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.532246:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd45c00 with x1830949052177024 ext(4194304->4964351) 00002000:00010000:2.0:1746129751.532250:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd45c00 00000100:00100000:2.0:1746129751.532263:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4053 00000100:00100000:2.0:1746129751.532267:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1963:x1830949052177024:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129751.557159:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1963:x1830949052177024:12345-192.168.204.31@tcp:3:cat.0 Request processed in 24881us (25309us total) trans 0 rc 770048/770048 00000100:00100000:2.0:1746129751.557171:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4053 00002000:00100000:2.0:1746129751.557187:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009fd45c00 x1830949052177024/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/440 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.557286:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd45c00 with x1830949052177024 ext(4194304->4964351) 00002000:00010000:2.0:1746129751.557527:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd45c00 00000100:00100000:0.0:1746129751.574068:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.575099:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052177280 00000100:00100000:3.0:1746129751.575108:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052177280 00000100:00100000:3.0:1746129751.575161:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9862 00000100:00100000:3.0:1746129751.575169:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28575:x1830949052177280:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129751.575191:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129751.575206:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092840800/0x48868a4e439493de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f54e expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.575294:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092841800/0x48868a4e439493e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.575306:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092841800/0x48868a4e439493e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.575315:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092841800/0x48868a4e439493e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.575327:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092840400/0x48868a4e439493ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.575333:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092840400/0x48868a4e439493ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.575338:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092840400/0x48868a4e439493ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.575441:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092841400/0x48868a4e439493f3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.575448:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092841400/0x48868a4e439493f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.575453:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092841400/0x48868a4e439493f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129751.575460:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129751.575527:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092841800/0x48868a4e439493e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.575535:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092841800/0x48868a4e439493e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.575541:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092841800/0x48868a4e439493e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.575545:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092841800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129751.575548:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092841800/0x48868a4e439493e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.575554:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092841800/0x48868a4e439493e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.575562:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129751.575564:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129751.575567:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092841800/0x48868a4e439493e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.575571:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092841800/0x48868a4e439493e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.575595:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092840400/0x48868a4e439493ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.575599:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092840400/0x48868a4e439493ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.575603:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092840400/0x48868a4e439493ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.575607:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092840400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129751.575608:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092840400/0x48868a4e439493ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.575615:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092840400/0x48868a4e439493ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.575620:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f581100) 00010000:00010000:3.0:1746129751.575622:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129751.575624:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092840400/0x48868a4e439493ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.575627:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092840400/0x48868a4e439493ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.575655:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092840800/0x48868a4e439493de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f54e expref: 287 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.575665:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092841400/0x48868a4e439493f3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f54e expref: 286 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.575670:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129751.575672:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129751.575674:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092841400, rc 0) 00000100:00100000:3.0:1746129751.575727:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:28575:x1830949052177280:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 559us (1667us total) trans 8589943642 rc 0/0 00000100:00100000:3.0:1746129751.575733:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9862 00000100:00100000:0.0:1746129751.579578:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.579742:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052177536 00000100:00100000:3.0:1746129751.579793:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052177536 00000100:00100000:3.0:1746129751.579842:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3873 00000100:00100000:3.0:1746129751.579866:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:28575:x1830949052177536:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129751.580048:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:28575:x1830949052177536:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 199us (476us total) trans 8589943643 rc 0/0 00000100:00100000:3.0:1746129751.580055:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3873 00000100:00100000:0.0:1746129751.625933:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.626021:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052177792 00000100:00100000:2.0:1746129751.626028:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052177792 00000100:00100000:2.0:1746129751.626074:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9863 00000100:00100000:2.0:1746129751.626081:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28580:x1830949052177792:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129751.626100:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129751.626115:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283800/0x48868a4e43949401 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f555 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.626197:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e35e800/0x48868a4e43949408 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.626207:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e35e800/0x48868a4e43949408 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.626215:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e35e800/0x48868a4e43949408 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.626226:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78600/0x48868a4e4394940f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.626231:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78600/0x48868a4e4394940f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.626235:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78600/0x48868a4e4394940f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.626312:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78e00/0x48868a4e43949416 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.626318:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78e00/0x48868a4e43949416 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.626323:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78e00/0x48868a4e43949416 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:2.0:1746129751.626330:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129751.626395:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e35e800/0x48868a4e43949408 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.626417:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e35e800/0x48868a4e43949408 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.626422:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e35e800/0x48868a4e43949408 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.626426:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e35e800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129751.626429:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e35e800/0x48868a4e43949408 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.626435:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e35e800/0x48868a4e43949408 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.626443:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129751.626446:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129751.626448:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e35e800/0x48868a4e43949408 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.626453:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e35e800/0x48868a4e43949408 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.626466:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78600/0x48868a4e4394940f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.626470:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78600/0x48868a4e4394940f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.626474:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78600/0x48868a4e4394940f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.626477:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa78600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129751.626478:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78600/0x48868a4e4394940f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.626485:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78600/0x48868a4e4394940f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.626489:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800920d3f00) 00010000:00010000:2.0:1746129751.626491:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129751.626493:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78600/0x48868a4e4394940f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.626497:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78600/0x48868a4e4394940f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.626528:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283800/0x48868a4e43949401 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f555 expref: 13 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.626539:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78e00/0x48868a4e43949416 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f555 expref: 12 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.626544:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129751.626546:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129751.626548:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa78e00, rc 0) 00000100:00100000:2.0:1746129751.626590:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28580:x1830949052177792:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 509us (664us total) trans 8589943644 rc 0/0 00000100:00100000:2.0:1746129751.626595:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9863 00000100:00100000:0.0:1746129751.705744:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.705916:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052178048 00000100:00100000:3.0:1746129751.705926:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052178048 00000100:00100000:3.0:1746129751.705996:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9864 00000100:00100000:3.0:1746129751.706007:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28583:x1830949052178048:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129751.706031:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129751.706048:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092840a00/0x48868a4e43949424 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f55c expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.706154:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092840c00/0x48868a4e4394942b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.706167:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092840c00/0x48868a4e4394942b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.706177:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092840c00/0x48868a4e4394942b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.706190:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092841c00/0x48868a4e43949432 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.706196:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092841c00/0x48868a4e43949432 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.706201:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092841c00/0x48868a4e43949432 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.706313:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092841600/0x48868a4e43949439 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.706323:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092841600/0x48868a4e43949439 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.706331:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092841600/0x48868a4e43949439 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129751.706340:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129751.706451:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092840c00/0x48868a4e4394942b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.706457:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092840c00/0x48868a4e4394942b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.706462:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092840c00/0x48868a4e4394942b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.706466:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092840c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129751.706470:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092840c00/0x48868a4e4394942b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.706475:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092840c00/0x48868a4e4394942b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.706487:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129751.706489:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129751.706493:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092840c00/0x48868a4e4394942b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.706498:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092840c00/0x48868a4e4394942b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.706529:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092841c00/0x48868a4e43949432 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.706535:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092841c00/0x48868a4e43949432 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.706542:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092841c00/0x48868a4e43949432 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.706546:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092841c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129751.706549:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092841c00/0x48868a4e43949432 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.706553:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092841c00/0x48868a4e43949432 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.706560:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f581700) 00010000:00010000:3.0:1746129751.706562:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129751.706565:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092841c00/0x48868a4e43949432 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.706569:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092841c00/0x48868a4e43949432 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.706608:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092840a00/0x48868a4e43949424 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f55c expref: 15 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.706621:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092841600/0x48868a4e43949439 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f55c expref: 14 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.706627:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129751.706629:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129751.706631:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092841600, rc 0) 00000100:00100000:3.0:1746129751.706705:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28583:x1830949052178048:12345-192.168.204.31@tcp:101:cat.0 Request processed in 699us (968us total) trans 8589943645 rc 0/0 00000100:00100000:3.0:1746129751.706712:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9864 00000100:00100000:0.0:1746129751.708647:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.709156:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052178432 00000100:00100000:2.0:1746129751.709165:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052178432 00000100:00100000:2.0:1746129751.709207:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3874 00000100:00100000:2.0:1746129751.709216:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28583:x1830949052178432:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129751.709412:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28583:x1830949052178432:12345-192.168.204.31@tcp:35:cat.0 Request processed in 194us (765us total) trans 8589943646 rc 0/0 00000100:00100000:2.0:1746129751.709419:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3874 00000100:00100000:0.0:1746129751.710736:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.710895:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052178176 00000100:00100000:2.0:1746129751.710902:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052178176 00000100:00100000:2.0:1746129751.710944:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 569 00000100:00100000:2.0:1746129751.710951:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8e0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1964:x1830949052178176:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129751.710966:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129751.710989:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092841600/0x48868a4e43949439 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f55c expref: 15 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.711003:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129751.711007:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129751.711041:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8e0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1964:x1830949052178176:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 89us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129751.711047:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 569 00000100:00100000:0.0:1746129751.745552:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.745624:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052178560 00000100:00100000:2.0:1746129751.745631:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052178560 00000100:00100000:2.0:1746129751.745679:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10901 00000100:00100000:2.0:1746129751.745686:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:28575:x1830949052178560:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129751.745701:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129751.745716:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa78c00/0x48868a4e43949447 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f563 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.745739:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c12d600/0x48868a4e439492b1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f49f expref: 8 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129751.745747:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013558b000/0x48868a4e4394939f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f508 expref: 27 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129751.745753:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094b2d400/0x48868a4e43949352 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4d7 expref: 13 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129751.745759:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129751.745761:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129751.745763:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa78c00/0x48868a4e43949447 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2949120->3145727] (req 2949120->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f563 expref: 27 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.745787:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094b2d400/0x48868a4e43949352 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4d7 expref: 13 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129751.745797:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094b2d400/0x48868a4e43949352 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4d7 expref: 13 pid: 7976 timeout: 797 lvb_type: 1 00000100:00100000:2.0:1746129751.745808:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053301376:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129751.745918:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013558b000/0x48868a4e4394939f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f508 expref: 27 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129751.745926:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013558b000/0x48868a4e4394939f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f508 expref: 27 pid: 7976 timeout: 797 lvb_type: 1 00000100:00100000:2.0:1746129751.745934:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053301504:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129751.745962:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c12d600/0x48868a4e439492b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f49f expref: 8 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129751.745974:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c12d600/0x48868a4e439492b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f49f expref: 8 pid: 1877 timeout: 797 lvb_type: 1 00000100:00100000:2.0:1746129751.745981:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053301632:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129751.745999:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4e14000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129751.751951:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.752585:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053301376:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129751.752599:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053301504:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129751.753552:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052178688 00000100:00100000:0.0:1746129751.753556:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.753558:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052178688 00000100:00100000:0.0:1746129751.753585:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052178816 00010000:00010000:3.0:1746129751.753587:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094b2d400/0x48868a4e43949352 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4d7 expref: 14 pid: 7976 timeout: 797 lvb_type: 1 00000100:00100000:0.0:1746129751.753587:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052178816 00010000:00010000:0.0:1746129751.753598:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c12d600/0x48868a4e439492b1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f49f expref: 9 pid: 1877 timeout: 797 lvb_type: 1 00000100:00100000:3.0:1746129751.753610:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5231 00000100:00100000:3.0:1746129751.753616:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1963:x1830949052178688:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129751.753617:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5232 00000100:00100000:0.0:1746129751.753621:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:1963:x1830949052178816:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129751.753627:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129751.753627:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129751.753645:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094b2d400/0x48868a4e43949352 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4d7 expref: 14 pid: 7976 timeout: 797 lvb_type: 1 00010000:00010000:0.0:1746129751.753645:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c12d600/0x48868a4e439492b1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f49f expref: 9 pid: 1877 timeout: 797 lvb_type: 1 00010000:00010000:3.0:1746129751.753653:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094b2d400/0x48868a4e43949352 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4d7 expref: 14 pid: 7976 timeout: 797 lvb_type: 1 00000100:00100000:2.0:1746129751.753767:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053301632:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129751.754312:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c12d600/0x48868a4e439492b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f49f expref: 9 pid: 1877 timeout: 797 lvb_type: 1 00010000:00010000:3.0:1746129751.754330:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094b2d400/0x48868a4e43949352 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4d7 expref: 14 pid: 7976 timeout: 797 lvb_type: 1 00010000:00010000:2.0:1746129751.754337:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa78c00/0x48868a4e43949447 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2949120->3145727] (req 2949120->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f563 expref: 27 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.754349:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa78c00, rc 0) 00010000:00010000:0.0:1746129751.754454:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c12d600/0x48868a4e439492b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f49f expref: 9 pid: 1877 timeout: 797 lvb_type: 1 00010000:00010000:0.0:1746129751.754466:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129751.755252:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:28575:x1830949052178560:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 9564us (9708us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129751.755260:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10901 00010000:00010000:3.0:1746129751.755999:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129751.756027:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1963:x1830949052178688:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2411us (4086us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129751.756034:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5231 00000100:00100000:1.0:1746129751.759657:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+8:1963:x1830949052178816:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6025us (6092us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129751.759667:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5232 00000100:00100000:0.0:1746129751.768642:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129751.768755:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052178944 00000100:00100000:1.0:1746129751.768765:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052178944 00010000:00010000:1.0:1746129751.768800:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013558b000/0x48868a4e4394939f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f508 expref: 27 pid: 7976 timeout: 797 lvb_type: 1 00000100:00100000:1.0:1746129751.768866:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5233 00000100:00100000:1.0:1746129751.768874:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949052178944:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129751.768890:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129751.768914:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013558b000/0x48868a4e4394939f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f508 expref: 27 pid: 7976 timeout: 797 lvb_type: 1 00010000:00010000:1.0:1746129751.768926:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013558b000/0x48868a4e4394939f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f508 expref: 27 pid: 7976 timeout: 797 lvb_type: 1 00010000:00010000:1.0:1746129751.768947:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013558b000/0x48868a4e4394939f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f508 expref: 27 pid: 7976 timeout: 797 lvb_type: 1 00010000:00010000:1.0:1746129751.768979:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129751.768981:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129751.768988:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa78c00/0x48868a4e43949447 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2949120->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f563 expref: 26 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.768996:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa78c00/0x48868a4e43949447 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2949120->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f563 expref: 26 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.769031:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa78c00/0x48868a4e43949447 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2949120->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f563 expref: 26 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129751.769042:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053301760:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129751.769115:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129751.771319:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053301760:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129751.771335:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129751.771362:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949052178944:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2489us (2729us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129751.771370:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5233 00000100:00100000:0.0:1746129751.771592:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.771645:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052179200 00000100:00100000:3.0:1746129751.771650:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052179200 00002000:00100000:3.0:1746129751.771686:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2949120->2953215) req@ffff88009f6a7100 x1830949052179200/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129751.771694:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a7100 with x1830949052179200 ext(2949120->2953215) 00002000:00010000:3.0:1746129751.771698:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a7100 00000100:00100000:3.0:1746129751.771713:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4054 00000100:00100000:3.0:1746129751.771718:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949052179200:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129751.771873:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949052179200:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 154us (280us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129751.771879:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4054 00002000:00100000:3.0:1746129751.771883:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2949120->2953215) req@ffff88009f6a7100 x1830949052179200/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/4536 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129751.771890:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a7100 with x1830949052179200 ext(2949120->2953215) 00002000:00010000:3.0:1746129751.771892:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a7100 00000100:00100000:0.0:1746129751.779265:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.779357:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052179328 00000100:00100000:2.0:1746129751.779364:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052179328 00000100:00100000:2.0:1746129751.779413:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10902 00000100:00100000:2.0:1746129751.779421:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:28575:x1830949052179328:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129751.779437:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129751.779451:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa79c00/0x48868a4e4394944e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f56a expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.779482:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f5c600/0x48868a4e439493d0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f540 expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.779489:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0054600/0x48868a4e439493d7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f547 expref: 13 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.779496:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129751.779497:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129751.779500:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa79c00/0x48868a4e4394944e lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->2719743] (req 2097152->2719743) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f56a expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.779524:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0054600/0x48868a4e439493d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f547 expref: 13 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.779533:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0054600/0x48868a4e439493d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f547 expref: 13 pid: 1877 timeout: 797 lvb_type: 0 00000100:00100000:2.0:1746129751.779543:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053301888:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129751.779953:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4f5c600/0x48868a4e439493d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f540 expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.779961:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f5c600/0x48868a4e439493d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f540 expref: 18 pid: 1877 timeout: 797 lvb_type: 0 00000100:00100000:2.0:1746129751.779970:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053302016:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129751.780232:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4e14000 going to sleep for 11 seconds 00000100:00100000:2.0:1746129751.784688:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053301888:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129751.784698:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053302016:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129751.784719:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa79c00/0x48868a4e4394944e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->2719743] (req 2097152->2719743) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f56a expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.784734:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa79c00, rc 0) 00000100:00100000:2.0:1746129751.785582:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:28575:x1830949052179328:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6159us (6322us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129751.785590:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10902 00000100:00100000:3.0:1746129751.788669:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129751.788758:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052179456 00000100:00100000:1.0:1746129751.788766:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052179456 00010000:00010000:1.0:1746129751.788797:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0054600/0x48868a4e439493d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f547 expref: 14 pid: 1877 timeout: 797 lvb_type: 0 00000100:00100000:1.0:1746129751.788820:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5234 00000100:00100000:1.0:1746129751.788826:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949052179456:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129751.788838:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129751.788875:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0054600/0x48868a4e439493d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f547 expref: 14 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:1.0:1746129751.788886:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0054600/0x48868a4e439493d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f547 expref: 14 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:1.0:1746129751.788903:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0054600/0x48868a4e439493d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f547 expref: 14 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:1.0:1746129751.788933:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129751.788968:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949052179456:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 141us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129751.788975:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5234 00000100:00100000:0.0:1746129751.790535:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.792736:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.792936:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.792964:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052179968 00000100:00100000:0.0:1746129751.792971:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052179968 00000100:00100000:0.0:1746129751.793014:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10903 00000100:00100000:0.0:1746129751.793020:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28580:x1830949052179968:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129751.793040:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129751.793058:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e43949455 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f578 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129751.793080:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129751.793083:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129751.793087:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e43949455 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2957312->3145727] (req 2957312->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f578 expref: 14 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129751.793102:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e43949455 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2957312->3145727] (req 2957312->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f578 expref: 14 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129751.793110:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e78c00, rc 0) 00000100:00100000:0.0:1746129751.793156:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28580:x1830949052179968:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 135us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129751.793161:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10903 00000100:00100000:2.0:1746129751.793320:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052179840 00000100:00100000:2.0:1746129751.793324:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052179840 00000100:00100000:2.0:1746129751.793348:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9865 00000100:00100000:2.0:1746129751.793353:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:28587:x1830949052179840:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129751.793365:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129751.793375:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e4394945c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f571 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.793469:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e43949463 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.793479:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e43949463 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.793488:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e43949463 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.793497:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e4394946a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.793503:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e4394946a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.793508:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e4394946a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.793586:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78a00/0x48868a4e43949471 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.793593:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78a00/0x48868a4e43949471 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.793599:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78a00/0x48868a4e43949471 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:2.0:1746129751.793606:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129751.793667:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e43949463 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.793673:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e43949463 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.793677:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e43949463 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.793682:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa79000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129751.793686:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e43949463 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.793691:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e43949463 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.793698:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129751.793701:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129751.793704:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e43949463 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.793708:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e43949463 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.793720:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e4394946a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.793724:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e4394946a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.793728:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e4394946a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.793731:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa78000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129751.793733:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e4394946a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.793737:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e4394946a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.793742:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134a2da00) 00010000:00010000:2.0:1746129751.793744:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129751.793746:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e4394946a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.793749:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e4394946a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129751.793777:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e4394945c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f571 expref: 290 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.793790:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78a00/0x48868a4e43949471 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f571 expref: 289 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.793794:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129751.793796:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129751.793798:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa78a00, rc 0) 00000100:00100000:2.0:1746129751.793818:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:28587:x1830949052179840:12345-192.168.204.31@tcp:101:cat.0 Request processed in 465us (1089us total) trans 8589943647 rc 0/0 00000100:00100000:2.0:1746129751.793823:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9865 00000100:00100000:3.0:1746129751.794031:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052179584 00000100:00100000:3.0:1746129751.794036:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052179584 00010000:00010000:3.0:1746129751.794054:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f5c600/0x48868a4e439493d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f540 expref: 18 pid: 1877 timeout: 797 lvb_type: 0 00000100:00100000:3.0:1746129751.794073:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5235 00000100:00100000:3.0:1746129751.794078:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1962:x1830949052179584:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129751.794086:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129751.794099:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4f5c600/0x48868a4e439493d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f540 expref: 18 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:3.0:1746129751.794108:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4f5c600/0x48868a4e439493d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f540 expref: 18 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:3.0:1746129751.794120:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f5c600/0x48868a4e439493d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f540 expref: 18 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:3.0:1746129751.794136:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129751.794137:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129751.794142:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa79c00/0x48868a4e4394944e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->2949119] (req 2097152->2719743) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f56a expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.794148:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa79c00/0x48868a4e4394944e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->2949119] (req 2097152->2719743) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f56a expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.794275:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129751.794277:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129751.794281:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e43949455 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2957312->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f578 expref: 13 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.794287:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e43949455 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2957312->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f578 expref: 13 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.794311:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e43949455 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2957312->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f578 expref: 13 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129751.794322:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053302144:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129751.794378:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa79c00/0x48868a4e4394944e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->2949119] (req 2097152->2719743) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f56a expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129751.794386:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053302272:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129751.794414:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68300 going to sleep for 11 seconds 00000100:00100000:3.0:1746129751.796363:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053302144:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129751.796375:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053302272:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129751.796390:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129751.796590:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949052179584:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2511us (6058us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129751.796598:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5235 00000100:00100000:0.0:1746129751.798124:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.798155:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.798186:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.798245:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052180224 00000100:00100000:3.0:1746129751.798250:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052180224 00002000:00100000:3.0:1746129751.798281:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2957312->2961407) req@ffff8800a504f800 x1830949052180224/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129751.798290:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504f800 with x1830949052180224 ext(2957312->2961407) 00002000:00010000:3.0:1746129751.798294:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504f800 00000100:00100000:2.0:1746129751.798339:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052180480 00000100:00100000:2.0:1746129751.798342:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052180480 00000100:00100000:2.0:1746129751.798367:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 570 00000100:00100000:2.0:1746129751.798372:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:1961:x1830949052180480:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129751.798382:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129751.798407:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78a00/0x48868a4e43949471 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f571 expref: 289 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.798420:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129751.798423:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129751.798472:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052180352 00000100:00100000:1.0:1746129751.798475:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052180352 00000100:00100000:1.0:1746129751.798493:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10904 00000100:00100000:1.0:1746129751.798497:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949052180352:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129751.798508:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129751.798518:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f9bcc00/0x48868a4e4394947f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f57f expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129751.798548:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053302400:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129751.798593:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4055 00000100:00100000:3.0:1746129751.798597:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1964:x1830949052180224:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129751.799582:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:1961:x1830949052180480:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1205us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129751.799589:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 570 00000100:00100000:1.0:1746129751.799678:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129751.801175:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1964:x1830949052180224:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 2572us (3051us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129751.801185:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4055 00002000:00100000:3.0:1746129751.801195:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2957312->2961407) req@ffff8800a504f800 x1830949052180224/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/4536 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129751.801204:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504f800 with x1830949052180224 ext(2957312->2961407) 00002000:00010000:3.0:1746129751.801208:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504f800 00000100:00100000:0.0:1746129751.802937:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.803027:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052180736 00000100:00100000:3.0:1746129751.803034:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052180736 00002000:00100000:3.0:1746129751.803067:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2715648->2719743) req@ffff8800a5491180 x1830949052180736/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129751.803082:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5491180 with x1830949052180736 ext(2715648->2719743) 00002000:00010000:3.0:1746129751.803086:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5491180 00000100:00100000:3.0:1746129751.803100:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4056 00000100:00100000:3.0:1746129751.803107:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1963:x1830949052180736:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129751.803832:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1963:x1830949052180736:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 722us (899us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129751.803840:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4056 00002000:00100000:3.0:1746129751.803876:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2715648->2719743) req@ffff8800a5491180 x1830949052180736/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/4536 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129751.803883:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5491180 with x1830949052180736 ext(2715648->2719743) 00002000:00010000:3.0:1746129751.803886:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5491180 00002000:00010000:2.0:1746129751.804944:0:4589:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746129750 -> 1746129752 00000100:00100000:2.0:1746129751.804962:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053302400:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129751.804985:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f9bcc00/0x48868a4e4394947f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f57f expref: 18 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129751.804997:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bcc00/0x48868a4e4394947f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f57f expref: 18 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129751.805006:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9bcc00, rc 0) 00000100:00100000:2.0:1746129751.805199:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949052180352:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6699us (7041us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129751.805206:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10904 00000100:00100000:0.0:1746129751.806715:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.806778:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052180864 00000100:00100000:2.0:1746129751.806785:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052180864 00000100:00100000:2.0:1746129751.807148:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10905 00000100:00100000:2.0:1746129751.807155:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28580:x1830949052180864:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129751.807169:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129751.807180:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa78000/0x48868a4e43949486 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f586 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.807201:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa78c00/0x48868a4e43949447 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2949120->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f563 expref: 25 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.807207:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129751.807209:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129751.807212:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa78000/0x48868a4e43949486 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->3821567] (req 3145728->3821567) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f586 expref: 14 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.807232:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa78c00/0x48868a4e43949447 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2949120->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f563 expref: 25 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.807245:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa78c00/0x48868a4e43949447 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2949120->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f563 expref: 25 pid: 1877 timeout: 797 lvb_type: 0 00000100:00100000:2.0:1746129751.807255:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053302528:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129751.807320:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4e14000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129751.813830:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053302528:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129751.813883:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa78000/0x48868a4e43949486 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->3821567] (req 3145728->3821567) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f586 expref: 14 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129751.813898:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa78000, rc 0) 00000100:00100000:0.0:1746129751.813945:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28580:x1830949052180864:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6790us (7232us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129751.813952:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10905 00000100:00100000:0.0:1746129751.819739:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.819789:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.819887:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052181120 00000100:00100000:2.0:1746129751.819894:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052181120 00000100:00100000:3.0:1746129751.819927:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052180992 00000100:00100000:3.0:1746129751.819932:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052180992 00000100:00100000:2.0:1746129751.819934:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10906 00000100:00100000:2.0:1746129751.819940:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:28587:x1830949052181120:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129751.819952:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:3.0:1746129751.819959:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2949120->3145727) req@ffff88009207d180 x1830949052180992/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746129751.819964:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa79800/0x48868a4e4394948d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f58d expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746129751.819968:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207d180 with x1830949052180992 ext(2949120->3145727) 00010000:00010000:3.0:1746129751.819974:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa78c00/0x48868a4e43949447 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2949120->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f563 expref: 28 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746129751.819984:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129751.819985:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa78c00/0x48868a4e43949447 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2949120->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f563 expref: 28 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746129751.819986:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129751.819989:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa79800/0x48868a4e4394948d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f58d expref: 28 pid: 4589 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129751.819991:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009207d180 00010000:00010000:2.0:1746129751.819998:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa79800/0x48868a4e4394948d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f58d expref: 28 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129751.820004:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 581 00010000:00010000:2.0:1746129751.820005:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa79800, rc 0) 00000100:00100000:3.0:1746129751.820009:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949052180992:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:2.0:1746129751.820042:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:28587:x1830949052181120:12345-192.168.204.31@tcp:101:cat.0 Request processed in 102us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129751.820047:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10906 00000100:00100000:3.0:1746129751.833231:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949052180992:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 13213us (13432us total) trans 17179873147 rc 0/0 00000100:00100000:3.0:1746129751.833241:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 581 00002000:00100000:3.0:1746129751.833250:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2949120->3145727) req@ffff88009207d180 x1830949052180992/t17179873147(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/448 e 0 to 0 dl 1746129762 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129751.833259:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207d180 with x1830949052180992 ext(2949120->3145727) 00010000:00010000:3.0:1746129751.833267:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa78c00/0x48868a4e43949447 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2949120->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f563 expref: 29 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:3.0:1746129751.833279:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa78c00/0x48868a4e43949447 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2949120->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f563 expref: 29 pid: 1877 timeout: 797 lvb_type: 0 00002000:00010000:3.0:1746129751.833286:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009207d180 00000100:00100000:0.0:1746129751.835808:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.835886:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052181248 00000100:00100000:2.0:1746129751.835895:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052181248 00010000:00010000:2.0:1746129751.835923:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa78c00/0x48868a4e43949447 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2949120->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f563 expref: 29 pid: 1877 timeout: 797 lvb_type: 0 00000100:00100000:2.0:1746129751.836090:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5236 00000100:00100000:2.0:1746129751.836098:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8e0d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1964:x1830949052181248:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129751.836112:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129751.836127:0:7109:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129750 -> 1746129752 00002000:00010000:2.0:1746129751.836130:0:7109:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129750 -> 1746129752 00010000:00010000:2.0:1746129751.836134:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa78c00/0x48868a4e43949447 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2949120->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f563 expref: 29 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746129751.836144:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa78c00/0x48868a4e43949447 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2949120->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f563 expref: 29 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746129751.836161:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa78c00/0x48868a4e43949447 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2949120->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f563 expref: 29 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746129751.836178:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129751.836180:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129751.836186:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa78000/0x48868a4e43949486 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f586 expref: 13 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.836193:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa78000/0x48868a4e43949486 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f586 expref: 13 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.836199:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129751.836201:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129751.836204:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa79800/0x48868a4e4394948d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f58d expref: 28 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.836220:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa79800/0x48868a4e4394948d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f58d expref: 28 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.836243:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa79800/0x48868a4e4394948d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f58d expref: 28 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129751.836252:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053302656:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129751.836335:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa78000/0x48868a4e43949486 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f586 expref: 13 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129751.836342:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053302784:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129751.836360:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4e14cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129751.839275:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053302656:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129751.839287:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053302784:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129751.839303:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129751.839336:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8e0d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1964:x1830949052181248:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3238us (3534us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129751.839344:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5236 00000100:00100000:0.0:1746129751.845515:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.845552:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129751.845597:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052181504 00000100:00100000:1.0:1746129751.845605:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052181504 00002000:00100000:1.0:1746129751.845646:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009207e300 x1830949052181504/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129751.845653:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207e300 with x1830949052181504 ext(2097152->3145727) 00002000:00010000:1.0:1746129751.845657:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207e300 00000100:00100000:1.0:1746129751.845676:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052181760 00000100:00100000:1.0:1746129751.845678:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052181760 00002000:00100000:1.0:1746129751.845689:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2719744->2949119) req@ffff88009207dc00 x1830949052181760/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129751.845695:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207dc00 with x1830949052181760 ext(2719744->2949119) 00002000:00010000:1.0:1746129751.845698:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207dc00 00000100:00100000:1.0:1746129751.845722:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4057 00000100:00100000:1.0:1746129751.845728:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949052181504:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129751.846077:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4058 00000100:00100000:3.0:1746129751.846086:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949052181760:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129751.849609:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.849682:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052182016 00000100:00100000:2.0:1746129751.849693:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052182016 00002000:00100000:2.0:1746129751.849724:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3817472->3821567) req@ffff88009207e680 x1830949052182016/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.849740:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207e680 with x1830949052182016 ext(3817472->3821567) 00002000:00010000:2.0:1746129751.849744:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207e680 00000100:00100000:2.0:1746129751.849759:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4059 00000100:00100000:2.0:1746129751.849764:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052182016:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129751.850670:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052182016:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 901us (1065us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129751.850676:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4059 00002000:00100000:2.0:1746129751.850682:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3817472->3821567) req@ffff88009207e680 x1830949052182016/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/4536 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.850688:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207e680 with x1830949052182016 ext(3817472->3821567) 00002000:00010000:2.0:1746129751.850691:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207e680 00000100:00100000:3.0:1746129751.856760:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949052181760:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10667us (11196us total) trans 0 rc 229376/229376 00000100:00100000:3.0:1746129751.856772:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4058 00002000:00100000:3.0:1746129751.856780:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2719744->2949119) req@ffff88009207dc00 x1830949052181760/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/440 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 229376/229376 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129751.856789:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207dc00 with x1830949052181760 ext(2719744->2949119) 00002000:00010000:3.0:1746129751.856794:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207dc00 00000100:00100000:1.0:1746129751.860989:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949052181504:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15251us (15471us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129751.860998:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4057 00002000:00100000:1.0:1746129751.861008:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009207e300 x1830949052181504/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/440 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129751.861022:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207e300 with x1830949052181504 ext(2097152->3145727) 00002000:00010000:1.0:1746129751.861026:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207e300 00000100:00100000:0.0:1746129751.861907:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.862053:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052182272 00000100:00100000:2.0:1746129751.862060:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052182272 00000100:00100000:2.0:1746129751.862091:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3875 00000100:00100000:2.0:1746129751.862097:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28580:x1830949052182272:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129751.862261:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28580:x1830949052182272:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 163us (356us total) trans 8589943648 rc 0/0 00000100:00100000:2.0:1746129751.862267:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3875 00000100:00100000:0.0:1746129751.867812:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.867905:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052182528 00000100:00100000:2.0:1746129751.867913:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052182528 00000100:00100000:2.0:1746129751.867945:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9866 00000100:00100000:2.0:1746129751.867952:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28591:x1830949052182528:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129751.867967:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129751.867981:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79400/0x48868a4e43949494 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f594 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.868062:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79600/0x48868a4e4394949b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.868072:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79600/0x48868a4e4394949b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.868080:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79600/0x48868a4e4394949b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.868090:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e439494a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.868094:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e439494a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.868098:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e439494a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.868178:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e439494a9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.868186:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e439494a9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.868191:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e439494a9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:2.0:1746129751.868198:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129751.868262:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79600/0x48868a4e4394949b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.868268:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79600/0x48868a4e4394949b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.868273:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79600/0x48868a4e4394949b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.868278:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa79600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129751.868280:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79600/0x48868a4e4394949b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.868286:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79600/0x48868a4e4394949b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.868295:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129751.868297:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129751.868300:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79600/0x48868a4e4394949b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.868304:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79600/0x48868a4e4394949b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.870045:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e439494a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.870055:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e439494a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.870061:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e439494a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.870065:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa78800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129751.870067:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e439494a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.870072:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e439494a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.870085:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5099100) 00010000:00010000:2.0:1746129751.870087:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129751.870089:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e439494a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.870093:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e439494a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129751.870136:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79400/0x48868a4e43949494 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f594 expref: 18 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.870145:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e439494a9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f594 expref: 17 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.870150:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129751.870152:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129751.870154:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa79000, rc 0) 00000100:00100000:2.0:1746129751.870200:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28591:x1830949052182528:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2248us (2395us total) trans 8589943649 rc 0/0 00000100:00100000:2.0:1746129751.870206:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9866 00000100:00100000:0.0:1746129751.871161:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.871229:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052182656 00000100:00100000:2.0:1746129751.871235:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052182656 00000100:00100000:2.0:1746129751.871312:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10907 00000100:00100000:2.0:1746129751.871318:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:28587:x1830949052182656:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129751.871329:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129751.871339:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa79a00/0x48868a4e439494b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f59b expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.871362:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa79c00/0x48868a4e4394944e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->2949119] (req 2097152->2719743) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f56a expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.871369:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e43949455 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2957312->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f578 expref: 13 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.871374:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746129751.871375:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746129751.871377:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa79a00/0x48868a4e439494b7 lrc: 5/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f59b expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.871408:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e43949455 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2957312->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f578 expref: 13 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.871417:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e43949455 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2957312->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f578 expref: 13 pid: 1877 timeout: 797 lvb_type: 0 00000100:00100000:2.0:1746129751.871426:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053302912:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129751.871495:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa79c00/0x48868a4e4394944e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->2949119] (req 2097152->2719743) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f56a expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129751.871502:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa79c00/0x48868a4e4394944e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->2949119] (req 2097152->2719743) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f56a expref: 18 pid: 1877 timeout: 797 lvb_type: 0 00000100:00100000:2.0:1746129751.871510:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053303040:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129751.871529:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b7b0cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129751.874045:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.874111:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053302912:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129751.874120:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053303040:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129751.874141:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa79a00/0x48868a4e439494b7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f59b expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.874154:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa79a00, rc 0) 00000100:00100000:3.0:1746129751.874183:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:28587:x1830949052182656:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2865us (3025us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129751.874190:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10907 00000100:00100000:0.0:1746129751.874304:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.874318:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052183168 00000100:00100000:0.0:1746129751.874322:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052183168 00000100:00100000:0.0:1746129751.874343:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3876 00000100:00100000:0.0:1746129751.874348:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c563850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28591:x1830949052183168:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:0.0:1746129751.874486:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c563850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28591:x1830949052183168:12345-192.168.204.31@tcp:35:cat.0 Request processed in 137us (181us total) trans 8589943650 rc 0/0 00000100:00100000:0.0:1746129751.874491:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3876 00000100:00100000:1.0:1746129751.875309:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052182784 00000100:00100000:1.0:1746129751.875313:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052182784 00002000:00100000:1.0:1746129751.875337:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2957312->3145727) req@ffff88009207fb80 x1830949052182784/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129751.875345:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207fb80 with x1830949052182784 ext(2957312->3145727) 00010000:00010000:1.0:1746129751.875350:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e43949455 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2957312->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f578 expref: 14 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:1.0:1746129751.875359:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e43949455 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2957312->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f578 expref: 14 pid: 1877 timeout: 797 lvb_type: 0 00002000:00010000:1.0:1746129751.875364:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009207fb80 00000100:00100000:1.0:1746129751.875388:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 582 00000100:00100000:1.0:1746129751.875403:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052182784:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:0.0:1746129751.876424:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.876463:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.876465:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052182912 00000100:00100000:2.0:1746129751.876470:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052182912 00002000:00100000:2.0:1746129751.876487:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->2719743) req@ffff88009207c380 x1830949052182912/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.876495:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207c380 with x1830949052182912 ext(2097152->2719743) 00010000:00010000:2.0:1746129751.876501:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fa79c00/0x48868a4e4394944e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->2949119] (req 2097152->2719743) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f56a expref: 18 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746129751.876509:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fa79c00/0x48868a4e4394944e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->2949119] (req 2097152->2719743) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f56a expref: 18 pid: 1877 timeout: 797 lvb_type: 0 00002000:00010000:2.0:1746129751.876515:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009207c380 00000100:00100000:2.0:1746129751.876531:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 583 00000100:00100000:2.0:1746129751.876535:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1964:x1830949052182912:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129751.877186:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052183296 00000100:00100000:3.0:1746129751.877191:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052183296 00000100:00100000:3.0:1746129751.877228:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 571 00000100:00100000:3.0:1746129751.877234:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949052183296:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129751.877243:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129751.877261:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e439494a9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f594 expref: 18 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.877276:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129751.877279:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129751.877301:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949052183296:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 68us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129751.877306:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 571 00000100:00100000:0.0:1746129751.881723:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.881796:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.882641:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052183424 00000100:00100000:3.0:1746129751.882648:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052183424 00000100:00100000:1.0:1746129751.882648:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052183552 00000100:00100000:1.0:1746129751.882651:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052183552 00000100:00100000:3.0:1746129751.882895:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10908 00000100:00100000:3.0:1746129751.882902:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052183424:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129751.882915:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129751.882928:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bc60400/0x48868a4e439494be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f5a2 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129751.882967:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053303168:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129751.883022:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129751.883468:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10909 00000100:00100000:1.0:1746129751.883475:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052183552:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129751.883483:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129751.883491:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f9bd600/0x48868a4e439494c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f5a9 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129751.883514:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053303296:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129751.883537:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129751.884263:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052182784:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 8867us (10221us total) trans 21474840300 rc 0/0 00000100:00100000:2.0:1746129751.884270:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 582 00002000:00100000:2.0:1746129751.884277:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2957312->3145727) req@ffff88009207fb80 x1830949052182784/t21474840300(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/448 e 0 to 0 dl 1746129762 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.884286:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207fb80 with x1830949052182784 ext(2957312->3145727) 00010000:00010000:2.0:1746129751.884292:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e43949455 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2957312->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f578 expref: 18 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746129751.884301:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e43949455 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2957312->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f578 expref: 18 pid: 1877 timeout: 797 lvb_type: 0 00002000:00010000:2.0:1746129751.884307:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009207fb80 00002000:00010000:3.0:1746129751.885792:0:4589:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime: 1746129750 -> 1746129752 00000100:00100000:3.0:1746129751.885812:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053303168:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129751.885835:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bc60400/0x48868a4e439494be lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5a2 expref: 15 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129751.885865:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bc60400/0x48868a4e439494be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5a2 expref: 15 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129751.885874:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bc60400, rc 0) 00000100:00100000:3.0:1746129751.885900:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052183424:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2998us (4184us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129751.885906:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10908 00000100:00100000:0.0:1746129751.888877:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.889200:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052183680 00000100:00100000:2.0:1746129751.889208:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052183680 00010000:00010000:2.0:1746129751.889236:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e43949455 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2957312->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f578 expref: 18 pid: 1877 timeout: 797 lvb_type: 0 00000100:00100000:1.0:1746129751.889713:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053303296:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129751.889724:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5237 00000100:00100000:2.0:1746129751.889731:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949052183680:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129751.889737:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f9bd600/0x48868a4e439494c5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5a9 expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129751.889741:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129751.889746:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bd600/0x48868a4e439494c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5a9 expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129751.889747:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e43949455 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [2957312->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f578 expref: 18 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746129751.889755:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e43949455 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2957312->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f578 expref: 17 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746129751.889951:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e78c00/0x48868a4e43949455 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2957312->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f578 expref: 17 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746129751.889969:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129751.890030:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9bd600, rc 0) 00000100:00100000:1.0:1746129751.890117:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052183552:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6642us (8320us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129751.890124:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10909 00000100:00100000:2.0:1746129751.890145:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1961:x1830949052183680:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 415us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129751.890150:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5237 00000100:00100000:2.0:1746129751.894980:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1964:x1830949052182912:12345-192.168.204.31@tcp:4:cat.0 Request processed in 18433us (18547us total) trans 21474840301 rc 0/0 00000100:00100000:2.0:1746129751.894992:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 583 00002000:00100000:2.0:1746129751.895006:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->2719743) req@ffff88009207c380 x1830949052182912/t21474840301(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/448 e 0 to 0 dl 1746129762 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.895014:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207c380 with x1830949052182912 ext(2097152->2719743) 00010000:00010000:2.0:1746129751.895023:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fa79c00/0x48868a4e4394944e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->2949119] (req 2097152->2719743) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f56a expref: 20 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746129751.895040:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fa79c00/0x48868a4e4394944e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->2949119] (req 2097152->2719743) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f56a expref: 20 pid: 1877 timeout: 797 lvb_type: 0 00002000:00010000:2.0:1746129751.895046:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009207c380 00000100:00100000:0.0:1746129751.898010:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.898060:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.898145:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052183808 00000100:00100000:3.0:1746129751.898152:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052183808 00010000:00010000:3.0:1746129751.898179:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa79c00/0x48868a4e4394944e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->2949119] (req 2097152->2719743) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f56a expref: 20 pid: 1877 timeout: 797 lvb_type: 0 00000100:00100000:3.0:1746129751.898211:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5238 00000100:00100000:3.0:1746129751.898218:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c135f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949052183808:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129751.898228:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129751.898246:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa79c00/0x48868a4e4394944e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->2949119] (req 2097152->2719743) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f56a expref: 20 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:3.0:1746129751.898256:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa79c00/0x48868a4e4394944e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->2949119] (req 2097152->2719743) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f56a expref: 20 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:3.0:1746129751.898274:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa79c00/0x48868a4e4394944e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->2949119] (req 2097152->2719743) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f56a expref: 20 pid: 1877 timeout: 797 lvb_type: 0 00010000:00010000:3.0:1746129751.898288:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129751.898289:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129751.898295:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa79a00/0x48868a4e439494b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f59b expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.898302:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa79a00/0x48868a4e439494b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f59b expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.898327:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa79a00/0x48868a4e439494b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f59b expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129751.898338:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053303424:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129751.898412:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129751.898670:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052183936 00000100:00100000:1.0:1746129751.898674:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052183936 00000100:00100000:1.0:1746129751.899340:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10910 00000100:00100000:1.0:1746129751.899347:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28591:x1830949052183936:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129751.899358:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129751.899369:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f9bc800/0x48868a4e439494cc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f5b0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.899384:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129751.899385:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129751.899390:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9bc800/0x48868a4e439494cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5b0 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.899411:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f9bc800/0x48868a4e439494cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5b0 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.899423:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9bc800, rc 0) 00000100:00100000:1.0:1746129751.899571:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28591:x1830949052183936:12345-192.168.204.31@tcp:101:cat.0 Request processed in 224us (1568us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129751.899577:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10910 00000100:00100000:3.0:1746129751.903948:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053303424:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129751.903966:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129751.904011:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c135f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949052183808:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5793us (5950us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129751.904019:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5238 00000100:00100000:0.0:1746129751.904319:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.904433:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052184320 00000100:00100000:3.0:1746129751.904439:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052184320 00002000:00100000:3.0:1746129751.904469:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009c136a00 x1830949052184320/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129751.904477:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c136a00 with x1830949052184320 ext(2097152->3145727) 00002000:00010000:3.0:1746129751.904481:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c136a00 00000100:00100000:3.0:1746129751.904504:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4060 00000100:00100000:3.0:1746129751.904510:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1961:x1830949052184320:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129751.911067:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.911156:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052184448 00000100:00100000:2.0:1746129751.911164:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052184448 00002000:00100000:2.0:1746129751.911198:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009c136680 x1830949052184448/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.911207:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c136680 with x1830949052184448 ext(2097152->3145727) 00002000:00010000:2.0:1746129751.911212:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c136680 00000100:00100000:2.0:1746129751.911239:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4061 00000100:00100000:2.0:1746129751.911246:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949052184448:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129751.918627:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1961:x1830949052184320:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14109us (14300us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129751.918637:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4060 00002000:00100000:3.0:1746129751.918646:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009c136a00 x1830949052184320/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/440 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129751.918655:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c136a00 with x1830949052184320 ext(2097152->3145727) 00002000:00010000:3.0:1746129751.918660:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c136a00 00000100:00100000:2.0:1746129751.922333:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949052184448:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11081us (11268us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129751.922342:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4061 00002000:00100000:2.0:1746129751.922351:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009c136680 x1830949052184448/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/440 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.922360:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c136680 with x1830949052184448 ext(2097152->3145727) 00002000:00010000:2.0:1746129751.922364:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c136680 00000100:00100000:0.0:1746129751.927362:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129751.927440:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052184576 00000100:00100000:1.0:1746129751.927447:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052184576 00000100:00100000:1.0:1746129751.928150:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10911 00000100:00100000:1.0:1746129751.928159:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28591:x1830949052184576:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129751.928175:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129751.928189:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a511b600/0x48868a4e439494d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f5b7 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.928211:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129751.928213:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129751.928219:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a511b600/0x48868a4e439494d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5b7 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.928232:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a511b600/0x48868a4e439494d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5b7 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.928242:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a511b600, rc 0) 00000100:00100000:1.0:1746129751.928291:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28591:x1830949052184576:12345-192.168.204.31@tcp:101:cat.0 Request processed in 133us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129751.928296:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10911 00000100:00100000:0.0:1746129751.938949:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129751.939108:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052184704 00000100:00100000:1.0:1746129751.939117:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052184704 00000100:00100000:1.0:1746129751.939147:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10912 00000100:00100000:1.0:1746129751.939153:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:28587:x1830949052184704:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129751.939167:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129751.939181:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a511b200/0x48868a4e439494da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f5be expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.939206:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa78000/0x48868a4e43949486 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f586 expref: 14 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.939213:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129751.939214:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129751.939217:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a511b200/0x48868a4e439494da lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5be expref: 29 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.939241:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa78000/0x48868a4e43949486 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f586 expref: 14 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.939250:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa78000/0x48868a4e43949486 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f586 expref: 14 pid: 4589 timeout: 797 lvb_type: 0 00000100:00100000:1.0:1746129751.939260:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053303552:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129751.939321:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129751.940430:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.942972:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052184960 00000100:00100000:3.0:1746129751.942981:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052184960 00000100:00100000:1.0:1746129751.943055:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053303552:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129751.943077:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a511b200/0x48868a4e439494da lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5be expref: 29 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.943095:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a511b200, rc 0) 00000100:00100000:1.0:1746129751.943139:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:28587:x1830949052184704:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3984us (4196us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129751.943147:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10912 00002000:00100000:2.0:1746129751.943273:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800a645f100 x1830949052184960/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.943282:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645f100 with x1830949052184960 ext(2097152->3145727) 00002000:00010000:2.0:1746129751.943286:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645f100 00000100:00100000:2.0:1746129751.943299:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4062 00000100:00100000:2.0:1746129751.943305:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1961:x1830949052184960:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129751.950187:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.950238:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.950263:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052185088 00000100:00100000:3.0:1746129751.950271:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052185088 00002000:00100000:3.0:1746129751.950307:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3821567) req@ffff8800a645ce00 x1830949052185088/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129751.950315:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645ce00 with x1830949052185088 ext(3145728->3821567) 00010000:00010000:3.0:1746129751.950323:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa78000/0x48868a4e43949486 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f586 expref: 15 pid: 4589 timeout: 797 lvb_type: 0 00010000:00010000:3.0:1746129751.950335:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa78000/0x48868a4e43949486 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f586 expref: 15 pid: 4589 timeout: 798 lvb_type: 0 00002000:00010000:3.0:1746129751.950342:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a645ce00 00000100:00100000:3.0:1746129751.950363:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052185472 00000100:00100000:3.0:1746129751.950365:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052185472 00002000:00100000:3.0:1746129751.950377:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3821568->4194303) req@ffff8800a645c700 x1830949052185472/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129751.950383:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645c700 with x1830949052185472 ext(3821568->4194303) 00010000:00010000:3.0:1746129751.950387:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa78000/0x48868a4e43949486 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f586 expref: 16 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129751.950405:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa78000/0x48868a4e43949486 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f586 expref: 16 pid: 4589 timeout: 798 lvb_type: 0 00002000:00010000:3.0:1746129751.950411:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a645c700 00000100:00100000:3.0:1746129751.950423:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 584 00000100:00100000:3.0:1746129751.950429:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1961:x1830949052185088:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129751.951110:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 585 00000100:00100000:0.0:1746129751.951117:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1963:x1830949052185472:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129751.951173:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129751.951223:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052185600 00000100:00100000:1.0:1746129751.951226:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052185600 00002000:00100000:1.0:1746129751.951241:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012ba39180 x1830949052185600/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129751.951247:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba39180 with x1830949052185600 ext(3145728->4194303) 00002000:00010000:1.0:1746129751.951250:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba39180 00000100:00100000:1.0:1746129751.951262:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4063 00000100:00100000:1.0:1746129751.951266:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052185600:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129751.960151:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949052184960:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16837us (19714us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129751.960162:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4062 00002000:00100000:3.0:1746129751.960172:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800a645f100 x1830949052184960/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/440 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129751.960180:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645f100 with x1830949052184960 ext(2097152->3145727) 00002000:00010000:3.0:1746129751.960184:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645f100 00000100:00100000:1.0:1746129751.960516:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1963:x1830949052185472:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9398us (10275us total) trans 0 rc 372736/372736 00000100:00100000:1.0:1746129751.960524:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 585 00002000:00100000:1.0:1746129751.960530:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3821568->4194303) req@ffff8800a645c700 x1830949052185472/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/440 e 0 to 0 dl 1746129762 ref 1 fl Complete:H/200/0 rc 372736/372736 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129751.960537:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645c700 with x1830949052185472 ext(3821568->4194303) 00010000:00010000:1.0:1746129751.960546:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa78000/0x48868a4e43949486 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f586 expref: 17 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129751.960558:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa78000/0x48868a4e43949486 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f586 expref: 17 pid: 4589 timeout: 798 lvb_type: 0 00002000:00010000:1.0:1746129751.960565:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a645c700 00000100:00100000:0.0:1746129751.967216:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.967765:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052185728 00000100:00100000:3.0:1746129751.967773:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052185728 00000100:00100000:3.0:1746129751.967822:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9867 00000100:00100000:3.0:1746129751.967829:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6141239f-0c60-480d-830c-e22ba61457b0+6:28593:x1830949052185728:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129751.967866:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129751.967871:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129751.967883:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc200/0x48868a4e439494e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f5c5 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129751.968013:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052185856 00000100:00100000:0.0:1746129751.968016:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052185856 00000100:00100000:1.0:1746129751.968298:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052185600:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17030us (17124us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129751.968305:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4063 00002000:00100000:1.0:1746129751.968312:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012ba39180 x1830949052185600/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/440 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129751.968321:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba39180 with x1830949052185600 ext(3145728->4194303) 00002000:00010000:1.0:1746129751.968324:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba39180 00010000:00010000:3.0:1746129751.968475:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc600/0x48868a4e439494e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.968486:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc600/0x48868a4e439494e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.968496:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc600/0x48868a4e439494e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.968508:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bca00/0x48868a4e439494ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.968514:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bca00/0x48868a4e439494ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.968519:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bca00/0x48868a4e439494ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.968868:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bdc00/0x48868a4e439494f6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.970292:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949391 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f50f expref: 287 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.970302:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bdc00/0x48868a4e439494f6 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.970333:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949391 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f50f expref: 287 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.970343:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949391 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f50f expref: 287 pid: 14315 timeout: 798 lvb_type: 0 00000100:00100000:3.0:1746129751.970354:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053303680:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129751.970417:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10913 00000100:00100000:1.0:1746129751.970428:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28591:x1830949052185856:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129751.970439:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129751.970449:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a511a800/0x48868a4e439494fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f5cc expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.970466:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129751.970470:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a511a800/0x48868a4e439494fd lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5cc expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.970548:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a511a800/0x48868a4e439494fd lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5cc expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.970557:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a511a800, rc 0) 00000100:00100000:1.0:1746129751.970591:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28591:x1830949052185856:12345-192.168.204.31@tcp:101:cat.0 Request processed in 166us (2719us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129751.970599:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10913 00000100:00100000:3.0:1746129751.970666:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129751.976777:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.976870:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053303680:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129751.976888:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bdc00/0x48868a4e439494f6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:1.0:1746129751.976982:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052186112 00000100:00100000:1.0:1746129751.976988:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052186112 00000100:00100000:1.0:1746129751.977020:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3877 00000100:00100000:1.0:1746129751.977027:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:23993:x1830949052186112:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746129751.977166:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:23993:x1830949052186112:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 139us (394us total) trans 8589943651 rc 0/0 00000100:00100000:1.0:1746129751.977172:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3877 00000100:00100000:2.0:1746129751.980622:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949052185088:12345-192.168.204.31@tcp:4:cat.0 Request processed in 30184us (30432us total) trans 17179873148 rc 0/0 00000100:00100000:2.0:1746129751.980634:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 584 00002000:00100000:2.0:1746129751.980644:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3821567) req@ffff8800a645ce00 x1830949052185088/t17179873148(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/448 e 0 to 0 dl 1746129762 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.980653:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645ce00 with x1830949052185088 ext(3145728->3821567) 00010000:00010000:2.0:1746129751.980662:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa78000/0x48868a4e43949486 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f586 expref: 18 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129751.980674:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa78000/0x48868a4e43949486 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f586 expref: 18 pid: 4589 timeout: 798 lvb_type: 0 00002000:00010000:2.0:1746129751.980681:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a645ce00 00000100:00100000:1.0:1746129751.981128:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.981339:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052186240 00000100:00100000:3.0:1746129751.981346:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052186240 00010000:00010000:3.0:1746129751.981369:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949391 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f50f expref: 289 pid: 14315 timeout: 798 lvb_type: 0 00000100:00100000:3.0:1746129751.981548:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5239 00000100:00100000:3.0:1746129751.981555:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:1961:x1830949052186240:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129751.981565:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129751.981570:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949391 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f50f expref: 289 pid: 14315 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129751.981578:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949391 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f50f expref: 289 pid: 14315 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129751.981595:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0fe00/0x48868a4e43949391 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f50f expref: 289 pid: 14315 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129751.981610:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129751.981614:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bdc00/0x48868a4e439494f6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.981622:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bdc00/0x48868a4e439494f6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.981627:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bdc00/0x48868a4e439494f6 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129751.981642:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129751.982833:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:1961:x1830949052186240:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1274us (1702us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129751.982840:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5239 00010000:00010000:1.0:1746129751.982998:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bdc00/0x48868a4e439494f6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129751.983005:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bdc00/0x48868a4e439494f6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:1.0:1746129751.983036:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:1.0:1746129751.983039:0:14313:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746129751.983050:0:14313:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bdc00/0x48868a4e439494f6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129751.983058:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bdc00/0x48868a4e439494f6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129751.983064:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc600/0x48868a4e439494e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129751.983069:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc600/0x48868a4e439494e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129751.983074:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc600/0x48868a4e439494e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129751.983079:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f9bc600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129751.983081:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc600/0x48868a4e439494e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129751.983087:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc600/0x48868a4e439494e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129751.983094:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129751.983096:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129751.983099:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc600/0x48868a4e439494e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129751.983103:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc600/0x48868a4e439494e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129751.983110:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bca00/0x48868a4e439494ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129751.983114:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bca00/0x48868a4e439494ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129751.983118:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bca00/0x48868a4e439494ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129751.983121:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f9bca00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129751.983123:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bca00/0x48868a4e439494ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129751.983127:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bca00/0x48868a4e439494ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129751.983131:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f581100) 00010000:00010000:1.0:1746129751.983132:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129751.983134:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bca00/0x48868a4e439494ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129751.983138:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bca00/0x48868a4e439494ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129751.983163:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc200/0x48868a4e439494e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5c5 expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.983172:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bdc00/0x48868a4e439494f6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5c5 expref: 7 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.983177:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129751.983179:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129751.983181:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9bdc00, rc 0) 00000100:00100000:1.0:1746129751.983606:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6141239f-0c60-480d-830c-e22ba61457b0+7:28593:x1830949052185728:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 15776us (16395us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129751.983612:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9867 00000100:00100000:0.0:1746129751.984778:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129751.984904:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052186368 00000100:00100000:3.0:1746129751.984910:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052186368 00010000:00010000:3.0:1746129751.984932:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa78000/0x48868a4e43949486 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f586 expref: 18 pid: 4589 timeout: 798 lvb_type: 0 00000100:00100000:3.0:1746129751.984951:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5240 00000100:00100000:3.0:1746129751.984957:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949052186368:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129751.984965:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129751.984980:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa78000/0x48868a4e43949486 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f586 expref: 18 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129751.984990:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa78000/0x48868a4e43949486 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f586 expref: 18 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129751.985007:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa78000/0x48868a4e43949486 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f586 expref: 18 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129751.985023:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129751.985025:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129751.985030:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a511b200/0x48868a4e439494da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5be expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.985038:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a511b200/0x48868a4e439494da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5be expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.985044:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129751.985045:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129751.985049:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a511a800/0x48868a4e439494fd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5cc expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.985055:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a511a800/0x48868a4e439494fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5cc expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129751.985080:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a511a800/0x48868a4e439494fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5cc expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129751.985089:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053303808:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129751.985165:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a511b200/0x48868a4e439494da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5be expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129751.985173:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053303936:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129751.985191:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68780 going to sleep for 11 seconds 00000100:00100000:3.0:1746129751.987600:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053303808:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129751.987611:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053303936:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129751.987628:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129751.987660:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949052186368:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2703us (2884us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129751.987669:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5240 00000100:00100000:0.0:1746129751.990255:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129751.990486:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129751.990767:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052186496 00000100:00100000:1.0:1746129751.990775:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052186496 00000100:00100000:1.0:1746129751.990808:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052186624 00000100:00100000:1.0:1746129751.990810:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052186624 00000100:00100000:1.0:1746129751.990822:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10914 00000100:00100000:1.0:1746129751.990829:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+8:1964:x1830949052186496:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129751.990844:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129751.990878:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a511b400/0x48868a4e43949504 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f5d3 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.990897:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129751.990899:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129751.990907:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a511b400/0x48868a4e43949504 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5d3 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129751.990919:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a511b400/0x48868a4e43949504 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5d3 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129751.990929:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a511b400, rc 0) 00000100:00100000:1.0:1746129751.990966:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:1964:x1830949052186496:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 136us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129751.990971:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10914 00000100:00100000:1.0:1746129751.990984:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10915 00000100:00100000:1.0:1746129751.990988:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+8:1964:x1830949052186624:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129751.990994:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129751.991002:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a511b800/0x48868a4e4394950b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f5da expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129751.991011:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129751.991012:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129751.991015:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a511b800/0x48868a4e4394950b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5da expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129751.991025:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a511b800/0x48868a4e4394950b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5da expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129751.991031:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a511b800, rc 0) 00000100:00100000:1.0:1746129751.991044:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:1964:x1830949052186624:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 56us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129751.991051:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10915 00000100:00100000:0.0:1746129751.993310:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.993359:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052186880 00000100:00100000:2.0:1746129751.993366:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052186880 00002000:00100000:2.0:1746129751.993413:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009adad880 x1830949052186880/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.993422:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adad880 with x1830949052186880 ext(3145728->4194303) 00002000:00010000:2.0:1746129751.993427:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adad880 00000100:00100000:2.0:1746129751.993456:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4064 00000100:00100000:2.0:1746129751.993462:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052186880:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129751.997017:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129751.998803:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052187136 00000100:00100000:2.0:1746129751.998813:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052187136 00002000:00100000:2.0:1746129751.998864:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009adac700 x1830949052187136/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/0 e 0 to 0 dl 1746129762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129751.998873:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adac700 with x1830949052187136 ext(3145728->4194303) 00002000:00010000:2.0:1746129751.998878:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adac700 00000100:00100000:2.0:1746129751.998897:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4065 00000100:00100000:2.0:1746129751.998903:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949052187136:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129752.008314:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.008363:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.008385:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052187392 00000100:00100000:1.0:1746129752.008418:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052187392 00002000:00100000:1.0:1746129752.008451:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012ba3b100 x1830949052187392/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129752.008459:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3b100 with x1830949052187392 ext(3145728->4194303) 00002000:00010000:1.0:1746129752.008465:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba3b100 00000100:00100000:1.0:1746129752.008497:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4066 00000100:00100000:1.0:1746129752.008505:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949052187392:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129752.008673:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052187648 00000100:00100000:2.0:1746129752.008676:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052187648 00000100:00100000:2.0:1746129752.008703:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9868 00000100:00100000:2.0:1746129752.008708:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6141239f-0c60-480d-830c-e22ba61457b0+7:28593:x1830949052187648:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129752.008716:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.008730:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e43949512 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f5e1 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.008794:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e43949519 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129752.008806:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bdc00/0x48868a4e439494f6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5c5 expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.008812:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e43949519 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129752.008834:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bdc00/0x48868a4e439494f6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5c5 expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.008842:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bdc00/0x48868a4e439494f6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5c5 expref: 8 pid: 14313 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.008867:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053304064:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129752.008925:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b7b0c9c0 going to sleep for 11 seconds 00000100:00080000:2.0:1746129752.008976:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746129752.012898:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052186880:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19425us (19584us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129752.012911:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4064 00002000:00100000:2.0:1746129752.012923:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009adad880 x1830949052186880/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:492/0 lens 488/440 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.012932:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adad880 with x1830949052186880 ext(3145728->4194303) 00002000:00010000:2.0:1746129752.012937:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adad880 00000100:00100000:2.0:1746129752.017536:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053304064:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129752.017556:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e43949519 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:3.0:1746129752.018668:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949052187136:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19762us (21656us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129752.018677:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4065 00002000:00100000:3.0:1746129752.018686:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009adac700 x1830949052187136/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:492/0 lens 488/440 e 0 to 0 dl 1746129762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129752.018694:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adac700 with x1830949052187136 ext(3145728->4194303) 00002000:00010000:3.0:1746129752.018698:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adac700 00000100:00100000:0.0:1746129752.020808:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.021133:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052187776 00000100:00100000:3.0:1746129752.021141:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052187776 00010000:00010000:3.0:1746129752.021170:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bdc00/0x48868a4e439494f6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5c5 expref: 9 pid: 14313 timeout: 798 lvb_type: 0 00000100:00100000:3.0:1746129752.021208:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5241 00000100:00100000:3.0:1746129752.021215:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052187776:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129752.021226:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129752.021232:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bdc00/0x48868a4e439494f6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5c5 expref: 9 pid: 14313 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129752.021246:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bdc00/0x48868a4e439494f6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5c5 expref: 9 pid: 14313 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129752.021263:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bdc00/0x48868a4e439494f6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5c5 expref: 9 pid: 14313 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129752.021291:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129752.021296:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e43949519 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.021304:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e43949519 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.021309:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e43949519 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.021325:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129752.021368:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052187776:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 153us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129752.021374:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5241 00010000:00010000:2.0:1746129752.021520:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e43949519 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129752.021527:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e43949519 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:2.0:1746129752.021543:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129752.021658:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e43949512 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5e1 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.021673:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e43949519 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5e1 expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.021678:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129752.021680:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129752.021682:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d7f8a00, rc 0) 00000100:00100000:2.0:1746129752.021703:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6141239f-0c60-480d-830c-e22ba61457b0+8:28593:x1830949052187648:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 12995us (13396us total) trans 8589943652 rc 0/0 00000100:00100000:2.0:1746129752.021709:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9868 00000100:00100000:0.0:1746129752.022561:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949052187392:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14055us (14195us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129752.022569:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4066 00002000:00100000:0.0:1746129752.022576:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012ba3b100 x1830949052187392/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129752.022584:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3b100 with x1830949052187392 ext(3145728->4194303) 00002000:00010000:0.0:1746129752.022587:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba3b100 00000100:00100000:0.0:1746129752.026455:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.026688:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052187904 00000100:00100000:2.0:1746129752.026696:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052187904 00000100:00100000:2.0:1746129752.027138:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9869 00000100:00100000:2.0:1746129752.027146:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6141239f-0c60-480d-830c-e22ba61457b0+8:28593:x1830949052187904:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129752.027167:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.027181:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a14a00/0x48868a4e43949527 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f5e8 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.027249:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394952e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129752.027261:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e43949519 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5e1 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.027267:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394952e lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129752.027295:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e43949519 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5e1 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.027305:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e43949519 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5e1 expref: 9 pid: 14313 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.027315:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053304192:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129752.027406:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b7b0c9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746129752.028983:0:12137:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129752.030445:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.030909:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052188160 00000100:00100000:2.0:1746129752.030918:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052188160 00002000:00100000:2.0:1746129752.030954:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009adaf800 x1830949052188160/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.030962:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adaf800 with x1830949052188160 ext(4194304->4964351) 00002000:00010000:2.0:1746129752.030967:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adaf800 00000100:00100000:2.0:1746129752.030996:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4067 00000100:00100000:2.0:1746129752.031003:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052188160:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129752.033337:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.033360:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052188288 00000100:00100000:0.0:1746129752.033365:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052188288 00010000:00010000:0.0:1746129752.033389:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e43949519 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5e1 expref: 10 pid: 14313 timeout: 798 lvb_type: 0 00000100:00100000:0.0:1746129752.033433:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5242 00000100:00100000:0.0:1746129752.033440:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8e0f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+10:1964:x1830949052188288:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129752.033451:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129752.033456:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e43949519 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5e1 expref: 10 pid: 14313 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746129752.033465:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e43949519 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5e1 expref: 10 pid: 14313 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746129752.033483:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129752.033487:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394952e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129752.033495:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394952e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129752.033500:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394952e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129752.033514:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129752.033537:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8e0f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+10:1964:x1830949052188288:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 98us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.033544:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5242 00000100:00100000:0.0:1746129752.034535:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129752.035102:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e43949519 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5e1 expref: 9 pid: 14313 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.035622:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053304192:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129752.035640:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394952e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129752.035648:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394952e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129752.035656:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394952e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:2.0:1746129752.035688:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:2.0:1746129752.035691:0:14313:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129752.035703:0:14313:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394952e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129752.035728:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a14a00/0x48868a4e43949527 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5e8 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.035737:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394952e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5e8 expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.035744:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129752.035746:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129752.035748:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d7f9a00, rc 0) 00000100:00100000:2.0:1746129752.035781:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6141239f-0c60-480d-830c-e22ba61457b0+8:28593:x1830949052187904:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 8636us (9336us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.035787:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9869 00000100:00100000:3.0:1746129752.036755:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052188544 00000100:00100000:3.0:1746129752.036762:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052188544 00002000:00100000:3.0:1746129752.036789:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009adac380 x1830949052188544/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129752.036797:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adac380 with x1830949052188544 ext(4194304->4964351) 00002000:00010000:3.0:1746129752.036801:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adac380 00000100:00100000:3.0:1746129752.036866:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4068 00000100:00100000:3.0:1746129752.036873:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949052188544:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129752.039860:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052188160:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8836us (9400us total) trans 0 rc 770048/770048 00000100:00100000:2.0:1746129752.039870:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4067 00002000:00100000:2.0:1746129752.039878:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009adaf800 x1830949052188160/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.039886:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adaf800 with x1830949052188160 ext(4194304->4964351) 00002000:00010000:2.0:1746129752.039891:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adaf800 00000100:00100000:0.0:1746129752.042471:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.042515:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052188800 00000100:00100000:2.0:1746129752.042522:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052188800 00000100:00100000:0.0:1746129752.042540:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.042561:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052189056 00000100:00100000:2.0:1746129752.042564:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052189056 00000100:00100000:3.0:1746129752.042904:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9870 00000100:00100000:3.0:1746129752.042916:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:28595:x1830949052188800:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129752.042937:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129752.042953:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f400/0x48868a4e43949535 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f5ef expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.043044:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ec00/0x48868a4e4394953c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.043055:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ec00/0x48868a4e4394953c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.043064:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ec00/0x48868a4e4394953c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.043076:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fa00/0x48868a4e43949543 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.043082:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fa00/0x48868a4e43949543 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.043087:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fa00/0x48868a4e43949543 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.043176:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f200/0x48868a4e4394954a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.043184:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f200/0x48868a4e4394954a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.043190:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f200/0x48868a4e4394954a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:3.0:1746129752.043198:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129752.043265:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ec00/0x48868a4e4394953c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.043275:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ec00/0x48868a4e4394953c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.043280:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ec00/0x48868a4e4394953c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.043285:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800acc1ec00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129752.043288:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ec00/0x48868a4e4394953c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.043293:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ec00/0x48868a4e4394953c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.043302:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129752.043304:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129752.043307:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ec00/0x48868a4e4394953c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.043311:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ec00/0x48868a4e4394953c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.043332:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fa00/0x48868a4e43949543 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.043337:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fa00/0x48868a4e43949543 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.043340:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fa00/0x48868a4e43949543 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.043344:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800acc1fa00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129752.043346:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fa00/0x48868a4e43949543 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.043353:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fa00/0x48868a4e43949543 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.043358:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009baa2a00) 00010000:00010000:3.0:1746129752.043360:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129752.043361:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fa00/0x48868a4e43949543 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.043365:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fa00/0x48868a4e43949543 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.043404:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f400/0x48868a4e43949535 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5ef expref: 291 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.043414:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f200/0x48868a4e4394954a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5ef expref: 290 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.043420:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129752.043422:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129752.043424:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1f200, rc 0) 00000100:00100000:2.0:1746129752.043468:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9871 00000100:00100000:2.0:1746129752.043497:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6141239f-0c60-480d-830c-e22ba61457b0+8:28593:x1830949052189056:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129752.043505:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.043515:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1a9be00/0x48868a4e43949558 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f5f6 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.043551:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e4394955f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129752.043558:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e4394955f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129752.043564:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e4394955f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129752.043571:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e4394955f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129752.043576:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e4394955f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129752.043580:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e4394955f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129752.043584:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d7f8a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129752.043586:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e4394955f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129752.043590:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e4394955f lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129752.043597:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129752.043598:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129752.043601:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e4394955f lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129752.043605:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e4394955f lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129752.043634:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1a9be00/0x48868a4e43949558 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5f6 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.043640:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1a9be00/0x48868a4e43949558 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5f6 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.043646:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1a9be00, rc 0) 00000100:00100000:2.0:1746129752.043675:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6141239f-0c60-480d-830c-e22ba61457b0+8:28593:x1830949052189056:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 202us (1135us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129752.043680:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9871 00000100:00100000:3.0:1746129752.044375:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:28595:x1830949052188800:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1460us (1907us total) trans 8589943653 rc 0/0 00000100:00100000:3.0:1746129752.044381:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9870 00000100:00100000:3.0:1746129752.045753:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949052188544:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8876us (11215us total) trans 0 rc 770048/770048 00000100:00100000:3.0:1746129752.045761:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4068 00002000:00100000:3.0:1746129752.045768:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009adac380 x1830949052188544/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129752.045781:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adac380 with x1830949052188544 ext(4194304->4964351) 00002000:00010000:3.0:1746129752.045785:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adac380 00000100:00100000:0.0:1746129752.046381:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.050000:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052189312 00000100:00100000:2.0:1746129752.050011:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052189312 00000100:00100000:2.0:1746129752.050078:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3878 00000100:00100000:2.0:1746129752.050085:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6141239f-0c60-480d-830c-e22ba61457b0+8:28593:x1830949052189312:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:2.0:1746129752.050271:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6141239f-0c60-480d-830c-e22ba61457b0+9:28593:x1830949052189312:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 186us (3891us total) trans 8589943654 rc 0/0 00000100:00100000:2.0:1746129752.050277:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3878 00000100:00100000:0.0:1746129752.051229:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.051922:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052189568 00000100:00100000:1.0:1746129752.051928:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052189568 00000100:00100000:1.0:1746129752.051957:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3879 00000100:00100000:1.0:1746129752.051963:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:28587:x1830949052189568:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129752.052167:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:28587:x1830949052189568:12345-192.168.204.31@tcp:35:cat.0 Request processed in 202us (939us total) trans 8589943655 rc 0/0 00000100:00100000:1.0:1746129752.052173:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3879 00000100:00100000:0.0:1746129752.098067:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.098128:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052189824 00000100:00100000:3.0:1746129752.098136:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052189824 00000100:00100000:3.0:1746129752.098191:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9872 00000100:00100000:3.0:1746129752.098198:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28600:x1830949052189824:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129752.098220:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129752.098235:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1e000/0x48868a4e43949566 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f5fd expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.098327:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e4394956d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129752.098337:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e4394956d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129752.098346:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e4394956d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129752.098357:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ee00/0x48868a4e43949574 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129752.098362:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ee00/0x48868a4e43949574 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129752.098366:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ee00/0x48868a4e43949574 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129752.098464:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e4394957b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129752.098476:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e4394957b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129752.098482:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e4394957b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129752.098490:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129752.098619:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e4394956d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129752.098625:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e4394956d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129752.098630:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e4394956d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129752.098635:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800acc1ea00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129752.098637:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e4394956d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129752.098643:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e4394956d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129752.098652:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129752.098654:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129752.098656:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e4394956d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129752.098660:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e4394956d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129752.099409:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ee00/0x48868a4e43949574 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129752.099419:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ee00/0x48868a4e43949574 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129752.099424:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ee00/0x48868a4e43949574 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129752.099432:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800acc1ee00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129752.099434:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ee00/0x48868a4e43949574 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129752.099439:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ee00/0x48868a4e43949574 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129752.099447:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009baa2a00) 00010000:00010000:3.0:1746129752.099449:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129752.099452:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ee00/0x48868a4e43949574 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129752.099456:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ee00/0x48868a4e43949574 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129752.099492:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1e000/0x48868a4e43949566 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5fd expref: 20 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.099503:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e4394957b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5fd expref: 19 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.099509:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129752.099511:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129752.099513:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1fe00, rc 0) 00000100:00100000:3.0:1746129752.099561:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:28600:x1830949052189824:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1363us (1501us total) trans 8589943656 rc 0/0 00000100:00100000:3.0:1746129752.099568:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9872 00000100:00100000:0.0:1746129752.107085:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.107174:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052189952 00000100:00100000:2.0:1746129752.107182:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052189952 00000100:00100000:2.0:1746129752.107227:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10916 00000100:00100000:2.0:1746129752.107233:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28600:x1830949052189952:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129752.107247:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.107262:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9800/0x48868a4e43949589 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f604 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.107290:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a511b200/0x48868a4e439494da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5be expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.107299:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a511b400/0x48868a4e43949504 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5d3 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.107307:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a511a800/0x48868a4e439494fd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5cc expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.107312:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.107314:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.107317:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9800/0x48868a4e43949589 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3997696->4132863] (req 3997696->4132863) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f604 expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.107351:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a511a800/0x48868a4e439494fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5cc expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.107364:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a511a800/0x48868a4e439494fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5cc expref: 18 pid: 8436 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.107377:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053304320:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129752.108778:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a511b400/0x48868a4e43949504 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5d3 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.108788:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a511b400/0x48868a4e43949504 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5d3 expref: 8 pid: 8436 timeout: 798 lvb_type: 1 00000100:00100000:2.0:1746129752.108796:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053304448:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129752.108821:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a511b200/0x48868a4e439494da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5be expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.108828:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a511b200/0x48868a4e439494da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5be expref: 28 pid: 8436 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.108834:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053304576:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129752.108844:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b7b0ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129752.121887:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053304320:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129752.121902:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053304448:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129752.121910:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053304576:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129752.121937:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9800/0x48868a4e43949589 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3997696->4132863] (req 3997696->4132863) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f604 expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.121953:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d7f9800, rc 0) 00000100:00100000:2.0:1746129752.122003:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28600:x1830949052189952:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 14769us (14924us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.122013:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10916 00000100:00100000:0.0:1746129752.126099:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.126133:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.126173:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.126255:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052190080 00000100:00100000:2.0:1746129752.126262:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052190080 00010000:00010000:2.0:1746129752.126290:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a511b200/0x48868a4e439494da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5be expref: 29 pid: 8436 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.126310:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052190336 00000100:00100000:2.0:1746129752.126312:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052190336 00010000:00010000:2.0:1746129752.126320:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a511b400/0x48868a4e43949504 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5d3 expref: 9 pid: 8436 timeout: 798 lvb_type: 1 00000100:00100000:2.0:1746129752.126329:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052190208 00000100:00100000:2.0:1746129752.126330:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052190208 00010000:00010000:2.0:1746129752.126337:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a511a800/0x48868a4e439494fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5cc expref: 18 pid: 8436 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.126348:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5243 00000100:00100000:2.0:1746129752.126352:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1964:x1830949052190080:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129752.126362:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129752.126379:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a511b200/0x48868a4e439494da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5be expref: 29 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.126387:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a511b200/0x48868a4e439494da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5be expref: 29 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.126417:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a511b200/0x48868a4e439494da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5be expref: 29 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.126448:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129752.126480:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1964:x1830949052190080:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 126us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.126485:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5243 00000100:00100000:2.0:1746129752.126499:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5244 00000100:00100000:2.0:1746129752.126504:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+9:1964:x1830949052190336:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129752.126509:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129752.126516:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a511b400/0x48868a4e43949504 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5d3 expref: 9 pid: 8436 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746129752.126523:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a511b400/0x48868a4e43949504 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5d3 expref: 9 pid: 8436 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746129752.126534:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a511b400/0x48868a4e43949504 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5d3 expref: 9 pid: 8436 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746129752.126541:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129752.126553:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+8:1964:x1830949052190336:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 49us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.126558:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5244 00000100:00100000:2.0:1746129752.126565:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5245 00000100:00100000:2.0:1746129752.126569:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949052190208:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129752.126575:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129752.126581:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a511a800/0x48868a4e439494fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5cc expref: 18 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.126588:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a511a800/0x48868a4e439494fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5cc expref: 18 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.126597:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a511a800/0x48868a4e439494fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5cc expref: 18 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.126604:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.126606:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.126611:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9800/0x48868a4e43949589 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3997696->18446744073709551615] (req 3997696->4132863) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f604 expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.126618:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9800/0x48868a4e43949589 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3997696->18446744073709551615] (req 3997696->4132863) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f604 expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.126642:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9800/0x48868a4e43949589 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3997696->18446744073709551615] (req 3997696->4132863) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f604 expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129752.126652:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053304704:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129752.126698:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b7b0ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129752.130696:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.130888:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053304704:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129752.130904:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129752.130937:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052190208:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4366us (4762us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.130947:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5245 00000100:00100000:3.0:1746129752.131020:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052190592 00000100:00100000:3.0:1746129752.131026:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052190592 00002000:00100000:3.0:1746129752.131057:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3997696->4001791) req@ffff880131462300 x1830949052190592/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129752.131065:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131462300 with x1830949052190592 ext(3997696->4001791) 00002000:00010000:3.0:1746129752.131069:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131462300 00000100:00100000:3.0:1746129752.131081:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4069 00000100:00100000:3.0:1746129752.131088:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052190592:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129752.131232:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052190592:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 143us (542us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129752.131240:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4069 00002000:00100000:3.0:1746129752.131246:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3997696->4001791) req@ffff880131462300 x1830949052190592/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/4536 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129752.131252:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131462300 with x1830949052190592 ext(3997696->4001791) 00002000:00010000:3.0:1746129752.131256:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131462300 00000100:00100000:0.0:1746129752.139143:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.139291:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052190848 00000100:00100000:2.0:1746129752.139298:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052190848 00002000:00100000:2.0:1746129752.139329:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4128768->4132863) req@ffff880131460700 x1830949052190848/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.139338:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131460700 with x1830949052190848 ext(4128768->4132863) 00002000:00010000:2.0:1746129752.139342:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131460700 00000100:00100000:2.0:1746129752.139525:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4070 00000100:00100000:2.0:1746129752.139532:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949052190848:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129752.139678:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949052190848:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 146us (541us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129752.139684:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4070 00002000:00100000:2.0:1746129752.139689:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4128768->4132863) req@ffff880131460700 x1830949052190848/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/4536 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.139695:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131460700 with x1830949052190848 ext(4128768->4132863) 00002000:00010000:2.0:1746129752.139698:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131460700 00000100:00100000:0.0:1746129752.143416:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.145190:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052191104 00000100:00100000:2.0:1746129752.145198:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052191104 00000100:00100000:2.0:1746129752.145247:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3880 00000100:00100000:2.0:1746129752.145253:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:28600:x1830949052191104:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129752.145437:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:28600:x1830949052191104:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 184us (2027us total) trans 8589943657 rc 0/0 00000100:00100000:2.0:1746129752.145443:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3880 00000100:00100000:0.0:1746129752.181734:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.182144:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052191232 00000100:00100000:2.0:1746129752.182151:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052191232 00000100:00100000:2.0:1746129752.182187:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10917 00000100:00100000:2.0:1746129752.182193:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1963:x1830949052191232:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129752.182210:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.182224:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801356e3600/0x48868a4e43949590 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f60b expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129752.182267:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053304832:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129752.185949:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b7b0c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129752.186186:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.186348:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052191488 00000100:00100000:3.0:1746129752.186354:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052191488 00000100:00100000:3.0:1746129752.186671:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9873 00000100:00100000:3.0:1746129752.186680:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:28608:x1830949052191488:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129752.186698:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129752.186712:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949597 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f612 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.186792:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f400/0x48868a4e4394959e lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129752.186804:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f400/0x48868a4e4394959e lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129752.186812:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f400/0x48868a4e4394959e lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129752.186821:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129752.186928:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949597 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f612 expref: 294 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.186944:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f400/0x48868a4e4394959e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f612 expref: 293 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.186950:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129752.186952:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746129752.186955:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1f400, rc 0) 00000100:00100000:3.0:1746129752.186999:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:28608:x1830949052191488:12345-192.168.204.31@tcp:101:cat.0 Request processed in 320us (815us total) trans 8589943658 rc 0/0 00000100:00100000:3.0:1746129752.187005:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9873 00000100:00100000:0.0:1746129752.190189:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.190313:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053304832:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129752.190336:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801356e3600/0x48868a4e43949590 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f60b expref: 18 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129752.190349:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356e3600/0x48868a4e43949590 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f60b expref: 18 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129752.190362:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356e3600, rc 0) 00000100:00100000:3.0:1746129752.190409:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1963:x1830949052191232:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8216us (8682us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129752.190416:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10917 00000100:00100000:3.0:1746129752.190434:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052191616 00000100:00100000:3.0:1746129752.190438:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052191616 00000100:00100000:3.0:1746129752.190458:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10918 00000100:00100000:3.0:1746129752.190463:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1964:x1830949052191616:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129752.190473:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129752.190482:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fa00/0x48868a4e439495ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f619 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129752.190512:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053304960:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129752.190552:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129752.199045:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053304960:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129752.199089:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fa00/0x48868a4e439495ac lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f619 expref: 29 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129752.199101:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fa00/0x48868a4e439495ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f619 expref: 29 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129752.199122:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1fa00, rc 0) 00000100:00100000:3.0:1746129752.199163:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1964:x1830949052191616:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8698us (8981us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129752.199174:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10918 00000100:00100000:0.0:1746129752.213377:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.213474:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052191744 00000100:00100000:3.0:1746129752.213482:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052191744 00000100:00100000:3.0:1746129752.213520:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10919 00000100:00100000:3.0:1746129752.213527:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:28595:x1830949052191744:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129752.213543:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129752.213559:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ec00/0x48868a4e439495b3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f620 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.213584:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a149600/0x48868a4e439492a3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f498 expref: 7 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129752.213592:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4600/0x48868a4e4394937c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f501 expref: 29 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129752.213598:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094b2ce00/0x48868a4e4394934b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4d0 expref: 16 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129752.213603:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129752.213605:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129752.213608:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ec00/0x48868a4e439495b3 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1617920->2097151] (req 1617920->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f620 expref: 29 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.213633:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094b2ce00/0x48868a4e4394934b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4d0 expref: 16 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129752.213644:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094b2ce00/0x48868a4e4394934b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4d0 expref: 16 pid: 7975 timeout: 798 lvb_type: 1 00000100:00100000:3.0:1746129752.213656:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053305088:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129752.215487:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4600/0x48868a4e4394937c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f501 expref: 29 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129752.215499:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4600/0x48868a4e4394937c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f501 expref: 29 pid: 8435 timeout: 798 lvb_type: 1 00000100:00100000:3.0:1746129752.215511:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053305216:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129752.216413:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a149600/0x48868a4e439492a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f498 expref: 7 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129752.216423:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a149600/0x48868a4e439492a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f498 expref: 7 pid: 3623 timeout: 798 lvb_type: 1 00000100:00100000:3.0:1746129752.216433:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053305344:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129752.217549:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129752.217684:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.218122:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052191872 00000100:00100000:1.0:1746129752.218129:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052191872 00000100:00100000:1.0:1746129752.218161:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10920 00000100:00100000:1.0:1746129752.218167:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28607:x1830949052191872:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129752.218180:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129752.218193:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e439495ba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f627 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.218216:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9800/0x48868a4e43949589 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3997696->18446744073709551615] (req 3997696->4132863) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f604 expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.218223:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129752.218224:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129752.218227:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e439495ba lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f627 expref: 18 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.218250:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9800/0x48868a4e43949589 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3997696->18446744073709551615] (req 3997696->4132863) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f604 expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.218258:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9800/0x48868a4e43949589 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3997696->18446744073709551615] (req 3997696->4132863) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f604 expref: 18 pid: 4589 timeout: 798 lvb_type: 0 00000100:00100000:1.0:1746129752.218268:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053305472:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129752.218320:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129752.221595:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053305088:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129752.221608:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053305216:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129752.222656:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.226468:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052192000 00000100:00100000:2.0:1746129752.226479:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052192000 00010000:00010000:2.0:1746129752.226512:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4600/0x48868a4e4394937c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f501 expref: 30 pid: 8435 timeout: 798 lvb_type: 1 00000100:00100000:2.0:1746129752.226547:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5246 00000100:00100000:2.0:1746129752.226553:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949052192000:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129752.226564:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129752.226582:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4600/0x48868a4e4394937c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f501 expref: 30 pid: 8435 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746129752.226591:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4600/0x48868a4e4394937c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f501 expref: 30 pid: 8435 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746129752.226608:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4600/0x48868a4e4394937c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f501 expref: 30 pid: 8435 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746129752.226627:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129752.226676:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949052192000:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 123us (4024us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.226683:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5246 00000100:00100000:0.0:1746129752.228826:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.228885:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.228907:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.228940:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.228959:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052192128 00000100:00100000:0.0:1746129752.228965:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052192128 00010000:00010000:0.0:1746129752.228991:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a149600/0x48868a4e439492a3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f498 expref: 8 pid: 3623 timeout: 798 lvb_type: 1 00000100:00100000:1.0:1746129752.229371:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053305472:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129752.229404:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e439495ba lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f627 expref: 18 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.229417:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801360b3400, rc 0) 00000100:00100000:1.0:1746129752.229452:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28607:x1830949052191872:12345-192.168.204.31@tcp:101:cat.0 Request processed in 11285us (11770us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129752.229459:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10920 00000100:00100000:1.0:1746129752.229476:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052192384 00000100:00100000:1.0:1746129752.229478:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052192384 00000100:00100000:1.0:1746129752.229493:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10921 00000100:00100000:1.0:1746129752.229498:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:28608:x1830949052192384:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129752.229508:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129752.229519:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801360b3e00/0x48868a4e439495c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f62e expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.229535:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129752.229539:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801360b3e00/0x48868a4e439495c1 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f62e expref: 30 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.229547:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801360b3e00/0x48868a4e439495c1 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f62e expref: 30 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129752.229580:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052192512 00000100:00100000:0.0:1746129752.229586:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052192512 00010000:00010000:0.0:1746129752.229599:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094b2ce00/0x48868a4e4394934b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4d0 expref: 18 pid: 7975 timeout: 798 lvb_type: 1 00010000:00010000:1.0:1746129752.229619:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801360b3e00, rc 0) 00000100:00100000:0.0:1746129752.229789:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5247 00000100:00100000:0.0:1746129752.229801:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949052192128:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129752.229809:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129752.229832:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a149600/0x48868a4e439492a3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f498 expref: 8 pid: 3623 timeout: 798 lvb_type: 1 00000100:00100000:1.0:1746129752.229876:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:28608:x1830949052192384:12345-192.168.204.31@tcp:101:cat.0 Request processed in 377us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129752.229880:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10921 00000100:00100000:1.0:1746129752.229908:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5248 00000100:00100000:1.0:1746129752.229917:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949052192512:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129752.229926:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129752.229964:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a149600/0x48868a4e439492a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f498 expref: 8 pid: 3623 timeout: 798 lvb_type: 1 00010000:00010000:1.0:1746129752.229995:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094b2ce00/0x48868a4e4394934b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4d0 expref: 18 pid: 7975 timeout: 798 lvb_type: 1 00010000:00010000:1.0:1746129752.230007:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094b2ce00/0x48868a4e4394934b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4d0 expref: 18 pid: 7975 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746129752.230077:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129752.230094:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949052192128:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 298us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.230100:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5247 00010000:00010000:3.0:1746129752.230102:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a149600/0x48868a4e439492a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f498 expref: 8 pid: 3623 timeout: 798 lvb_type: 1 00000100:00100000:3.0:1746129752.230119:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053305344:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129752.230140:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ec00/0x48868a4e439495b3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1617920->2097151] (req 1617920->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f620 expref: 29 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.230149:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1ec00, rc 0) 00000100:00100000:3.0:1746129752.230172:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:28595:x1830949052191744:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 16645us (16803us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129752.230178:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10919 00000100:00100000:3.0:1746129752.230196:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052192256 00000100:00100000:3.0:1746129752.230198:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052192256 00002000:00100000:3.0:1746129752.230217:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3997696->4132863) req@ffff88009be67100 x1830949052192256/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129752.230226:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be67100 with x1830949052192256 ext(3997696->4132863) 00010000:00010000:3.0:1746129752.230231:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9800/0x48868a4e43949589 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3997696->18446744073709551615] (req 3997696->4132863) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f604 expref: 19 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129752.230246:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9800/0x48868a4e43949589 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3997696->18446744073709551615] (req 3997696->4132863) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f604 expref: 19 pid: 4589 timeout: 798 lvb_type: 0 00002000:00010000:3.0:1746129752.230252:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009be67100 00000100:00100000:3.0:1746129752.230262:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 586 00000100:00100000:3.0:1746129752.230267:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1961:x1830949052192256:12345-192.168.204.31@tcp:4:cat.0 00010000:00010000:1.0:1746129752.230520:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094b2ce00/0x48868a4e4394934b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4d0 expref: 20 pid: 7975 timeout: 798 lvb_type: 1 00010000:00010000:1.0:1746129752.230543:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.230544:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.230549:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ec00/0x48868a4e439495b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f620 expref: 28 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.230556:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ec00/0x48868a4e439495b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f620 expref: 28 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.230578:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ec00/0x48868a4e439495b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f620 expref: 28 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129752.230588:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053305600:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129752.230631:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26000 going to sleep for 11 seconds 00000100:00100000:2.0:1746129752.238128:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.238289:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052192768 00000100:00100000:3.0:1746129752.238296:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052192768 00002000:00100000:3.0:1746129752.238335:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3ea:0x0] (1617920->1622015) req@ffff8800a02fdc00 x1830949052192768/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129752.238349:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02fdc00 with x1830949052192768 ext(1617920->1622015) 00002000:00010000:3.0:1746129752.238354:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a02fdc00 00000100:00100000:3.0:1746129752.238370:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4071 00000100:00100000:3.0:1746129752.238377:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949052192768:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129752.238533:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949052192768:12345-192.168.204.31@tcp:3:cat.0 Request processed in 156us (412us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129752.238539:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4071 00002000:00100000:3.0:1746129752.238544:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3ea:0x0] (1617920->1622015) req@ffff8800a02fdc00 x1830949052192768/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/4536 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129752.238550:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02fdc00 with x1830949052192768 ext(1617920->1622015) 00002000:00010000:3.0:1746129752.238552:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a02fdc00 00000100:00100000:1.0:1746129752.238670:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053305600:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129752.238688:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129752.238711:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1961:x1830949052192512:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8793us (9769us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129752.238718:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5248 00000100:00100000:3.0:1746129752.239507:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1961:x1830949052192256:12345-192.168.204.31@tcp:4:cat.0 Request processed in 9238us (10620us total) trans 17179873149 rc 0/0 00000100:00100000:3.0:1746129752.239514:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 586 00002000:00100000:3.0:1746129752.239520:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3997696->4132863) req@ffff88009be67100 x1830949052192256/t17179873149(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/448 e 0 to 0 dl 1746129763 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129752.239527:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be67100 with x1830949052192256 ext(3997696->4132863) 00010000:00010000:3.0:1746129752.239534:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9800/0x48868a4e43949589 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3997696->18446744073709551615] (req 3997696->4132863) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f604 expref: 19 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129752.239545:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9800/0x48868a4e43949589 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3997696->18446744073709551615] (req 3997696->4132863) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f604 expref: 19 pid: 4589 timeout: 798 lvb_type: 0 00002000:00010000:3.0:1746129752.239554:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009be67100 00000100:00100000:0.0:1746129752.254261:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.254303:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.254368:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052192896 00000100:00100000:1.0:1746129752.254375:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052192896 00010000:00010000:1.0:1746129752.254412:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9800/0x48868a4e43949589 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3997696->18446744073709551615] (req 3997696->4132863) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f604 expref: 19 pid: 4589 timeout: 798 lvb_type: 0 00000100:00100000:1.0:1746129752.254451:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5249 00000100:00100000:1.0:1746129752.254458:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8e0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1963:x1830949052192896:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129752.254473:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129752.254492:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9800/0x48868a4e43949589 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3997696->18446744073709551615] (req 3997696->4132863) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f604 expref: 19 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.254502:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9800/0x48868a4e43949589 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3997696->18446744073709551615] (req 3997696->4132863) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f604 expref: 19 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.254521:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d7f9800/0x48868a4e43949589 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3997696->18446744073709551615] (req 3997696->4132863) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f604 expref: 19 pid: 4589 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.254720:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052193024 00000100:00100000:2.0:1746129752.254724:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052193024 00010000:00010000:1.0:1746129752.254730:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.254732:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.254738:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e439495ba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f627 expref: 18 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.254746:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e439495ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f627 expref: 18 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129752.254775:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10922 00000100:00100000:2.0:1746129752.254781:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:28595:x1830949052193024:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129752.254793:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.254802:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801356e2e00/0x48868a4e439495c8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f635 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.254833:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.254834:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.254838:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801360b3e00/0x48868a4e439495c1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f62e expref: 30 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.254843:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801360b3e00/0x48868a4e439495c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f62e expref: 30 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.254874:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e439495ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f627 expref: 18 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.254882:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801360b3e00/0x48868a4e439495c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f62e expref: 30 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.254889:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa79800/0x48868a4e4394948d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f58d expref: 30 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.254896:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f9bc800/0x48868a4e439494cc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5b0 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.254901:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746129752.254902:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746129752.254905:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801356e2e00/0x48868a4e439495c8 lrc: 7/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->2605055] (req 2097152->2605055) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f635 expref: 30 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.255002:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801360b3e00/0x48868a4e439495c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f62e expref: 30 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.255013:0:7109:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801360b3e00/0x48868a4e439495c1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f62e expref: 30 pid: 20441 timeout: 798 lvb_type: 0 00000100:00100000:1.0:1746129752.255023:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053305728:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129752.255237:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f9bc800/0x48868a4e439494cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5b0 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.255245:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f9bc800/0x48868a4e439494cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5b0 expref: 18 pid: 8436 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.255252:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053305856:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129752.255616:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e439495ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f627 expref: 18 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.255624:0:7109:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e439495ba lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f627 expref: 18 pid: 20441 timeout: 798 lvb_type: 0 00000100:00100000:1.0:1746129752.255632:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053305984:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129752.255649:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26000 going to sleep for 11 seconds 00010000:00010000:2.0:1746129752.255835:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa79800/0x48868a4e4394948d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f58d expref: 30 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.255843:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa79800/0x48868a4e4394948d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f58d expref: 30 pid: 4589 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.255866:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053306112:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129752.255897:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801360b3e00/0x48868a4e439495c1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f62e expref: 30 pid: 20441 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.255904:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801360b3e00/0x48868a4e439495c1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f62e expref: 30 pid: 20441 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.255916:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053306240:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129752.255938:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e439495ba lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f627 expref: 18 pid: 20441 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.255949:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e439495ba lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f627 expref: 18 pid: 20441 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.255956:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053306368:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129752.255971:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b7b0c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129752.263787:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053305984:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129752.263938:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053305856:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129752.263947:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053306112:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129752.263954:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053306240:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129752.263960:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053306368:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129752.263989:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801356e2e00/0x48868a4e439495c8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->2605055] (req 2097152->2605055) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f635 expref: 30 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.264004:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356e2e00, rc 0) 00000100:00100000:2.0:1746129752.264040:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:28595:x1830949052193024:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 9259us (9736us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.264049:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10922 00000100:00100000:0.0:1746129752.271841:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.271893:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.271916:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052193152 00000100:00100000:3.0:1746129752.271924:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052193152 00010000:00010000:3.0:1746129752.271952:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9bc800/0x48868a4e439494cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5b0 expref: 19 pid: 8436 timeout: 798 lvb_type: 0 00000100:00100000:0.0:1746129752.271959:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053305728:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129752.271974:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052193280 00010000:00010000:0.0:1746129752.271975:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129752.271976:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052193280 00010000:00010000:3.0:1746129752.271985:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa79800/0x48868a4e4394948d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f58d expref: 30 pid: 4589 timeout: 798 lvb_type: 0 00000100:00100000:0.0:1746129752.272004:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8e0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1963:x1830949052192896:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 17547us (17747us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.272011:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5249 00000100:00100000:0.0:1746129752.272049:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5250 00000100:00100000:0.0:1746129752.272055:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949052193152:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129752.272068:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129752.272085:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f9bc800/0x48868a4e439494cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5b0 expref: 18 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746129752.272100:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f9bc800/0x48868a4e439494cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5b0 expref: 18 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746129752.272116:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f9bc800/0x48868a4e439494cc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5b0 expref: 18 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746129752.272933:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129752.273063:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052193152:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1006us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.273069:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5250 00000100:00100000:0.0:1746129752.273082:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5251 00000100:00100000:0.0:1746129752.273087:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949052193280:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129752.273093:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129752.273101:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa79800/0x48868a4e4394948d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f58d expref: 30 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746129752.273109:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa79800/0x48868a4e4394948d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f58d expref: 30 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746129752.273120:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa79800/0x48868a4e4394948d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f58d expref: 30 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746129752.273126:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129752.273136:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949052193280:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 50us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.273144:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5251 00000100:00100000:0.0:1746129752.275546:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.276966:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.277183:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052193664 00000100:00100000:1.0:1746129752.277190:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052193664 00002000:00100000:1.0:1746129752.277228:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009c1c4000 x1830949052193664/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129752.277237:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c4000 with x1830949052193664 ext(3145728->4194303) 00010000:00010000:1.0:1746129752.277244:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801360b3e00/0x48868a4e439495c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f62e expref: 29 pid: 20441 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.277260:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801360b3e00/0x48868a4e439495c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f62e expref: 29 pid: 20441 timeout: 798 lvb_type: 0 00002000:00010000:1.0:1746129752.277267:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c1c4000 00000100:00100000:1.0:1746129752.277332:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052193792 00000100:00100000:1.0:1746129752.277336:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052193792 00002000:00100000:1.0:1746129752.277350:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009c1c4380 x1830949052193792/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129752.277356:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c4380 with x1830949052193792 ext(3145728->4194303) 00010000:00010000:1.0:1746129752.277360:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e439495ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f627 expref: 17 pid: 20441 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.277368:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e439495ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f627 expref: 17 pid: 20441 timeout: 798 lvb_type: 0 00002000:00010000:1.0:1746129752.277374:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c1c4380 00000100:00100000:1.0:1746129752.277398:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 587 00000100:00100000:1.0:1746129752.277406:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1964:x1830949052193664:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129752.277509:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 588 00000100:00100000:3.0:1746129752.277517:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1963:x1830949052193792:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129752.290449:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.290822:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052194048 00000100:00100000:2.0:1746129752.290831:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052194048 00000100:00100000:2.0:1746129752.290908:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9874 00000100:00100000:2.0:1746129752.290916:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:28610:x1830949052194048:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129752.290938:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.290953:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e439495cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f63c expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.291025:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e439495d6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129752.291037:0:14314:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394952e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5e8 expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.291044:0:14314:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f200/0x48868a4e4394954a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5ef expref: 292 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.291064:0:14314:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e4394957b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5fd expref: 21 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.291070:0:14314:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e439495d6 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129752.291096:0:14314:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e4394957b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5fd expref: 21 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.291105:0:14314:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e4394957b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5fd expref: 21 pid: 14315 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.291115:0:14314:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053306496:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129752.291193:0:14314:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f200/0x48868a4e4394954a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5ef expref: 292 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.291201:0:14314:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f200/0x48868a4e4394954a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5ef expref: 292 pid: 14314 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.291212:0:14314:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053306624:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129752.291233:0:14314:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394952e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5e8 expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.291240:0:14314:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394952e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5e8 expref: 8 pid: 14313 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.291246:0:14314:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053306752:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129752.291258:0:14314:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b7b0c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129752.296359:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.296403:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.296419:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052194304 00000100:00100000:1.0:1746129752.296426:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052194304 00000100:00100000:0.0:1746129752.296428:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.296628:0:14314:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053306496:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129752.296639:0:14314:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053306624:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129752.296647:0:14314:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053306752:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129752.296656:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052194176 00000100:00100000:1.0:1746129752.296659:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052194176 00010000:00010000:2.0:1746129752.296669:0:14314:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e439495d6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129752.296678:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e4394957b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5fd expref: 22 pid: 14315 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746129752.296678:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f200/0x48868a4e4394954a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5ef expref: 293 pid: 14314 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.296687:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052194432 00000100:00100000:2.0:1746129752.296690:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052194432 00000100:00100000:1.0:1746129752.296699:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5252 00010000:00010000:2.0:1746129752.296702:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394952e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5e8 expref: 9 pid: 14313 timeout: 798 lvb_type: 0 00000100:00100000:0.0:1746129752.296704:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5253 00000100:00100000:1.0:1746129752.296706:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052194176:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129752.296711:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:1963:x1830949052194304:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129752.296715:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129752.296718:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5254 00010000:00010000:0.0:1746129752.296719:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129752.296720:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e4394957b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5fd expref: 22 pid: 14315 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.296723:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052194432:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129752.296723:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f200/0x48868a4e4394954a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5ef expref: 293 pid: 14314 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.296729:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e4394957b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5fd expref: 22 pid: 14315 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.296730:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129752.296734:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394952e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5e8 expref: 9 pid: 14313 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746129752.296737:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f200/0x48868a4e4394954a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5ef expref: 293 pid: 14314 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.296753:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e4394957b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5fd expref: 22 pid: 14315 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.296754:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394952e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5e8 expref: 9 pid: 14313 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746129752.296765:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f200/0x48868a4e4394954a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5ef expref: 293 pid: 14314 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.296772:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394952e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5e8 expref: 9 pid: 14313 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.296772:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129752.296776:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e439495d6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129752.296783:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e439495d6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129752.296789:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e439495d6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129752.296795:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129752.296798:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129752.296798:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129752.296801:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129752.296804:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129752.296825:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052194432:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 101us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129752.296825:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1962:x1830949052194176:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 119us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129752.296826:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1963:x1830949052193792:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19309us (19863us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129752.296827:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:1963:x1830949052194304:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 117us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129752.296830:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5252 00000100:00100000:2.0:1746129752.296833:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5254 00000100:00100000:3.0:1746129752.296834:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 588 00000100:00100000:0.0:1746129752.296836:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5253 00002000:00100000:3.0:1746129752.296842:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009c1c4380 x1830949052193792/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746129752.296866:0:14314:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e439495d6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00002000:00100000:3.0:1746129752.296869:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c4380 with x1830949052193792 ext(3145728->4194303) 00010000:00010000:1.0:1746129752.296871:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e439495d6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.296876:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e439495ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f627 expref: 17 pid: 20441 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129752.296886:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e439495ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f627 expref: 17 pid: 20441 timeout: 798 lvb_type: 0 00000004:00200000:1.0:1746129752.296890:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00002000:00010000:3.0:1746129752.296897:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c1c4380 00010000:00010000:1.0:1746129752.296993:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e439495cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f63c expref: 22 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.297005:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e439495d6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f63c expref: 21 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.297011:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129752.297013:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129752.297015:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d7f9800, rc 0) 00000100:00100000:1.0:1746129752.297045:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:28610:x1830949052194048:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6131us (6603us total) trans 8589943659 rc 0/0 00000100:00100000:1.0:1746129752.297051:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9874 00000100:00100000:1.0:1746129752.301627:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1964:x1830949052193664:12345-192.168.204.31@tcp:3:cat.0 Request processed in 24213us (26079us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129752.301638:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 587 00002000:00100000:1.0:1746129752.302126:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009c1c4000 x1830949052193664/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129752.302135:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c4000 with x1830949052193664 ext(3145728->4194303) 00010000:00010000:1.0:1746129752.302143:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801360b3e00/0x48868a4e439495c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f62e expref: 29 pid: 20441 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.302153:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801360b3e00/0x48868a4e439495c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f62e expref: 29 pid: 20441 timeout: 798 lvb_type: 0 00002000:00010000:1.0:1746129752.302163:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c1c4000 00000100:00100000:0.0:1746129752.303602:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.305210:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052194688 00000100:00100000:1.0:1746129752.305218:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052194688 00002000:00100000:1.0:1746129752.305250:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009be64000 x1830949052194688/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129752.305259:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be64000 with x1830949052194688 ext(4194304->4964351) 00010000:00010000:1.0:1746129752.305265:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e439495ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f627 expref: 17 pid: 20441 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.305276:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e439495ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f627 expref: 17 pid: 20441 timeout: 798 lvb_type: 0 00002000:00010000:1.0:1746129752.305282:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009be64000 00000100:00100000:1.0:1746129752.305307:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 589 00000100:00100000:1.0:1746129752.305313:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052194688:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129752.309504:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.309592:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052194816 00000100:00100000:2.0:1746129752.309600:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052194816 00000100:00100000:2.0:1746129752.309646:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10923 00000100:00100000:2.0:1746129752.309653:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949052194816:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129752.309667:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.309682:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801356e3600/0x48868a4e439495e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f643 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129752.309727:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053306880:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129752.309942:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b7b0c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129752.312177:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.312758:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.313461:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052195200 00000100:00100000:3.0:1746129752.313470:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052195200 00002000:00100000:3.0:1746129752.313505:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88012ba39c00 x1830949052195200/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129752.313514:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba39c00 with x1830949052195200 ext(4194304->4964351) 00010000:00010000:3.0:1746129752.313522:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801360b3e00/0x48868a4e439495c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f62e expref: 29 pid: 20441 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129752.313533:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801360b3e00/0x48868a4e439495c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f62e expref: 29 pid: 20441 timeout: 798 lvb_type: 0 00002000:00010000:3.0:1746129752.313539:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ba39c00 00000100:00100000:3.0:1746129752.313555:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 590 00000100:00100000:3.0:1746129752.313563:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949052195200:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129752.315767:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052194944 00000100:00100000:2.0:1746129752.315777:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052194944 00000100:00100000:2.0:1746129752.315815:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10924 00000100:00100000:2.0:1746129752.315821:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1961:x1830949052194944:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129752.315836:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.315868:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801356e2800/0x48868a4e439495eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f64a expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.315888:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.315896:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801356e2800/0x48868a4e439495eb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f64a expref: 22 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.315906:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356e2800/0x48868a4e439495eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f64a expref: 22 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.315921:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356e2800, rc 0) 00000100:00100000:2.0:1746129752.315957:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1961:x1830949052194944:12345-192.168.204.31@tcp:101:cat.0 Request processed in 136us (3199us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129752.315963:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10924 00000100:00100000:0.0:1746129752.316228:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00010000:3.0:1746129752.316328:0:1877:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime: 1746129747 -> 1746129752 00002000:00010000:3.0:1746129752.316331:0:1877:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime: 1746129747 -> 1746129752 00002000:00010000:3.0:1746129752.316332:0:1877:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime: 1746129747 -> 1746129752 00000100:00100000:3.0:1746129752.316349:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053306880:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129752.316370:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801356e3600/0x48868a4e439495e4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f643 expref: 20 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129752.316378:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356e3600/0x48868a4e439495e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f643 expref: 20 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129752.316403:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356e3600, rc 0) 00000100:00100000:3.0:1746129752.316425:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949052194816:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6773us (6928us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129752.316430:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10923 00000100:00100000:3.0:1746129752.316439:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052195328 00000100:00100000:3.0:1746129752.316441:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052195328 00000100:00100000:3.0:1746129752.316469:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10925 00000100:00100000:3.0:1746129752.316474:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949052195328:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129752.316480:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129752.316487:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x48868a4e439495f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f651 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.316496:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129752.316501:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x48868a4e439495f2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f651 expref: 32 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129752.316506:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x48868a4e439495f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f651 expref: 32 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129752.316512:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11a00, rc 0) 00000100:00100000:3.0:1746129752.316526:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949052195328:12345-192.168.204.31@tcp:101:cat.0 Request processed in 52us (299us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129752.316530:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10925 00000100:00100000:0.0:1746129752.324028:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052194688:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18707us (20423us total) trans 0 rc 770048/770048 00000100:00100000:0.0:1746129752.324039:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 589 00002000:00100000:0.0:1746129752.324048:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009be64000 x1830949052194688/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:H/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129752.324056:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be64000 with x1830949052194688 ext(4194304->4964351) 00010000:00010000:0.0:1746129752.324066:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e439495ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f627 expref: 17 pid: 20441 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746129752.324077:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e439495ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f627 expref: 17 pid: 20441 timeout: 798 lvb_type: 0 00002000:00010000:0.0:1746129752.324083:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009be64000 00000100:00100000:3.0:1746129752.330105:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949052195200:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16534us (17926us total) trans 0 rc 770048/770048 00000100:00100000:3.0:1746129752.330118:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 590 00002000:00100000:3.0:1746129752.330128:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88012ba39c00 x1830949052195200/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:H/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129752.330137:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba39c00 with x1830949052195200 ext(4194304->4964351) 00010000:00010000:3.0:1746129752.330288:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801360b3e00/0x48868a4e439495c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f62e expref: 29 pid: 20441 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129752.330300:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801360b3e00/0x48868a4e439495c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f62e expref: 29 pid: 20441 timeout: 798 lvb_type: 0 00002000:00010000:3.0:1746129752.330307:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ba39c00 00000100:00100000:0.0:1746129752.337315:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.338030:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.338075:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.338166:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052195712 00000100:00100000:2.0:1746129752.338174:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052195712 00010000:00010000:2.0:1746129752.338206:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e439495ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f627 expref: 17 pid: 20441 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.338227:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052195584 00000100:00100000:2.0:1746129752.338229:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052195584 00010000:00010000:2.0:1746129752.338237:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801360b3e00/0x48868a4e439495c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f62e expref: 29 pid: 20441 timeout: 798 lvb_type: 0 00000100:00100000:1.0:1746129752.338311:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052195456 00000100:00100000:1.0:1746129752.338315:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052195456 00000100:00100000:1.0:1746129752.338343:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10926 00000100:00100000:1.0:1746129752.338351:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:28608:x1830949052195456:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129752.338363:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129752.338375:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8e00/0x48868a4e439495f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f658 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.338405:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.338407:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.338413:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8e00/0x48868a4e439495f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2605056->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f658 expref: 31 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.338426:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8e00/0x48868a4e439495f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2605056->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f658 expref: 31 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.338435:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d7f8e00, rc 0) 00000100:00100000:1.0:1746129752.338470:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8790a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:28608:x1830949052195456:12345-192.168.204.31@tcp:101:cat.0 Request processed in 120us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129752.338475:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10926 00000100:00100000:2.0:1746129752.338819:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5255 00000100:00100000:2.0:1746129752.338825:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8793480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949052195712:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129752.338834:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129752.338870:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e439495ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f627 expref: 17 pid: 20441 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.338879:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e439495ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f627 expref: 17 pid: 20441 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.338893:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801360b3400/0x48868a4e439495ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f627 expref: 17 pid: 20441 timeout: 798 lvb_type: 0 00000100:00100000:3.0:1746129752.338959:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5256 00000100:00100000:3.0:1746129752.338966:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1aea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1964:x1830949052195584:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129752.338972:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129752.338980:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801360b3e00/0x48868a4e439495c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f62e expref: 30 pid: 20441 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129752.338989:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801360b3e00/0x48868a4e439495c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f62e expref: 30 pid: 20441 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129752.338999:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801360b3e00/0x48868a4e439495c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f62e expref: 30 pid: 20441 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129752.339010:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129752.339011:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129752.339015:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801356e2e00/0x48868a4e439495c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->2605055] (req 2097152->2605055) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f635 expref: 29 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.339022:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801356e2e00/0x48868a4e439495c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->2605055] (req 2097152->2605055) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f635 expref: 29 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.339045:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801356e2e00/0x48868a4e439495c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->2605055] (req 2097152->2605055) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f635 expref: 29 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129752.339055:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053307008:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129752.339821:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129752.342589:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8793480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949052195712:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3755us (4552us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.342600:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5255 00000100:00100000:3.0:1746129752.342644:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129752.342748:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.342772:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052195840 00000100:00100000:0.0:1746129752.342780:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052195840 00000100:00100000:0.0:1746129752.342817:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10927 00000100:00100000:0.0:1746129752.342827:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28607:x1830949052195840:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129752.342844:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129752.342881:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a14800/0x48868a4e43949600 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f65f expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.342904:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129752.342906:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129752.343627:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a14800/0x48868a4e43949600 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f65f expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.343640:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a14800/0x48868a4e43949600 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f65f expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.343648:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a14800, rc 0) 00000100:00100000:0.0:1746129752.343699:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28607:x1830949052195840:12345-192.168.204.31@tcp:101:cat.0 Request processed in 875us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.343705:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10927 00000100:00100000:1.0:1746129752.343863:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.343921:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052196096 00000100:00100000:3.0:1746129752.343925:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052196096 00002000:00100000:3.0:1746129752.343948:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009206ed80 x1830949052196096/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129752.343956:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206ed80 with x1830949052196096 ext(4194304->4964351) 00002000:00010000:3.0:1746129752.343960:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009206ed80 00000100:00100000:3.0:1746129752.343969:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4072 00000100:00100000:3.0:1746129752.343973:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949052196096:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129752.348947:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053307008:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129752.348970:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129752.349021:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1aea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1964:x1830949052195584:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 10054us (10943us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129752.349032:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5256 00000100:00100000:0.0:1746129752.349131:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.351646:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052196352 00000100:00100000:2.0:1746129752.351655:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052196352 00002000:00100000:2.0:1746129752.351688:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff8800a8792a00 x1830949052196352/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.351695:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8792a00 with x1830949052196352 ext(4194304->4964351) 00002000:00010000:2.0:1746129752.351700:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8792a00 00000100:00100000:2.0:1746129752.351720:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4073 00000100:00100000:2.0:1746129752.351726:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052196352:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129752.353677:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949052196096:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9696us (9807us total) trans 0 rc 770048/770048 00000100:00100000:3.0:1746129752.353690:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4072 00002000:00100000:3.0:1746129752.353698:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009206ed80 x1830949052196096/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129752.353706:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206ed80 with x1830949052196096 ext(4194304->4964351) 00002000:00010000:3.0:1746129752.353710:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009206ed80 00000100:00100000:0.0:1746129752.359063:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.359402:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052196352:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7673us (10270us total) trans 0 rc 770048/770048 00000100:00100000:2.0:1746129752.359413:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4073 00002000:00100000:2.0:1746129752.359423:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff8800a8792a00 x1830949052196352/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.359437:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8792a00 with x1830949052196352 ext(4194304->4964351) 00002000:00010000:2.0:1746129752.359443:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8792a00 00000100:00100000:2.0:1746129752.359463:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052196608 00000100:00100000:2.0:1746129752.359470:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052196608 00002000:00100000:2.0:1746129752.359494:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2600960->2605055) req@ffff8800a8790380 x1830949052196608/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.359501:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8790380 with x1830949052196608 ext(2600960->2605055) 00002000:00010000:2.0:1746129752.359503:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8790380 00000100:00100000:2.0:1746129752.360280:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4074 00000100:00100000:2.0:1746129752.360406:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949052196608:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129752.360537:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949052196608:12345-192.168.204.31@tcp:3:cat.0 Request processed in 134us (1480us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129752.360544:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4074 00002000:00100000:2.0:1746129752.360550:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2600960->2605055) req@ffff8800a8790380 x1830949052196608/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/4536 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.360557:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8790380 with x1830949052196608 ext(2600960->2605055) 00002000:00010000:2.0:1746129752.360559:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8790380 00000100:00100000:0.0:1746129752.363807:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.363894:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052196736 00000100:00100000:2.0:1746129752.363901:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052196736 00000100:00100000:2.0:1746129752.364250:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10928 00000100:00100000:2.0:1746129752.364259:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949052196736:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:1.0:1746129752.364285:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.364303:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052196992 00000100:00100000:1.0:1746129752.364307:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052196992 00010000:00010000:2.0:1746129752.364676:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.364691:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801356e2200/0x48868a4e43949607 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f666 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.364718:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801356e2200/0x48868a4e43949607 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f666 expref: 30 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.364727:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356e2200/0x48868a4e43949607 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f666 expref: 30 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.364741:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356e2200, rc 0) 00000100:00100000:2.0:1746129752.364778:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949052196736:12345-192.168.204.31@tcp:101:cat.0 Request processed in 521us (978us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129752.364919:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10928 00000100:00100000:2.0:1746129752.364953:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.364965:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052197248 00000100:00100000:2.0:1746129752.364967:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052197248 00000100:00100000:2.0:1746129752.364980:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10929 00000100:00100000:1.0:1746129752.364982:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3881 00000100:00100000:2.0:1746129752.364985:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052197248:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:1.0:1746129752.364988:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:28595:x1830949052196992:12345-192.168.204.31@tcp:35:multiop.0 00010000:00010000:2.0:1746129752.364992:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.364997:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801356e3200/0x48868a4e4394960e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f674 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.365011:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801356e3200/0x48868a4e4394960e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f674 expref: 18 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.365019:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356e3200/0x48868a4e4394960e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f674 expref: 18 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.365030:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356e3200, rc 0) 00000100:00100000:2.0:1746129752.365046:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052197248:12345-192.168.204.31@tcp:101:cat.0 Request processed in 61us (93us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129752.365050:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10929 00000100:00100000:2.0:1746129752.365095:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.365106:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052197120 00000100:00100000:2.0:1746129752.365109:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052197120 00000100:00100000:2.0:1746129752.365123:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10930 00000100:00100000:2.0:1746129752.365127:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052197120:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129752.365133:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.365139:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801356e2800/0x48868a4e43949615 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f66d expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129752.365153:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:28595:x1830949052196992:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 165us (868us total) trans 8589943660 rc 0/0 00000100:00100000:1.0:1746129752.365158:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3881 00000100:00100000:2.0:1746129752.365170:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053307136:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129752.365663:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b7b0c9c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746129752.367661:0:4589:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime: 1746129752 -> 1746129753 00002000:00010000:2.0:1746129752.367667:0:4589:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime: 1746129752 -> 1746129753 00002000:00010000:2.0:1746129752.367669:0:4589:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime: 1746129752 -> 1746129753 00000100:00100000:2.0:1746129752.367689:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053307136:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129752.367712:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801356e2800/0x48868a4e43949615 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f66d expref: 18 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.367723:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356e2800/0x48868a4e43949615 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f66d expref: 18 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.369152:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356e2800, rc 0) 00000100:00100000:2.0:1746129752.369210:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052197120:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4079us (4112us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129752.369217:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10930 00000100:00100000:3.0:1746129752.370175:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.370257:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052197376 00000100:00100000:2.0:1746129752.370263:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052197376 00000100:00100000:2.0:1746129752.370299:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10931 00000100:00100000:2.0:1746129752.370305:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1963:x1830949052197376:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129752.370317:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.370330:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801356e2200/0x48868a4e4394961c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f67b expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.370353:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801356e2200/0x48868a4e4394961c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f67b expref: 30 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.370363:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356e2200/0x48868a4e4394961c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f67b expref: 30 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.370370:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356e2200, rc 0) 00000100:00100000:2.0:1746129752.370411:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1963:x1830949052197376:12345-192.168.204.31@tcp:101:cat.0 Request processed in 106us (240us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129752.370417:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10931 00000100:00100000:0.0:1746129752.375380:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.375441:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.375549:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052197632 00000100:00100000:2.0:1746129752.375556:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052197632 00000100:00100000:2.0:1746129752.375583:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052197504 00000100:00100000:2.0:1746129752.375585:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052197504 00000100:00100000:2.0:1746129752.375598:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10932 00000100:00100000:2.0:1746129752.375605:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949052197632:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129752.375619:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.375633:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801356e3600/0x48868a4e43949623 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f689 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.375658:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801356e3600/0x48868a4e43949623 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f689 expref: 19 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.375667:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356e3600/0x48868a4e43949623 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f689 expref: 19 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.375677:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356e3600, rc 0) 00000100:00100000:2.0:1746129752.375712:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949052197632:12345-192.168.204.31@tcp:101:cat.0 Request processed in 107us (338us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129752.375717:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10932 00000100:00100000:2.0:1746129752.375730:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10933 00000100:00100000:2.0:1746129752.375734:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052197504:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129752.375739:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.377520:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801356e2600/0x48868a4e4394962a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f682 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129752.377575:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053307264:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129752.378029:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b7b0c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129752.380324:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053307264:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129752.380353:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801356e2600/0x48868a4e4394962a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f682 expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.380366:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356e2600/0x48868a4e4394962a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f682 expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.380374:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356e2600, rc 0) 00000100:00100000:2.0:1746129752.380432:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052197504:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4696us (4989us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129752.380439:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10933 00000100:00100000:0.0:1746129752.464317:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.464442:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052197760 00000100:00100000:2.0:1746129752.464451:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052197760 00000100:00100000:2.0:1746129752.464487:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10934 00000100:00100000:2.0:1746129752.464494:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28610:x1830949052197760:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129752.464509:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.464523:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9b800/0x48868a4e43949631 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f690 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.464547:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa79a00/0x48868a4e439494b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f59b expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.464556:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a511b800/0x48868a4e4394950b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5da expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.464563:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a511b600/0x48868a4e439494d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5b7 expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.464574:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.464575:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.464578:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9b800/0x48868a4e43949631 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2465792->3145727] (req 2465792->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f690 expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.464602:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a511b600/0x48868a4e439494d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5b7 expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.464612:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a511b600/0x48868a4e439494d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5b7 expref: 17 pid: 8436 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.464622:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053307392:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129752.466756:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a511b800/0x48868a4e4394950b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5da expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.466771:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a511b800/0x48868a4e4394950b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5da expref: 8 pid: 8436 timeout: 798 lvb_type: 1 00000100:00100000:2.0:1746129752.466783:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053307520:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129752.469184:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa79a00/0x48868a4e439494b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f59b expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.469199:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa79a00/0x48868a4e439494b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f59b expref: 18 pid: 4589 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.469215:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053307648:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129752.469255:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b7b0c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129752.472964:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.473064:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053307392:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129752.473164:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052197888 00000100:00100000:3.0:1746129752.473170:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052197888 00010000:00010000:3.0:1746129752.473196:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a511b600/0x48868a4e439494d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5b7 expref: 18 pid: 8436 timeout: 798 lvb_type: 0 00000100:00100000:3.0:1746129752.473225:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5257 00000100:00100000:3.0:1746129752.473232:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8793480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949052197888:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129752.473242:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129752.473257:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a511b600/0x48868a4e439494d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5b7 expref: 18 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129752.473266:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a511b600/0x48868a4e439494d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5b7 expref: 18 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129752.473283:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a511b600/0x48868a4e439494d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5b7 expref: 18 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129752.473299:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129752.473329:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8793480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949052197888:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 98us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129752.473335:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5257 00000100:00100000:2.0:1746129752.478979:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053307520:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129752.478989:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053307648:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129752.479018:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9b800/0x48868a4e43949631 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2465792->3145727] (req 2465792->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f690 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.479032:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1a9b800, rc 0) 00000100:00100000:2.0:1746129752.479066:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28610:x1830949052197760:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 14572us (14755us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.479073:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10934 00000100:00100000:0.0:1746129752.480934:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.480982:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.481045:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052198144 00000100:00100000:3.0:1746129752.481051:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052198144 00010000:00010000:3.0:1746129752.481077:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa79a00/0x48868a4e439494b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f59b expref: 19 pid: 4589 timeout: 798 lvb_type: 0 00000100:00100000:3.0:1746129752.481109:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052198016 00000100:00100000:3.0:1746129752.481111:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052198016 00010000:00010000:3.0:1746129752.481120:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a511b800/0x48868a4e4394950b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5da expref: 9 pid: 8436 timeout: 798 lvb_type: 1 00000100:00100000:3.0:1746129752.481132:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5258 00000100:00100000:3.0:1746129752.481139:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1964:x1830949052198144:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129752.481141:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5259 00000100:00100000:2.0:1746129752.481148:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:1964:x1830949052198016:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129752.481149:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129752.481156:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129752.481166:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa79a00/0x48868a4e439494b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f59b expref: 19 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.481167:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a511b800/0x48868a4e4394950b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5da expref: 9 pid: 8436 timeout: 798 lvb_type: 1 00010000:00010000:3.0:1746129752.481174:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa79a00/0x48868a4e439494b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f59b expref: 19 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.481804:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a511b800/0x48868a4e4394950b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5da expref: 9 pid: 8436 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746129752.481824:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a511b800/0x48868a4e4394950b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f5da expref: 9 pid: 8436 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746129752.481842:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129752.481903:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+8:1964:x1830949052198016:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 755us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.481909:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5259 00010000:00010000:3.0:1746129752.482065:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa79a00/0x48868a4e439494b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f59b expref: 19 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129752.482078:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129752.482080:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129752.482086:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9b800/0x48868a4e43949631 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f690 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.482097:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9b800/0x48868a4e43949631 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f690 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.482123:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9b800/0x48868a4e43949631 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f690 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129752.482133:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053307776:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129752.482185:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129752.487735:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.491715:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.491743:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052198528 00000100:00100000:0.0:1746129752.491750:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052198528 00002000:00100000:0.0:1746129752.491786:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2465792->2469887) req@ffff88009ba84000 x1830949052198528/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129752.491795:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba84000 with x1830949052198528 ext(2465792->2469887) 00002000:00010000:0.0:1746129752.491800:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba84000 00000100:00100000:0.0:1746129752.491815:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4075 00000100:00100000:0.0:1746129752.491822:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1961:x1830949052198528:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129752.493296:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052198272 00000100:00100000:1.0:1746129752.493303:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052198272 00000100:00100000:3.0:1746129752.493306:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053307776:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129752.493324:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129752.493338:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9875 00000100:00100000:1.0:1746129752.493343:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6141239f-0c60-480d-830c-e22ba61457b0+8:28614:x1830949052198272:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129752.493364:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129752.493378:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e43949638 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f697 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.493438:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4600/0x48868a4e4394963f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129752.493449:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4600/0x48868a4e4394963f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129752.493457:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4600/0x48868a4e4394963f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129752.493467:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e43949646 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129752.493473:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e43949646 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129752.493478:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e43949646 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129752.493568:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e4394964d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129752.493578:0:14314:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e439495d6 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f63c expref: 20 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.493584:0:14314:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e4394964d lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129752.493610:0:14314:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e439495d6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f63c expref: 20 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.493620:0:14314:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e439495d6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f63c expref: 20 pid: 14314 timeout: 798 lvb_type: 0 00000100:00100000:1.0:1746129752.493640:0:14314:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053307904:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129752.493749:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1961:x1830949052198528:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 1925us (2040us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129752.493757:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4075 00002000:00100000:0.0:1746129752.493763:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2465792->2469887) req@ffff88009ba84000 x1830949052198528/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/4536 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129752.493771:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba84000 with x1830949052198528 ext(2465792->2469887) 00002000:00010000:0.0:1746129752.493775:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba84000 00000100:00100000:3.0:1746129752.494627:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1964:x1830949052198144:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 13485us (13696us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129752.494636:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5258 00000100:00100000:1.0:1746129752.497400:0:14314:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129752.499771:0:14314:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053307904:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129752.499803:0:14314:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e4394964d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000100:00100000:0.0:1746129752.499803:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.499884:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052198656 00000100:00100000:3.0:1746129752.499890:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052198656 00010000:00010000:3.0:1746129752.499916:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e439495d6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f63c expref: 21 pid: 14314 timeout: 798 lvb_type: 0 00000100:00100000:3.0:1746129752.499952:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5260 00000100:00100000:3.0:1746129752.499959:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1963:x1830949052198656:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129752.499971:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129752.499976:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e439495d6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f63c expref: 21 pid: 14314 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129752.499986:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e439495d6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f63c expref: 21 pid: 14314 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129752.500004:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f9800/0x48868a4e439495d6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f63c expref: 21 pid: 14314 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129752.500028:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129752.500032:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e4394964d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.500041:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e4394964d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.500046:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e4394964d lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.500063:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129752.500100:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1963:x1830949052198656:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 137us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129752.500107:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5260 00010000:00010000:0.0:1746129752.500217:0:14314:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e4394964d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129752.500224:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e4394964d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:0.0:1746129752.500258:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:0.0:1746129752.500261:0:14314:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129752.500273:0:14314:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e4394964d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129752.500281:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e4394964d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129752.500289:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4600/0x48868a4e4394963f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129752.500294:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4600/0x48868a4e4394963f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129752.500299:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4600/0x48868a4e4394963f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129752.500304:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012baa4600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129752.500307:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4600/0x48868a4e4394963f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129752.500313:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4600/0x48868a4e4394963f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129752.500320:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:0.0:1746129752.500322:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129752.500325:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4600/0x48868a4e4394963f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129752.500330:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4600/0x48868a4e4394963f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129752.500354:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e43949646 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129752.500359:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e43949646 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129752.500364:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e43949646 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129752.500368:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012baa5600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129752.500371:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e43949646 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129752.500375:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e43949646 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129752.500390:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e2d8a00) 00010000:00010000:0.0:1746129752.500393:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129752.500395:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e43949646 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129752.500399:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e43949646 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129752.500429:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8a00/0x48868a4e43949638 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f697 expref: 10 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.500440:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e4394964d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f697 expref: 9 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.500445:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129752.500447:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129752.500449:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baa4800, rc 0) 00000100:00100000:0.0:1746129752.500481:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:28614:x1830949052198272:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 7138us (12753us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.500487:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9875 00000100:00100000:1.0:1746129752.504157:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.504192:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.504227:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.504251:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052198784 00000100:00100000:1.0:1746129752.504257:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052198784 00000100:00100000:1.0:1746129752.504286:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052198912 00000100:00100000:1.0:1746129752.504289:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052198912 00000100:00100000:1.0:1746129752.504301:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052199040 00000100:00100000:1.0:1746129752.504302:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052199040 00000100:00100000:1.0:1746129752.504317:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10935 00000100:00100000:1.0:1746129752.504324:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052198784:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129752.504339:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129752.504353:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8fece00/0x48868a4e43949654 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f69e expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129752.504407:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053308032:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129752.504473:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129752.504489:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10936 00000100:00100000:1.0:1746129752.504494:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052198912:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129752.504503:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129752.504510:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093beec00/0x48868a4e4394965b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f6a5 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.504540:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093beec00/0x48868a4e4394965b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6a5 expref: 10 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129752.504549:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093beec00/0x48868a4e4394965b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6a5 expref: 10 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129752.504562:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093beec00, rc 0) 00000100:00100000:1.0:1746129752.504582:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052198912:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 88us (390us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129752.504588:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10936 00000100:00100000:1.0:1746129752.504602:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10937 00000100:00100000:1.0:1746129752.504607:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052199040:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129752.504613:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129752.504623:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bee000/0x48868a4e43949662 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f6ac expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129752.504642:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053308160:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129752.504660:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129752.509334:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.509491:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052199168 00000100:00100000:3.0:1746129752.509498:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052199168 00000100:00100000:3.0:1746129752.509531:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10938 00000100:00100000:3.0:1746129752.509537:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28610:x1830949052199168:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129752.509549:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129752.509562:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x48868a4e43949669 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f6b3 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.509582:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8e00/0x48868a4e439495f9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2605056->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f658 expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.509593:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129752.509594:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129752.509597:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x48868a4e43949669 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->3358719] (req 3145728->3358719) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6b3 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.509619:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8e00/0x48868a4e439495f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2605056->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f658 expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.509627:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8e00/0x48868a4e439495f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2605056->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f658 expref: 28 pid: 8436 timeout: 798 lvb_type: 0 00000100:00100000:3.0:1746129752.509636:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053308288:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129752.509702:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129752.509950:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053308032:192.168.204.31@tcp:106: 00002000:00010000:1.0:1746129752.509958:0:3623:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime: 1746129752 -> 1746129753 00002000:00010000:1.0:1746129752.509962:0:3623:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746129752 -> 1746129753 00002000:00010000:1.0:1746129752.509964:0:3623:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime: 1746129752 -> 1746129753 00010000:00010000:0.0:1746129752.509970:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8fece00/0x48868a4e43949654 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f69e expref: 8 pid: 1877 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129752.509976:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053308160:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129752.509984:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fece00/0x48868a4e43949654 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f69e expref: 8 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129752.509993:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093bee000/0x48868a4e43949662 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6ac expref: 9 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129752.510003:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bee000/0x48868a4e43949662 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6ac expref: 9 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129752.510007:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fece00, rc 0) 00010000:00010000:1.0:1746129752.510011:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bee000, rc 0) 00000100:00100000:0.0:1746129752.510032:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+7:1962:x1830949052198784:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5708us (5881us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129752.510038:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10935 00000100:00100000:1.0:1746129752.510253:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052199040:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5644us (6023us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129752.510259:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10937 00000100:00100000:0.0:1746129752.512523:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.512575:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052199296 00000100:00100000:2.0:1746129752.512581:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052199296 00010000:00010000:2.0:1746129752.512602:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8e00/0x48868a4e439495f9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2605056->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f658 expref: 29 pid: 8436 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.512630:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5261 00000100:00100000:2.0:1746129752.512634:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949052199296:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129752.512642:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129752.512655:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8e00/0x48868a4e439495f9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2605056->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f658 expref: 29 pid: 8436 timeout: 798 lvb_type: 0 00000100:00100000:3.0:1746129752.512658:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053308288:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129752.512662:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8e00/0x48868a4e439495f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2605056->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f658 expref: 29 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.512676:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8e00/0x48868a4e439495f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2605056->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f658 expref: 29 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129752.512757:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x48868a4e43949669 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->3358719] (req 3145728->3358719) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6b3 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.512769:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129752.512771:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129752.512776:0:8436:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x48868a4e43949669 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3358719) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6b3 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.512783:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x48868a4e43949669 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3358719) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6b3 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.512806:0:8436:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x48868a4e43949669 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3358719) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6b3 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129752.512817:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053308416:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129752.512891:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68a80 going to sleep for 11 seconds 00010000:00010000:2.0:1746129752.512950:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129752.512972:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949052199296:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 336us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.512978:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5261 00000100:00100000:0.0:1746129752.516595:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.516620:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052199552 00000100:00100000:0.0:1746129752.516626:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052199552 00000100:00100000:0.0:1746129752.516659:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9876 00000100:00100000:0.0:1746129752.516666:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:28614:x1830949052199552:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129752.516682:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129752.516696:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e000/0x48868a4e43949670 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f6ba expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.516774:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ee00/0x48868a4e43949677 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129752.516786:0:14314:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e4394964d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f697 expref: 10 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.516792:0:14314:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ee00/0x48868a4e43949677 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129752.516816:0:14314:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e4394964d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f697 expref: 10 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.516827:0:14314:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e4394964d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f697 expref: 10 pid: 14314 timeout: 798 lvb_type: 0 00000100:00100000:0.0:1746129752.516837:0:14314:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba85180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053308544:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129752.516915:0:14314:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ceb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129752.517191:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053308416:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129752.517206:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:2.0:1746129752.517229:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28610:x1830949052199168:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 7692us (7900us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.517236:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10938 00000100:00100000:0.0:1746129752.520737:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.520811:0:14314:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba85180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053308544:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129752.520831:0:14314:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ee00/0x48868a4e43949677 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000100:00100000:1.0:1746129752.521581:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052199680 00000100:00100000:1.0:1746129752.521588:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052199680 00010000:00010000:1.0:1746129752.521612:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e4394964d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f697 expref: 11 pid: 14314 timeout: 798 lvb_type: 0 00000100:00100000:1.0:1746129752.521642:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5262 00000100:00100000:1.0:1746129752.521648:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052199680:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129752.521658:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129752.521663:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e4394964d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f697 expref: 11 pid: 14314 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.521672:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e4394964d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f697 expref: 11 pid: 14314 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.521688:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e4394964d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f697 expref: 11 pid: 14314 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.521710:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129752.521714:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ee00/0x48868a4e43949677 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129752.521721:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ee00/0x48868a4e43949677 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129752.521727:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ee00/0x48868a4e43949677 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129752.522439:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129752.522480:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949052199680:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 829us (1747us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129752.522487:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5262 00010000:00010000:3.0:1746129752.522754:0:14314:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ee00/0x48868a4e43949677 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.522761:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ee00/0x48868a4e43949677 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:3.0:1746129752.522776:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129752.522902:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e000/0x48868a4e43949670 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6ba expref: 11 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.522931:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ee00/0x48868a4e43949677 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6ba expref: 10 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.522937:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129752.522939:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129752.522942:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6ee00, rc 0) 00000100:00100000:3.0:1746129752.522965:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6141239f-0c60-480d-830c-e22ba61457b0+10:28614:x1830949052199552:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 6299us (6378us total) trans 8589943661 rc 0/0 00000100:00100000:3.0:1746129752.522971:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9876 00000100:00100000:0.0:1746129752.523548:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.523736:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052199936 00000100:00100000:1.0:1746129752.523741:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052199936 00002000:00100000:1.0:1746129752.523768:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3354624->3358719) req@ffff88009a04f480 x1830949052199936/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129752.523775:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04f480 with x1830949052199936 ext(3354624->3358719) 00002000:00010000:1.0:1746129752.523779:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04f480 00000100:00100000:1.0:1746129752.523797:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4076 00000100:00100000:1.0:1746129752.523802:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949052199936:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129752.523935:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949052199936:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 133us (388us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129752.523941:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4076 00002000:00100000:1.0:1746129752.523945:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3354624->3358719) req@ffff88009a04f480 x1830949052199936/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/4536 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129752.523952:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04f480 with x1830949052199936 ext(3354624->3358719) 00002000:00010000:1.0:1746129752.523954:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04f480 00000100:00100000:0.0:1746129752.525408:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.525555:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052200064 00000100:00100000:3.0:1746129752.525560:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052200064 00000100:00100000:3.0:1746129752.525592:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9877 00000100:00100000:3.0:1746129752.525598:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6141239f-0c60-480d-830c-e22ba61457b0+10:28614:x1830949052200064:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129752.525615:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129752.525629:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e43949685 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f6c1 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.525687:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394968c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.525699:0:14314:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ee00/0x48868a4e43949677 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6ba expref: 11 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.525704:0:14314:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394968c lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.525726:0:14314:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ee00/0x48868a4e43949677 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6ba expref: 11 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.525735:0:14314:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ee00/0x48868a4e43949677 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6ba expref: 11 pid: 14314 timeout: 798 lvb_type: 0 00000100:00100000:3.0:1746129752.525744:0:14314:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053308672:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129752.525812:0:14314:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129752.526426:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.526508:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052200320 00000100:00100000:3.0:1746129752.526512:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052200320 00000100:00100000:3.0:1746129752.526549:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3882 00000100:00100000:3.0:1746129752.526554:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d62850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:28610:x1830949052200320:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129752.526697:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d62850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:28610:x1830949052200320:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 136us (266us total) trans 8589943662 rc 0/0 00000100:00100000:3.0:1746129752.526704:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3882 00000100:00100000:3.0:1746129752.527772:0:14314:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053308672:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129752.527787:0:14314:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394968c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000100:00100000:0.0:1746129752.528044:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.528106:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052200448 00000100:00100000:1.0:1746129752.528111:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052200448 00010000:00010000:1.0:1746129752.528131:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ee00/0x48868a4e43949677 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6ba expref: 12 pid: 14314 timeout: 798 lvb_type: 0 00000100:00100000:1.0:1746129752.528160:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5263 00000100:00100000:1.0:1746129752.528166:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1ae9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949052200448:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129752.528175:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129752.528180:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ee00/0x48868a4e43949677 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6ba expref: 12 pid: 14314 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.528189:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ee00/0x48868a4e43949677 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6ba expref: 12 pid: 14314 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.528204:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ee00/0x48868a4e43949677 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6ba expref: 12 pid: 14314 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.528215:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129752.528219:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394968c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129752.528409:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394968c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129752.528417:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394968c lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129752.528443:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129752.528529:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1ae9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052200448:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 362us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129752.528535:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5263 00010000:00010000:3.0:1746129752.528705:0:14314:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394968c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.528712:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394968c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:3.0:1746129752.528743:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:3.0:1746129752.528747:0:14314:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129752.528758:0:14314:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394968c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.528783:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e43949685 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6c1 expref: 11 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.528796:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394968c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6c1 expref: 10 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.528802:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129752.528804:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129752.528807:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10000, rc 0) 00000100:00100000:3.0:1746129752.528840:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6141239f-0c60-480d-830c-e22ba61457b0+10:28614:x1830949052200064:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3242us (3436us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129752.528867:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9877 00000100:00100000:0.0:1746129752.533819:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.534496:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.534532:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.534553:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052200576 00000100:00100000:0.0:1746129752.534561:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052200576 00000100:00100000:0.0:1746129752.534589:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052200832 00000100:00100000:0.0:1746129752.534591:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052200832 00000100:00100000:0.0:1746129752.534600:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052200704 00000100:00100000:0.0:1746129752.534601:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052200704 00000100:00100000:0.0:1746129752.534611:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10939 00000100:00100000:0.0:1746129752.534617:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a341450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+8:1964:x1830949052200576:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129752.534632:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129752.534645:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e200/0x48868a4e43949693 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f6c8 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129752.534690:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053308800:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129752.534762:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ceb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129752.534780:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10940 00000100:00100000:0.0:1746129752.534785:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+8:1964:x1830949052200832:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129752.534792:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129752.534800:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb6fa00/0x48868a4e4394969a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f6d6 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129752.534822:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053308928:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129752.534840:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce780 going to sleep for 11 seconds 00000100:00100000:2.0:1746129752.535005:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10941 00000100:00100000:2.0:1746129752.535012:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:1963:x1830949052200704:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129752.535019:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.535026:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801356e2600/0x48868a4e439496a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f6cf expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.535125:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801356e2600/0x48868a4e439496a1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6cf expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.535135:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356e2600/0x48868a4e439496a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6cf expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.535148:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356e2600, rc 0) 00000100:00100000:2.0:1746129752.536460:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:1963:x1830949052200704:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1444us (1922us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129752.536468:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10941 00000100:00100000:2.0:1746129752.538391:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053308928:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129752.538501:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053308800:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129752.538524:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e200/0x48868a4e43949693 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6c8 expref: 8 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129752.538536:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e200/0x48868a4e43949693 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6c8 expref: 8 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129752.538734:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6e200, rc 0) 00010000:00010000:2.0:1746129752.538753:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb6fa00/0x48868a4e4394969a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6d6 expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.538764:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6fa00/0x48868a4e4394969a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6d6 expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.538771:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6fa00, rc 0) 00000100:00100000:1.0:1746129752.538842:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a341450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+7:1964:x1830949052200576:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4223us (5028us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129752.538868:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10939 00000100:00100000:2.0:1746129752.539543:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+8:1964:x1830949052200832:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4755us (5045us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129752.539549:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10940 00000100:00100000:0.0:1746129752.542118:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.542211:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052201088 00000100:00100000:3.0:1746129752.542219:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052201088 00000100:00100000:3.0:1746129752.542254:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9878 00000100:00100000:3.0:1746129752.542262:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6141239f-0c60-480d-830c-e22ba61457b0+10:28614:x1830949052201088:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129752.542435:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129752.542450:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bdc00/0x48868a4e439496a8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f6dd expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.542525:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e439496af lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.542536:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e439496af lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.542545:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e439496af lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:3.0:1746129752.542554:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129752.542637:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bdc00/0x48868a4e439496a8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6dd expref: 13 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.542657:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e439496af lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6dd expref: 12 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.542664:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129752.542666:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129752.542668:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10400, rc 0) 00000100:00100000:3.0:1746129752.543293:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6141239f-0c60-480d-830c-e22ba61457b0+12:28614:x1830949052201088:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1030us (1181us total) trans 8589943663 rc 0/0 00000100:00100000:3.0:1746129752.543299:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9878 00000100:00100000:0.0:1746129752.545948:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.546058:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.546080:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.546115:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.546131:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052201344 00000100:00100000:3.0:1746129752.546138:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052201344 00000100:00100000:3.0:1746129752.546169:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052201600 00000100:00100000:3.0:1746129752.546171:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052201600 00000100:00100000:3.0:1746129752.546179:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052201856 00000100:00100000:3.0:1746129752.546181:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052201856 00000100:00100000:2.0:1746129752.546182:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052201216 00000100:00100000:2.0:1746129752.546186:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052201216 00000100:00100000:3.0:1746129752.546200:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10942 00000100:00100000:3.0:1746129752.546207:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949052201344:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:3.0:1746129752.546251:0:7975:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f9bc800/0x48868a4e439496bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129752.546255:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10943 00000100:00100000:2.0:1746129752.546262:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949052201600:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:3.0:1746129752.546266:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094b2da00/0x48868a4e43949295 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f48a expref: 9 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129752.546274:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5200/0x48868a4e43949375 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4f3 expref: 17 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.546280:0:20441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801356e2800/0x48868a4e439496c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.546281:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6ea00/0x48868a4e4394933d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4c2 expref: 15 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129752.546287:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129752.546289:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129752.546291:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9bc800/0x48868a4e439496bd lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.546297:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ec00/0x48868a4e439495b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f620 expref: 27 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.546302:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129752.546304:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129752.546306:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801356e2800/0x48868a4e439496c4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.546317:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6ea00/0x48868a4e4394933d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4c2 expref: 15 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.546321:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ec00/0x48868a4e439495b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f620 expref: 27 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.546328:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6ea00/0x48868a4e4394933d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4c2 expref: 15 pid: 1877 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746129752.546338:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ec00/0x48868a4e439495b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f620 expref: 27 pid: 4589 timeout: 798 lvb_type: 0 00000100:00100000:3.0:1746129752.546339:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053309056:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129752.546346:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053309184:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129752.546403:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10944 00000100:00100000:2.0:1746129752.546410:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949052201856:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:3.0:1746129752.546415:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5200/0x48868a4e43949375 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4f3 expref: 17 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129752.546423:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5200/0x48868a4e43949375 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4f3 expref: 17 pid: 8435 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746129752.546428:0:7976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801356e2c00/0x48868a4e439496cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129752.546431:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053309312:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129752.546437:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9b800/0x48868a4e43949631 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f690 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.546442:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129752.546444:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129752.546445:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801356e2c00/0x48868a4e439496cb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.546455:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094b2da00/0x48868a4e43949295 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f48a expref: 9 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.546460:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9b800/0x48868a4e43949631 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f690 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.546462:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094b2da00/0x48868a4e43949295 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f48a expref: 9 pid: 1877 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746129752.546467:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9b800/0x48868a4e43949631 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f690 expref: 15 pid: 8436 timeout: 798 lvb_type: 0 00000100:00100000:3.0:1746129752.546469:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053309440:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129752.546475:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053309568:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129752.546484:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129752.546484:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10945 00000100:00100000:0.0:1746129752.546490:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949052201216:12345-192.168.204.31@tcp:1:lfs.0 00000100:00100000:2.0:1746129752.546495:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b7b0ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129752.546503:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b7b0c9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746129752.546503:0:3623:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ea00/0x48868a4e439496d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.546512:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff000/0x48868a4e4394928e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f483 expref: 8 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129752.546518:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4000/0x48868a4e4394936e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4ec expref: 27 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129752.546525:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f400/0x48868a4e43949336 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4bb expref: 17 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129752.546531:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129752.546532:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129752.546534:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ea00/0x48868a4e439496d2 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.546548:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f400/0x48868a4e43949336 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4bb expref: 17 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129752.546556:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f400/0x48868a4e43949336 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4bb expref: 17 pid: 1877 timeout: 798 lvb_type: 1 00000100:00100000:0.0:1746129752.546564:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053309696:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129752.546588:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4000/0x48868a4e4394936e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4ec expref: 27 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129752.546596:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4000/0x48868a4e4394936e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4ec expref: 27 pid: 8435 timeout: 798 lvb_type: 1 00000100:00100000:0.0:1746129752.546602:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053309824:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129752.546622:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff000/0x48868a4e4394928e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f483 expref: 8 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129752.546629:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff000/0x48868a4e4394928e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f483 expref: 8 pid: 1140 timeout: 798 lvb_type: 1 00000100:00100000:0.0:1746129752.546640:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053309952:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129752.546652:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ced80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129752.546673:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.546722:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052201472 00000100:00100000:1.0:1746129752.546725:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052201472 00000100:00100000:0.0:1746129752.546751:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.546754:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10946 00000100:00100000:1.0:1746129752.546760:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949052201472:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:1.0:1746129752.546774:0:4589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012baa4600/0x48868a4e439496d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.546784:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a148800/0x48868a4e4394929c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f491 expref: 10 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129752.546795:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4c00/0x48868a4e43949383 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4fa expref: 17 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129752.546801:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f000/0x48868a4e43949344 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4c9 expref: 15 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129752.546806:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.546808:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.546809:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012baa4600/0x48868a4e439496d9 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.546823:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f000/0x48868a4e43949344 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4c9 expref: 15 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129752.546830:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f000/0x48868a4e43949344 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4c9 expref: 15 pid: 1877 timeout: 798 lvb_type: 1 00000100:00100000:1.0:1746129752.546838:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053310080:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129752.546875:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052201728 00000100:00100000:2.0:1746129752.546878:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052201728 00000100:00100000:2.0:1746129752.546895:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10947 00000100:00100000:2.0:1746129752.546899:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949052201728:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:2.0:1746129752.546913:0:1877:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a149600/0x48868a4e439496e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.546922:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801356e2e00/0x48868a4e439495c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->2605055] (req 2097152->2605055) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f635 expref: 27 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.546929:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x48868a4e43949669 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3358719) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6b3 expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.546936:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a14800/0x48868a4e43949600 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f65f expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.546940:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746129752.546941:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746129752.546943:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a149600/0x48868a4e439496e0 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.546957:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a14800/0x48868a4e43949600 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f65f expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.546964:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a14800/0x48868a4e43949600 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f65f expref: 17 pid: 4589 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.546976:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053310208:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129752.547037:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4c00/0x48868a4e43949383 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4fa expref: 17 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129752.547045:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4c00/0x48868a4e43949383 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4fa expref: 17 pid: 8435 timeout: 798 lvb_type: 1 00000100:00100000:1.0:1746129752.547052:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053310336:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129752.547107:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x48868a4e43949669 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3358719) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6b3 expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.547115:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x48868a4e43949669 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3358719) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6b3 expref: 17 pid: 8436 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.547122:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053310464:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129752.547141:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801356e2e00/0x48868a4e439495c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->2605055] (req 2097152->2605055) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f635 expref: 27 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.547147:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801356e2e00/0x48868a4e439495c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->2605055] (req 2097152->2605055) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f635 expref: 27 pid: 1877 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.547153:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053310592:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129752.547162:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b7b0cb40 going to sleep for 11 seconds 00010000:00010000:1.0:1746129752.547183:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a148800/0x48868a4e4394929c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f491 expref: 10 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129752.547191:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a148800/0x48868a4e4394929c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f491 expref: 10 pid: 3623 timeout: 798 lvb_type: 1 00000100:00100000:1.0:1746129752.547198:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053310720:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129752.547215:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a266c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129752.554064:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.554104:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.554126:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052201984 00000100:00100000:1.0:1746129752.554133:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052201984 00000100:00100000:0.0:1746129752.554162:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053309696:192.168.204.31@tcp:104: 00002000:00100000:1.0:1746129752.554166:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3ea:0x0] (1617920->2097151) req@ffff8800936ddf80 x1830949052201984/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129752.554173:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936ddf80 with x1830949052201984 ext(1617920->2097151) 00000100:00100000:0.0:1746129752.554179:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129752.554180:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ec00/0x48868a4e439495b3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f620 expref: 28 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.554191:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ec00/0x48868a4e439495b3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f620 expref: 28 pid: 4589 timeout: 798 lvb_type: 0 00000100:00100000:0.0:1746129752.554191:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00010000:1.0:1746129752.554197:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936ddf80 00000100:00100000:0.0:1746129752.554203:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052202112 00000100:00100000:0.0:1746129752.554205:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052202112 00000100:00100000:1.0:1746129752.554210:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052202240 00000100:00100000:1.0:1746129752.554212:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052202240 00010000:00010000:0.0:1746129752.554220:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094b2da00/0x48868a4e43949295 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f48a expref: 11 pid: 1877 timeout: 798 lvb_type: 1 00002000:00100000:1.0:1746129752.554221:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2465792->3145727) req@ffff8800936ded80 x1830949052202240/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129752.554227:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936ded80 with x1830949052202240 ext(2465792->3145727) 00010000:00010000:1.0:1746129752.554231:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9b800/0x48868a4e43949631 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f690 expref: 16 pid: 8436 timeout: 798 lvb_type: 0 00000100:00100000:0.0:1746129752.554234:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052202368 00000100:00100000:0.0:1746129752.554235:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052202368 00010000:00010000:1.0:1746129752.554239:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9b800/0x48868a4e43949631 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f690 expref: 16 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746129752.554242:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5200/0x48868a4e43949375 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4f3 expref: 18 pid: 8435 timeout: 798 lvb_type: 1 00002000:00010000:1.0:1746129752.554244:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800936ded80 00000100:00100000:1.0:1746129752.554253:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 591 00000100:00100000:0.0:1746129752.554253:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5264 00000100:00100000:1.0:1746129752.554258:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1963:x1830949052201984:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129752.554258:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949052202112:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129752.554267:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129752.554284:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094b2da00/0x48868a4e43949295 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f48a expref: 11 pid: 1877 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746129752.554295:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094b2da00/0x48868a4e43949295 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f48a expref: 11 pid: 1877 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746129752.554312:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129752.554337:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949052202112:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 80us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.554343:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5264 00000100:00100000:0.0:1746129752.554354:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5265 00000100:00100000:0.0:1746129752.554358:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1963:x1830949052202368:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129752.554364:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129752.554369:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5200/0x48868a4e43949375 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4f3 expref: 18 pid: 8435 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746129752.554376:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5200/0x48868a4e43949375 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4f3 expref: 18 pid: 8435 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746129752.554399:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129752.554412:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1963:x1830949052202368:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 54us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.554416:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5265 00000100:00100000:0.0:1746129752.554454:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053309824:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129752.554491:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053309952:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129752.554511:0:3623:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ea00/0x48868a4e439496d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129752.554553:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.554561:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052202880 00000100:00100000:0.0:1746129752.554564:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052202880 00010000:00010000:0.0:1746129752.554573:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4000/0x48868a4e4394936e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4ec expref: 29 pid: 8435 timeout: 798 lvb_type: 1 00000100:00100000:0.0:1746129752.554584:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5266 00000100:00100000:0.0:1746129752.554588:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949052202880:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129752.554594:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129752.554602:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4000/0x48868a4e4394936e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4ec expref: 30 pid: 8435 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746129752.554608:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4000/0x48868a4e4394936e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4ec expref: 30 pid: 8435 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746129752.554620:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4000/0x48868a4e4394936e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4ec expref: 30 pid: 8435 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746129752.554631:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129752.554635:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053310080:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129752.554642:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949052202880:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 54us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.554646:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5266 00000100:00100000:3.0:1746129752.554941:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 592 00000100:00100000:3.0:1746129752.554950:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1963:x1830949052202240:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:3.0:1746129752.556409:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053309056:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129752.556423:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5200/0x48868a4e43949375 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4f3 expref: 17 pid: 8435 timeout: 798 lvb_type: 1 00000100:00100000:3.0:1746129752.556445:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053309312:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129752.556455:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094b2da00/0x48868a4e43949295 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f48a expref: 10 pid: 1877 timeout: 798 lvb_type: 1 00000100:00100000:3.0:1746129752.556462:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053309440:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129752.556482:0:7975:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f9bc800/0x48868a4e439496bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129752.556799:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.556833:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.556860:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052202496 00000100:00100000:0.0:1746129752.556864:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052202496 00010000:00010000:0.0:1746129752.556884:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6ea00/0x48868a4e4394933d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4c2 expref: 18 pid: 1877 timeout: 798 lvb_type: 1 00000100:00100000:0.0:1746129752.556900:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052202624 00000100:00100000:0.0:1746129752.556902:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052202624 00010000:00010000:0.0:1746129752.556910:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff000/0x48868a4e4394928e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f483 expref: 10 pid: 1140 timeout: 798 lvb_type: 1 00000100:00100000:0.0:1746129752.556921:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5267 00000100:00100000:0.0:1746129752.556926:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949052202496:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129752.556934:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129752.556947:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6ea00/0x48868a4e4394933d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4c2 expref: 18 pid: 1877 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746129752.556956:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6ea00/0x48868a4e4394933d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4c2 expref: 18 pid: 1877 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746129752.556971:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6ea00/0x48868a4e4394933d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4c2 expref: 18 pid: 1877 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746129752.556981:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129752.556982:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129752.556985:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bc800/0x48868a4e439496bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.556992:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9bc800/0x48868a4e439496bd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.557010:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129752.557026:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052202496:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 100us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.557030:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5267 00000100:00100000:0.0:1746129752.557041:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5268 00000100:00100000:0.0:1746129752.557045:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+10:1963:x1830949052202624:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129752.557050:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129752.557060:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff000/0x48868a4e4394928e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f483 expref: 10 pid: 1140 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746129752.557066:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff000/0x48868a4e4394928e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f483 expref: 10 pid: 1140 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746129752.557075:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff000/0x48868a4e4394928e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f483 expref: 10 pid: 1140 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746129752.557082:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129752.557091:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:1963:x1830949052202624:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 46us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.557095:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5268 00000100:00100000:0.0:1746129752.557113:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.557122:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052203008 00000100:00100000:0.0:1746129752.557124:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052203008 00010000:00010000:0.0:1746129752.557131:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a14800/0x48868a4e43949600 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f65f expref: 18 pid: 4589 timeout: 798 lvb_type: 0 00000100:00100000:0.0:1746129752.557145:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5269 00000100:00100000:0.0:1746129752.557149:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1963:x1830949052203008:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129752.557153:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129752.557159:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a14800/0x48868a4e43949600 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f65f expref: 18 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746129752.557165:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a14800/0x48868a4e43949600 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f65f expref: 18 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746129752.557174:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129752.557182:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1963:x1830949052203008:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 34us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.557186:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5269 00000100:00100000:0.0:1746129752.557211:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.557220:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052202752 00000100:00100000:0.0:1746129752.557222:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052202752 00010000:00010000:0.0:1746129752.557231:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f400/0x48868a4e43949336 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4bb expref: 18 pid: 1877 timeout: 798 lvb_type: 1 00000100:00100000:0.0:1746129752.557241:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5270 00000100:00100000:0.0:1746129752.557245:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1ae9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1963:x1830949052202752:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129752.557250:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129752.557256:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f400/0x48868a4e43949336 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4bb expref: 18 pid: 1877 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746129752.557266:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f400/0x48868a4e43949336 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4bb expref: 18 pid: 1877 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746129752.557275:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f400/0x48868a4e43949336 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4bb expref: 18 pid: 1877 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746129752.557281:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129752.557283:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129752.557285:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ea00/0x48868a4e439496d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.557290:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ea00/0x48868a4e439496d2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.557301:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129752.557313:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1ae9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1963:x1830949052202752:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 68us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.557318:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5270 00010000:00010000:0.0:1746129752.557344:0:3623:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ea00/0x48868a4e439496d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.557351:0:3623:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ea00/0x48868a4e439496d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.557365:0:3623:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ea00/0x48868a4e439496d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.557375:0:3623:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ea00/0x48868a4e439496d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.557391:0:3623:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ea00/0x48868a4e439496d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.557396:0:3623:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb6ea00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129752.557399:0:3623:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ea00/0x48868a4e439496d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.557406:0:3623:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ea00/0x48868a4e439496d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.557413:0:3623:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ea00/0x48868a4e439496d2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.557418:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ea00/0x48868a4e439496d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129752.557453:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949052201216:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 10963us (11336us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.557460:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10945 00000100:00100000:0.0:1746129752.557486:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.557495:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052203136 00000100:00100000:0.0:1746129752.557498:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052203136 00010000:00010000:0.0:1746129752.557506:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f000/0x48868a4e43949344 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4c9 expref: 17 pid: 1877 timeout: 798 lvb_type: 1 00000100:00100000:0.0:1746129752.557518:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5271 00000100:00100000:0.0:1746129752.557522:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1963:x1830949052203136:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129752.557527:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129752.557534:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f000/0x48868a4e43949344 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4c9 expref: 17 pid: 1877 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746129752.557541:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f000/0x48868a4e43949344 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4c9 expref: 17 pid: 1877 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746129752.557550:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f000/0x48868a4e43949344 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4c9 expref: 17 pid: 1877 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746129752.557557:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129752.557569:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1963:x1830949052203136:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 46us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.557573:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5271 00000100:00100000:0.0:1746129752.557627:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.557638:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.557647:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052203648 00000100:00100000:0.0:1746129752.557649:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052203648 00010000:00010000:0.0:1746129752.557658:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a148800/0x48868a4e4394929c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f491 expref: 10 pid: 3623 timeout: 798 lvb_type: 1 00000100:00100000:0.0:1746129752.557671:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5272 00000100:00100000:0.0:1746129752.557675:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949052203648:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129752.557680:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129752.557686:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a148800/0x48868a4e4394929c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f491 expref: 10 pid: 3623 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746129752.557692:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a148800/0x48868a4e4394929c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f491 expref: 10 pid: 3623 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746129752.557702:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129752.557712:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949052203648:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 37us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.557716:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5272 00000100:00100000:0.0:1746129752.557736:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.557768:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.557776:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052203520 00000100:00100000:0.0:1746129752.557779:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052203520 00010000:00010000:0.0:1746129752.557787:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4c00/0x48868a4e43949383 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4fa expref: 17 pid: 8435 timeout: 798 lvb_type: 1 00000100:00100000:0.0:1746129752.557798:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5273 00000100:00100000:0.0:1746129752.557801:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949052203520:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129752.557806:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129752.557812:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4c00/0x48868a4e43949383 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4fa expref: 17 pid: 8435 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746129752.557818:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4c00/0x48868a4e43949383 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4fa expref: 17 pid: 8435 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746129752.557831:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129752.557832:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129752.557835:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012baa4600/0x48868a4e439496d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.557840:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012baa4600/0x48868a4e439496d9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129752.558126:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053309568:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129752.558139:0:7976:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801356e2c00/0x48868a4e439496cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129752.558160:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053309184:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129752.558168:0:20441:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801356e2800/0x48868a4e439496c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.558196:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a14800/0x48868a4e43949600 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f65f expref: 16 pid: 4589 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.558207:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053310208:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129752.558214:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053310464:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129752.558220:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053310592:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129752.558232:0:1877:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a149600/0x48868a4e439496e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129752.558247:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052203392 00000100:00100000:2.0:1746129752.558249:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052203392 00002000:00100000:2.0:1746129752.558269:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->2605055) req@ffff8800936ddc00 x1830949052203392/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.558276:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936ddc00 with x1830949052203392 ext(2097152->2605055) 00010000:00010000:2.0:1746129752.558281:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801356e2e00/0x48868a4e439495c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->2605055] (req 2097152->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f635 expref: 29 pid: 1877 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.558288:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801356e2e00/0x48868a4e439495c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->2605055] (req 2097152->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f635 expref: 29 pid: 1877 timeout: 798 lvb_type: 0 00002000:00010000:2.0:1746129752.558293:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936ddc00 00000100:00100000:2.0:1746129752.558308:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052203264 00000100:00100000:2.0:1746129752.558310:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052203264 00002000:00100000:2.0:1746129752.558320:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3358719) req@ffff8800936de300 x1830949052203264/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.558327:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936de300 with x1830949052203264 ext(3145728->3358719) 00010000:00010000:2.0:1746129752.558331:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x48868a4e43949669 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3358719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6b3 expref: 16 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.558338:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x48868a4e43949669 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3358719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6b3 expref: 16 pid: 8436 timeout: 798 lvb_type: 0 00002000:00010000:2.0:1746129752.558343:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936de300 00000100:00100000:2.0:1746129752.558353:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 593 00000100:00100000:2.0:1746129752.558358:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949052203392:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129752.558786:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 594 00000100:00100000:2.0:1746129752.558791:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1961:x1830949052203264:12345-192.168.204.31@tcp:4:multiop.0 00010000:00010000:3.0:1746129752.559162:0:7975:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f9bc800/0x48868a4e439496bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.559170:0:7975:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f9bc800/0x48868a4e439496bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.559187:0:7975:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f9bc800/0x48868a4e439496bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.559195:0:7975:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9bc800/0x48868a4e439496bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.559201:0:7975:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f9bc800/0x48868a4e439496bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.559206:0:7975:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f9bc800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129752.559208:0:7975:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f9bc800/0x48868a4e439496bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.559214:0:7975:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f9bc800/0x48868a4e439496bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.559225:0:7975:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f9bc800/0x48868a4e439496bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.559225:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4c00/0x48868a4e43949383 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4fa expref: 17 pid: 8435 timeout: 798 lvb_type: 1 00010000:00010000:3.0:1746129752.559235:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bc800/0x48868a4e439496bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129752.559240:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053310336:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129752.559256:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a148800/0x48868a4e4394929c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f491 expref: 9 pid: 3623 timeout: 798 lvb_type: 1 00000100:00100000:1.0:1746129752.559264:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053310720:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129752.559269:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949052201344:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 13063us (13329us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129752.559276:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10942 00010000:00010000:1.0:1746129752.559280:0:4589:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012baa4600/0x48868a4e439496d9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.559426:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129752.559442:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1961:x1830949052203520:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1639us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.559448:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5273 00010000:00010000:1.0:1746129752.559492:0:4589:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012baa4600/0x48868a4e439496d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.559498:0:4589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012baa4600/0x48868a4e439496d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.559515:0:4589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012baa4600/0x48868a4e439496d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.559521:0:4589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012baa4600/0x48868a4e439496d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.559527:0:4589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012baa4600/0x48868a4e439496d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.559532:0:4589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012baa4600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129752.559534:0:4589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012baa4600/0x48868a4e439496d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.559540:0:4589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012baa4600/0x48868a4e439496d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.559548:0:4589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012baa4600/0x48868a4e439496d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.559552:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012baa4600/0x48868a4e439496d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129752.559582:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+7:1961:x1830949052201472:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 12823us (12908us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129752.559588:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10946 00000100:00100000:1.0:1746129752.569947:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949052201984:12345-192.168.204.31@tcp:4:cat.0 Request processed in 15679us (15882us total) trans 17179873150 rc 0/0 00000100:00100000:1.0:1746129752.569958:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 591 00002000:00100000:1.0:1746129752.569968:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3ea:0x0] (1617920->2097151) req@ffff8800936ddf80 x1830949052201984/t17179873150(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/448 e 0 to 0 dl 1746129763 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129752.569977:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936ddf80 with x1830949052201984 ext(1617920->2097151) 00010000:00010000:1.0:1746129752.569986:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ec00/0x48868a4e439495b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f620 expref: 31 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.569999:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ec00/0x48868a4e439495b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f620 expref: 31 pid: 4589 timeout: 798 lvb_type: 0 00002000:00010000:1.0:1746129752.570006:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936ddf80 00000100:00100000:3.0:1746129752.570557:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1963:x1830949052202240:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 15607us (16374us total) trans 21474840302 rc 0/0 00000100:00100000:3.0:1746129752.570566:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 592 00002000:00100000:3.0:1746129752.570571:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2465792->3145727) req@ffff8800936ded80 x1830949052202240/t21474840302(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/448 e 0 to 0 dl 1746129763 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129752.570579:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936ded80 with x1830949052202240 ext(2465792->3145727) 00010000:00010000:3.0:1746129752.570585:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9b800/0x48868a4e43949631 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f690 expref: 16 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129752.570595:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9b800/0x48868a4e43949631 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f690 expref: 16 pid: 8436 timeout: 798 lvb_type: 0 00002000:00010000:3.0:1746129752.570600:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800936ded80 00000100:00100000:3.0:1746129752.574820:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949052203264:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 16021us (17075us total) trans 17179873151 rc 0/0 00000100:00100000:3.0:1746129752.574831:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 594 00002000:00100000:3.0:1746129752.574840:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3358719) req@ffff8800936de300 x1830949052203264/t17179873151(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/448 e 0 to 0 dl 1746129763 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129752.574874:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936de300 with x1830949052203264 ext(3145728->3358719) 00010000:00010000:3.0:1746129752.574881:0:21600:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x48868a4e43949669 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3358719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6b3 expref: 18 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129752.574892:0:21600:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x48868a4e43949669 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3358719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6b3 expref: 18 pid: 8436 timeout: 798 lvb_type: 0 00002000:00010000:3.0:1746129752.574897:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936de300 00000100:00100000:1.0:1746129752.574990:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.575077:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.575092:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052203776 00000100:00100000:1.0:1746129752.575097:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052203776 00010000:00010000:1.0:1746129752.575116:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ec00/0x48868a4e439495b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f620 expref: 31 pid: 4589 timeout: 798 lvb_type: 0 00000100:00100000:1.0:1746129752.575131:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052203904 00000100:00100000:1.0:1746129752.575132:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052203904 00010000:00010000:1.0:1746129752.575139:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9b800/0x48868a4e43949631 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f690 expref: 16 pid: 8436 timeout: 798 lvb_type: 0 00000100:00100000:1.0:1746129752.575149:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5274 00000100:00100000:1.0:1746129752.575154:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1964:x1830949052203776:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129752.575162:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129752.575176:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ec00/0x48868a4e439495b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f620 expref: 31 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.575183:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ec00/0x48868a4e439495b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f620 expref: 31 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.575200:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ec00/0x48868a4e439495b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f620 expref: 31 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.575210:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.575211:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.575214:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801356e2800/0x48868a4e439496c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.575222:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801356e2800/0x48868a4e439496c4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.575248:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129752.575264:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1964:x1830949052203776:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 110us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129752.575268:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5274 00000100:00100000:1.0:1746129752.575277:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5275 00000100:00100000:1.0:1746129752.575281:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052203904:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129752.575287:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129752.575296:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9b800/0x48868a4e43949631 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f690 expref: 16 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.575302:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9b800/0x48868a4e43949631 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f690 expref: 16 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.575312:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1a9b800/0x48868a4e43949631 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f690 expref: 16 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.575319:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.575320:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.575322:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801356e2c00/0x48868a4e439496cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.575328:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801356e2c00/0x48868a4e439496cb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.575337:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129752.575347:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949052203904:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 66us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129752.575350:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5275 00010000:00010000:3.0:1746129752.575429:0:20441:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801356e2800/0x48868a4e439496c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.575436:0:20441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801356e2800/0x48868a4e439496c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.575450:0:20441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801356e2800/0x48868a4e439496c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.575456:0:20441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801356e2800/0x48868a4e439496c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.575462:0:20441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801356e2800/0x48868a4e439496c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.575467:0:20441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801356e2800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129752.575470:0:20441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801356e2800/0x48868a4e439496c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.575480:0:20441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801356e2800/0x48868a4e439496c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.575489:0:20441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801356e2800/0x48868a4e439496c4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.575493:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356e2800/0x48868a4e439496c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129752.575524:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+7:1961:x1830949052201600:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 29264us (29467us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129752.575530:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10943 00010000:00010000:2.0:1746129752.575879:0:7976:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801356e2c00/0x48868a4e439496cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.575888:0:7976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801356e2c00/0x48868a4e439496cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.575903:0:7976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801356e2c00/0x48868a4e439496cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.575908:0:7976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801356e2c00/0x48868a4e439496cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.575913:0:7976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801356e2c00/0x48868a4e439496cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.575918:0:7976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801356e2c00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129752.575920:0:7976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801356e2c00/0x48868a4e439496cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.575925:0:7976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801356e2c00/0x48868a4e439496cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.575934:0:7976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801356e2c00/0x48868a4e439496cb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.575939:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801356e2c00/0x48868a4e439496cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129752.577403:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+6:1961:x1830949052201856:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 30986us (31314us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.577412:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10944 00000100:00100000:2.0:1746129752.577563:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949052203392:12345-192.168.204.31@tcp:4:cat.0 Request processed in 19203us (19934us total) trans 17179873152 rc 0/0 00000100:00100000:2.0:1746129752.577570:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 593 00002000:00100000:2.0:1746129752.577578:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->2605055) req@ffff8800936ddc00 x1830949052203392/t17179873152(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/448 e 0 to 0 dl 1746129763 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.577587:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936ddc00 with x1830949052203392 ext(2097152->2605055) 00010000:00010000:2.0:1746129752.577597:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801356e2e00/0x48868a4e439495c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->2605055] (req 2097152->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f635 expref: 30 pid: 1877 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.577613:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801356e2e00/0x48868a4e439495c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->2605055] (req 2097152->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f635 expref: 30 pid: 1877 timeout: 798 lvb_type: 0 00002000:00010000:2.0:1746129752.577618:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936ddc00 00000100:00100000:0.0:1746129752.577944:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.578238:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052204032 00000100:00100000:2.0:1746129752.578245:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052204032 00010000:00010000:2.0:1746129752.578264:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x48868a4e43949669 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3358719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6b3 expref: 18 pid: 8436 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.578288:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5276 00000100:00100000:2.0:1746129752.578294:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052204032:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129752.578305:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129752.578315:0:7107:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129752 -> 1746129753 00002000:00010000:2.0:1746129752.578551:0:7107:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129752 -> 1746129753 00002000:00010000:2.0:1746129752.578555:0:7107:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129752 -> 1746129753 00010000:00010000:2.0:1746129752.578561:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x48868a4e43949669 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3358719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6b3 expref: 18 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.578570:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x48868a4e43949669 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3358719) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6b3 expref: 18 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.578588:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11000/0x48868a4e43949669 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3358719) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6b3 expref: 18 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.578599:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129752.579987:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052204032:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1686us (2038us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.579996:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5276 00000100:00100000:0.0:1746129752.582252:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.583285:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052204160 00000100:00100000:2.0:1746129752.583293:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052204160 00010000:00010000:2.0:1746129752.583321:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801356e2e00/0x48868a4e439495c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->2605055] (req 2097152->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f635 expref: 30 pid: 1877 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.583472:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5277 00000100:00100000:2.0:1746129752.583480:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1ae9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949052204160:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129752.583491:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129752.583509:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801356e2e00/0x48868a4e439495c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->2605055] (req 2097152->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f635 expref: 30 pid: 1877 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.583519:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801356e2e00/0x48868a4e439495c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->2605055] (req 2097152->2605055) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f635 expref: 30 pid: 1877 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.583535:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356e2e00/0x48868a4e439495c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->2605055] (req 2097152->2605055) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f635 expref: 30 pid: 1877 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.583548:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.583549:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.583552:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a149600/0x48868a4e439496e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.583560:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a149600/0x48868a4e439496e0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.583783:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129752.583826:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1ae9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949052204160:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 346us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.583831:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5277 00010000:00010000:3.0:1746129752.584106:0:1877:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a149600/0x48868a4e439496e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.584114:0:1877:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a149600/0x48868a4e439496e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.584131:0:1877:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a149600/0x48868a4e439496e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.584137:0:1877:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a149600/0x48868a4e439496e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.584143:0:1877:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a149600/0x48868a4e439496e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.584153:0:1877:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a149600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129752.584156:0:1877:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a149600/0x48868a4e439496e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.584162:0:1877:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a149600/0x48868a4e439496e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.584171:0:1877:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a149600/0x48868a4e439496e0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.584176:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a149600/0x48868a4e439496e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129752.584222:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+6:1961:x1830949052201728:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 37322us (37471us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129752.584229:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10947 00000100:00100000:0.0:1746129752.590005:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.590544:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052204416 00000100:00100000:3.0:1746129752.590552:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052204416 00000100:00100000:3.0:1746129752.590591:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9879 00000100:00100000:3.0:1746129752.590598:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6141239f-0c60-480d-830c-e22ba61457b0+12:28614:x1830949052204416:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:3.0:1746129752.590642:0:14314:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129752.590665:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394968c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6c1 expref: 12 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.590678:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129752.590683:0:14314:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129752.590706:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ec000/0x48868a4e439496e7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.590717:0:14314:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238c00/0x48868a4e43949367 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4e5 expref: 20 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.590723:0:14314:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013558be00/0x48868a4e43949398 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f516 expref: 20 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.590729:0:14314:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013558b400/0x48868a4e439493b4 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f524 expref: 292 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.590735:0:14314:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f400/0x48868a4e4394959e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f612 expref: 292 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.590740:0:14314:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092841400/0x48868a4e439493f3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f54e expref: 292 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.590745:0:14314:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78e00/0x48868a4e43949416 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f555 expref: 20 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.590750:0:14314:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ec000/0x48868a4e439496e7 lrc: 9/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.590775:0:14314:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78e00/0x48868a4e43949416 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f555 expref: 20 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.590786:0:14314:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78e00/0x48868a4e43949416 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f555 expref: 20 pid: 14314 timeout: 798 lvb_type: 0 00000100:00100000:3.0:1746129752.590801:0:14314:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053310848:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129752.590917:0:14314:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092841400/0x48868a4e439493f3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f54e expref: 292 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.590924:0:14314:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092841400/0x48868a4e439493f3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f54e expref: 292 pid: 14313 timeout: 798 lvb_type: 0 00000100:00100000:3.0:1746129752.590931:0:14314:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053310976:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129752.590954:0:14314:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f400/0x48868a4e4394959e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f612 expref: 292 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.590960:0:14314:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f400/0x48868a4e4394959e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f612 expref: 292 pid: 14315 timeout: 798 lvb_type: 0 00000100:00100000:3.0:1746129752.590966:0:14314:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053311104:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129752.590982:0:14314:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013558b400/0x48868a4e439493b4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f524 expref: 292 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.590988:0:14314:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013558b400/0x48868a4e439493b4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f524 expref: 292 pid: 14315 timeout: 798 lvb_type: 0 00000100:00100000:3.0:1746129752.590994:0:14314:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053311232:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129752.591018:0:14314:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013558be00/0x48868a4e43949398 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f516 expref: 20 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.591028:0:14314:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013558be00/0x48868a4e43949398 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f516 expref: 20 pid: 14314 timeout: 798 lvb_type: 0 00000100:00100000:3.0:1746129752.591034:0:14314:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053311360:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129752.591132:0:14314:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238c00/0x48868a4e43949367 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4e5 expref: 20 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.591139:0:14314:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238c00/0x48868a4e43949367 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4e5 expref: 20 pid: 14313 timeout: 798 lvb_type: 0 00000100:00100000:3.0:1746129752.591145:0:14314:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adad500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053311488:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129752.591166:0:14314:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129752.596474:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.596504:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.596522:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.596541:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052205056 00000100:00100000:0.0:1746129752.596547:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.596549:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052205056 00010000:00010000:2.0:1746129752.596576:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013558b400/0x48868a4e439493b4 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f524 expref: 293 pid: 14315 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.596596:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052205312 00000100:00100000:2.0:1746129752.596597:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052205312 00010000:00010000:2.0:1746129752.596609:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238c00/0x48868a4e43949367 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4e5 expref: 21 pid: 14313 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.596618:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052205184 00000100:00100000:2.0:1746129752.596619:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052205184 00010000:00010000:2.0:1746129752.596625:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013558be00/0x48868a4e43949398 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f516 expref: 22 pid: 14314 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.596635:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5278 00000100:00100000:2.0:1746129752.596641:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:1964:x1830949052205056:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129752.596651:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129752.596656:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013558b400/0x48868a4e439493b4 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f524 expref: 293 pid: 14315 timeout: 798 lvb_type: 0 00000100:00100000:3.0:1746129752.596657:0:14314:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053310848:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129752.596664:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013558b400/0x48868a4e439493b4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f524 expref: 293 pid: 14315 timeout: 798 lvb_type: 0 00000100:00100000:3.0:1746129752.596665:0:14314:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053310976:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129752.596671:0:14314:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053311104:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129752.596676:0:14314:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053311232:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129752.596681:0:14314:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053311360:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129752.596684:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013558b400/0x48868a4e439493b4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f524 expref: 293 pid: 14315 timeout: 798 lvb_type: 0 00000100:00100000:3.0:1746129752.596686:0:14314:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adad500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053311488:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129752.596695:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129752.596698:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ec000/0x48868a4e439496e7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129752.596706:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129752.596709:0:14314:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ec000/0x48868a4e439496e7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000100:00100000:2.0:1746129752.596734:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:1964:x1830949052205056:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 93us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.596739:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5278 00000100:00100000:2.0:1746129752.596750:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5279 00000100:00100000:2.0:1746129752.596753:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1964:x1830949052205312:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129752.596757:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129752.596760:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238c00/0x48868a4e43949367 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4e5 expref: 22 pid: 14313 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.596766:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238c00/0x48868a4e43949367 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4e5 expref: 22 pid: 14313 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.596774:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238c00/0x48868a4e43949367 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f4e5 expref: 22 pid: 14313 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.596781:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129752.596783:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ec000/0x48868a4e439496e7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129752.596790:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129752.596798:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1964:x1830949052205312:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 44us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.596802:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5279 00000100:00100000:2.0:1746129752.596807:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5280 00000100:00100000:2.0:1746129752.596810:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949052205184:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129752.596814:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129752.596817:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013558be00/0x48868a4e43949398 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f516 expref: 20 pid: 14314 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.596822:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013558be00/0x48868a4e43949398 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f516 expref: 20 pid: 14314 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.596829:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013558be00/0x48868a4e43949398 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f516 expref: 20 pid: 14314 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.596834:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129752.596837:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ec000/0x48868a4e439496e7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129752.596841:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129752.596867:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1964:x1830949052205184:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 55us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.596871:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5280 00000100:00100000:3.0:1746129752.597494:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052204928 00000100:00100000:3.0:1746129752.597499:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052204928 00000100:00100000:3.0:1746129752.597520:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3883 00000100:00100000:3.0:1746129752.597524:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:27192:x1830949052204928:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746129752.597661:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:27192:x1830949052204928:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 136us (1113us total) trans 8589943664 rc 0/0 00000100:00100000:3.0:1746129752.597667:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3883 00000100:00100000:0.0:1746129752.599147:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.599178:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.599240:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.599267:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052204544 00000100:00100000:0.0:1746129752.599272:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052204544 00010000:00010000:0.0:1746129752.599292:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78e00/0x48868a4e43949416 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f555 expref: 19 pid: 14314 timeout: 798 lvb_type: 0 00000100:00100000:1.0:1746129752.599308:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052204672 00000100:00100000:1.0:1746129752.599311:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052204672 00000100:00100000:0.0:1746129752.599324:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052205440 00000100:00100000:0.0:1746129752.599326:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052205440 00010000:00010000:0.0:1746129752.599334:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f400/0x48868a4e4394959e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f612 expref: 294 pid: 14315 timeout: 798 lvb_type: 0 00000100:00100000:0.0:1746129752.599346:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5281 00000100:00100000:3.0:1746129752.599350:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5282 00000100:00100000:0.0:1746129752.599351:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1961:x1830949052204544:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129752.599355:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:1961:x1830949052205440:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129752.599359:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129752.599362:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129752.599363:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78e00/0x48868a4e43949416 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f555 expref: 19 pid: 14314 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129752.599364:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f400/0x48868a4e4394959e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f612 expref: 294 pid: 14315 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746129752.599372:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78e00/0x48868a4e43949416 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f555 expref: 19 pid: 14314 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129752.599387:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f400/0x48868a4e4394959e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f612 expref: 294 pid: 14315 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746129752.599403:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78e00/0x48868a4e43949416 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f555 expref: 19 pid: 14314 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129752.599407:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f400/0x48868a4e4394959e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f612 expref: 294 pid: 14315 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746129752.599415:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129752.599420:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ec000/0x48868a4e439496e7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.599430:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129752.599465:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:1961:x1830949052205440:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 109us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129752.599470:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5282 00010000:00010000:1.0:1746129752.599511:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092841400/0x48868a4e439493f3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f54e expref: 292 pid: 14313 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746129752.599661:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129752.599665:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ec000/0x48868a4e439496e7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129752.599670:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129752.599673:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5283 00000100:00100000:1.0:1746129752.599679:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:1961:x1830949052204672:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129752.599686:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129752.599689:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092841400/0x48868a4e439493f3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f54e expref: 292 pid: 14313 timeout: 798 lvb_type: 0 00000100:00100000:0.0:1746129752.599689:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949052204544:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 338us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.599693:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5281 00010000:00010000:1.0:1746129752.599701:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092841400/0x48868a4e439493f3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f54e expref: 292 pid: 14313 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.599711:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092841400/0x48868a4e439493f3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f54e expref: 292 pid: 14313 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.599722:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129752.599725:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ec000/0x48868a4e439496e7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129752.599731:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ec000/0x48868a4e439496e7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129752.599736:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ec000/0x48868a4e439496e7 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129752.599786:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129752.599793:0:14314:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ec000/0x48868a4e439496e7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.599802:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ec000/0x48868a4e439496e7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000100:00100000:1.0:1746129752.599812:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:1961:x1830949052204672:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 133us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129752.599912:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5283 00000040:00080000:3.0:1746129752.600490:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2823, 88 off235272 00000004:00080000:3.0:1746129752.600497:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 698658648553ns, next at 641639930618ns, rc = 0 00000100:00100000:0.0:1746129752.600563:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000040:00080000:3.0:1746129752.600585:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2758, 88 off229640 00000004:00080000:3.0:1746129752.600590:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 698658741983ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129752.600602:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2759, 88 off229728 00000004:00080000:3.0:1746129752.600605:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 698658756709ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129752.600612:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2824, 88 off235360 00000004:00080000:3.0:1746129752.600614:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 698658765716ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129752.600619:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2825, 88 off235448 00000004:00080000:3.0:1746129752.600621:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 698658773259ns, next at 641639930618ns, rc = 0 00000100:00100000:1.0:1746129752.600752:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052205696 00000100:00100000:1.0:1746129752.600757:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052205696 00000100:00100000:1.0:1746129752.600777:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9880 00000100:00100000:1.0:1746129752.600782:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:28622:x1830949052205696:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129752.600795:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000040:00080000:3.0:1746129752.600799:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2760, 88 off229816 00000004:00080000:3.0:1746129752.600804:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 698658955656ns, next at 641623252291ns, rc = 0 00010000:00010000:1.0:1746129752.600805:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4200/0x48868a4e439496ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f6e4 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1746129752.600815:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2761, 88 off229904 00000004:00080000:3.0:1746129752.600818:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 698658969928ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129752.600824:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2762, 88 off229992 00000004:00080000:3.0:1746129752.600827:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 698658978796ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129752.600834:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2826, 88 off235536 00000004:00080000:3.0:1746129752.600836:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 698658988293ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129752.600869:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2763, 88 off230080 00000004:00080000:3.0:1746129752.600872:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 698659024241ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129752.600878:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2827, 88 off235624 00000004:00080000:3.0:1746129752.600880:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 698659032599ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129752.600886:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2764, 88 off230168 00000004:00080000:3.0:1746129752.600890:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 698659042311ns, next at 641623252291ns, rc = 0 00010000:00010000:1.0:1746129752.600894:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5000/0x48868a4e439496f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00000040:00080000:3.0:1746129752.600896:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2828, 88 off235712 00000004:00080000:3.0:1746129752.600899:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 698659050799ns, next at 641639930618ns, rc = 0 00010000:00010000:1.0:1746129752.600903:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5000/0x48868a4e439496f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00000040:00080000:3.0:1746129752.600905:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2829, 88 off235800 00000004:00080000:3.0:1746129752.600907:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 698659059050ns, next at 641639930618ns, rc = 0 00010000:00010000:1.0:1746129752.600909:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5000/0x48868a4e439496f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000040:00080000:3.0:1746129752.600913:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2830, 88 off235888 00000004:00080000:3.0:1746129752.600915:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 698659067290ns, next at 641639930618ns, rc = 0 00010000:00010000:1.0:1746129752.600918:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5a00/0x48868a4e439496fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00000040:00080000:3.0:1746129752.600921:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2831, 88 off235976 00010000:00010000:1.0:1746129752.600922:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5a00/0x48868a4e439496fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00000004:00080000:3.0:1746129752.600923:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 698659075393ns, next at 641639930618ns, rc = 0 00010000:00010000:1.0:1746129752.600927:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5a00/0x48868a4e439496fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000040:00080000:3.0:1746129752.600929:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2765, 88 off230256 00000004:00080000:3.0:1746129752.600932:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 698659083851ns, next at 641623252291ns, rc = 0 00000004:00010000:3.0:1746129752.630375:0:14314:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800936dce00 reply state ffff88009fae3400 transno 8589943665 ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ec000/0x48868a4e439496e7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000100:00100000:3.0:1746129752.630398:0:14314:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746129752.630495:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6141239f-0c60-480d-830c-e22ba61457b0+13:28614:x1830949052204416:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 39894us (40495us total) trans 8589943665 rc 0/0 00000100:00100000:3.0:1746129752.630502:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9879 00000001:00080000:1.0:1746129752.630557:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943650 is committed 00000001:00080000:1.0:1746129752.630572:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943660 is committed 00000001:00080000:1.0:1746129752.630580:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943659 is committed 00000001:00080000:1.0:1746129752.630589:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943654 is committed 00000001:00080000:1.0:1746129752.630607:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943665 is committed 00000004:00080000:1.0:1746129752.630611:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1950 committed 00000004:00080000:1.0:1746129752.630627:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2013 committed 00000004:00080000:1.0:1746129752.630633:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2012 committed 00000004:00080000:1.0:1746129752.630635:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2011 committed 00000004:00080000:1.0:1746129752.630636:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2010 committed 00000004:00080000:1.0:1746129752.630637:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1949 committed 00000004:00080000:1.0:1746129752.630639:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2009 committed 00000004:00080000:1.0:1746129752.630640:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1948 committed 00000004:00080000:1.0:1746129752.630641:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2008 committed 00000004:00080000:1.0:1746129752.630643:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1947 committed 00000004:00080000:1.0:1746129752.630644:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1946 committed 00000004:00080000:1.0:1746129752.630645:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1945 committed 00000004:00080000:1.0:1746129752.630647:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2007 committed 00000004:00080000:1.0:1746129752.630648:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2006 committed 00000004:00080000:1.0:1746129752.630649:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1944 committed 00000004:00080000:1.0:1746129752.630651:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1943 committed 00000004:00080000:1.0:1746129752.630652:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2005 committed 00000001:00080000:1.0:1746129752.630656:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943664 is committed 00000001:00080000:1.0:1746129752.630660:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943662 is committed 00010000:00010000:1.0:1746129752.630694:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5800/0x48868a4e43949703 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.630706:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5800/0x48868a4e43949703 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.630714:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5800/0x48868a4e43949703 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:1.0:1746129752.630723:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000100:00100000:0.0:1746129752.630756:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053312000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129752.630794:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746129752.630825:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5800/0x48868a4e43949703 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.630832:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5800/0x48868a4e43949703 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.630837:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5800/0x48868a4e43949703 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.630842:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a49b5800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129752.630845:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5800/0x48868a4e43949703 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.630869:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5800/0x48868a4e43949703 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.630878:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129752.630880:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746129752.630884:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5800/0x48868a4e43949703 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.630888:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5800/0x48868a4e43949703 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.630900:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5000/0x48868a4e439496f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.630905:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5000/0x48868a4e439496f5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.630908:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5000/0x48868a4e439496f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.630912:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a49b5000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129752.630913:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5000/0x48868a4e439496f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.630917:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5000/0x48868a4e439496f5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.630922:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129752.630924:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129752.630926:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5000/0x48868a4e439496f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.630930:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5000/0x48868a4e439496f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.630936:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5a00/0x48868a4e439496fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.630941:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5a00/0x48868a4e439496fc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.630944:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5a00/0x48868a4e439496fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.630948:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a49b5a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129752.630950:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5a00/0x48868a4e439496fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.630953:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5a00/0x48868a4e439496fc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.630958:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e2d8a00) 00010000:00010000:1.0:1746129752.630959:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129752.630961:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5a00/0x48868a4e439496fc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.630964:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5a00/0x48868a4e439496fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.630996:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4200/0x48868a4e439496ee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6e4 expref: 283 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.631003:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4200/0x48868a4e439496ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6e4 expref: 283 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.631009:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a49b4200, rc 0) 00000100:00100000:1.0:1746129752.631033:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:28622:x1830949052205696:12345-192.168.204.31@tcp:101:cat.0 Request processed in 30249us (30470us total) trans 8589943666 rc 301/301 00000100:00100000:1.0:1746129752.631038:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9880 00000100:00100000:1.0:1746129752.631055:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053311744:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129752.631075:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129752.631095:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053312000 00000100:00100000:2.0:1746129752.631101:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053312000 00000100:00100000:2.0:1746129752.631123:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053311744 00000100:00100000:2.0:1746129752.631125:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053311744 00000100:00100000:2.0:1746129752.631143:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10948 00000100:00100000:2.0:1746129752.631149:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3298:x1830949053312000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129752.631272:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3298:x1830949053312000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 123us (477us total) trans 21474840303 rc 0/0 00000100:00100000:2.0:1746129752.631277:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10948 00000100:00100000:2.0:1746129752.631287:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10949 00000100:00100000:2.0:1746129752.631291:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3296:x1830949053311744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129752.631365:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3296:x1830949053311744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (288us total) trans 21474840304 rc 0/0 00000100:00100000:2.0:1746129752.631369:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10949 00000004:00080000:0.0:1746129752.631472:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d4000/2, rc 0, transno 21474840303 00000100:00100000:0.0:1746129752.631477:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053312000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129752.631482:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053312512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129752.631499:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129752.631515:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053313024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129752.631527:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129752.631535:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053313536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129752.631546:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129752.631556:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746129752.631561:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053311616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129752.631573:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129752.631581:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053312128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129752.631592:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129752.631601:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053312640:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129752.631612:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129752.631620:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053313152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129752.631632:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129752.631646:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053312512 00000100:00100000:0.0:1746129752.631649:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053312512 00000100:00100000:0.0:1746129752.631661:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053313024 00000100:00100000:0.0:1746129752.631663:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053313024 00000100:00100000:0.0:1746129752.631671:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053313536 00000100:00100000:0.0:1746129752.631673:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053313536 00000100:00100000:0.0:1746129752.631679:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053311616 00000100:00100000:0.0:1746129752.631680:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053311616 00000100:00100000:0.0:1746129752.631686:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053312128 00000100:00100000:0.0:1746129752.631688:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053312128 00000100:00100000:0.0:1746129752.631693:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053312640 00000100:00100000:0.0:1746129752.631694:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053312640 00000100:00100000:0.0:1746129752.631700:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053313152 00000100:00100000:0.0:1746129752.631701:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053313152 00000100:00100000:0.0:1746129752.631708:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10950 00000100:00100000:0.0:1746129752.631712:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+25:3298:x1830949053312512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129752.631789:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+26:3298:x1830949053312512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (288us total) trans 21474840305 rc 0/0 00000100:00100000:0.0:1746129752.631794:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10950 00000100:00100000:0.0:1746129752.631803:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10951 00000100:00100000:0.0:1746129752.631807:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3298:x1830949053313024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129752.631903:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1746129752.632246:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10952 00000100:00100000:2.0:1746129752.632252:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3298:x1830949053313536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129752.633316:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3298:x1830949053313536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1062us (1766us total) trans 17179873154 rc 0/0 00000100:00100000:2.0:1746129752.633322:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10952 00000100:00100000:2.0:1746129752.633335:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10953 00000100:00100000:2.0:1746129752.633340:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3298:x1830949053311616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129752.633433:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3298:x1830949053311616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (1859us total) trans 21474840306 rc 0/0 00000100:00100000:2.0:1746129752.633439:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10953 00000100:00100000:2.0:1746129752.633448:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10954 00000100:00100000:2.0:1746129752.633452:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3298:x1830949053312128:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129752.633677:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129752.633679:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129752.633680:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129752.633682:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129752.633704:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3298:x1830949053313024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1895us (2175us total) trans 17179873153 rc 0/0 00000100:00100000:0.0:1746129752.633709:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10951 00000100:00100000:0.0:1746129752.633718:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10955 00000100:00100000:0.0:1746129752.633723:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3298:x1830949053312640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129752.633806:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3298:x1830949053312640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (2193us total) trans 17179873155 rc 0/0 00000100:00100000:0.0:1746129752.633811:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10955 00000100:00100000:0.0:1746129752.633819:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10956 00000100:00100000:0.0:1746129752.633824:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3298:x1830949053313152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129752.633900:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3298:x1830949053313152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (2267us total) trans 17179873156 rc 0/0 00000100:00100000:0.0:1746129752.633905:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10956 00000004:00080000:0.0:1746129752.634020:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130505c00/2, rc 0, transno 21474840306 00000100:00100000:0.0:1746129752.634025:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053311616:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129752.634034:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f6a5880/2, rc 0, transno 17179873155 00000100:00100000:0.0:1746129752.634044:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053312640:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129752.634050:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f6a5f80/2, rc 0, transno 17179873156 00000100:00100000:0.0:1746129752.634052:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053313152:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129752.634058:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f6a7480/2, rc 0, transno 17179873153 00000100:00100000:0.0:1746129752.634061:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053313024:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129752.634066:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba87480/2, rc 0, transno 17179873154 00000100:00100000:0.0:1746129752.634068:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053313536:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129752.634075:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d7b80/2, rc 0, transno 21474840305 00000100:00100000:0.0:1746129752.634078:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053312512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129752.634115:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746129752.634124:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053313664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129752.634146:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129752.634170:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053313664 00000100:00100000:0.0:1746129752.634174:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053313664 00000100:00100000:0.0:1746129752.634189:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10957 00000100:00100000:0.0:1746129752.634193:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3298:x1830949053313664:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129752.634759:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746129752.634763:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746129752.634765:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746129752.634766:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746129752.634768:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746129752.634794:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3298:x1830949053312128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1341us (3200us total) trans 21474840307 rc 0/0 00000100:00100000:2.0:1746129752.634833:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10954 00000004:00080000:2.0:1746129752.634877:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009423d880/2, rc 0, transno 21474840304 00000100:00100000:2.0:1746129752.634881:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053311744:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129752.634886:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053312256:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129752.634904:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129752.634916:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053312768:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129752.634930:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129752.634939:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053313280:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129752.634952:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129752.634977:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1746129752.634981:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053311872:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129752.634996:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129752.635006:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053312384:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746129752.635036:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ec000/0x48868a4e439496e7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.635045:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ec000/0x48868a4e439496e7 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.635050:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ec000/0x48868a4e439496e7 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.635055:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801310ec000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129752.635059:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ec000/0x48868a4e439496e7 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.635068:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ec000/0x48868a4e439496e7 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.635081:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129752.635083:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129752.635086:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ec000/0x48868a4e439496e7 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.635091:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ec000/0x48868a4e439496e7 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00000100:00100000:3.0:1746129752.635118:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053312256 00000100:00100000:3.0:1746129752.635122:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053312256 00000100:00100000:3.0:1746129752.635135:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053312768 00000100:00100000:3.0:1746129752.635137:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053312768 00000100:00100000:2.0:1746129752.635142:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129752.635143:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053313280 00000100:00100000:3.0:1746129752.635145:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053313280 00000100:00100000:3.0:1746129752.635150:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053311872 00000100:00100000:3.0:1746129752.635152:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053311872 00000100:00100000:2.0:1746129752.635154:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053312896:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129752.635157:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053312384 00000100:00100000:3.0:1746129752.635159:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053312384 00000100:00100000:3.0:1746129752.635166:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10958 00000100:00100000:2.0:1746129752.635169:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129752.635170:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3296:x1830949053312256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129752.635176:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053313408:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129752.635187:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129752.635199:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053312896 00000100:00100000:2.0:1746129752.635202:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053312896 00000100:00100000:2.0:1746129752.635213:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053313408 00000100:00100000:2.0:1746129752.635214:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053313408 00000100:00100000:2.0:1746129752.635222:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10959 00000100:00100000:2.0:1746129752.635226:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3296:x1830949053312768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129752.635275:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10960 00000100:00100000:2.0:1746129752.635279:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3296:x1830949053313280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129752.635295:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3296:x1830949053312256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 123us (389us total) trans 21474840308 rc 0/0 00000100:00100000:3.0:1746129752.635300:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10958 00000100:00100000:3.0:1746129752.635314:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10961 00000004:00080000:2.0:1746129752.635316:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d6d80/2, rc 0, transno 21474840308 00000100:00100000:3.0:1746129752.635319:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3296:x1830949053311872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129752.635319:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053312256:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129752.635329:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10962 00000100:00100000:2.0:1746129752.635334:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3296:x1830949053312384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129752.635443:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10963 00000100:00100000:1.0:1746129752.635453:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+40:3296:x1830949053312896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129752.635566:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3296:x1830949053311872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 247us (568us total) trans 21474840309 rc 0/0 00000100:00100000:3.0:1746129752.635572:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10961 00000100:00100000:0.0:1746129752.635576:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10964 00000100:00100000:0.0:1746129752.635583:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3296:x1830949053313408:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129752.635626:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d5c00/2, rc 0, transno 21474840309 00000100:00100000:2.0:1746129752.635630:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053311872:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129752.635637:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d4a80/2, rc 0, transno 21474840307 00000100:00100000:0.0:1746129752.635640:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053312128:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129752.635668:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3296:x1830949053312384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 334us (526us total) trans 21474840310 rc 0/0 00000100:00100000:2.0:1746129752.635673:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10962 00000004:00080000:3.0:1746129752.635683:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d7800/2, rc 0, transno 21474840310 00000100:00100000:3.0:1746129752.635687:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053312384:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129752.635797:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+43:3296:x1830949053312896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 346us (626us total) trans 17179873158 rc 0/0 00000100:00100000:2.0:1746129752.635800:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+43:3296:x1830949053312768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 572us (868us total) trans 17179873159 rc 0/0 00000100:00100000:1.0:1746129752.635803:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10963 00000100:00100000:2.0:1746129752.635805:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10959 00000100:00100000:0.0:1746129752.635888:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+42:3298:x1830949053313664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1694us (1741us total) trans 17179873157 rc 0/0 00000100:00100000:0.0:1746129752.635894:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10957 00000100:00100000:3.0:1746129752.635917:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3296:x1830949053313280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 637us (964us total) trans 17179873160 rc 0/0 00000100:00100000:3.0:1746129752.635922:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10960 00000004:00080000:3.0:1746129752.635943:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f6a7b80/2, rc 0, transno 17179873158 00000100:00100000:3.0:1746129752.635947:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053312896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129752.635953:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3296:x1830949053313408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 370us (764us total) trans 17179873161 rc 0/0 00000004:00080000:3.0:1746129752.635954:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba86680/2, rc 0, transno 17179873161 00000100:00100000:3.0:1746129752.635958:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053313408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129752.635958:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10964 00000004:00080000:3.0:1746129752.635963:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f6a6680/2, rc 0, transno 17179873159 00000100:00100000:3.0:1746129752.635965:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053312768:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129752.635970:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f6a4000/2, rc 0, transno 17179873160 00000100:00100000:3.0:1746129752.635972:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053313280:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129752.635976:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eb5f80/2, rc 0, transno 17179873157 00000100:00100000:0.0:1746129752.635979:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053313664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129752.636469:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.636766:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052206080 00000100:00100000:1.0:1746129752.636771:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052206080 00000100:00100000:1.0:1746129752.636806:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9881 00000100:00100000:1.0:1746129752.636812:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:28624:x1830949052206080:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129752.636825:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129752.636838:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e43949711 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f6f2 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.636932:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4e00/0x48868a4e43949718 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.636943:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4e00/0x48868a4e43949718 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.636951:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4e00/0x48868a4e43949718 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.636962:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e4394971f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.636967:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e4394971f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.636972:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e4394971f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129752.637054:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129752.637063:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43949726 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129752.637072:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052205824 00010000:00010000:1.0:1746129752.637073:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43949726 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129752.637075:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052205824 00010000:00010000:1.0:1746129752.637078:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43949726 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:1.0:1746129752.637085:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000100:00100000:0.0:1746129752.637091:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9882 00000100:00100000:0.0:1746129752.637096:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+7:28614:x1830949052205824:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129752.637136:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43949726 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.637142:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43949726 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.637147:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43949726 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.637151:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1aa200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129752.637153:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43949726 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.637159:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43949726 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.637168:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129752.637170:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746129752.637173:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43949726 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.637178:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43949726 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.637188:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4e00/0x48868a4e43949718 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.637195:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4e00/0x48868a4e43949718 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.637200:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4e00/0x48868a4e43949718 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.637204:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a49b4e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129752.637206:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4e00/0x48868a4e43949718 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.637210:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4e00/0x48868a4e43949718 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.637215:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129752.637217:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129752.637219:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4e00/0x48868a4e43949718 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.637223:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4e00/0x48868a4e43949718 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.637228:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e4394971f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.637232:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e4394971f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.637236:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e4394971f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.637239:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1ab600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129752.637241:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e4394971f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.637247:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e4394971f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.637252:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e2d8300) 00010000:00010000:1.0:1746129752.637253:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129752.637255:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e4394971f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.637258:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e4394971f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129752.637285:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e43949711 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6f2 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.637291:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e43949711 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6f2 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.637298:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9bc800, rc 0) 00000100:00100000:1.0:1746129752.637330:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28624:x1830949052206080:12345-192.168.204.31@tcp:101:cat.0 Request processed in 518us (863us total) trans 8589943667 rc 301/301 00000100:00100000:1.0:1746129752.637336:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9881 00010000:00010000:0.0:1746129752.638809:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129752.638825:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e43949734 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f6eb expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.638876:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e43949734 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6eb expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.638886:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e43949734 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6eb expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.638904:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129752.638907:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129752.638909:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6fa00, rc 0) 00000100:00100000:0.0:1746129752.638933:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+8:28614:x1830949052205824:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1836us (1879us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.638938:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9882 00000100:00100000:0.0:1746129752.656511:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.656557:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.656622:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052206208 00000100:00100000:3.0:1746129752.656631:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052206208 00000100:00100000:3.0:1746129752.656663:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052206464 00000100:00100000:3.0:1746129752.656665:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052206464 00000100:00100000:3.0:1746129752.656678:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9883 00000100:00100000:3.0:1746129752.656684:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28622:x1830949052206208:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129752.656704:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129752.656719:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eca00/0x48868a4e4394973b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f6f9 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.656779:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949742 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.656790:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949742 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.656800:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949742 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129752.656820:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:3.0:1746129752.656823:0:14313:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129752.656834:0:14313:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949742 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.656881:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eca00/0x48868a4e4394973b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6f9 expref: 285 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.656899:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949742 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6f9 expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.656906:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129752.656908:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129752.656910:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310eda00, rc 0) 00000100:00100000:1.0:1746129752.656926:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9884 00000100:00100000:1.0:1746129752.656935:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28619:x1830949052206464:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129752.656943:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129752.656948:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28622:x1830949052206208:12345-192.168.204.31@tcp:101:cat.0 Request processed in 264us (444us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129752.656951:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa000/0x48868a4e43949749 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f700 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129752.656954:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9883 00010000:00010000:1.0:1746129752.657018:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab800/0x48868a4e43949750 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129752.657025:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab800/0x48868a4e43949750 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129752.657031:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab800/0x48868a4e43949750 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129752.657041:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abe00/0x48868a4e43949757 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129752.657045:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abe00/0x48868a4e43949757 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129752.657049:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abe00/0x48868a4e43949757 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129752.657123:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa600/0x48868a4e4394975e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129752.657132:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e439496af lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6dd expref: 7 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.657138:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa600/0x48868a4e4394975e lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129752.657164:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e439496af lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6dd expref: 7 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.657175:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e439496af lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6dd expref: 7 pid: 14314 timeout: 798 lvb_type: 0 00000100:00100000:1.0:1746129752.657184:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053313792:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129752.657253:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a260c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129752.660908:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.660950:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.661119:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052206720 00000100:00100000:3.0:1746129752.661127:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052206720 00000100:00100000:3.0:1746129752.661171:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3884 00000100:00100000:3.0:1746129752.661178:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28624:x1830949052206720:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129752.661295:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052206848 00000100:00100000:2.0:1746129752.661299:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052206848 00000100:00100000:2.0:1746129752.661323:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9885 00000100:00100000:2.0:1746129752.661329:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6141239f-0c60-480d-830c-e22ba61457b0+8:28614:x1830949052206848:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129752.661338:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129752.661340:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28624:x1830949052206720:12345-192.168.204.31@tcp:35:cat.0 Request processed in 161us (438us total) trans 8589943668 rc 0/0 00000100:00100000:3.0:1746129752.661348:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3884 00010000:00010000:2.0:1746129752.661357:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e054000/0x48868a4e43949765 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f707 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129752.661411:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053313792:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129752.661421:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37200/0x48868a4e4394976c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129752.661428:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa600/0x48868a4e4394975e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129752.661432:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37200/0x48868a4e4394976c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129752.661440:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37200/0x48868a4e4394976c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:2.0:1746129752.661459:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:2.0:1746129752.661463:0:14314:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129752.661473:0:14314:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37200/0x48868a4e4394976c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129752.661490:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e054000/0x48868a4e43949765 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f707 expref: 10 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.661517:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37200/0x48868a4e4394976c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f707 expref: 9 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.661523:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129752.661526:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129752.661528:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d37200, rc 0) 00000100:00100000:2.0:1746129752.661550:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:28614:x1830949052206848:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 221us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.661554:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9885 00000100:00100000:0.0:1746129752.672485:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.672548:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.672604:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052207104 00000100:00100000:2.0:1746129752.672612:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052207104 00000100:00100000:2.0:1746129752.672644:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052207232 00000100:00100000:2.0:1746129752.672646:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052207232 00000100:00100000:2.0:1746129752.672663:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10965 00000100:00100000:2.0:1746129752.672669:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1963:x1830949052207104:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129752.672685:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.672702:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6e600/0x48868a4e43949773 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f70e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129752.673029:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e8:0x0] initial LVB size: 1048576, mtime: 0x6813d356, atime: 0x6813d355, ctime: 0x6813d356, blocks: 0x807 00010000:00010000:2.0:1746129752.673047:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.673048:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.673056:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6e600/0x48868a4e43949773 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f70e expref: 30 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.673069:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6e600/0x48868a4e43949773 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f70e expref: 30 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.673079:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d6e600, rc 0) 00000100:00100000:2.0:1746129752.673115:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1963:x1830949052207104:12345-192.168.204.31@tcp:101:cat.0 Request processed in 447us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.673121:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10965 00000100:00100000:2.0:1746129752.673133:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10966 00000100:00100000:2.0:1746129752.673137:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1963:x1830949052207232:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129752.673143:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.673150:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f800/0x48868a4e4394977a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f715 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129752.673161:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e6:0x0] initial LVB size: 2097152, mtime: 0x6813d355, atime: 0x6813d353, ctime: 0x6813d355, blocks: 0x821 00010000:00010000:2.0:1746129752.673168:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.673169:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.673172:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f800/0x48868a4e4394977a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f715 expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.673180:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f800/0x48868a4e4394977a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f715 expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.673186:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d6f800, rc 0) 00000100:00100000:2.0:1746129752.673196:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1963:x1830949052207232:12345-192.168.204.31@tcp:101:cat.0 Request processed in 59us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.673200:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10966 00000100:00100000:0.0:1746129752.674342:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.674370:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.674916:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052208256 00000100:00100000:2.0:1746129752.674921:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052208256 00000100:00100000:0.0:1746129752.674935:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.675263:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.675337:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052208512 00000100:00100000:2.0:1746129752.675340:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052208512 00000100:00100000:2.0:1746129752.675366:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052208128 00000100:00100000:2.0:1746129752.675368:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052208128 00000100:00100000:2.0:1746129752.675391:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10967 00000100:00100000:2.0:1746129752.675398:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1964:x1830949052208256:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:1.0:1746129752.675400:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10968 00010000:00010000:2.0:1746129752.675409:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129752.675409:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1964:x1830949052208512:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129752.675417:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.675425:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6ec00/0x48868a4e43949781 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f74d expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.675426:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e1abc00/0x48868a4e43949788 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f75b expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129752.675442:0:1140:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3ea:0x0] initial LVB size: 2097152, mtime: 0x6813d358, atime: 0x6813d353, ctime: 0x6813d358, blocks: 0x821 00002000:00010000:1.0:1746129752.675442:0:4589:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e8:0x0] initial LVB size: 4194304, mtime: 0x6813d359, atime: 0x6813d358, ctime: 0x6813d359, blocks: 0x1029 00010000:00010000:2.0:1746129752.675453:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.675453:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.675454:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.675455:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.675460:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e1abc00/0x48868a4e43949788 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f75b expref: 19 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.675461:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6ec00/0x48868a4e43949781 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f74d expref: 31 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129752.675471:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e1abc00/0x48868a4e43949788 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f75b expref: 19 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.675474:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6ec00/0x48868a4e43949781 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f74d expref: 31 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129752.675479:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1abc00, rc 0) 00010000:00010000:2.0:1746129752.675481:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d6ec00, rc 0) 00000100:00100000:1.0:1746129752.675509:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1964:x1830949052208512:12345-192.168.204.31@tcp:101:cat.0 Request processed in 102us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.675510:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1964:x1830949052208256:12345-192.168.204.31@tcp:101:cat.0 Request processed in 112us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129752.675514:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10968 00000100:00100000:2.0:1746129752.675517:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10967 00000100:00100000:1.0:1746129752.675525:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052208384 00000100:00100000:2.0:1746129752.675528:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10969 00000100:00100000:1.0:1746129752.675528:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052208384 00000100:00100000:2.0:1746129752.675532:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1964:x1830949052208128:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129752.675538:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129752.675540:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10970 00000100:00100000:1.0:1746129752.675544:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1964:x1830949052208384:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129752.675545:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f000/0x48868a4e4394978f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f746 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129752.675549:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129752.675552:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1746129752.675556:0:1140:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e7:0x0] initial LVB size: 2097152, mtime: 0x6813d353, atime: 0x6813d353, ctime: 0x6813d353, blocks: 0x81f 00010000:00010000:1.0:1746129752.675558:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa400/0x48868a4e43949796 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f754 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.675566:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.675567:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1746129752.675567:0:4589:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3eb:0x0] initial LVB size: 4960928, mtime: 0x6813d359, atime: 0x6813d359, ctime: 0x6813d359, blocks: 0x1629 00010000:00010000:2.0:1746129752.675571:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f000/0x48868a4e4394978f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f746 expref: 19 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129752.675573:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.675575:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.675578:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa400/0x48868a4e43949796 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f754 expref: 32 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.675580:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f000/0x48868a4e4394978f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f746 expref: 19 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.675586:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d6f000, rc 0) 00010000:00010000:1.0:1746129752.675587:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa400/0x48868a4e43949796 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f754 expref: 32 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129752.675593:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1aa400, rc 0) 00000100:00100000:1.0:1746129752.675606:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949052208384:12345-192.168.204.31@tcp:101:cat.0 Request processed in 61us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.675607:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1964:x1830949052208128:12345-192.168.204.31@tcp:101:cat.0 Request processed in 74us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129752.675610:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10970 00000100:00100000:2.0:1746129752.675615:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10969 00000100:00100000:0.0:1746129752.675615:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.675624:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052207360 00000100:00100000:2.0:1746129752.675627:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052207360 00000100:00100000:1.0:1746129752.675637:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052206976 00000100:00100000:2.0:1746129752.675639:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10971 00000100:00100000:1.0:1746129752.675639:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052206976 00000100:00100000:2.0:1746129752.675643:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+6:1961:x1830949052207360:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129752.675648:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129752.675652:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e439496af lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6dd expref: 9 pid: 14314 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.675653:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6fc00/0x48868a4e4394979d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f71c expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.675661:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.675662:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.675666:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6fc00/0x48868a4e4394979d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f71c expref: 7 pid: 1140 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129752.675666:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5284 00000100:00100000:1.0:1746129752.675670:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052206976:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129752.675673:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6fc00/0x48868a4e4394979d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f71c expref: 7 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.675678:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d6fc00, rc 0) 00010000:00010000:1.0:1746129752.675678:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129752.675683:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e439496af lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6dd expref: 9 pid: 14314 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.675690:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+7:1961:x1830949052207360:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 47us (76us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.675694:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10971 00010000:00010000:1.0:1746129752.675695:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e439496af lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6dd expref: 9 pid: 14314 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.675709:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e439496af lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6dd expref: 9 pid: 14314 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.675722:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129752.675727:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa600/0x48868a4e4394975e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129752.675734:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa600/0x48868a4e4394975e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129752.675739:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa600/0x48868a4e4394975e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129752.675751:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129752.675763:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052206976:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 93us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129752.675768:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5284 00010000:00010000:0.0:1746129752.675793:0:15044:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa600/0x48868a4e4394975e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.675801:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa600/0x48868a4e4394975e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:0.0:1746129752.675813:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129752.676660:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa600/0x48868a4e4394975e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.676667:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa600/0x48868a4e4394975e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.676673:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa600/0x48868a4e4394975e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.676678:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1aa600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129752.676681:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa600/0x48868a4e4394975e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.676687:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa600/0x48868a4e4394975e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.676694:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129752.676696:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129752.676698:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa600/0x48868a4e4394975e lrc: 2/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.676702:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa600/0x48868a4e4394975e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.678281:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab800/0x48868a4e43949750 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.678291:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab800/0x48868a4e43949750 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.678301:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab800/0x48868a4e43949750 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.678305:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1ab800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129752.678308:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab800/0x48868a4e43949750 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.678313:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab800/0x48868a4e43949750 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.678325:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:0.0:1746129752.678328:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129752.678330:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab800/0x48868a4e43949750 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.678337:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab800/0x48868a4e43949750 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.678352:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abe00/0x48868a4e43949757 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.678356:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abe00/0x48868a4e43949757 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.678360:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abe00/0x48868a4e43949757 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.678363:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1abe00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129752.678365:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abe00/0x48868a4e43949757 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.678369:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abe00/0x48868a4e43949757 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.678373:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e2d8300) 00010000:00010000:0.0:1746129752.678377:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129752.678386:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abe00/0x48868a4e43949757 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.678390:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abe00/0x48868a4e43949757 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.678432:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa000/0x48868a4e43949749 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f700 expref: 285 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.678439:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa000/0x48868a4e43949749 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f700 expref: 285 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.678445:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1aa000, rc 0) 00000100:00100000:0.0:1746129752.678491:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28619:x1830949052206464:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 21559us (21935us total) trans 8589943669 rc 301/301 00000100:00100000:0.0:1746129752.678498:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9884 00000100:00100000:0.0:1746129752.679348:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.679400:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.679405:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052207488 00000100:00100000:3.0:1746129752.679412:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052207488 00000100:00100000:0.0:1746129752.679427:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.679440:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10972 00000100:00100000:0.0:1746129752.679441:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.679446:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+6:1962:x1830949052207488:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:0.0:1746129752.679453:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129752.679462:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129752.679465:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129752.679473:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801310ec000/0x48868a4e439497ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f723 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129752.679484:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129752.679488:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129752.679490:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129752.679496:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801310ec000/0x48868a4e439497ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f723 expref: 7 pid: 7976 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129752.679499:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052207744 00000100:00100000:0.0:1746129752.679502:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052207744 00010000:00010000:3.0:1746129752.679508:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801310ec000/0x48868a4e439497ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f723 expref: 7 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129752.679515:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310ec000, rc 0) 00000100:00100000:0.0:1746129752.679518:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052208000 00000100:00100000:0.0:1746129752.679520:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052208000 00000100:00100000:0.0:1746129752.679528:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052207616 00000100:00100000:0.0:1746129752.679530:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052207616 00000100:00100000:3.0:1746129752.679537:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052207488:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 91us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.679538:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052207872 00000100:00100000:0.0:1746129752.679539:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052207872 00000100:00100000:3.0:1746129752.679541:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10972 00000100:00100000:0.0:1746129752.679557:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10973 00000100:00100000:3.0:1746129752.679562:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10974 00000100:00100000:0.0:1746129752.679562:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052207744:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:3.0:1746129752.679567:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052208000:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129752.679569:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129752.679577:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f200/0x48868a4e439497b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f731 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.679579:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129752.679585:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801310ed400/0x48868a4e439497b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f73f expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.679592:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129752.679594:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129752.679598:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f200/0x48868a4e439497b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f731 expref: 9 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129752.679607:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f200/0x48868a4e439497b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f731 expref: 9 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129752.679614:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6f200, rc 0) 00000100:00100000:0.0:1746129752.679629:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052207744:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 66us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.679635:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10973 00000100:00100000:0.0:1746129752.679645:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10975 00000100:00100000:0.0:1746129752.679650:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949052207616:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129752.679656:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129752.679662:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e439497c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f72a expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.679670:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129752.679672:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129752.679675:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e439497c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f72a expref: 9 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129752.679684:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e439497c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f72a expref: 9 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129752.679695:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6e800, rc 0) 00000100:00100000:0.0:1746129752.679709:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949052207616:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 59us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.679714:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10975 00000100:00100000:0.0:1746129752.679723:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10976 00000100:00100000:0.0:1746129752.679727:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949052207872:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129752.679732:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129752.679738:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ee00/0x48868a4e439497c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f738 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.679747:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129752.679747:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129752.679748:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129752.679748:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129752.679752:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ee00/0x48868a4e439497c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f738 expref: 9 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129752.679753:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801310ed400/0x48868a4e439497b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f73f expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129752.679759:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ee00/0x48868a4e439497c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f738 expref: 9 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129752.679762:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801310ed400/0x48868a4e439497b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f73f expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129752.679766:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6ee00, rc 0) 00010000:00010000:3.0:1746129752.679769:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310ed400, rc 0) 00000100:00100000:0.0:1746129752.679778:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949052207872:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 52us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.679783:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10976 00000100:00100000:3.0:1746129752.679786:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052208000:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 219us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129752.679791:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10974 00000100:00100000:2.0:1746129752.679873:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052208896 00000100:00100000:2.0:1746129752.679877:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052208896 00000100:00100000:2.0:1746129752.679894:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052208640 00000100:00100000:2.0:1746129752.679895:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052208640 00000100:00100000:3.0:1746129752.679901:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9886 00000100:00100000:3.0:1746129752.679908:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28626:x1830949052208896:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129752.679918:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129752.679925:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e439497ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f769 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.680005:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e439497d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.680014:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e439497d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.680022:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e439497d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.680032:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eca00/0x48868a4e439497dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.680037:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eca00/0x48868a4e439497dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.680042:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eca00/0x48868a4e439497dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.680123:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e439497e3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.680131:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e439497e3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.680137:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e439497e3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129752.680145:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129752.680203:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e439497e3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.680208:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e439497e3 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.680213:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e439497e3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.680218:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f9bc800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129752.680220:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e439497e3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.680225:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e439497e3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.680233:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129752.680236:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129752.680238:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e439497e3 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.680242:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e439497e3 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.680255:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e439497d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.680260:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e439497d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00000100:00100000:2.0:1746129752.680263:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9887 00010000:00010000:3.0:1746129752.680264:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e439497d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.680267:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801310ede00 already unused, calling callback (ffffffffa1371690) 00000100:00100000:2.0:1746129752.680269:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28624:x1830949052208640:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129752.680270:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e439497d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.680274:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e439497d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.680279:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129752.680279:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129752.680280:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129752.680282:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e439497d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.680286:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ede00/0x48868a4e439497d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129752.680286:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055c00/0x48868a4e439497f1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f762 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.680292:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eca00/0x48868a4e439497dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.680296:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eca00/0x48868a4e439497dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.680300:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eca00/0x48868a4e439497dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.680304:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801310eca00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129752.680305:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eca00/0x48868a4e439497dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.680309:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eca00/0x48868a4e439497dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.680313:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f93fb00) 00010000:00010000:3.0:1746129752.680315:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129752.680316:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eca00/0x48868a4e439497dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129752.680320:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eca00/0x48868a4e439497dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129752.680320:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e054000/0x48868a4e439497f8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129752.680327:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e054000/0x48868a4e439497f8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129752.680332:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e054000/0x48868a4e439497f8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.680343:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e439497ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f769 expref: 13 pid: 14313 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1746129752.680344:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:2.0:1746129752.680347:0:14314:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:3.0:1746129752.680348:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e439497ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f769 expref: 13 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.680354:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310ed600, rc 0) 00000004:00010000:2.0:1746129752.680354:0:14314:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008e054000/0x48868a4e439497f8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129752.680368:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055c00/0x48868a4e439497f1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f762 expref: 13 pid: 14314 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129752.680373:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28626:x1830949052208896:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 466us (973us total) trans 8589943670 rc 301/301 00000100:00100000:3.0:1746129752.680389:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9886 00010000:00010000:2.0:1746129752.680392:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e054000/0x48868a4e439497f8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f762 expref: 12 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.680397:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129752.680399:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129752.680401:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e054000, rc 0) 00000100:00100000:2.0:1746129752.680419:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28624:x1830949052208640:12345-192.168.204.31@tcp:101:cat.0 Request processed in 150us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.680423:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9887 00000100:00100000:0.0:1746129752.685675:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.685948:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052209152 00000100:00100000:2.0:1746129752.685956:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052209152 00002000:00100000:2.0:1746129752.685991:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88008f4dc000 x1830949052209152/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.685999:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4dc000 with x1830949052209152 ext(0->1048575) 00002000:00010000:2.0:1746129752.686004:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f4dc000 00000100:00100000:2.0:1746129752.686033:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4077 00000100:00100000:2.0:1746129752.686040:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949052209152:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129752.686989:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.687002:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.687058:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.687256:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052209408 00000100:00100000:0.0:1746129752.687260:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052209408 00002000:00100000:0.0:1746129752.687278:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009b00f100 x1830949052209408/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129752.687286:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00f100 with x1830949052209408 ext(1048576->2097151) 00002000:00010000:0.0:1746129752.687289:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00f100 00000100:00100000:0.0:1746129752.687299:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052209664 00000100:00100000:0.0:1746129752.687300:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052209664 00002000:00100000:0.0:1746129752.687306:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009b00ca80 x1830949052209664/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129752.687312:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00ca80 with x1830949052209664 ext(1048576->2097151) 00002000:00010000:0.0:1746129752.687314:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00ca80 00000100:00100000:0.0:1746129752.687320:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052209920 00000100:00100000:0.0:1746129752.687321:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052209920 00002000:00100000:0.0:1746129752.687327:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009b00fb80 x1830949052209920/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129752.687333:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00fb80 with x1830949052209920 ext(1048576->2097151) 00002000:00010000:0.0:1746129752.687335:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00fb80 00000100:00100000:0.0:1746129752.687341:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4078 00000100:00100000:0.0:1746129752.687345:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1964:x1830949052209408:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129752.687805:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4079 00000100:00100000:3.0:1746129752.687814:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1964:x1830949052209664:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129752.687897:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4080 00000100:00100000:0.0:1746129752.687903:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1964:x1830949052209920:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129752.701447:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.701947:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052210048 00000100:00100000:2.0:1746129752.701955:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052210048 00000100:00100000:1.0:1746129752.702465:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.702608:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052210304 00000100:00100000:2.0:1746129752.702611:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052210304 00000100:00100000:2.0:1746129752.702625:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10977 00000100:00100000:2.0:1746129752.702631:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1963:x1830949052210048:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129752.702645:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.702658:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f907800/0x48868a4e439497ff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f770 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.702675:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.702677:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.702684:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f907800/0x48868a4e439497ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f770 expref: 18 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.702696:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f907800/0x48868a4e439497ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f770 expref: 18 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.702706:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f907800, rc 0) 00000100:00100000:2.0:1746129752.702743:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1963:x1830949052210048:12345-192.168.204.31@tcp:101:cat.0 Request processed in 111us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.702748:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10977 00000100:00100000:2.0:1746129752.702763:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10978 00000100:00100000:2.0:1746129752.702767:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a341050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1963:x1830949052210304:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129752.702773:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.702781:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f906000/0x48868a4e43949806 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f77e expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.702791:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.702792:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.702796:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f906000/0x48868a4e43949806 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f77e expref: 16 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.702805:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f906000/0x48868a4e43949806 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f77e expref: 16 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.702812:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f906000, rc 0) 00000100:00100000:2.0:1746129752.702827:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a341050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1963:x1830949052210304:12345-192.168.204.31@tcp:101:cat.0 Request processed in 60us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.702832:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10978 00000100:00100000:1.0:1746129752.703580:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.704779:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052210560 00000100:00100000:2.0:1746129752.704785:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052210560 00000100:00100000:2.0:1746129752.704812:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10979 00000100:00100000:2.0:1746129752.704818:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1963:x1830949052210560:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129752.704828:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.704838:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f907000/0x48868a4e4394980d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f78c expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.704873:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.704875:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.704881:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f907000/0x48868a4e4394980d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f78c expref: 19 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.704891:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f907000/0x48868a4e4394980d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f78c expref: 19 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.704899:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f907000, rc 0) 00000100:00100000:2.0:1746129752.704938:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1963:x1830949052210560:12345-192.168.204.31@tcp:101:cat.0 Request processed in 119us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.704943:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10979 00000100:00100000:0.0:1746129752.710507:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.710549:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.710587:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.710722:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052210176 00000100:00100000:3.0:1746129752.710731:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052210176 00000100:00100000:3.0:1746129752.710768:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052210432 00000100:00100000:3.0:1746129752.710770:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052210432 00000100:00100000:3.0:1746129752.711126:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052210688 00000100:00100000:3.0:1746129752.711130:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052210688 00000100:00100000:2.0:1746129752.711166:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10980 00000100:00100000:2.0:1746129752.711174:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1963:x1830949052210176:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129752.711189:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.711202:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f907600/0x48868a4e43949814 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f777 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.711219:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.711221:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.711228:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f907600/0x48868a4e43949814 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f777 expref: 18 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.711240:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f907600/0x48868a4e43949814 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f777 expref: 18 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.711254:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f907600, rc 0) 00000100:00100000:2.0:1746129752.711290:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1963:x1830949052210176:12345-192.168.204.31@tcp:101:cat.0 Request processed in 117us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.711295:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10980 00000100:00100000:2.0:1746129752.711312:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10981 00000100:00100000:2.0:1746129752.711317:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1963:x1830949052210432:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129752.711323:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.711332:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e055c00/0x48868a4e4394981b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f785 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.711341:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.711342:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.711346:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e055c00/0x48868a4e4394981b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f785 expref: 20 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.711354:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e055c00/0x48868a4e4394981b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f785 expref: 20 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.711360:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e055c00, rc 0) 00000100:00100000:2.0:1746129752.711374:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1963:x1830949052210432:12345-192.168.204.31@tcp:101:cat.0 Request processed in 57us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.711391:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10981 00000100:00100000:2.0:1746129752.711402:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10982 00000100:00100000:2.0:1746129752.711406:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1963:x1830949052210688:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129752.711413:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.711419:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x48868a4e43949822 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f793 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.711427:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.711428:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.711432:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x48868a4e43949822 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f793 expref: 18 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.711441:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x48868a4e43949822 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f793 expref: 18 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129752.711447:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f98f200, rc 0) 00000100:00100000:2.0:1746129752.711460:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1963:x1830949052210688:12345-192.168.204.31@tcp:101:cat.0 Request processed in 54us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.711464:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10982 00000100:00100000:0.0:1746129752.733696:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.734541:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.735039:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1964:x1830949052209152:12345-192.168.204.31@tcp:3:cat.0 Request processed in 48995us (49367us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129752.735051:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4077 00002000:00100000:2.0:1746129752.735064:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88008f4dc000 x1830949052209152/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.735073:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4dc000 with x1830949052209152 ext(0->1048575) 00002000:00010000:2.0:1746129752.735078:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f4dc000 00000100:00100000:3.0:1746129752.735824:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.735840:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.736871:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052210944 00000100:00100000:2.0:1746129752.737010:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052210944 00000100:00100000:2.0:1746129752.737059:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052211200 00000100:00100000:2.0:1746129752.737062:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052211200 00000100:00100000:2.0:1746129752.737085:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4081 00000100:00100000:2.0:1746129752.737092:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6141239f-0c60-480d-830c-e22ba61457b0+9:1963:x1830949052210944:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:2.0:1746129752.737120:0:21599:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f98f600/0x48868a4e43949829 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129752.737295:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4082 00000100:00100000:1.0:1746129752.737306:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6141239f-0c60-480d-830c-e22ba61457b0+9:1964:x1830949052211200:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:1.0:1746129752.737330:0:25617:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012e1abe00/0x48868a4e43949830 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.737344:0:25617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.737345:0:25617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.737350:0:25617:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e1abe00/0x48868a4e43949830 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.737362:0:25617:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e1abe00/0x48868a4e43949830 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.737872:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.737874:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.737877:0:21599:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f98f600/0x48868a4e43949829 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.737889:0:21599:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f98f600/0x48868a4e43949829 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129752.738357:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052211456 00000100:00100000:0.0:1746129752.738363:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052211456 00000100:00100000:0.0:1746129752.738371:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052211712 00000100:00100000:0.0:1746129752.738373:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052211712 00000100:00100000:0.0:1746129752.738404:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4083 00000100:00100000:0.0:1746129752.738409:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6141239f-0c60-480d-830c-e22ba61457b0+10:1963:x1830949052211712:12345-192.168.204.31@tcp:3:lfs.0 00000100:00100000:3.0:1746129752.738475:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.738485:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052211968 00000100:00100000:3.0:1746129752.738488:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052211968 00010000:00010000:0.0:1746129752.738506:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e43949837 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.738513:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129752.738514:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746129752.738516:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4084 00010000:00010000:0.0:1746129752.738517:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e43949837 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129752.738522:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6141239f-0c60-480d-830c-e22ba61457b0+10:1963:x1830949052211968:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:0.0:1746129752.738523:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e43949837 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.738536:0:21605:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ef3a00/0x48868a4e4394983e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.738543:0:21605:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129752.738544:0:21605:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129752.738547:0:21605:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ef3a00/0x48868a4e4394983e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.738554:0:21605:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4ef3a00/0x48868a4e4394983e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129752.739512:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.739527:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052212224 00000100:00100000:3.0:1746129752.739530:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052212224 00000100:00100000:3.0:1746129752.739557:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4085 00000100:00100000:3.0:1746129752.739562:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6141239f-0c60-480d-830c-e22ba61457b0+13:1963:x1830949052212224:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129752.739579:0:21601:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095345a00/0x48868a4e43949845 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.739586:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129752.739588:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129752.739590:0:21601:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095345a00/0x48868a4e43949845 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.739597:0:21601:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095345a00/0x48868a4e43949845 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129752.739762:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.739773:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052212480 00000100:00100000:2.0:1746129752.739776:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052212480 00000100:00100000:2.0:1746129752.739794:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4086 00000100:00100000:2.0:1746129752.739798:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949052212480:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:2.0:1746129752.739812:0:8440:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e4394984c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.739819:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.739821:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129752.739823:0:8440:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e4394984c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.739831:0:8440:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e4394984c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129752.743055:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9888 00000100:00100000:2.0:1746129752.743065:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28626:x1830949052211456:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129752.743084:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.743087:0:15044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746129752.743109:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e054000/0x48868a4e439497f8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f762 expref: 11 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.743136:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129752.743140:0:15044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129752.743149:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801305e2a00/0x48868a4e43949853 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f79a expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.743189:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e4394985a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129752.743199:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e43949734 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6eb expref: 7 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.743205:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949742 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6f9 expref: 283 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.743211:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37200/0x48868a4e4394976c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f707 expref: 7 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.743216:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e4394985a lrc: 6/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129752.743245:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37200/0x48868a4e4394976c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f707 expref: 7 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.743255:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37200/0x48868a4e4394976c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f707 expref: 7 pid: 14314 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.743265:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053313920:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129752.743983:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949742 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6f9 expref: 283 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.743992:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949742 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6f9 expref: 283 pid: 14313 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.744000:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ff100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053314048:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129752.744021:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e43949734 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6eb expref: 7 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.744028:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e43949734 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6eb expref: 7 pid: 15044 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.744034:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053314176:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129752.744045:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129752.744313:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.744329:0:8442:0:(service.c:3346:ptlrpc_start_thread()) ost_io[0] started 11 min 3 max 116 00000100:00100000:2.0:1746129752.744334:0:8442:0:(service.c:3405:ptlrpc_start_thread()) starting thread 'll_ost_io00_011' 00000100:00100000:2.0:1746129752.744373:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.744393:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052212864 00000100:00100000:2.0:1746129752.744399:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052212864 00000100:00100000:2.0:1746129752.744418:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9889 00000100:00100000:2.0:1746129752.744424:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28624:x1830949052212864:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129752.744431:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.744439:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43949861 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f7a1 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.744467:0:14314:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e4394985a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129752.744473:0:14314:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43949861 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a1 expref: 13 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.744482:0:14314:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e4394985a lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129752.744490:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43949861 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a1 expref: 13 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.744498:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129752.744500:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129752.744502:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e4394985a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129752.744507:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924f9600, rc 0) 00000100:00100000:2.0:1746129752.744524:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28624:x1830949052212864:12345-192.168.204.31@tcp:101:cat.0 Request processed in 100us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.744529:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9889 00000100:00100000:3.0:1746129752.745612:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052212736 00000100:00100000:3.0:1746129752.745619:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052212736 00000100:00100000:1.0:1746129752.746100:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4087 00000100:00100000:1.0:1746129752.746109:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949052212736:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:1.0:1746129752.746131:0:2677:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43949868 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.746142:0:2677:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.746144:0:2677:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.746148:0:2677:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43949868 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.746158:0:2677:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43949868 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129752.749554:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.749938:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1964:x1830949052209408:12345-192.168.204.31@tcp:3:cat.0 Request processed in 62589us (62948us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129752.749947:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4078 00002000:00100000:0.0:1746129752.749955:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009b00f100 x1830949052209408/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129752.749963:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00f100 with x1830949052209408 ext(1048576->2097151) 00002000:00010000:0.0:1746129752.749968:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00f100 00000100:00100000:0.0:1746129752.749984:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052213120 00000100:00100000:0.0:1746129752.749989:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052213120 00000100:00100000:0.0:1746129752.750014:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4088 00000100:00100000:0.0:1746129752.750019:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949052213120:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:0.0:1746129752.750042:0:21602:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394986f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.750052:0:21602:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129752.750054:0:21602:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129752.750059:0:21602:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394986f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.750069:0:21602:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394986f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129752.757966:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1964:x1830949052209664:12345-192.168.204.31@tcp:3:cat.0 Request processed in 70147us (70955us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129752.757977:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4079 00002000:00100000:2.0:1746129752.757987:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009b00ca80 x1830949052209664/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.757996:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00ca80 with x1830949052209664 ext(1048576->2097151) 00002000:00010000:2.0:1746129752.758000:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00ca80 00000100:00100000:3.0:1746129752.758207:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053313920:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129752.759893:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.759914:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.759938:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.759953:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052213376 00000100:00100000:0.0:1746129752.759958:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052213376 00010000:00010000:0.0:1746129752.759984:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949742 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6f9 expref: 284 pid: 14313 timeout: 798 lvb_type: 0 00000100:00100000:0.0:1746129752.760001:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052213504 00000100:00100000:0.0:1746129752.760003:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052213504 00010000:00010000:0.0:1746129752.760011:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e43949734 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6eb expref: 8 pid: 15044 timeout: 798 lvb_type: 0 00000100:00100000:0.0:1746129752.760019:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052213248 00000100:00100000:0.0:1746129752.760020:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052213248 00010000:00010000:0.0:1746129752.760027:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37200/0x48868a4e4394976c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f707 expref: 9 pid: 14314 timeout: 798 lvb_type: 0 00000100:00100000:0.0:1746129752.760042:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5285 00000100:00100000:0.0:1746129752.760048:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:1963:x1830949052213376:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129752.760060:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129752.760064:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949742 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6f9 expref: 284 pid: 14313 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746129752.760072:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949742 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6f9 expref: 284 pid: 14313 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746129752.760090:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129752.760095:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e4394985a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.760102:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e4394985a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.760106:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129752.760133:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:1963:x1830949052213376:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 85us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.760138:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5285 00000100:00100000:0.0:1746129752.760151:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5286 00000100:00100000:0.0:1746129752.760155:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:1964:x1830949052213504:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129752.760161:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129752.760165:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e43949734 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6eb expref: 9 pid: 15044 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746129752.760175:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e43949734 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6eb expref: 9 pid: 15044 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746129752.760184:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129752.760187:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e4394985a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.760191:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e4394985a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.760195:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129752.760208:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:1964:x1830949052213504:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 53us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.760213:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5286 00000100:00100000:0.0:1746129752.760222:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5287 00000100:00100000:0.0:1746129752.760226:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949052213248:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129752.760232:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129752.760235:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37200/0x48868a4e4394976c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f707 expref: 8 pid: 14314 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746129752.760242:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37200/0x48868a4e4394976c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f707 expref: 8 pid: 14314 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746129752.760252:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d37200/0x48868a4e4394976c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f707 expref: 8 pid: 14314 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746129752.760265:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129752.760268:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e4394985a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.760274:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e4394985a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.760280:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e4394985a lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129752.760287:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43949861 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a1 expref: 12 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.760299:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129752.760313:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+7:1961:x1830949052213248:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 87us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.760318:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5287 00000100:00100000:0.0:1746129752.760534:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949052209920:12345-192.168.204.31@tcp:3:cat.0 Request processed in 72630us (73474us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129752.760541:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4080 00002000:00100000:0.0:1746129752.760547:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009b00fb80 x1830949052209920/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129752.760554:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00fb80 with x1830949052209920 ext(1048576->2097151) 00002000:00010000:0.0:1746129752.760558:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00fb80 00010000:00010000:3.0:1746129752.760746:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e43949742 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6f9 expref: 283 pid: 14313 timeout: 798 lvb_type: 0 00000100:00100000:3.0:1746129752.760760:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ff100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053314048:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129752.760769:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e43949734 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f6eb expref: 6 pid: 15044 timeout: 798 lvb_type: 0 00000100:00100000:3.0:1746129752.760777:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053314176:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129752.760799:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e4394985a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129752.760807:0:15044:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e4394985a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129752.760812:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e4394985a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00000040:00080000:3.0:1746129752.762076:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2832, 88 off236064 00000004:00080000:3.0:1746129752.762085:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 698820236405ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129752.762129:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2766, 88 off230344 00000004:00080000:3.0:1746129752.762133:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 698820285186ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129752.762145:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2767, 88 off230432 00000004:00080000:3.0:1746129752.762148:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 698820299890ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129752.762155:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2833, 88 off236152 00000004:00080000:3.0:1746129752.762157:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 698820309423ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129752.762163:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2834, 88 off236240 00000004:00080000:3.0:1746129752.762165:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 698820316990ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129752.762170:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2768, 88 off230520 00000004:00080000:3.0:1746129752.762172:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 698820324639ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129752.762177:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2769, 88 off230608 00000004:00080000:3.0:1746129752.762180:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 698820332216ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129752.762185:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2770, 88 off230696 00000004:00080000:3.0:1746129752.762187:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 698820339431ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129752.762193:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2835, 88 off236328 00000004:00080000:3.0:1746129752.762195:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 698820347003ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129752.762200:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2771, 88 off230784 00000004:00080000:3.0:1746129752.762202:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 698820354260ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129752.762208:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2836, 88 off236416 00000004:00080000:3.0:1746129752.762210:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 698820362041ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129752.762216:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2772, 88 off230872 00000004:00080000:3.0:1746129752.762218:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 698820370388ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129752.762224:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2837, 88 off236504 00000004:00080000:3.0:1746129752.762226:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 698820378035ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129752.762232:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2838, 88 off236592 00000004:00080000:3.0:1746129752.762234:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 698820386550ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129752.762240:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2839, 88 off236680 00000004:00080000:3.0:1746129752.762242:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 698820394311ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129752.762248:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2840, 88 off236768 00000004:00080000:3.0:1746129752.762250:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 698820401773ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129752.762255:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2773, 88 off230960 00000004:00080000:3.0:1746129752.762258:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 698820409700ns, next at 641623252291ns, rc = 0 00000100:00100000:2.0:1746129752.764721:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129752.765070:0:21605:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ef3a00/0x48868a4e4394983e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.765081:0:21605:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ef3a00/0x48868a4e4394983e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.765088:0:21605:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a4ef3a00/0x48868a4e4394983e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.765094:0:21605:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ef3a00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129752.765097:0:21605:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4ef3a00/0x48868a4e4394983e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.765103:0:21605:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4ef3a00/0x48868a4e4394983e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.765118:0:21605:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a4ef3a00/0x48868a4e4394983e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.765124:0:21605:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ef3a00/0x48868a4e4394983e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129752.766164:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6141239f-0c60-480d-830c-e22ba61457b0+15:1963:x1830949052211968:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 27639us (27688us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129752.766173:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4084 00000100:00100000:2.0:1746129752.766201:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052213632 00000100:00100000:2.0:1746129752.766205:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052213632 00000100:00100000:2.0:1746129752.766230:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9890 00000100:00100000:2.0:1746129752.766236:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28622:x1830949052213632:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129752.766253:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.766269:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3400/0x48868a4e43949876 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f7a8 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.766310:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3400/0x48868a4e43949876 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a8 expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.766319:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3400/0x48868a4e43949876 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a8 expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.766328:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129752.766330:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129752.766333:0:14313:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43949861 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a1 expref: 13 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.766338:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801360b3400, rc 0) 00000100:00100000:2.0:1746129752.766354:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28622:x1830949052213632:12345-192.168.204.31@tcp:101:cat.0 Request processed in 118us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.766359:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9890 00010000:00010000:2.0:1746129752.774155:0:8440:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e4394984c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.774174:0:8440:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e4394984c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.774181:0:8440:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e4394984c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.774187:0:8440:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f98fa00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129752.774190:0:8440:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e4394984c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.774196:0:8440:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e4394984c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.774212:0:8440:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e4394984c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.774217:0:8440:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e4394984c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129752.774275:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6141239f-0c60-480d-830c-e22ba61457b0+15:1963:x1830949052212480:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 34472us (34509us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129752.774284:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4086 00010000:00010000:3.0:1746129752.774594:0:21599:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f98f600/0x48868a4e43949829 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.774603:0:21599:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f98f600/0x48868a4e43949829 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.774609:0:21599:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f98f600/0x48868a4e43949829 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.774613:0:21599:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f98f600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129752.774615:0:21599:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f98f600/0x48868a4e43949829 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.774620:0:21599:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f98f600/0x48868a4e43949829 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.774629:0:21599:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f98f600/0x48868a4e43949829 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.774634:0:21599:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f98f600/0x48868a4e43949829 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129752.774686:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6141239f-0c60-480d-830c-e22ba61457b0+13:1963:x1830949052210944:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 37594us (40997us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129752.774692:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4081 00010000:00010000:3.0:1746129752.782729:0:21601:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095345a00/0x48868a4e43949845 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.782741:0:21601:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095345a00/0x48868a4e43949845 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.782748:0:21601:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095345a00/0x48868a4e43949845 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.782753:0:21601:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095345a00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129752.782756:0:21601:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095345a00/0x48868a4e43949845 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.782763:0:21601:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095345a00/0x48868a4e43949845 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.782777:0:21601:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095345a00/0x48868a4e43949845 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.782782:0:21601:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095345a00/0x48868a4e43949845 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129752.782844:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949052212224:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 43278us (43331us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129752.782875:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4085 00010000:00010000:0.0:1746129752.794623:0:8441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e43949837 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.794634:0:8441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e43949837 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.794647:0:8441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e43949837 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.794653:0:8441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb10000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129752.794657:0:8441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e43949837 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.794664:0:8441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e43949837 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.794680:0:8441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e43949837 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.794686:0:8441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e43949837 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129752.801200:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6141239f-0c60-480d-830c-e22ba61457b0+13:1963:x1830949052211712:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 62782us (65350us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129752.801212:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4083 00010000:00010000:0.0:1746129752.804103:0:25617:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012e1abe00/0x48868a4e43949830 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.804116:0:25617:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e1abe00/0x48868a4e43949830 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.804123:0:25617:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e1abe00/0x48868a4e43949830 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.804135:0:25617:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1abe00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129752.804138:0:25617:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e1abe00/0x48868a4e43949830 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.804145:0:25617:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e1abe00/0x48868a4e43949830 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.804161:0:25617:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e1abe00/0x48868a4e43949830 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.804167:0:25617:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e1abe00/0x48868a4e43949830 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129752.804236:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052211200:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 66928us (69693us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129752.804245:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4082 00010000:00010000:0.0:1746129752.810330:0:2677:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43949868 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.810342:0:2677:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43949868 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.810349:0:2677:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43949868 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.810356:0:2677:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1aac00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129752.810360:0:2677:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43949868 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.810366:0:2677:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43949868 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.810390:0:2677:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43949868 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.810396:0:2677:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43949868 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129752.810453:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949052212736:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 64341us (66135us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129752.810462:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4087 00010000:00010000:1.0:1746129752.812201:0:21602:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394986f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.812212:0:21602:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394986f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.812218:0:21602:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394986f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.812224:0:21602:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb10800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129752.812226:0:21602:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394986f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.812232:0:21602:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394986f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.812243:0:21602:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394986f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.812247:0:21602:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394986f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129752.812290:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949052213120:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 62267us (67861us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129752.812298:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4088 00000100:00100000:1.0:1746129752.822125:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.822488:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052213888 00000100:00100000:2.0:1746129752.822496:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052213888 00000100:00100000:2.0:1746129752.822528:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9891 00000100:00100000:2.0:1746129752.822534:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6141239f-0c60-480d-830c-e22ba61457b0+6:28614:x1830949052213888:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:2.0:1746129752.822605:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2e00/0x48868a4e4394987d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129752.822617:0:14314:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2e00/0x48868a4e4394987d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129752.822624:0:14314:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2e00/0x48868a4e4394987d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000001:00080000:1.0:1746129752.827723:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943669 is committed 00000001:00080000:1.0:1746129752.827736:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943667 is committed 00000001:00080000:1.0:1746129752.827747:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943671 is committed 00000004:00080000:1.0:1746129752.827750:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1958 committed 00000004:00080000:1.0:1746129752.827758:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2022 committed 00000004:00080000:1.0:1746129752.827763:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2021 committed 00000004:00080000:1.0:1746129752.827764:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2020 committed 00000004:00080000:1.0:1746129752.827766:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2019 committed 00000004:00080000:1.0:1746129752.827767:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1957 committed 00000004:00080000:1.0:1746129752.827768:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2018 committed 00000004:00080000:1.0:1746129752.827770:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1956 committed 00000004:00080000:1.0:1746129752.827771:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2017 committed 00000004:00080000:1.0:1746129752.827773:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1955 committed 00000004:00080000:1.0:1746129752.827774:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1954 committed 00000004:00080000:1.0:1746129752.827776:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1953 committed 00000004:00080000:1.0:1746129752.827777:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2016 committed 00000004:00080000:1.0:1746129752.827779:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2015 committed 00000004:00080000:1.0:1746129752.827780:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1952 committed 00000004:00080000:1.0:1746129752.827782:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1951 committed 00000004:00080000:1.0:1746129752.827783:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2014 committed 00010000:00010000:3.0:1746129752.827918:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e4394985a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f79a expref: 10 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.827928:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129752.827931:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746129752.827934:0:15044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2e00/0x48868a4e4394987d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.827942:0:15044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2e00/0x48868a4e4394987d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.827947:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2e00/0x48868a4e4394987d lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.827953:0:15044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43949861 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a1 expref: 10 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.827959:0:15044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43949861 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a1 expref: 10 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.827963:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43949861 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a1 expref: 10 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.827969:0:15044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3400/0x48868a4e43949876 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a8 expref: 281 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.827975:0:15044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3400/0x48868a4e43949876 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a8 expref: 281 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.827983:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3400/0x48868a4e43949876 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a8 expref: 281 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.828002:0:15044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3400/0x48868a4e43949876 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a8 expref: 281 pid: 14313 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129752.828011:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053314432:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129752.828081:0:15044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43949861 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a1 expref: 10 pid: 14314 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129752.828087:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053314560:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129752.828103:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129752.828213:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053314304:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129752.828240:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746129752.828265:0:14314:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2e00/0x48868a4e4394987d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129752.828271:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2e00/0x48868a4e4394987d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00010000:2.0:1746129752.828417:0:14314:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009b00ea00 reply state ffff88009a723000 transno 8589943672 ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2e00/0x48868a4e4394987d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000100:00100000:2.0:1746129752.828422:0:14314:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746129752.828478:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6141239f-0c60-480d-830c-e22ba61457b0+8:28614:x1830949052213888:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 5944us (6359us total) trans 8589943672 rc 0/0 00000100:00100000:2.0:1746129752.828486:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9891 00000100:00100000:0.0:1746129752.828903:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053314816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129752.828927:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129752.828943:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053315328:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129752.828955:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129752.828965:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053315840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129752.828978:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129752.828988:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053316352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129752.828998:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129752.829008:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746129752.829011:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053314944:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129752.829022:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129752.829030:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053315456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129752.829039:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129752.829047:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053315968:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129752.829056:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129752.829063:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053316480:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129752.829071:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129752.829086:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053314304 00000100:00100000:0.0:1746129752.829091:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053314304 00000100:00100000:0.0:1746129752.829109:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053314816 00000100:00100000:0.0:1746129752.829110:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053314816 00000100:00100000:0.0:1746129752.829117:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053315328 00000100:00100000:0.0:1746129752.829118:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053315328 00000100:00100000:0.0:1746129752.829123:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053315840 00000100:00100000:0.0:1746129752.829125:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053315840 00000100:00100000:0.0:1746129752.829130:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053316352 00000100:00100000:0.0:1746129752.829131:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053316352 00000100:00100000:0.0:1746129752.829136:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053314944 00000100:00100000:0.0:1746129752.829137:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053314944 00000100:00100000:0.0:1746129752.829141:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053315456 00000100:00100000:0.0:1746129752.829142:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053315456 00000100:00100000:0.0:1746129752.829145:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053315968 00000100:00100000:0.0:1746129752.829147:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053315968 00000100:00100000:0.0:1746129752.829150:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053316480 00000100:00100000:0.0:1746129752.829152:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053316480 00000100:00100000:0.0:1746129752.829157:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10983 00000100:00100000:0.0:1746129752.829162:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3296:x1830949053314304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129752.829278:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129752.829281:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129749 -> 1746129749 00002000:00010000:0.0:1746129752.829282:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129747 -> 1746129747 00002000:00010000:0.0:1746129752.829284:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129749 -> 1746129749 00002000:00010000:0.0:1746129752.829286:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129752.829304:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3296:x1830949053314304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 141us (1063us total) trans 21474840311 rc 0/0 00000100:00100000:0.0:1746129752.829309:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10983 00000100:00100000:0.0:1746129752.829319:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10984 00000100:00100000:0.0:1746129752.829323:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3298:x1830949053314816:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129752.829401:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746129752.829404:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129753 -> 1746129753 00002000:00010000:0.0:1746129752.829405:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129752 -> 1746129752 00002000:00010000:0.0:1746129752.829407:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129753 -> 1746129753 00002000:00010000:0.0:1746129752.829408:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746129752.829429:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3298:x1830949053314816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (502us total) trans 21474840312 rc 0/0 00000100:00100000:0.0:1746129752.829434:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10984 00000100:00100000:0.0:1746129752.829443:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10985 00000100:00100000:0.0:1746129752.829446:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3298:x1830949053315328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129752.829519:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3298:x1830949053315328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (562us total) trans 21474840313 rc 0/0 00000100:00100000:0.0:1746129752.829524:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10985 00000100:00100000:0.0:1746129752.829533:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10986 00000100:00100000:0.0:1746129752.829537:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3298:x1830949053315840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129752.829591:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10987 00000100:00100000:3.0:1746129752.829599:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3298:x1830949053316352:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129752.829622:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:0.0:1746129752.829624:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129753 -> 1746129753 00002000:00010000:0.0:1746129752.829625:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129753 -> 1746129753 00002000:00010000:0.0:1746129752.829627:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129753 -> 1746129753 00002000:00010000:0.0:1746129752.829629:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5673 -> 5673 00000100:00100000:0.0:1746129752.829644:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3298:x1830949053315840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (666us total) trans 17179873162 rc 0/0 00000100:00100000:0.0:1746129752.829649:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10986 00000100:00100000:0.0:1746129752.829657:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10988 00000100:00100000:0.0:1746129752.829660:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3298:x1830949053314944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129752.829692:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3298:x1830949053316352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (692us total) trans 17179873163 rc 0/0 00000100:00100000:3.0:1746129752.829697:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10987 00000100:00100000:3.0:1746129752.829706:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10989 00000100:00100000:3.0:1746129752.829711:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+34:3298:x1830949053315456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129752.829717:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3298:x1830949053314944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (693us total) trans 21474840314 rc 0/0 00000100:00100000:0.0:1746129752.829721:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10988 00000100:00100000:0.0:1746129752.829728:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10990 00000100:00100000:0.0:1746129752.829731:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3298:x1830949053315968:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129752.829777:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129752.829779:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129752.829781:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129752.829782:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129752.829784:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746129752.829788:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+34:3298:x1830949053315456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (746us total) trans 21474840315 rc 0/0 00000100:00100000:3.0:1746129752.829793:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10989 00000100:00100000:0.0:1746129752.829798:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3298:x1830949053315968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (741us total) trans 17179873164 rc 0/0 00000100:00100000:0.0:1746129752.829801:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10990 00000100:00100000:3.0:1746129752.829804:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10991 00000100:00100000:3.0:1746129752.829808:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3298:x1830949053316480:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129752.829835:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936dea00/2, rc 0, transno 21474840314 00000100:00100000:0.0:1746129752.829839:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053314944:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129752.829845:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04d880/2, rc 0, transno 21474840315 00000100:00100000:0.0:1746129752.829865:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053315456:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129752.829871:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04ce00/2, rc 0, transno 17179873164 00000100:00100000:0.0:1746129752.829876:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053315968:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129752.829882:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b00e680/2, rc 0, transno 21474840312 00000100:00100000:0.0:1746129752.829884:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053314816:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129752.829889:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936df100/2, rc 0, transno 21474840313 00000100:00100000:0.0:1746129752.829891:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053315328:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129752.829895:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04d500/2, rc 0, transno 17179873162 00000100:00100000:0.0:1746129752.829897:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053315840:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129752.829901:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04c000/2, rc 0, transno 17179873163 00000100:00100000:0.0:1746129752.829903:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053316352:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129752.829909:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3298:x1830949053316480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 100us (836us total) trans 17179873165 rc 0/0 00000004:00080000:0.0:1746129752.829909:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04f100/2, rc 0, transno 17179873165 00000100:00100000:0.0:1746129752.829911:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053316480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129752.829915:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10991 00000100:00100000:3.0:1746129752.830021:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053314688:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129752.830043:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129752.830057:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053315200:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129752.830069:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129752.830077:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053315712:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129752.830089:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129752.830098:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053316224:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129752.830110:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129752.830120:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1746129752.830124:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053315072:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129752.830137:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129752.830145:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053315584:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129752.830156:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129752.830164:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053316096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129752.830177:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129752.830195:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053314688 00000100:00100000:3.0:1746129752.830198:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053314688 00000100:00100000:3.0:1746129752.830210:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053315200 00000100:00100000:3.0:1746129752.830212:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053315200 00000100:00100000:3.0:1746129752.830217:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053315712 00000100:00100000:3.0:1746129752.830219:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053315712 00000100:00100000:3.0:1746129752.830224:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053316224 00000100:00100000:3.0:1746129752.830226:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053316224 00000100:00100000:3.0:1746129752.830231:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053315072 00000100:00100000:3.0:1746129752.830232:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053315072 00000100:00100000:3.0:1746129752.830237:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053315584 00000100:00100000:3.0:1746129752.830238:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053315584 00000100:00100000:3.0:1746129752.830243:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10992 00000100:00100000:3.0:1746129752.830247:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3297:x1830949053314688:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129752.830267:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b00d500/2, rc 0, transno 21474840311 00000100:00100000:2.0:1746129752.830271:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053314304:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129752.830316:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129752.830319:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129747 -> 1746129747 00002000:00010000:3.0:1746129752.830321:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129747 -> 1746129747 00002000:00010000:3.0:1746129752.830323:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129747 -> 1746129747 00002000:00010000:3.0:1746129752.830325:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746129752.830353:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053316096 00000100:00100000:1.0:1746129752.830358:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053316096 00000100:00100000:3.0:1746129752.830361:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3297:x1830949053314688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 113us (317us total) trans 21474840316 rc 0/0 00000100:00100000:3.0:1746129752.830366:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10992 00000100:00100000:1.0:1746129752.830374:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10993 00000004:00080000:2.0:1746129752.830385:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b00c000/2, rc 0, transno 21474840316 00000100:00100000:2.0:1746129752.830388:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053314688:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129752.830393:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3297:x1830949053315200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129752.830394:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10994 00000100:00100000:3.0:1746129752.830398:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3297:x1830949053315712:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129752.830460:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129752.830462:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129752 -> 1746129752 00002000:00010000:3.0:1746129752.830464:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746129747 -> 1746129747 00002000:00010000:3.0:1746129752.830466:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129752 -> 1746129752 00002000:00010000:3.0:1746129752.830467:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746129752.830488:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3297:x1830949053315712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (397us total) trans 17179873166 rc 0/0 00000100:00100000:3.0:1746129752.830493:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10994 00000100:00100000:3.0:1746129752.830503:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10995 00000100:00100000:3.0:1746129752.830507:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3297:x1830949053316224:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129752.830571:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04ed80/2, rc 0, transno 17179873166 00000100:00100000:2.0:1746129752.830575:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053315712:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129752.830578:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3297:x1830949053316224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (466us total) trans 17179873167 rc 0/0 00000004:00080000:2.0:1746129752.830582:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04dc00/2, rc 0, transno 17179873167 00000100:00100000:3.0:1746129752.830583:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10995 00000100:00100000:2.0:1746129752.830584:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053316224:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129752.830593:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10996 00000100:00100000:3.0:1746129752.830597:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3297:x1830949053315072:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129752.830652:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129752.830654:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746129752.830656:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746129752.830657:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746129752.830659:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746129752.830676:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3297:x1830949053315072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (538us total) trans 21474840317 rc 0/0 00000100:00100000:3.0:1746129752.830680:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10996 00000100:00100000:3.0:1746129752.830690:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10997 00000100:00100000:3.0:1746129752.830694:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3297:x1830949053315584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129752.830748:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746129752.830751:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129750 -> 1746129750 00002000:00010000:3.0:1746129752.830752:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129749 -> 1746129749 00002000:00010000:3.0:1746129752.830754:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129750 -> 1746129750 00002000:00010000:3.0:1746129752.830755:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:3.0:1746129752.830770:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3297:x1830949053315584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (613us total) trans 17179873168 rc 0/0 00000100:00100000:3.0:1746129752.830774:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10997 00000100:00100000:3.0:1746129752.830782:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10998 00000100:00100000:3.0:1746129752.830791:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3297:x1830949053316096:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129752.831040:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936de680/2, rc 0, transno 21474840317 00000100:00100000:2.0:1746129752.831044:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053315072:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129752.831050:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04c380/2, rc 0, transno 17179873168 00000100:00100000:2.0:1746129752.831053:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053315584:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129752.831088:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3297:x1830949053316096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 301us (909us total) trans 17179873169 rc 0/0 00000100:00100000:3.0:1746129752.831094:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10998 00000100:00100000:1.0:1746129752.831180:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3297:x1830949053315200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 787us (1109us total) trans 21474840318 rc 0/0 00000100:00100000:1.0:1746129752.831186:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10993 00000004:00080000:2.0:1746129752.831196:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04c700/2, rc 0, transno 17179873169 00000100:00100000:2.0:1746129752.831200:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053316096:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129752.831211:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936df480/2, rc 0, transno 21474840318 00000100:00100000:2.0:1746129752.831213:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053315200:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129752.831233:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053316608:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129752.831253:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129752.831271:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053316608 00000100:00100000:2.0:1746129752.831274:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053316608 00000100:00100000:2.0:1746129752.831295:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10999 00000100:00100000:2.0:1746129752.831299:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3296:x1830949053316608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129752.831383:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3296:x1830949053316608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (121us total) trans 17179873170 rc 0/0 00000100:00100000:2.0:1746129752.831388:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10999 00000004:00080000:3.0:1746129752.831396:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5493800/2, rc 0, transno 17179873170 00000100:00100000:3.0:1746129752.831400:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053316608:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129752.832409:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.832449:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.832463:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.832472:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052214016 00000100:00100000:2.0:1746129752.832476:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052214016 00000100:00100000:2.0:1746129752.832496:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052214272 00000100:00100000:2.0:1746129752.832497:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052214272 00000100:00100000:2.0:1746129752.832509:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3885 00000100:00100000:2.0:1746129752.832514:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28624:x1830949052214016:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:1.0:1746129752.832524:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.832580:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052214144 00000100:00100000:3.0:1746129752.832584:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052214144 00000100:00100000:2.0:1746129752.832588:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28624:x1830949052214016:12345-192.168.204.31@tcp:49:cat.0 Request processed in 73us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.832593:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3885 00000100:00100000:3.0:1746129752.832602:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052214400 00000100:00100000:2.0:1746129752.832603:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3886 00000100:00100000:3.0:1746129752.832604:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052214400 00000100:00100000:2.0:1746129752.832608:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28622:x1830949052214272:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:3.0:1746129752.832617:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9892 00000100:00100000:3.0:1746129752.832623:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6141239f-0c60-480d-830c-e22ba61457b0+8:28614:x1830949052214144:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129752.832633:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129752.832638:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28622:x1830949052214272:12345-192.168.204.31@tcp:49:cat.0 Request processed in 30us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.832643:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3886 00010000:00010000:3.0:1746129752.832646:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25fc00/0x48868a4e43949884 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f7af expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.832659:0:3283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2e00/0x48868a4e4394987d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129752.832666:0:3283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2e00/0x48868a4e4394987d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129752.832671:0:3283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2e00/0x48868a4e4394987d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129752.832680:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25fc00/0x48868a4e43949884 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7af expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.832690:0:3283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801360b2e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129752.832692:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25fc00/0x48868a4e43949884 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7af expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.832692:0:3283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2e00/0x48868a4e4394987d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129752.832696:0:3283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2e00/0x48868a4e4394987d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129752.832704:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129752.832705:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129752.832708:0:3283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2e00/0x48868a4e4394987d lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129752.832710:0:3283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b2e00/0x48868a4e4394987d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00000100:00100000:0.0:1746129752.832782:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9893 00000100:00100000:0.0:1746129752.832789:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:28619:x1830949052214400:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129752.832797:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129752.832803:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e79e00/0x48868a4e4394988b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f7b6 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.833320:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129752.833323:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129752.833326:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f25fc00, rc 0) 00000100:00100000:3.0:1746129752.833347:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6141239f-0c60-480d-830c-e22ba61457b0+8:28614:x1830949052214144:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 723us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129752.833351:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9892 00000100:00100000:3.0:1746129752.833460:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053314432:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129752.833469:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053314560:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129752.833492:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801305e2a00/0x48868a4e43949853 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f79a expref: 10 pid: 15044 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746129752.833502:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e4394985a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f79a expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.833515:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d79a00, rc 0) 00000100:00100000:3.0:1746129752.833539:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28626:x1830949052211456:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 90476us (97716us total) trans 8589943671 rc 0/0 00000100:00100000:3.0:1746129752.833545:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9888 00010000:00010000:0.0:1746129752.834559:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e79e00/0x48868a4e4394988b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7b6 expref: 283 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.834572:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e79e00/0x48868a4e4394988b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7b6 expref: 283 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.834587:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129752.834589:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129752.834592:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e79e00, rc 0) 00000100:00100000:0.0:1746129752.834623:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28619:x1830949052214400:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1834us (2098us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.834629:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9893 00000100:00100000:3.0:1746129752.841522:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.841544:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.841567:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.841581:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.841593:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.841612:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.841680:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052214656 00000100:00100000:1.0:1746129752.841688:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052214656 00000100:00100000:1.0:1746129752.841777:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052214912 00000100:00100000:1.0:1746129752.841780:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052214912 00000100:00100000:1.0:1746129752.841795:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052215168 00000100:00100000:1.0:1746129752.841797:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052215168 00000100:00100000:1.0:1746129752.842152:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052214528 00000100:00100000:1.0:1746129752.842156:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052214528 00000100:00100000:2.0:1746129752.842189:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052214784 00000100:00100000:2.0:1746129752.842192:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052214784 00000100:00100000:2.0:1746129752.842303:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052215040 00000100:00100000:2.0:1746129752.842306:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052215040 00000100:00100000:0.0:1746129752.842335:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11000 00000100:00100000:0.0:1746129752.842343:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052214656:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129752.842500:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129752.842503:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129749 -> 1746129753 00002000:00010000:0.0:1746129752.842505:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129747 -> 1746129753 00002000:00010000:0.0:1746129752.842506:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129749 -> 1746129753 00002000:00010000:0.0:1746129752.842508:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129752.842546:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+12:1964:x1830949052214656:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 204us (1031us total) trans 21474840319 rc 0/0 00000100:00100000:0.0:1746129752.842552:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11000 00000100:00100000:0.0:1746129752.842564:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11001 00000100:00100000:0.0:1746129752.842568:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052214912:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129752.842643:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129752.842646:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129752 -> 1746129753 00002000:00010000:0.0:1746129752.842647:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746129747 -> 1746129753 00002000:00010000:0.0:1746129752.842649:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129752 -> 1746129753 00002000:00010000:0.0:1746129752.842651:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129752.842666:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+12:1964:x1830949052214912:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 97us (1121us total) trans 17179873171 rc 0/0 00000100:00100000:0.0:1746129752.842671:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11001 00000100:00100000:0.0:1746129752.842681:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11002 00000100:00100000:0.0:1746129752.842686:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052215168:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129752.842738:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746129752.842740:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129753 -> 1746129753 00002000:00010000:0.0:1746129752.842742:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129752 -> 1746129753 00002000:00010000:0.0:1746129752.842744:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129753 -> 1746129753 00002000:00010000:0.0:1746129752.842745:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746129752.842758:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+12:1964:x1830949052215168:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 72us (1191us total) trans 21474840320 rc 0/0 00000100:00100000:0.0:1746129752.842762:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11002 00000100:00100000:0.0:1746129752.842770:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11003 00000100:00100000:0.0:1746129752.842774:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052214528:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129752.842820:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746129752.842821:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129750 -> 1746129753 00002000:00010000:0.0:1746129752.842823:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129749 -> 1746129753 00002000:00010000:0.0:1746129752.842825:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129750 -> 1746129753 00002000:00010000:0.0:1746129752.842826:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1746129752.842838:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+12:1964:x1830949052214528:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 63us (1260us total) trans 17179873172 rc 0/0 00000100:00100000:0.0:1746129752.842841:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11003 00000100:00100000:0.0:1746129752.842864:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11004 00000100:00100000:0.0:1746129752.842868:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052214784:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129752.842917:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129752.842919:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129747 -> 1746129753 00002000:00010000:0.0:1746129752.842920:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129747 -> 1746129753 00002000:00010000:0.0:1746129752.842922:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129747 -> 1746129753 00002000:00010000:0.0:1746129752.842924:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746129752.842936:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+12:1964:x1830949052214784:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 68us (1342us total) trans 21474840321 rc 0/0 00000100:00100000:0.0:1746129752.842940:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11004 00000100:00100000:0.0:1746129752.842948:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11005 00000100:00100000:0.0:1746129752.842951:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052215040:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129752.842990:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:0.0:1746129752.842992:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129753 -> 1746129753 00002000:00010000:0.0:1746129752.842994:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129753 -> 1746129753 00002000:00010000:0.0:1746129752.842995:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129753 -> 1746129753 00002000:00010000:0.0:1746129752.842997:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5673 -> 5673 00000100:00100000:0.0:1746129752.843007:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+12:1964:x1830949052215040:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 56us (1395us total) trans 17179873173 rc 0/0 00000100:00100000:0.0:1746129752.843011:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11005 00000100:00100000:0.0:1746129752.846493:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.846562:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052215424 00000100:00100000:1.0:1746129752.846570:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052215424 00002000:00100000:1.0:1746129752.846602:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009ba85c00 x1830949052215424/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129752.846611:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85c00 with x1830949052215424 ext(0->1048575) 00002000:00010000:1.0:1746129752.846615:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba85c00 00000100:00100000:1.0:1746129752.846630:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4089 00000100:00100000:1.0:1746129752.846636:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949052215424:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129752.848110:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.848138:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.848192:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.848212:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052215552 00000100:00100000:3.0:1746129752.848216:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052215552 00000100:00100000:3.0:1746129752.848239:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052215936 00000100:00100000:3.0:1746129752.848241:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052215936 00000100:00100000:3.0:1746129752.848252:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11006 00000100:00100000:3.0:1746129752.848258:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28626:x1830949052215552:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129752.848271:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129752.848287:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f25f800/0x48868a4e43949892 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f7bd expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.848309:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e1abc00/0x48868a4e43949788 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f75b expref: 19 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129752.848316:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x48868a4e43949822 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f793 expref: 19 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129752.848322:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801310ed400/0x48868a4e439497b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f73f expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129752.848328:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129752.848329:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129752.848332:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f25f800/0x48868a4e43949892 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2457600->2678783] (req 2457600->2678783) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7bd expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.848354:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801310ed400/0x48868a4e439497b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f73f expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129752.848370:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801310ed400/0x48868a4e439497b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f73f expref: 11 pid: 3624 timeout: 798 lvb_type: 1 00000100:00100000:3.0:1746129752.848388:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053316736:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129752.848450:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x48868a4e43949822 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f793 expref: 19 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129752.848462:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x48868a4e43949822 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f793 expref: 19 pid: 20441 timeout: 798 lvb_type: 1 00000100:00100000:3.0:1746129752.848470:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131463b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053316864:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129752.848493:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e1abc00/0x48868a4e43949788 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f75b expref: 19 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129752.848499:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e1abc00/0x48868a4e43949788 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f75b expref: 19 pid: 4589 timeout: 798 lvb_type: 1 00000100:00100000:3.0:1746129752.848507:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053316992:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129752.848522:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129752.848538:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11007 00000100:00100000:3.0:1746129752.848544:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:28619:x1830949052215936:12345-192.168.204.31@tcp:101:multiop.0 00000100:00100000:2.0:1746129752.848582:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052215680 00000100:00100000:2.0:1746129752.848585:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052215680 00000100:00100000:2.0:1746129752.848609:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 572 00000100:00100000:2.0:1746129752.848613:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:1961:x1830949052215680:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129752.848620:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129752.848634:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e79e00/0x48868a4e4394988b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7b6 expref: 283 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.848645:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129752.848649:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129752.848666:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:1961:x1830949052215680:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 52us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.848671:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 572 00000100:00100000:0.0:1746129752.849284:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.849300:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.849312:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.849334:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.849350:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052216064 00000100:00100000:0.0:1746129752.849352:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052216064 00002000:00100000:0.0:1746129752.849372:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ba85180 x1830949052216064/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129752.849392:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85180 with x1830949052216064 ext(1048576->2097151) 00002000:00010000:0.0:1746129752.849395:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba85180 00000100:00100000:0.0:1746129752.849417:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052216320 00000100:00100000:0.0:1746129752.849419:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052216320 00002000:00100000:0.0:1746129752.849428:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009ba84700 x1830949052216320/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129752.849435:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba84700 with x1830949052216320 ext(1048576->2097151) 00002000:00010000:0.0:1746129752.849437:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba84700 00000100:00100000:0.0:1746129752.849445:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052216832 00000100:00100000:0.0:1746129752.849447:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052216832 00002000:00100000:0.0:1746129752.849456:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009ba85500 x1830949052216832/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129752.849462:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85500 with x1830949052216832 ext(1048576->2097151) 00002000:00010000:0.0:1746129752.849465:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba85500 00000100:00100000:0.0:1746129752.849473:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4090 00000100:00100000:0.0:1746129752.849477:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1961:x1830949052216064:12345-192.168.204.31@tcp:3:multiop.0 00010000:00010000:3.0:1746129752.850206:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129752.850217:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800951f5a00/0x48868a4e43949899 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f7c4 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.850231:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129752.850235:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f25f800/0x48868a4e43949892 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2457600->2678783] (req 2457600->2678783) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7bd expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.850240:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129752.850242:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800951f5a00/0x48868a4e43949899 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2465792->3137535] (req 2465792->3137535) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7c4 expref: 20 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.850267:0:8435:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f25f800/0x48868a4e43949892 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2457600->2678783] (req 2457600->2678783) gid 0 flags: 0x60000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7bd expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.850278:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800951f5a00/0x48868a4e43949899 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2465792->3137535] (req 2465792->3137535) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7c4 expref: 20 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.850284:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800951f5a00, rc 0) 00000100:00100000:3.0:1746129752.850311:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:28619:x1830949052215936:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1768us (2118us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129752.850316:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11007 00000100:00100000:3.0:1746129752.850340:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4091 00000100:00100000:3.0:1746129752.850345:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949052216320:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129752.851606:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4092 00000100:00100000:1.0:1746129752.851616:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949052216832:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129752.853795:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052216576 00000100:00100000:1.0:1746129752.853804:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052216576 00000100:00100000:1.0:1746129752.853838:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3887 00000100:00100000:1.0:1746129752.853844:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d61850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6141239f-0c60-480d-830c-e22ba61457b0+8:28614:x1830949052216576:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:1.0:1746129752.853993:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d61850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6141239f-0c60-480d-830c-e22ba61457b0+9:28614:x1830949052216576:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 149us (4658us total) trans 8589943673 rc 0/0 00000100:00100000:1.0:1746129752.853998:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3887 00000100:00100000:1.0:1746129752.855939:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.856208:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052217088 00000100:00100000:2.0:1746129752.856215:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052217088 00002000:00100000:2.0:1746129752.856255:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800a645d880 x1830949052217088/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.856265:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645d880 with x1830949052217088 ext(1048576->2097151) 00002000:00010000:2.0:1746129752.856271:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645d880 00000100:00100000:2.0:1746129752.856291:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4093 00000100:00100000:2.0:1746129752.856298:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949052217088:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129752.860954:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053316736:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129752.860966:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131463b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053316864:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129752.860973:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053316992:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129752.860999:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f25f800/0x48868a4e43949892 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2457600->2678783] (req 2457600->2678783) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7bd expref: 23 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129752.861015:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f25f800, rc 0) 00000100:00100000:0.0:1746129752.861065:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:28626:x1830949052215552:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 12806us (12957us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129752.861072:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11006 00000100:00100000:0.0:1746129752.862792:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.862824:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.862866:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.862872:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052217344 00000100:00100000:2.0:1746129752.862879:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052217344 00000100:00100000:0.0:1746129752.862900:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129752.862904:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x48868a4e43949822 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f793 expref: 23 pid: 20441 timeout: 798 lvb_type: 1 00000100:00100000:2.0:1746129752.862925:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052217216 00000100:00100000:2.0:1746129752.862927:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052217216 00010000:00010000:2.0:1746129752.862934:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801310ed400/0x48868a4e439497b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f73f expref: 12 pid: 3624 timeout: 798 lvb_type: 1 00000100:00100000:2.0:1746129752.862944:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052217472 00000100:00100000:2.0:1746129752.862946:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052217472 00010000:00010000:2.0:1746129752.862953:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e1abc00/0x48868a4e43949788 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f75b expref: 22 pid: 4589 timeout: 798 lvb_type: 1 00000100:00100000:2.0:1746129752.862965:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5288 00000100:00100000:2.0:1746129752.862971:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1962:x1830949052217344:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129752.862981:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129752.862999:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x48868a4e43949822 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f793 expref: 23 pid: 20441 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746129752.863009:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x48868a4e43949822 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f793 expref: 23 pid: 20441 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746129752.863028:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f98f200/0x48868a4e43949822 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f793 expref: 23 pid: 20441 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746129752.863038:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129752.863067:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052217344:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 96us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.863073:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5288 00000100:00100000:2.0:1746129752.863086:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5289 00000100:00100000:2.0:1746129752.863090:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949052217216:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129752.863095:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129752.863102:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801310ed400/0x48868a4e439497b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f73f expref: 12 pid: 3624 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746129752.863109:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801310ed400/0x48868a4e439497b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f73f expref: 12 pid: 3624 timeout: 798 lvb_type: 1 00000100:00100000:1.0:1746129752.863110:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5290 00010000:00010000:2.0:1746129752.863118:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801310ed400/0x48868a4e439497b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f73f expref: 12 pid: 3624 timeout: 798 lvb_type: 1 00000100:00100000:1.0:1746129752.863118:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1ae8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052217472:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129752.863125:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129752.863126:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129752.863135:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e1abc00/0x48868a4e43949788 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f75b expref: 22 pid: 4589 timeout: 798 lvb_type: 1 00000100:00100000:2.0:1746129752.863138:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052217216:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 47us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.863142:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5289 00010000:00010000:1.0:1746129752.863144:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e1abc00/0x48868a4e43949788 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f75b expref: 22 pid: 4589 timeout: 798 lvb_type: 1 00010000:00010000:1.0:1746129752.863156:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e1abc00/0x48868a4e43949788 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f75b expref: 22 pid: 4589 timeout: 798 lvb_type: 1 00000100:00100000:2.0:1746129752.863165:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052217728 00000100:00100000:2.0:1746129752.863167:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052217728 00010000:00010000:1.0:1746129752.863167:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.863169:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.863174:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f25f800/0x48868a4e43949892 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2457600->2678783) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7bd expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.863181:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f25f800/0x48868a4e43949892 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2457600->2678783) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7bd expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129752.863183:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3888 00000100:00100000:2.0:1746129752.863187:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:28614:x1830949052217728:12345-192.168.204.31@tcp:35:lfs.0 00010000:00010000:1.0:1746129752.863206:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f25f800/0x48868a4e43949892 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2457600->2678783) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7bd expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.863215:0:16449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f25f800/0x48868a4e43949892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2457600->2678783) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7bd expref: 21 pid: 4589 timeout: 798 lvb_type: 0 00000100:00100000:1.0:1746129752.863224:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053317248:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129752.863262:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198da80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129752.863315:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6141239f-0c60-480d-830c-e22ba61457b0+10:28614:x1830949052217728:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 126us (413us total) trans 8589943674 rc 0/0 00000100:00100000:2.0:1746129752.863321:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3888 00000100:00100000:1.0:1746129752.863543:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052215424:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 16906us (17057us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129752.863550:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4089 00002000:00100000:1.0:1746129752.863557:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009ba85c00 x1830949052215424/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129752.863564:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85c00 with x1830949052215424 ext(0->1048575) 00002000:00010000:1.0:1746129752.863568:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba85c00 00000100:00100000:1.0:1746129752.870053:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053317248:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129752.870073:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129752.870115:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1ae8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052217472:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6997us (7247us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129752.870124:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5290 00000100:00100000:3.0:1746129752.870152:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949052216320:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 19805us (20849us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129752.870161:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4091 00002000:00100000:3.0:1746129752.870170:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009ba84700 x1830949052216320/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129752.870179:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba84700 with x1830949052216320 ext(1048576->2097151) 00002000:00010000:3.0:1746129752.870183:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba84700 00000100:00100000:2.0:1746129752.871087:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949052216064:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 21606us (21802us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129752.871095:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4090 00002000:00100000:2.0:1746129752.871100:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ba85180 x1830949052216064/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.871107:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85180 with x1830949052216064 ext(1048576->2097151) 00002000:00010000:2.0:1746129752.871109:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba85180 00000100:00100000:1.0:1746129752.874660:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949052216832:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 23038us (25338us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129752.874669:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4092 00002000:00100000:1.0:1746129752.874678:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009ba85500 x1830949052216832/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129752.874687:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85500 with x1830949052216832 ext(1048576->2097151) 00002000:00010000:1.0:1746129752.874692:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba85500 00000100:00100000:0.0:1746129752.879986:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.880316:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052217984 00000100:00100000:1.0:1746129752.880324:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052217984 00002000:00100000:1.0:1746129752.880356:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2674688->2678783) req@ffff88012c041f80 x1830949052217984/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129752.880364:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c041f80 with x1830949052217984 ext(2674688->2678783) 00010000:00010000:1.0:1746129752.880371:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f25f800/0x48868a4e43949892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2457600->2678783) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7bd expref: 18 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.880392:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f25f800/0x48868a4e43949892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2457600->2678783) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7bd expref: 18 pid: 4589 timeout: 798 lvb_type: 0 00002000:00010000:1.0:1746129752.880399:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c041f80 00000100:00100000:1.0:1746129752.880430:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 595 00000100:00100000:1.0:1746129752.880438:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052217984:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129752.880578:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052217984:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 140us (597us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129752.880584:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 595 00002000:00100000:1.0:1746129752.880590:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2674688->2678783) req@ffff88012c041f80 x1830949052217984/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/4536 e 0 to 0 dl 1746129763 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129752.880596:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c041f80 with x1830949052217984 ext(2674688->2678783) 00010000:00010000:1.0:1746129752.880601:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f25f800/0x48868a4e43949892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2457600->2678783) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7bd expref: 18 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.880609:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f25f800/0x48868a4e43949892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2457600->2678783) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7bd expref: 18 pid: 4589 timeout: 798 lvb_type: 0 00002000:00010000:1.0:1746129752.880614:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c041f80 00000100:00100000:2.0:1746129752.881442:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949052217088:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 25143us (25509us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129752.881448:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4093 00002000:00100000:2.0:1746129752.881453:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800a645d880 x1830949052217088/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.881463:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645d880 with x1830949052217088 ext(1048576->2097151) 00002000:00010000:2.0:1746129752.881465:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645d880 00000100:00100000:0.0:1746129752.886459:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.886546:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052218496 00000100:00100000:2.0:1746129752.886555:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052218496 00000100:00100000:2.0:1746129752.886599:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3889 00000100:00100000:2.0:1746129752.886606:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28626:x1830949052218496:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129752.886792:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28626:x1830949052218496:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 185us (341us total) trans 8589943675 rc 0/0 00000100:00100000:2.0:1746129752.886798:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3889 00000100:00100000:0.0:1746129752.887558:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.887886:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052218240 00000100:00100000:2.0:1746129752.887890:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052218240 00002000:00100000:2.0:1746129752.887916:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2457600->2678783) req@ffff88012c041180 x1830949052218240/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.887929:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c041180 with x1830949052218240 ext(2457600->2678783) 00010000:00010000:2.0:1746129752.887936:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f25f800/0x48868a4e43949892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2457600->2678783) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7bd expref: 18 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.887946:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f25f800/0x48868a4e43949892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2457600->2678783) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7bd expref: 18 pid: 4589 timeout: 798 lvb_type: 0 00002000:00010000:2.0:1746129752.887952:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c041180 00000100:00100000:2.0:1746129752.887978:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 596 00000100:00100000:2.0:1746129752.887984:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1963:x1830949052218240:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:2.0:1746129752.891389:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1963:x1830949052218240:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 3388us (3815us total) trans 21474840322 rc 0/0 00000100:00100000:2.0:1746129752.891399:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 596 00002000:00100000:2.0:1746129752.891408:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2457600->2678783) req@ffff88012c041180 x1830949052218240/t21474840322(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/448 e 0 to 0 dl 1746129763 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.891416:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c041180 with x1830949052218240 ext(2457600->2678783) 00010000:00010000:2.0:1746129752.891424:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f25f800/0x48868a4e43949892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2457600->2678783) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7bd expref: 20 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746129752.891437:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f25f800/0x48868a4e43949892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2457600->2678783) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7bd expref: 20 pid: 4589 timeout: 798 lvb_type: 0 00002000:00010000:2.0:1746129752.891443:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c041180 00000100:00100000:0.0:1746129752.892392:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.892548:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052218752 00000100:00100000:2.0:1746129752.892555:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052218752 00002000:00100000:2.0:1746129752.892579:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880135400000 x1830949052218752/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.892585:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135400000 with x1830949052218752 ext(1048576->2097151) 00002000:00010000:2.0:1746129752.892588:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135400000 00000100:00100000:2.0:1746129752.892613:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4094 00000100:00100000:2.0:1746129752.892619:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949052218752:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129752.900432:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.900794:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949052218752:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 8173us (8403us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129752.900958:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052218880 00000100:00100000:1.0:1746129752.900965:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052218880 00010000:00010000:1.0:1746129752.900991:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f25f800/0x48868a4e43949892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2457600->2678783) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7bd expref: 20 pid: 4589 timeout: 798 lvb_type: 0 00000100:00100000:1.0:1746129752.901031:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5291 00000100:00100000:1.0:1746129752.901038:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949052218880:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129752.901053:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129752.901072:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f25f800/0x48868a4e43949892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2457600->2678783) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7bd expref: 20 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.901086:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f25f800/0x48868a4e43949892 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2457600->2678783) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7bd expref: 20 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.901104:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f25f800/0x48868a4e43949892 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2457600->2678783) gid 0 flags: 0x44801000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7bd expref: 20 pid: 4589 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.901122:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.901123:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746129752.901127:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4094 00010000:00010000:1.0:1746129752.901129:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800951f5a00/0x48868a4e43949899 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3137535) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7c4 expref: 18 pid: 8435 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746129752.901135:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880135400000 x1830949052218752/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746129752.901136:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800951f5a00/0x48868a4e43949899 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3137535) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7c4 expref: 18 pid: 8435 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746129752.901142:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135400000 with x1830949052218752 ext(1048576->2097151) 00002000:00010000:2.0:1746129752.901146:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135400000 00010000:00010000:1.0:1746129752.901161:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800951f5a00/0x48868a4e43949899 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3137535) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7c4 expref: 18 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129752.901171:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053317376:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129752.901230:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198d780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129752.901288:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.901399:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052219136 00000100:00100000:3.0:1746129752.901403:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052219136 00002000:00100000:3.0:1746129752.901427:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009a56f800 x1830949052219136/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129752.901439:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56f800 with x1830949052219136 ext(2097152->3145727) 00002000:00010000:3.0:1746129752.901442:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a56f800 00000100:00100000:3.0:1746129752.901466:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4095 00000100:00100000:3.0:1746129752.901472:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949052219136:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129752.903293:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053317376:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129752.903308:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129752.903340:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1964:x1830949052218880:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2302us (2926us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129752.903347:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5291 00000100:00100000:0.0:1746129752.907260:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.907863:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052219392 00000100:00100000:2.0:1746129752.907872:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052219392 00002000:00100000:2.0:1746129752.907913:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2465792->2469887) req@ffff88009a56f480 x1830949052219392/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.907921:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56f480 with x1830949052219392 ext(2465792->2469887) 00002000:00010000:2.0:1746129752.907928:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a56f480 00000100:00100000:2.0:1746129752.907950:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4096 00000100:00100000:2.0:1746129752.907956:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949052219392:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129752.908327:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949052219392:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 369us (1077us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129752.908340:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4096 00002000:00100000:2.0:1746129752.908346:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2465792->2469887) req@ffff88009a56f480 x1830949052219392/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/4536 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.908352:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56f480 with x1830949052219392 ext(2465792->2469887) 00002000:00010000:2.0:1746129752.908355:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a56f480 00000100:00100000:0.0:1746129752.913218:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.913608:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052219648 00000100:00100000:2.0:1746129752.913615:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052219648 00000100:00100000:0.0:1746129752.913626:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.913657:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.913677:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052219904 00000100:00100000:1.0:1746129752.913680:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052219904 00000100:00100000:0.0:1746129752.913683:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:1.0:1746129752.913698:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009a56ce00 x1830949052219904/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129752.913707:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56ce00 with x1830949052219904 ext(3145728->4194303) 00002000:00010000:1.0:1746129752.913711:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a56ce00 00000100:00100000:1.0:1746129752.913729:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052220160 00000100:00100000:0.0:1746129752.913730:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052220416 00000100:00100000:1.0:1746129752.913731:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052220160 00000100:00100000:0.0:1746129752.913732:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052220416 00002000:00100000:1.0:1746129752.913742:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3149823) req@ffff88009a56c380 x1830949052220160/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 504/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129752.913743:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3149824->4194303) req@ffff88009a56ea00 x1830949052220416/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129752.913748:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56c380 with x1830949052220160 ext(2097152->3149823) 00002000:00100000:0.0:1746129752.913749:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56ea00 with x1830949052220416 ext(3149824->4194303) 00002000:00010000:1.0:1746129752.913751:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a56c380 00002000:00010000:0.0:1746129752.913751:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a56ea00 00000100:00100000:1.0:1746129752.913765:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4097 00000100:00100000:0.0:1746129752.913770:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4098 00000100:00100000:1.0:1746129752.913771:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949052219904:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129752.913774:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949052220160:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129752.914773:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4099 00000100:00100000:0.0:1746129752.914780:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052220416:12345-192.168.204.31@tcp:3:cat.0 00002000:00100000:2.0:1746129752.915111:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009a56ed80 x1830949052219648/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.915118:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56ed80 with x1830949052219648 ext(2097152->3145727) 00002000:00010000:2.0:1746129752.915122:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a56ed80 00000100:00100000:2.0:1746129752.915146:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4100 00000100:00100000:2.0:1746129752.915151:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949052219648:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129752.915938:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949052219136:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14464us (14647us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129752.915944:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4095 00002000:00100000:3.0:1746129752.915949:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009a56f800 x1830949052219136/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129752.915955:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56f800 with x1830949052219136 ext(2097152->3145727) 00002000:00010000:3.0:1746129752.915958:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a56f800 00000100:00100000:2.0:1746129752.925568:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052220160:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11785us (11902us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129752.925578:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4098 00002000:00100000:2.0:1746129752.925587:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3149823) req@ffff88009a56c380 x1830949052220160/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 504/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.925596:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56c380 with x1830949052220160 ext(2097152->3149823) 00002000:00010000:2.0:1746129752.925602:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a56c380 00000100:00100000:0.0:1746129752.930758:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.932262:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052220544 00000100:00100000:2.0:1746129752.932271:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052220544 00000100:00100000:2.0:1746129752.932318:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11008 00000100:00100000:2.0:1746129752.932325:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:28624:x1830949052220544:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129752.932340:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.932354:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e439498a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f7cb expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.932385:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800951f5a00/0x48868a4e43949899 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3137535) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7c4 expref: 20 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129752.932693:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949052219904:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18920us (19064us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129752.932701:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4097 00002000:00100000:0.0:1746129752.932709:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009a56ce00 x1830949052219904/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129752.932716:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56ce00 with x1830949052219904 ext(3145728->4194303) 00002000:00010000:0.0:1746129752.932721:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a56ce00 00010000:00010000:2.0:1746129752.932973:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129752.932974:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129752.932979:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e439498a0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7cb expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.933005:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800951f5a00/0x48868a4e43949899 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3137535) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7c4 expref: 20 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.933015:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800951f5a00/0x48868a4e43949899 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3137535) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7c4 expref: 20 pid: 8435 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746129752.933025:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053317504:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129752.933497:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1300 going to sleep for 11 seconds 00000100:00100000:3.0:1746129752.935525:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053317504:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129752.935550:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e439498a0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7cb expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129752.935562:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310ed600, rc 0) 00000100:00100000:3.0:1746129752.935600:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:28624:x1830949052220544:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3276us (4850us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129752.935606:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11008 00000100:00100000:2.0:1746129752.936941:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949052219648:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21785us (23726us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129752.936950:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4100 00002000:00100000:2.0:1746129752.936957:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009a56ed80 x1830949052219648/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.936965:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56ed80 with x1830949052219648 ext(2097152->3145727) 00002000:00010000:2.0:1746129752.936969:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a56ed80 00000100:00100000:1.0:1746129752.937157:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949052220416:12345-192.168.204.31@tcp:3:cat.0 Request processed in 22376us (23471us total) trans 0 rc 1044480/1044480 00000100:00100000:1.0:1746129752.937164:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4099 00002000:00100000:1.0:1746129752.937169:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3149824->4194303) req@ffff88009a56ea00 x1830949052220416/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129752.937176:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56ea00 with x1830949052220416 ext(3149824->4194303) 00010000:00010000:1.0:1746129752.937183:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800951f5a00/0x48868a4e43949899 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3137535) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7c4 expref: 19 pid: 8435 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.937195:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800951f5a00/0x48868a4e43949899 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3137535) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7c4 expref: 19 pid: 8435 timeout: 798 lvb_type: 0 00002000:00010000:1.0:1746129752.937204:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a56ea00 00000100:00100000:0.0:1746129752.939271:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.939316:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.939327:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052221056 00000100:00100000:2.0:1746129752.939334:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052221056 00000100:00100000:2.0:1746129752.939384:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3890 00000100:00100000:2.0:1746129752.939391:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:28619:x1830949052221056:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129752.939407:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052220800 00000100:00100000:1.0:1746129752.939410:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052220800 00002000:00100000:1.0:1746129752.939436:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2465792->3137535) req@ffff8800a504fb80 x1830949052220800/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129752.939443:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504fb80 with x1830949052220800 ext(2465792->3137535) 00010000:00010000:1.0:1746129752.939449:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800951f5a00/0x48868a4e43949899 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3137535) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7c4 expref: 19 pid: 8435 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746129752.939459:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800951f5a00/0x48868a4e43949899 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3137535) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7c4 expref: 19 pid: 8435 timeout: 798 lvb_type: 0 00002000:00010000:1.0:1746129752.939465:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a504fb80 00000100:00100000:1.0:1746129752.939482:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 597 00000100:00100000:1.0:1746129752.939487:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1963:x1830949052220800:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129752.940553:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28619:x1830949052221056:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 1160us (1285us total) trans 8589943676 rc 0/0 00000100:00100000:2.0:1746129752.940560:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3890 00000100:00100000:2.0:1746129752.945090:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.945233:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052221184 00000100:00100000:3.0:1746129752.945241:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052221184 00000100:00100000:2.0:1746129752.945539:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11009 00000100:00100000:2.0:1746129752.945548:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:28622:x1830949052221184:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129752.945564:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129752.945579:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801310eda00/0x48868a4e439498a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f7d2 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.945601:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129752.945607:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801310eda00/0x48868a4e439498a7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7d2 expref: 22 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.945618:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801310eda00/0x48868a4e439498a7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7d2 expref: 22 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129752.945627:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310eda00, rc 0) 00000100:00100000:2.0:1746129752.945668:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:28622:x1830949052221184:12345-192.168.204.31@tcp:101:cat.0 Request processed in 121us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129752.945674:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11009 00000100:00100000:0.0:1746129752.949662:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949052220800:12345-192.168.204.31@tcp:4:cat.0 Request processed in 10166us (10336us total) trans 21474840323 rc 0/0 00000100:00100000:0.0:1746129752.949673:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 597 00002000:00100000:0.0:1746129752.949682:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2465792->3137535) req@ffff8800a504fb80 x1830949052220800/t21474840323(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/448 e 0 to 0 dl 1746129763 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129752.949690:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504fb80 with x1830949052220800 ext(2465792->3137535) 00010000:00010000:0.0:1746129752.949698:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800951f5a00/0x48868a4e43949899 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2465792->3137535) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7c4 expref: 22 pid: 8435 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746129752.949711:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800951f5a00/0x48868a4e43949899 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2465792->3137535) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7c4 expref: 22 pid: 8435 timeout: 799 lvb_type: 0 00002000:00010000:0.0:1746129752.949716:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a504fb80 00000100:00100000:0.0:1746129752.956527:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129752.956630:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052221312 00000100:00100000:1.0:1746129752.956638:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052221312 00010000:00010000:1.0:1746129752.956667:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800951f5a00/0x48868a4e43949899 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2465792->3137535) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7c4 expref: 22 pid: 8435 timeout: 799 lvb_type: 0 00000100:00100000:1.0:1746129752.956704:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5292 00000100:00100000:1.0:1746129752.956710:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949052221312:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129752.956722:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129752.956738:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800951f5a00/0x48868a4e43949899 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2465792->3137535) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7c4 expref: 22 pid: 8435 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746129752.956749:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800951f5a00/0x48868a4e43949899 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2465792->3137535) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7c4 expref: 22 pid: 8435 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746129752.956768:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800951f5a00/0x48868a4e43949899 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2465792->3137535) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7c4 expref: 22 pid: 8435 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746129752.956784:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.956786:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.956792:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e439498a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7cb expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.956800:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e439498a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7cb expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.956807:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.956808:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129752.956811:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801310eda00/0x48868a4e439498a7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7d2 expref: 21 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.956817:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801310eda00/0x48868a4e439498a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7d2 expref: 21 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129752.956842:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801310eda00/0x48868a4e439498a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7d2 expref: 21 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129752.956876:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053317632:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129752.956969:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e439498a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7cb expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129752.956977:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4ddc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053317760:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129752.956996:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198d780 going to sleep for 11 seconds 00000100:00100000:1.0:1746129752.961258:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053317632:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129752.961271:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4ddc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053317760:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129752.961288:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129752.961325:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052221312:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4613us (4806us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129752.961334:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5292 00000100:00100000:0.0:1746129752.966269:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.966439:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052221568 00000100:00100000:2.0:1746129752.966447:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052221568 00002000:00100000:2.0:1746129752.966484:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88008fad2a00 x1830949052221568/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.966493:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad2a00 with x1830949052221568 ext(2097152->3145727) 00002000:00010000:2.0:1746129752.966498:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fad2a00 00000100:00100000:2.0:1746129752.966705:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4101 00000100:00100000:2.0:1746129752.966712:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052221568:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129752.967105:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129752.967519:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052221696 00000100:00100000:3.0:1746129752.967524:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052221696 00002000:00100000:3.0:1746129752.967545:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88008fad3100 x1830949052221696/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129752.967557:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad3100 with x1830949052221696 ext(3145728->4194303) 00002000:00010000:3.0:1746129752.967560:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fad3100 00000100:00100000:3.0:1746129752.967572:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4102 00000100:00100000:3.0:1746129752.967577:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052221696:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129752.967753:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.967765:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129752.967792:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129752.967820:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052222080 00000100:00100000:2.0:1746129752.967824:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052222080 00002000:00100000:2.0:1746129752.967839:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88008fad3480 x1830949052222080/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746129752.967857:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052222336 00002000:00100000:2.0:1746129752.967858:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad3480 with x1830949052222080 ext(2097152->3145727) 00000100:00100000:1.0:1746129752.967860:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052222336 00002000:00010000:2.0:1746129752.967861:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fad3480 00000100:00100000:2.0:1746129752.967872:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052222592 00000100:00100000:2.0:1746129752.967873:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052222592 00002000:00100000:1.0:1746129752.967874:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88008fad0e00 x1830949052222336/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129752.967880:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad0e00 with x1830949052222336 ext(3145728->4194303) 00002000:00100000:2.0:1746129752.967882:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88008fad2680 x1830949052222592/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1746129763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:1.0:1746129752.967882:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fad0e00 00002000:00100000:2.0:1746129752.967888:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad2680 with x1830949052222592 ext(3145728->4194303) 00002000:00010000:2.0:1746129752.967891:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fad2680 00000100:00100000:1.0:1746129752.967907:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4103 00000100:00100000:2.0:1746129752.967911:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4104 00000100:00100000:2.0:1746129752.967915:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1961:x1830949052222336:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129752.967916:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4105 00000100:00100000:1.0:1746129752.967919:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949052222592:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129752.970937:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949052222080:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129752.978481:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949052222336:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10556us (10706us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129752.978492:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4104 00002000:00100000:2.0:1746129752.978502:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88008fad0e00 x1830949052222336/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.978511:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad0e00 with x1830949052222336 ext(3145728->4194303) 00002000:00010000:2.0:1746129752.978515:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fad0e00 00000100:00100000:3.0:1746129752.982183:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949052221696:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14598us (15071us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129752.982193:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4102 00002000:00100000:3.0:1746129752.982203:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88008fad3100 x1830949052221696/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129752.982212:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad3100 with x1830949052221696 ext(3145728->4194303) 00002000:00010000:3.0:1746129752.982217:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fad3100 00000100:00100000:2.0:1746129752.995309:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052221568:12345-192.168.204.31@tcp:3:cat.0 Request processed in 28587us (29038us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129752.995320:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4101 00002000:00100000:2.0:1746129752.995330:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88008fad2a00 x1830949052221568/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129752.995339:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad2a00 with x1830949052221568 ext(2097152->3145727) 00002000:00010000:2.0:1746129752.995344:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fad2a00 00000100:00100000:1.0:1746129753.003053:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949052222592:12345-192.168.204.31@tcp:3:cat.0 Request processed in 35124us (35251us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129753.003067:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4105 00002000:00100000:1.0:1746129753.003077:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88008fad2680 x1830949052222592/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129753.003085:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad2680 with x1830949052222592 ext(3145728->4194303) 00002000:00010000:1.0:1746129753.003090:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fad2680 00000100:00100000:0.0:1746129753.005296:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129753.007110:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052222848 00000100:00100000:1.0:1746129753.007119:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052222848 00002000:00100000:1.0:1746129753.007171:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88008fad1500 x1830949052222848/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129753.007180:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad1500 with x1830949052222848 ext(4194304->4964351) 00002000:00010000:1.0:1746129753.007184:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fad1500 00000100:00100000:1.0:1746129753.007203:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4106 00000100:00100000:1.0:1746129753.007210:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949052222848:12345-192.168.204.31@tcp:3:cat.0 00000100:00080000:2.0:1746129753.007417:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129753.009629:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949052222080:12345-192.168.204.31@tcp:3:cat.0 Request processed in 41708us (41868us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129753.009640:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4103 00002000:00100000:1.0:1746129753.009649:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88008fad3480 x1830949052222080/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:493/0 lens 488/440 e 0 to 0 dl 1746129763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129753.009657:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad3480 with x1830949052222080 ext(2097152->3145727) 00002000:00010000:1.0:1746129753.009662:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fad3480 00000100:00100000:2.0:1746129753.020200:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949052222848:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12982us (14902us total) trans 0 rc 770048/770048 00000100:00100000:2.0:1746129753.020210:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4106 00002000:00100000:2.0:1746129753.020219:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88008fad1500 x1830949052222848/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/440 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.020227:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad1500 with x1830949052222848 ext(4194304->4964351) 00002000:00010000:2.0:1746129753.020232:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fad1500 00000100:00100000:0.0:1746129753.021444:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.022062:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052223104 00000100:00100000:2.0:1746129753.022070:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052223104 00002000:00100000:2.0:1746129753.023203:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88008fad0a80 x1830949052223104/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.023213:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad0a80 with x1830949052223104 ext(4194304->4964351) 00002000:00010000:2.0:1746129753.023219:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fad0a80 00000100:00100000:2.0:1746129753.023252:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4107 00000100:00100000:2.0:1746129753.023260:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949052223104:12345-192.168.204.31@tcp:3:cat.0 00000100:00080000:0.0:1746129753.027613:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129753.030123:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.030205:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052223360 00000100:00100000:2.0:1746129753.030214:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052223360 00000100:00100000:2.0:1746129753.030266:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9894 00000100:00100000:2.0:1746129753.030274:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28631:x1830949052223360:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129753.030295:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.030310:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244200/0x48868a4e439498ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f7d9 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.030414:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e439498b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.030424:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e439498b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.030434:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e439498b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.030446:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a148800/0x48868a4e439498bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.030451:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a148800/0x48868a4e439498bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.030456:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a148800/0x48868a4e439498bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.030544:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a149600/0x48868a4e439498c3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.030555:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a149600/0x48868a4e439498c3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.030561:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a149600/0x48868a4e439498c3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:2.0:1746129753.030569:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000100:00080000:0.0:1746129753.030601:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746129753.030643:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e439498b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.030649:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e439498b5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.030654:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e439498b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.030659:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b5244600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129753.030663:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e439498b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.030668:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e439498b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.030678:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129753.030680:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129753.030683:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e439498b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.030687:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e439498b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.030805:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a148800/0x48868a4e439498bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.030814:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a148800/0x48868a4e439498bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.030817:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a148800/0x48868a4e439498bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.030820:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a148800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129753.030823:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a148800/0x48868a4e439498bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.030827:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a148800/0x48868a4e439498bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.030833:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f888d00) 00010000:00010000:2.0:1746129753.030836:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129753.030838:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a148800/0x48868a4e439498bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.030842:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a148800/0x48868a4e439498bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.030906:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244200/0x48868a4e439498ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7d9 expref: 13 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.030916:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a149600/0x48868a4e439498c3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7d9 expref: 12 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.030921:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129753.030923:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129753.030925:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a149600, rc 0) 00000100:00100000:2.0:1746129753.030969:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28631:x1830949052223360:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 696us (853us total) trans 8589943677 rc 0/0 00000100:00100000:2.0:1746129753.030976:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9894 00010000:00010000:1.0:1746129753.031336:0:20054:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129753.033108:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.033279:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052223616 00000100:00100000:2.0:1746129753.033286:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052223616 00000100:00100000:2.0:1746129753.033332:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3891 00000100:00100000:2.0:1746129753.033338:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28622:x1830949052223616:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129753.033492:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28622:x1830949052223616:12345-192.168.204.31@tcp:35:cat.0 Request processed in 153us (389us total) trans 8589943678 rc 0/0 00000100:00100000:2.0:1746129753.033496:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3891 00000100:00080000:0.0:1746129753.034111:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746129753.034124:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949052223104:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10863us (12682us total) trans 0 rc 770048/770048 00000100:00100000:3.0:1746129753.034131:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4107 00002000:00100000:3.0:1746129753.034139:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88008fad0a80 x1830949052223104/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/440 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129753.034147:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad0a80 with x1830949052223104 ext(4194304->4964351) 00002000:00010000:3.0:1746129753.034151:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fad0a80 00000100:00100000:0.0:1746129753.090878:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.090961:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052223744 00000100:00100000:3.0:1746129753.090968:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052223744 00000100:00100000:3.0:1746129753.091085:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11010 00000100:00100000:3.0:1746129753.091093:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:28631:x1830949052223744:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129753.091112:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129753.091128:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bc60400/0x48868a4e439498d1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f7e0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.091152:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa400/0x48868a4e43949796 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f754 expref: 31 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.091159:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f907000/0x48868a4e4394980d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f78c expref: 21 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.091166:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ee00/0x48868a4e439497c7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f738 expref: 11 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.091172:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.091174:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.091176:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc60400/0x48868a4e439498d1 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2428928->3031039] (req 2428928->3031039) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7e0 expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.091202:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ee00/0x48868a4e439497c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f738 expref: 11 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.091212:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ee00/0x48868a4e439497c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f738 expref: 11 pid: 3623 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746129753.091222:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131460a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053317888:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129753.092228:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f907000/0x48868a4e4394980d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f78c expref: 21 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.092241:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f907000/0x48868a4e4394980d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f78c expref: 21 pid: 7976 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746129753.092249:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053318016:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129753.093523:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa400/0x48868a4e43949796 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f754 expref: 31 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.093534:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa400/0x48868a4e43949796 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f754 expref: 31 pid: 4589 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746129753.093542:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053318144:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129753.093587:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129753.105433:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131460a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053317888:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129753.105443:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053318016:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129753.105450:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053318144:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129753.105475:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bc60400/0x48868a4e439498d1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2428928->3031039] (req 2428928->3031039) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7e0 expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.105492:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bc60400, rc 0) 00000100:00100000:3.0:1746129753.106470:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:28631:x1830949052223744:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 15372us (15623us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129753.106478:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11010 00000100:00100000:0.0:1746129753.107418:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129753.107479:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052224000 00000100:00100000:1.0:1746129753.107486:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052224000 00010000:00010000:1.0:1746129753.107511:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f907000/0x48868a4e4394980d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f78c expref: 21 pid: 7976 timeout: 799 lvb_type: 1 00000100:00100000:1.0:1746129753.107544:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5293 00000100:00100000:1.0:1746129753.107550:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1964:x1830949052224000:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129753.107563:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129753.107582:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f907000/0x48868a4e4394980d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f78c expref: 21 pid: 7976 timeout: 799 lvb_type: 1 00010000:00010000:1.0:1746129753.107592:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f907000/0x48868a4e4394980d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f78c expref: 21 pid: 7976 timeout: 799 lvb_type: 1 00010000:00010000:1.0:1746129753.107610:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f907000/0x48868a4e4394980d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f78c expref: 21 pid: 7976 timeout: 799 lvb_type: 1 00010000:00010000:1.0:1746129753.107628:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129753.107656:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949052224000:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 106us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129753.107661:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5293 00000100:00100000:1.0:1746129753.108139:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.108235:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052223872 00000100:00100000:3.0:1746129753.108239:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052223872 00010000:00010000:3.0:1746129753.108878:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ee00/0x48868a4e439497c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f738 expref: 12 pid: 3623 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746129753.108906:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5294 00000100:00100000:3.0:1746129753.108912:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949052223872:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129753.108921:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129753.108934:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ee00/0x48868a4e439497c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f738 expref: 12 pid: 3623 timeout: 799 lvb_type: 1 00010000:00010000:3.0:1746129753.108942:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ee00/0x48868a4e439497c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f738 expref: 12 pid: 3623 timeout: 799 lvb_type: 1 00010000:00010000:3.0:1746129753.108954:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ee00/0x48868a4e439497c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f738 expref: 12 pid: 3623 timeout: 799 lvb_type: 1 00000100:00080000:0.0:1746129753.109026:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746129753.109598:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129753.109750:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052223872:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 836us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129753.109756:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5294 00000100:00100000:0.0:1746129753.112921:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.113000:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052224128 00000100:00100000:3.0:1746129753.113007:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052224128 00010000:00010000:3.0:1746129753.113034:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa400/0x48868a4e43949796 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f754 expref: 32 pid: 4589 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746129753.113068:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5295 00000100:00100000:3.0:1746129753.113075:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949052224128:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129753.113087:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129753.113106:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa400/0x48868a4e43949796 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f754 expref: 32 pid: 4589 timeout: 799 lvb_type: 1 00010000:00010000:3.0:1746129753.113117:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa400/0x48868a4e43949796 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f754 expref: 32 pid: 4589 timeout: 799 lvb_type: 1 00010000:00010000:3.0:1746129753.113135:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa400/0x48868a4e43949796 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f754 expref: 32 pid: 4589 timeout: 799 lvb_type: 1 00010000:00010000:3.0:1746129753.113148:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.113149:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.113154:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bc60400/0x48868a4e439498d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2428928->3031039) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7e0 expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.113162:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc60400/0x48868a4e439498d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2428928->3031039) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7e0 expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.113188:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bc60400/0x48868a4e439498d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2428928->3031039) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7e0 expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129753.113199:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053318272:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129753.113268:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129753.119734:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053318272:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129753.119756:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129753.119841:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949052224128:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6765us (6925us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129753.119871:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5295 00000100:00100000:0.0:1746129753.126614:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.126742:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052224384 00000100:00100000:3.0:1746129753.126750:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052224384 00002000:00100000:3.0:1746129753.126788:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3026944->3031039) req@ffff88009468c380 x1830949052224384/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129753.126796:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468c380 with x1830949052224384 ext(3026944->3031039) 00002000:00010000:3.0:1746129753.126801:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468c380 00000100:00100000:3.0:1746129753.126829:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4108 00000100:00100000:3.0:1746129753.126836:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949052224384:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129753.127008:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949052224384:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 171us (400us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129753.127013:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4108 00002000:00100000:3.0:1746129753.127018:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3026944->3031039) req@ffff88009468c380 x1830949052224384/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/4536 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129753.127025:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468c380 with x1830949052224384 ext(3026944->3031039) 00002000:00010000:3.0:1746129753.127027:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468c380 00000100:00100000:0.0:1746129753.128934:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.128996:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052224640 00000100:00100000:2.0:1746129753.129002:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052224640 00000100:00100000:2.0:1746129753.129045:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3892 00000100:00100000:2.0:1746129753.129051:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28631:x1830949052224640:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129753.130652:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28631:x1830949052224640:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 1596us (1719us total) trans 8589943679 rc 0/0 00000100:00100000:2.0:1746129753.130660:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3892 00000100:00100000:0.0:1746129753.171288:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.171424:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052224896 00000100:00100000:2.0:1746129753.171432:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052224896 00000100:00100000:2.0:1746129753.171481:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9895 00000100:00100000:2.0:1746129753.171489:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28636:x1830949052224896:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129753.171509:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.171523:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4600/0x48868a4e439498d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f7e7 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.171611:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4e00/0x48868a4e439498df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.171625:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4e00/0x48868a4e439498df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.171644:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4e00/0x48868a4e439498df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.171655:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5600/0x48868a4e439498e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.171661:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5600/0x48868a4e439498e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.171665:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5600/0x48868a4e439498e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.171820:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4c00/0x48868a4e439498ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.171828:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4c00/0x48868a4e439498ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.171834:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4c00/0x48868a4e439498ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:2.0:1746129753.171842:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129753.171934:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4e00/0x48868a4e439498df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.171940:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4e00/0x48868a4e439498df lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.171945:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4e00/0x48868a4e439498df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.171952:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a49b4e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129753.171955:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4e00/0x48868a4e439498df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.171960:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4e00/0x48868a4e439498df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.171969:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129753.171971:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129753.171975:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4e00/0x48868a4e439498df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.171979:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4e00/0x48868a4e439498df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.171995:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5600/0x48868a4e439498e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.171999:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5600/0x48868a4e439498e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.172002:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5600/0x48868a4e439498e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.172006:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a49b5600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129753.172008:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5600/0x48868a4e439498e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.172011:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5600/0x48868a4e439498e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.172015:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f888100) 00010000:00010000:2.0:1746129753.172017:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129753.172019:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5600/0x48868a4e439498e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.172023:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b5600/0x48868a4e439498e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.172049:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4600/0x48868a4e439498d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7e7 expref: 287 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.172058:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4c00/0x48868a4e439498ed lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7e7 expref: 286 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.172063:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129753.172065:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129753.172067:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a49b4c00, rc 0) 00000100:00100000:2.0:1746129753.173003:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:28636:x1830949052224896:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1512us (1719us total) trans 8589943680 rc 0/0 00000100:00100000:2.0:1746129753.173010:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9895 00000100:00100000:0.0:1746129753.179955:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.180001:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.180036:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052225152 00000100:00100000:0.0:1746129753.180042:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052225152 00000100:00100000:0.0:1746129753.180076:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9896 00000100:00100000:0.0:1746129753.180082:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:28639:x1830949052225152:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129753.180102:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129753.180117:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f000/0x48868a4e439498fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f7ee expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.180187:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e600/0x48868a4e43949902 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129753.180202:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e600/0x48868a4e43949902 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129753.180210:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e600/0x48868a4e43949902 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:0.0:1746129753.180220:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000100:00100000:3.0:1746129753.180775:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052225280 00000100:00100000:3.0:1746129753.180779:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052225280 00000100:00100000:3.0:1746129753.180808:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11011 00000100:00100000:3.0:1746129753.180815:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:28636:x1830949052225280:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129753.180822:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129753.180832:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bc61200/0x48868a4e43949910 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f7f5 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.180867:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e439498a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7cb expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.180874:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801310eda00/0x48868a4e439498a7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7d2 expref: 22 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.180879:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.180880:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.180883:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bc61200/0x48868a4e43949910 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3809280->3923967] (req 3809280->3923967) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7f5 expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.180907:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801310eda00/0x48868a4e439498a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7d2 expref: 22 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.180917:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801310eda00/0x48868a4e439498a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7d2 expref: 22 pid: 8435 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746129753.180927:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053318400:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129753.180992:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e439498a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7cb expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.181000:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e439498a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7cb expref: 19 pid: 4589 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746129753.181007:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053318528:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129753.181024:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68cc0 going to sleep for 11 seconds 00000100:00080000:1.0:1746129753.181456:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1746129753.183923:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f000/0x48868a4e439498fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7ee expref: 289 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129753.183944:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e600/0x48868a4e43949902 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7ee expref: 288 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129753.183951:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129753.183954:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746129753.183956:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6e600, rc 0) 00000100:00100000:1.0:1746129753.184011:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:28639:x1830949052225152:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3928us (4062us total) trans 8589943681 rc 0/0 00000100:00100000:1.0:1746129753.184018:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9896 00000100:00100000:3.0:1746129753.185186:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053318400:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129753.185195:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053318528:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129753.185215:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bc61200/0x48868a4e43949910 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3809280->3923967] (req 3809280->3923967) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7f5 expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.185227:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bc61200, rc 0) 00000100:00100000:3.0:1746129753.185259:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:28636:x1830949052225280:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4445us (5257us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129753.185265:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11011 00000100:00100000:0.0:1746129753.186435:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.188199:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052225408 00000100:00100000:3.0:1746129753.188207:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052225408 00010000:00010000:3.0:1746129753.188239:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801310eda00/0x48868a4e439498a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7d2 expref: 22 pid: 8435 timeout: 799 lvb_type: 0 00000100:00100000:1.0:1746129753.189077:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.189578:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5296 00000100:00100000:3.0:1746129753.189588:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1964:x1830949052225408:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129753.189602:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129753.189622:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801310eda00/0x48868a4e439498a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7d2 expref: 22 pid: 8435 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746129753.189633:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801310eda00/0x48868a4e439498a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7d2 expref: 22 pid: 8435 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746129753.189652:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801310eda00/0x48868a4e439498a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7d2 expref: 22 pid: 8435 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746129753.189675:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129753.189708:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1964:x1830949052225408:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 122us (3274us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129753.189715:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5296 00000100:00100000:1.0:1746129753.189970:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.190004:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052225536 00000100:00100000:2.0:1746129753.190009:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052225536 00000100:00100000:2.0:1746129753.190042:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052225664 00000100:00100000:2.0:1746129753.190045:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052225664 00000100:00100000:2.0:1746129753.190063:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11012 00000100:00100000:2.0:1746129753.190068:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949052225536:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129753.190081:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.190092:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5800/0x48868a4e43949917 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f7fc expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129753.190126:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053318656:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129753.190187:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129753.190200:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11013 00000100:00100000:2.0:1746129753.190204:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052225664:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129753.190211:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.190217:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a49b4e00/0x48868a4e4394991e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f803 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.190226:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129753.190232:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a49b4e00/0x48868a4e4394991e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f803 expref: 22 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.190240:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a49b4e00/0x48868a4e4394991e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f803 expref: 22 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.190248:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a49b4e00, rc 0) 00000100:00100000:2.0:1746129753.190265:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052225664:12345-192.168.204.31@tcp:101:cat.0 Request processed in 61us (296us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129753.190270:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11013 00000100:00100000:0.0:1746129753.193015:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.193129:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053318656:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129753.193154:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5800/0x48868a4e43949917 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7fc expref: 32 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.193165:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5800/0x48868a4e43949917 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7fc expref: 32 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.193175:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a49b5800, rc 0) 00000100:00100000:2.0:1746129753.193221:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949052225536:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3151us (4145us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129753.193228:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11012 00000100:00100000:3.0:1746129753.193301:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052225792 00000100:00100000:3.0:1746129753.193307:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052225792 00010000:00010000:3.0:1746129753.193348:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e439498a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7cb expref: 20 pid: 4589 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746129753.193366:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5297 00000100:00100000:3.0:1746129753.193382:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1ae8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949052225792:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129753.193394:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129753.193406:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e439498a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7cb expref: 20 pid: 4589 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746129753.193416:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e439498a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7cb expref: 20 pid: 4589 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746129753.193430:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801310ed600/0x48868a4e439498a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7cb expref: 20 pid: 4589 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746129753.193441:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.193443:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.193448:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bc61200/0x48868a4e43949910 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3809280->3923967) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7f5 expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.193459:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bc61200/0x48868a4e43949910 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3809280->3923967) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7f5 expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.193482:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bc61200/0x48868a4e43949910 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3809280->3923967) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7f5 expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129753.193492:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053318784:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129753.193536:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68cc0 going to sleep for 11 seconds 00000100:00080000:0.0:1746129753.193691:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129753.195523:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.195736:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052226048 00000100:00100000:2.0:1746129753.195742:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052226048 00002000:00100000:2.0:1746129753.195772:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3809280->3813375) req@ffff880136318380 x1830949052226048/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.195781:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136318380 with x1830949052226048 ext(3809280->3813375) 00002000:00010000:2.0:1746129753.195785:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136318380 00000100:00100000:2.0:1746129753.195811:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4109 00000100:00100000:2.0:1746129753.195818:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1964:x1830949052226048:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129753.195959:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1964:x1830949052226048:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 141us (440us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129753.195965:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4109 00002000:00100000:2.0:1746129753.195970:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3809280->3813375) req@ffff880136318380 x1830949052226048/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/4536 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.195977:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136318380 with x1830949052226048 ext(3809280->3813375) 00002000:00010000:2.0:1746129753.195980:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136318380 00000100:00100000:3.0:1746129753.196057:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053318784:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129753.196071:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129753.196092:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1ae8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1961:x1830949052225792:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2710us (3084us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129753.196098:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5297 00000100:00100000:2.0:1746129753.200213:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.200287:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052226304 00000100:00100000:3.0:1746129753.200294:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052226304 00002000:00100000:3.0:1746129753.200330:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3919872->3923967) req@ffff88009fbef100 x1830949052226304/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129753.200338:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbef100 with x1830949052226304 ext(3919872->3923967) 00002000:00010000:3.0:1746129753.200343:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbef100 00000100:00100000:3.0:1746129753.200358:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4110 00000100:00100000:3.0:1746129753.200363:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949052226304:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129753.200499:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949052226304:12345-192.168.204.31@tcp:3:cat.0 Request processed in 135us (293us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129753.200508:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4110 00002000:00100000:3.0:1746129753.200513:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3919872->3923967) req@ffff88009fbef100 x1830949052226304/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/4536 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129753.200519:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbef100 with x1830949052226304 ext(3919872->3923967) 00002000:00010000:3.0:1746129753.200522:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbef100 00000100:00100000:0.0:1746129753.201188:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.201231:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.201279:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052226560 00000100:00100000:2.0:1746129753.201282:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052226560 00002000:00100000:2.0:1746129753.201299:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88013631bb80 x1830949052226560/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.201306:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631bb80 with x1830949052226560 ext(0->1048575) 00002000:00010000:2.0:1746129753.201309:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013631bb80 00000100:00100000:2.0:1746129753.201319:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052226816 00000100:00100000:2.0:1746129753.201320:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052226816 00002000:00100000:2.0:1746129753.201328:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff880136319180 x1830949052226816/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.201333:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136319180 with x1830949052226816 ext(1048576->2097151) 00002000:00010000:2.0:1746129753.201336:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136319180 00000100:00100000:2.0:1746129753.201343:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4111 00000100:00100000:2.0:1746129753.201347:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949052226560:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129753.201604:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4112 00000100:00100000:0.0:1746129753.201610:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052226816:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129753.210530:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.210758:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052227072 00000100:00100000:2.0:1746129753.210765:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052227072 00000100:00100000:2.0:1746129753.210815:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3893 00000100:00100000:2.0:1746129753.210824:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d61450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:28636:x1830949052227072:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129753.211025:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d61450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:28636:x1830949052227072:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 202us (501us total) trans 8589943682 rc 0/0 00000100:00100000:2.0:1746129753.211032:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3893 00000100:00100000:1.0:1746129753.212042:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052226816:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10429us (10807us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129753.212050:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4112 00002000:00100000:1.0:1746129753.212057:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff880136319180 x1830949052226816/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/440 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129753.212065:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136319180 with x1830949052226816 ext(1048576->2097151) 00002000:00010000:1.0:1746129753.212070:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136319180 00000100:00100000:2.0:1746129753.213385:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949052226560:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12021us (12181us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129753.213393:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4111 00002000:00100000:2.0:1746129753.213401:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88013631bb80 x1830949052226560/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/440 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.213407:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631bb80 with x1830949052226560 ext(0->1048575) 00002000:00010000:2.0:1746129753.213411:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013631bb80 00000100:00100000:0.0:1746129753.221215:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.221486:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052227200 00000100:00100000:2.0:1746129753.221494:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052227200 00000100:00100000:2.0:1746129753.222125:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11014 00000100:00100000:2.0:1746129753.222134:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:28639:x1830949052227200:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129753.222149:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.222164:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5600/0x48868a4e43949925 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f80a expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.222188:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bc60400/0x48868a4e439498d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2428928->3031039) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7e0 expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.222194:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129753.222196:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129753.222199:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5600/0x48868a4e43949925 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f80a expref: 32 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.222221:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bc60400/0x48868a4e439498d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2428928->3031039) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7e0 expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.222231:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bc60400/0x48868a4e439498d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2428928->3031039) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7e0 expref: 19 pid: 4589 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746129753.222240:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053318912:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129753.222655:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129753.223917:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053318912:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129753.223947:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5600/0x48868a4e43949925 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f80a expref: 32 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.223960:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a49b5600, rc 0) 00000100:00100000:2.0:1746129753.223999:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:28639:x1830949052227200:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1866us (2792us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129753.224006:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11014 00000100:00100000:0.0:1746129753.224542:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.224610:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052227328 00000100:00100000:2.0:1746129753.224616:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052227328 00002000:00100000:2.0:1746129753.224646:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2428928->3031039) req@ffff880136319500 x1830949052227328/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.224655:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136319500 with x1830949052227328 ext(2428928->3031039) 00010000:00010000:2.0:1746129753.224661:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bc60400/0x48868a4e439498d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2428928->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7e0 expref: 20 pid: 4589 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746129753.224671:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bc60400/0x48868a4e439498d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2428928->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7e0 expref: 20 pid: 4589 timeout: 799 lvb_type: 0 00002000:00010000:2.0:1746129753.224677:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136319500 00000100:00100000:2.0:1746129753.224761:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 598 00000100:00100000:2.0:1746129753.224768:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949052227328:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:2.0:1746129753.230523:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052227328:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 5747us (5973us total) trans 17179873174 rc 0/0 00000100:00100000:2.0:1746129753.230533:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 598 00002000:00100000:2.0:1746129753.230542:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2428928->3031039) req@ffff880136319500 x1830949052227328/t17179873174(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1746129764 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.230550:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136319500 with x1830949052227328 ext(2428928->3031039) 00010000:00010000:2.0:1746129753.230559:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bc60400/0x48868a4e439498d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2428928->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7e0 expref: 22 pid: 4589 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746129753.230574:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bc60400/0x48868a4e439498d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2428928->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7e0 expref: 22 pid: 4589 timeout: 799 lvb_type: 0 00002000:00010000:2.0:1746129753.230580:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136319500 00000100:00100000:0.0:1746129753.234356:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.234520:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052227456 00000100:00100000:3.0:1746129753.234527:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052227456 00010000:00010000:3.0:1746129753.234558:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc60400/0x48868a4e439498d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2428928->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7e0 expref: 22 pid: 4589 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746129753.234596:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5298 00000100:00100000:3.0:1746129753.234604:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949052227456:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129753.234617:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129753.234636:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bc60400/0x48868a4e439498d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2428928->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7e0 expref: 22 pid: 4589 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746129753.234647:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bc60400/0x48868a4e439498d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2428928->3031039) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7e0 expref: 22 pid: 4589 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746129753.234665:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bc60400/0x48868a4e439498d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2428928->3031039) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7e0 expref: 22 pid: 4589 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746129753.234691:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.234693:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.234699:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5600/0x48868a4e43949925 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f80a expref: 31 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.234710:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5600/0x48868a4e43949925 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f80a expref: 31 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.234736:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5600/0x48868a4e43949925 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f80a expref: 31 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129753.234746:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053319040:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129753.234815:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129753.240987:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053319040:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129753.241005:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129753.241059:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1961:x1830949052227456:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6455us (6709us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129753.241067:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5298 00000100:00100000:0.0:1746129753.251123:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.251166:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.251434:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.252168:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052227712 00000100:00100000:2.0:1746129753.252176:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052227712 00000100:00100000:1.0:1746129753.252188:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052227968 00000100:00100000:1.0:1746129753.252193:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052227968 00002000:00100000:2.0:1746129753.252213:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880136319c00 x1830949052227712/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129753.252213:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880094768a80 x1830949052227968/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.252221:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136319c00 with x1830949052227712 ext(2097152->3145727) 00002000:00100000:1.0:1746129753.252222:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094768a80 with x1830949052227968 ext(3145728->4194303) 00002000:00010000:2.0:1746129753.252226:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136319c00 00002000:00010000:1.0:1746129753.252226:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094768a80 00000100:00100000:2.0:1746129753.252246:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052228224 00000100:00100000:2.0:1746129753.252248:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052228224 00002000:00100000:2.0:1746129753.252259:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009476ad80 x1830949052228224/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.252265:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476ad80 with x1830949052228224 ext(2097152->3145727) 00002000:00010000:2.0:1746129753.252268:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009476ad80 00000100:00100000:0.0:1746129753.252268:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.252865:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052228480 00000100:00100000:2.0:1746129753.252869:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052228480 00002000:00100000:2.0:1746129753.252890:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880094769f80 x1830949052228480/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 504/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.252900:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769f80 with x1830949052228480 ext(3145728->4194303) 00002000:00010000:2.0:1746129753.252902:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094769f80 00000100:00100000:3.0:1746129753.252916:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4113 00000100:00100000:2.0:1746129753.252923:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4114 00000100:00100000:3.0:1746129753.252925:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949052227712:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129753.252928:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949052227968:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129753.253097:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4115 00000100:00100000:0.0:1746129753.253104:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949052228224:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129753.254745:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4116 00000100:00100000:0.0:1746129753.254754:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949052228480:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129753.271318:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.271362:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.271399:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052228608 00000100:00100000:2.0:1746129753.271407:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052228608 00000100:00100000:2.0:1746129753.271447:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052228736 00000100:00100000:2.0:1746129753.271450:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052228736 00000100:00100000:2.0:1746129753.271470:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11015 00000100:00100000:2.0:1746129753.271477:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1962:x1830949052228608:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129753.271493:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.271507:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2800/0x48868a4e4394992c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f811 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.271525:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129753.271526:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129753.271534:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2800/0x48868a4e4394992c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f811 expref: 22 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.271546:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2800/0x48868a4e4394992c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f811 expref: 22 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.271556:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff2800, rc 0) 00000100:00100000:2.0:1746129753.271591:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052228608:12345-192.168.204.31@tcp:101:cat.0 Request processed in 115us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129753.271596:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11015 00000100:00100000:2.0:1746129753.271610:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11016 00000100:00100000:2.0:1746129753.271614:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1961:x1830949052228736:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129753.271621:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.271629:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3400/0x48868a4e43949933 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f818 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129753.271659:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c042d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053319168:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129753.271703:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129753.272613:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949052228224:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19509us (21177us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129753.272620:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4115 00002000:00100000:0.0:1746129753.272628:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009476ad80 x1830949052228224/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/440 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129753.272635:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476ad80 with x1830949052228224 ext(2097152->3145727) 00002000:00010000:0.0:1746129753.272639:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009476ad80 00000100:00100000:2.0:1746129753.276999:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949052227968:12345-192.168.204.31@tcp:3:cat.0 Request processed in 24061us (25822us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129753.277011:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4114 00002000:00100000:2.0:1746129753.277023:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880094768a80 x1830949052227968/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/440 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.277032:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094768a80 with x1830949052227968 ext(3145728->4194303) 00002000:00010000:2.0:1746129753.277038:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094768a80 00000100:00100000:2.0:1746129753.278800:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c042d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053319168:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129753.278830:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3400/0x48868a4e43949933 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f818 expref: 20 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.278842:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3400/0x48868a4e43949933 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f818 expref: 20 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.278868:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff3400, rc 0) 00000100:00100000:2.0:1746129753.278899:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1961:x1830949052228736:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7283us (7536us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129753.278906:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11016 00000100:00100000:2.0:1746129753.279114:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949052227712:12345-192.168.204.31@tcp:3:cat.0 Request processed in 26190us (27997us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129753.279123:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4113 00002000:00100000:2.0:1746129753.279129:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880136319c00 x1830949052227712/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/440 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.279137:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136319c00 with x1830949052227712 ext(2097152->3145727) 00002000:00010000:2.0:1746129753.279140:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136319c00 00000100:00100000:1.0:1746129753.280788:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052228480:12345-192.168.204.31@tcp:3:cat.0 Request processed in 26031us (28514us total) trans 0 rc 933888/933888 00000100:00100000:1.0:1746129753.280795:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4116 00002000:00100000:1.0:1746129753.280801:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880094769f80 x1830949052228480/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 504/440 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 933888/933888 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129753.280814:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769f80 with x1830949052228480 ext(3145728->4194303) 00002000:00010000:1.0:1746129753.280817:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094769f80 00000100:00100000:0.0:1746129753.296349:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.296407:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129753.296714:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052228992 00000100:00100000:1.0:1746129753.296722:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052228992 00002000:00100000:1.0:1746129753.296760:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880094769500 x1830949052228992/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129753.296769:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769500 with x1830949052228992 ext(4194304->4964351) 00002000:00010000:1.0:1746129753.296773:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094769500 00000100:00100000:1.0:1746129753.296801:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052229248 00000100:00100000:1.0:1746129753.296804:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052229248 00002000:00100000:1.0:1746129753.296816:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880094769c00 x1830949052229248/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129753.296822:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769c00 with x1830949052229248 ext(2097152->3145727) 00002000:00010000:1.0:1746129753.296825:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094769c00 00000100:00100000:1.0:1746129753.296845:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4117 00000100:00100000:1.0:1746129753.296872:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949052228992:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129753.296899:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4118 00000100:00100000:3.0:1746129753.296907:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052229248:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129753.309201:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052229248:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12288us (12786us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129753.309211:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4118 00002000:00100000:3.0:1746129753.309221:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880094769c00 x1830949052229248/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/440 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129753.309235:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769c00 with x1830949052229248 ext(2097152->3145727) 00002000:00010000:3.0:1746129753.309240:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094769c00 00000100:00100000:0.0:1746129753.312220:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949052228992:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15342us (15871us total) trans 0 rc 770048/770048 00000100:00100000:0.0:1746129753.312230:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4117 00002000:00100000:0.0:1746129753.312239:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880094769500 x1830949052228992/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/440 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129753.312246:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769500 with x1830949052228992 ext(4194304->4964351) 00002000:00010000:0.0:1746129753.312251:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094769500 00000100:00100000:0.0:1746129753.322738:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.324598:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052229376 00000100:00100000:2.0:1746129753.324609:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052229376 00000100:00100000:2.0:1746129753.324656:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11017 00000100:00100000:2.0:1746129753.324664:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a340c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:28643:x1830949052229376:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129753.324679:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.324695:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ec00/0x48868a4e4394993a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f81f expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.324717:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bc61200/0x48868a4e43949910 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3809280->3923967) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7f5 expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.324724:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129753.324725:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129753.324728:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ec00/0x48868a4e4394993a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f81f expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.324752:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bc61200/0x48868a4e43949910 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3809280->3923967) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7f5 expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.324762:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bc61200/0x48868a4e43949910 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3809280->3923967) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7f5 expref: 20 pid: 4589 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746129753.324777:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c042d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053319296:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129753.324874:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129753.327766:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c042d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053319296:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129753.327792:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ec00/0x48868a4e4394993a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f81f expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.327807:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1ec00, rc 0) 00000100:00100000:2.0:1746129753.327842:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a340c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:28643:x1830949052229376:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3179us (5110us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129753.327870:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11017 00000100:00100000:0.0:1746129753.328780:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129753.329235:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052229504 00000100:00100000:1.0:1746129753.329242:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052229504 00002000:00100000:1.0:1746129753.329273:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3809280->3923967) req@ffff880094768380 x1830949052229504/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129753.329281:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094768380 with x1830949052229504 ext(3809280->3923967) 00010000:00010000:1.0:1746129753.329288:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bc61200/0x48868a4e43949910 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3809280->3923967) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7f5 expref: 21 pid: 4589 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746129753.329303:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bc61200/0x48868a4e43949910 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3809280->3923967) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7f5 expref: 21 pid: 4589 timeout: 799 lvb_type: 0 00002000:00010000:1.0:1746129753.329308:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094768380 00000100:00100000:1.0:1746129753.329335:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 599 00000100:00100000:1.0:1746129753.329341:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052229504:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129753.334175:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949052229504:12345-192.168.204.31@tcp:4:cat.0 Request processed in 4825us (5387us total) trans 21474840324 rc 0/0 00000100:00100000:1.0:1746129753.334186:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 599 00002000:00100000:1.0:1746129753.334195:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3809280->3923967) req@ffff880094768380 x1830949052229504/t21474840324(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1746129764 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129753.334204:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094768380 with x1830949052229504 ext(3809280->3923967) 00010000:00010000:1.0:1746129753.334212:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bc61200/0x48868a4e43949910 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3809280->3923967) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7f5 expref: 23 pid: 4589 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746129753.334226:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bc61200/0x48868a4e43949910 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3809280->3923967) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7f5 expref: 23 pid: 4589 timeout: 799 lvb_type: 0 00002000:00010000:1.0:1746129753.334233:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094768380 00000100:00100000:0.0:1746129753.341037:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.341102:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052229632 00000100:00100000:3.0:1746129753.341109:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052229632 00010000:00010000:3.0:1746129753.341138:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bc61200/0x48868a4e43949910 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3809280->3923967) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7f5 expref: 23 pid: 4589 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746129753.341547:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5299 00000100:00100000:3.0:1746129753.341555:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949052229632:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129753.341566:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129753.341585:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bc61200/0x48868a4e43949910 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3809280->3923967) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7f5 expref: 23 pid: 4589 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746129753.341597:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bc61200/0x48868a4e43949910 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3809280->3923967) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7f5 expref: 23 pid: 4589 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746129753.341614:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bc61200/0x48868a4e43949910 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3809280->3923967) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7f5 expref: 23 pid: 4589 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746129753.341640:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.341642:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.341648:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ec00/0x48868a4e4394993a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f81f expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.341656:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ec00/0x48868a4e4394993a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f81f expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.341688:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ec00/0x48868a4e4394993a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f81f expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129753.341699:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053319424:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129753.341774:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129753.350177:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053319424:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129753.350195:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129753.350232:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949052229632:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8677us (9202us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129753.350241:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5299 00000100:00100000:0.0:1746129753.350436:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.351252:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.351287:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129753.351343:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052229888 00000100:00100000:1.0:1746129753.351350:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052229888 00002000:00100000:1.0:1746129753.351390:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880136a3b450 x1830949052229888/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129753.351399:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a3b450 with x1830949052229888 ext(2097152->3145727) 00002000:00010000:1.0:1746129753.351404:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a3b450 00000100:00100000:1.0:1746129753.351662:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052230144 00000100:00100000:1.0:1746129753.351666:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052230144 00002000:00100000:1.0:1746129753.351676:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009476b100 x1830949052230144/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129753.351683:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476b100 with x1830949052230144 ext(3145728->4194303) 00002000:00010000:1.0:1746129753.351685:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009476b100 00000100:00100000:2.0:1746129753.351702:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052230400 00000100:00100000:2.0:1746129753.351704:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052230400 00002000:00100000:2.0:1746129753.351716:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880094d8f480 x1830949052230400/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.351722:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8f480 with x1830949052230400 ext(3145728->4194303) 00002000:00010000:2.0:1746129753.351724:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8f480 00000100:00100000:2.0:1746129753.351735:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4119 00000100:00100000:2.0:1746129753.351740:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1961:x1830949052229888:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129753.352709:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4120 00000100:00100000:2.0:1746129753.352715:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949052230144:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129753.356208:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4121 00000100:00100000:3.0:1746129753.356224:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949052230400:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129753.369745:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949052229888:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17997us (19302us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129753.369760:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4119 00002000:00100000:2.0:1746129753.369769:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880136a3b450 x1830949052229888/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/440 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.369778:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a3b450 with x1830949052229888 ext(2097152->3145727) 00002000:00010000:2.0:1746129753.369783:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a3b450 00000100:00100000:2.0:1746129753.377835:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949052230144:12345-192.168.204.31@tcp:3:cat.0 Request processed in 25111us (26574us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129753.377870:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4120 00002000:00100000:2.0:1746129753.377881:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009476b100 x1830949052230144/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/440 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.377889:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476b100 with x1830949052230144 ext(3145728->4194303) 00002000:00010000:2.0:1746129753.377895:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009476b100 00000100:00100000:0.0:1746129753.384428:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.384466:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129753.384509:0:14312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052230528 00000100:00100000:1.0:1746129753.384517:0:14312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052230528 00000100:00100000:1.0:1746129753.384563:0:14312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 167 00000100:00100000:1.0:1746129753.384571:0:14312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008edfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5278c6ae-40e3-4880-9941-e4a223d3f965+15:1961:x1830949052230528:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1746129753.384842:0:14312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008edfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5278c6ae-40e3-4880-9941-e4a223d3f965+15:1961:x1830949052230528:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 271us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129753.384864:0:14312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 167 00000100:00100000:0.0:1746129753.389147:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129753.389217:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052230912 00000100:00100000:1.0:1746129753.389226:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052230912 00000100:00100000:1.0:1746129753.389265:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9897 00000100:00100000:1.0:1746129753.389272:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6141239f-0c60-480d-830c-e22ba61457b0+10:28648:x1830949052230912:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129753.389290:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129753.389303:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11a00/0x48868a4e43949941 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f826 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129753.389348:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e43949948 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.389358:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e43949948 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.389381:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e43949948 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.389392:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e4394994f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.389397:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e4394994f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.389402:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e4394994f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.389486:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x48868a4e43949956 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.389493:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x48868a4e43949956 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.389498:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x48868a4e43949956 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:1.0:1746129753.389520:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:1.0:1746129753.389523:0:14314:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746129753.389534:0:14314:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x48868a4e43949956 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.389540:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x48868a4e43949956 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.389547:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e43949948 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.389552:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e43949948 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.389561:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e43949948 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.389566:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb10400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129753.389569:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e43949948 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.389574:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e43949948 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.389582:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129753.389584:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129753.389587:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e43949948 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.389591:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e43949948 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00000100:00100000:3.0:1746129753.389696:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949052230400:12345-192.168.204.31@tcp:3:cat.0 Request processed in 33478us (38407us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129753.389704:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4121 00002000:00100000:3.0:1746129753.389711:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880094d8f480 x1830949052230400/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/440 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746129753.389717:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052230784 00002000:00100000:3.0:1746129753.389719:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8f480 with x1830949052230400 ext(3145728->4194303) 00000100:00100000:2.0:1746129753.389721:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052230784 00002000:00010000:3.0:1746129753.389723:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8f480 00002000:00100000:2.0:1746129753.389747:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880094d8f800 x1830949052230784/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.389754:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8f800 with x1830949052230784 ext(4194304->4964351) 00002000:00010000:2.0:1746129753.389757:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8f800 00000100:00100000:2.0:1746129753.389773:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4122 00000100:00100000:2.0:1746129753.389782:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949052230784:12345-192.168.204.31@tcp:3:cat.0 00010000:00010000:1.0:1746129753.392203:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e4394994f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.392215:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e4394994f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.392221:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e4394994f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.392227:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb11c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129753.392230:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e4394994f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.392236:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e4394994f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.392252:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009b251600) 00010000:00010000:1.0:1746129753.392255:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129753.392258:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e4394994f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.392263:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e4394994f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.392304:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11a00/0x48868a4e43949941 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f826 expref: 12 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129753.392317:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x48868a4e43949956 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f826 expref: 11 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129753.392322:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129753.392324:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129753.392327:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:1.0:1746129753.393105:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:28648:x1830949052230912:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3830us (3963us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129753.393114:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9897 00000100:00100000:0.0:1746129753.396456:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.398276:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949052230784:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8488us (13804us total) trans 0 rc 770048/770048 00000100:00100000:2.0:1746129753.398287:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4122 00002000:00100000:2.0:1746129753.398297:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880094d8f800 x1830949052230784/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/440 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.398305:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8f800 with x1830949052230784 ext(4194304->4964351) 00002000:00010000:2.0:1746129753.398310:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8f800 00000100:00100000:1.0:1746129753.398477:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052231168 00000100:00100000:1.0:1746129753.398484:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052231168 00000100:00100000:1.0:1746129753.398514:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9898 00000100:00100000:1.0:1746129753.398519:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28646:x1830949052231168:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129753.398535:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129753.398550:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11000/0x48868a4e4394995d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f82d expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129753.398681:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.398736:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.398801:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052231296 00000100:00100000:3.0:1746129753.398805:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052231296 00000100:00100000:3.0:1746129753.398825:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052231424 00000100:00100000:2.0:1746129753.398883:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11018 00000100:00100000:2.0:1746129753.398890:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052231296:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129753.398898:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.398906:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801360b3600/0x48868a4e43949964 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f834 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.398918:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129753.398920:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746129753.398926:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052231424 00010000:00010000:2.0:1746129753.398928:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801360b3600/0x48868a4e43949964 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f834 expref: 12 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.398940:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801360b3600/0x48868a4e43949964 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f834 expref: 12 pid: 7975 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129753.398949:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11019 00010000:00010000:2.0:1746129753.398949:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801360b3600, rc 0) 00000100:00100000:3.0:1746129753.398953:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052231424:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129753.398960:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129753.398966:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+12:1964:x1830949052231296:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 78us (286us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129753.398968:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf04600/0x48868a4e4394996b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f83b expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129753.398971:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11018 00010000:00010000:3.0:1746129753.398978:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.398979:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.398983:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf04600/0x48868a4e4394996b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f83b expref: 12 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.398993:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bf04600/0x48868a4e4394996b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f83b expref: 12 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.398999:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf04600, rc 0) 00000100:00100000:3.0:1746129753.399015:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+12:1964:x1830949052231424:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 62us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129753.399020:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11019 00000100:00080000:0.0:1746129753.399073:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1746129753.399401:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e43949972 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.399412:0:14314:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a149600/0x48868a4e439498c3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7d9 expref: 14 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129753.399419:0:14314:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4c00/0x48868a4e439498ed lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7e7 expref: 288 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129753.399425:0:14314:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x48868a4e43949956 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f826 expref: 10 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129753.399430:0:14314:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e43949972 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.399454:0:14314:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x48868a4e43949956 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f826 expref: 10 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129753.399464:0:14314:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x48868a4e43949956 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f826 expref: 10 pid: 14314 timeout: 799 lvb_type: 0 00000100:00100000:1.0:1746129753.399474:0:14314:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053319552:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129753.399547:0:14314:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4c00/0x48868a4e439498ed lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7e7 expref: 288 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129753.399555:0:14314:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4c00/0x48868a4e439498ed lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7e7 expref: 288 pid: 14314 timeout: 799 lvb_type: 0 00000100:00100000:1.0:1746129753.399567:0:14314:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4dd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053319680:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129753.399594:0:14314:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a149600/0x48868a4e439498c3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7d9 expref: 14 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129753.399601:0:14314:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a149600/0x48868a4e439498c3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7d9 expref: 14 pid: 14314 timeout: 799 lvb_type: 0 00000100:00100000:1.0:1746129753.399608:0:14314:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053319808:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129753.399623:0:14314:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129753.403758:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129753.405318:0:14314:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053319552:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129753.405328:0:14314:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053319808:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129753.405388:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052231680 00000100:00100000:2.0:1746129753.405393:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052231680 00000100:00100000:2.0:1746129753.405585:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9899 00000100:00100000:2.0:1746129753.405593:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:28648:x1830949052231680:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129753.405609:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.405622:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f200/0x48868a4e43949979 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f842 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.405698:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fc00/0x48868a4e43949980 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.405709:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fc00/0x48868a4e43949980 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.405716:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fc00/0x48868a4e43949980 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000100:00100000:0.0:1746129753.405925:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.406013:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052231808 00000100:00100000:3.0:1746129753.406017:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052231808 00010000:00010000:3.0:1746129753.406037:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a149600/0x48868a4e439498c3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7d9 expref: 15 pid: 14314 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746129753.406054:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5300 00000100:00100000:3.0:1746129753.406059:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1961:x1830949052231808:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129753.406066:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129753.406071:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a149600/0x48868a4e439498c3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7d9 expref: 15 pid: 14314 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746129753.406079:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a149600/0x48868a4e439498c3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7d9 expref: 15 pid: 14314 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746129753.406095:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a149600/0x48868a4e439498c3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7d9 expref: 15 pid: 14314 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746129753.406119:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129753.406124:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e43949972 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129753.406129:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e43949972 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129753.406134:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129753.406170:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949052231808:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 110us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129753.406176:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5300 00000100:00100000:1.0:1746129753.406944:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129753.406962:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052232064 00000100:00100000:1.0:1746129753.406965:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052232064 00010000:00010000:1.0:1746129753.406977:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4c00/0x48868a4e439498ed lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7e7 expref: 289 pid: 14314 timeout: 799 lvb_type: 0 00000100:00100000:1.0:1746129753.406990:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5301 00000100:00100000:1.0:1746129753.406994:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:1963:x1830949052232064:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129753.407001:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129753.407004:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4c00/0x48868a4e439498ed lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7e7 expref: 289 pid: 14314 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746129753.407010:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4c00/0x48868a4e439498ed lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7e7 expref: 289 pid: 14314 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746129753.407021:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129753.407024:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e43949972 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.407029:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e43949972 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.407032:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129753.407048:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:1963:x1830949052232064:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 53us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129753.407052:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5301 00010000:00010000:0.0:1746129753.407152:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49b4c00/0x48868a4e439498ed lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7e7 expref: 288 pid: 14314 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746129753.407165:0:14314:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4dd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053319680:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129753.407181:0:14314:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e43949972 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000100:00100000:0.0:1746129753.407966:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.408118:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052231936 00000100:00100000:2.0:1746129753.408123:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052231936 00010000:00010000:2.0:1746129753.408139:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x48868a4e43949956 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f826 expref: 13 pid: 14314 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746129753.408163:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5302 00000100:00100000:2.0:1746129753.408168:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949052231936:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129753.408174:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129753.408178:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x48868a4e43949956 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f826 expref: 13 pid: 14314 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746129753.408184:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x48868a4e43949956 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f826 expref: 13 pid: 14314 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746129753.408196:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x48868a4e43949956 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f826 expref: 13 pid: 14314 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746129753.408220:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129753.408223:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e43949972 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.408229:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e43949972 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.408235:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e43949972 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.408240:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fc00/0x48868a4e43949980 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.408244:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fc00/0x48868a4e43949980 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.408248:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fc00/0x48868a4e43949980 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.408271:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129753.408293:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949052231936:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 124us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129753.408298:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5302 00010000:00010000:1.0:1746129753.408402:0:14314:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e43949972 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.408407:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e43949972 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:1.0:1746129753.408421:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129753.408531:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11000/0x48868a4e4394995d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f82d expref: 15 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129753.408545:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e43949972 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f82d expref: 14 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129753.408550:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129753.408552:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129753.408554:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f907000, rc 0) 00000100:00100000:1.0:1746129753.408576:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28646:x1830949052231168:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 10057us (12127us total) trans 8589943683 rc 0/0 00000100:00100000:1.0:1746129753.408584:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9898 00010000:00010000:3.0:1746129753.408678:0:15044:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fc00/0x48868a4e43949980 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129753.408684:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fc00/0x48868a4e43949980 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:3.0:1746129753.408698:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129753.408751:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f200/0x48868a4e43949979 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f842 expref: 13 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.408760:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fc00/0x48868a4e43949980 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f842 expref: 12 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.408770:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129753.408772:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129753.408773:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f98fc00, rc 0) 00000100:00100000:3.0:1746129753.408791:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+12:28648:x1830949052231680:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3200us (5041us total) trans 8589943684 rc 0/0 00000100:00100000:3.0:1746129753.408795:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9899 00000100:00100000:0.0:1746129753.413249:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.413425:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052232192 00000100:00100000:3.0:1746129753.413433:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052232192 00000100:00100000:3.0:1746129753.413482:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9900 00000100:00100000:3.0:1746129753.413489:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+12:28648:x1830949052232192:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129753.413513:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129753.413528:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05600/0x48868a4e43949995 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f849 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.413589:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4394999c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129753.413600:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e43949972 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f82d expref: 13 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.413605:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fc00/0x48868a4e43949980 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f842 expref: 13 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.413609:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4394999c lrc: 5/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129753.413634:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fc00/0x48868a4e43949980 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f842 expref: 13 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.413643:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fc00/0x48868a4e43949980 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f842 expref: 13 pid: 15044 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746129753.413653:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053319936:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129753.413744:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e43949972 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f82d expref: 13 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.413750:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e43949972 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f82d expref: 13 pid: 14314 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746129753.413756:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053320064:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129753.413774:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129753.420543:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129753.420589:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052232448 00000100:00100000:1.0:1746129753.420595:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052232448 00000100:00100000:0.0:1746129753.420617:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129753.420621:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e43949972 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f82d expref: 14 pid: 14314 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746129753.420659:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052232320 00000100:00100000:2.0:1746129753.420663:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052232320 00010000:00010000:2.0:1746129753.420676:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fc00/0x48868a4e43949980 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f842 expref: 14 pid: 15044 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746129753.420698:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5303 00000100:00100000:2.0:1746129753.420704:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1ae8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+14:1964:x1830949052232320:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129753.420718:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129753.420723:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fc00/0x48868a4e43949980 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f842 expref: 14 pid: 15044 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746129753.420732:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fc00/0x48868a4e43949980 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f842 expref: 14 pid: 15044 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746129753.420749:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fc00/0x48868a4e43949980 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f842 expref: 14 pid: 15044 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746129753.420763:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129753.420767:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4394999c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.420773:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4394999c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.420778:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4394999c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.420782:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129753.420817:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1ae8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+13:1964:x1830949052232320:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 111us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129753.420823:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5303 00000100:00100000:1.0:1746129753.420911:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5304 00000100:00100000:1.0:1746129753.420917:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1964:x1830949052232448:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129753.420924:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129753.420928:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e43949972 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f82d expref: 14 pid: 14314 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746129753.420937:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e43949972 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f82d expref: 14 pid: 14314 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746129753.420947:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129753.420949:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4394999c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129753.420955:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4394999c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129753.420960:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4394999c lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129753.420972:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129753.420993:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1964:x1830949052232448:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 76us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129753.420998:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5304 00000100:00100000:3.0:1746129753.421120:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053319936:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129753.421136:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e43949972 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f82d expref: 13 pid: 14314 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746129753.421731:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053320064:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129753.421748:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4394999c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129753.421756:0:15044:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4394999c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129753.421760:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4394999c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:3.0:1746129753.421793:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:3.0:1746129753.421796:0:15044:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129753.421807:0:15044:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4394999c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129753.421830:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05600/0x48868a4e43949995 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f849 expref: 13 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.421840:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4394999c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f849 expref: 12 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.421844:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129753.421862:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129753.421864:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf05000, rc 0) 00000100:00100000:3.0:1746129753.421887:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+12:28648:x1830949052232192:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 8399us (8647us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129753.421892:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9900 00000100:00100000:0.0:1746129753.428804:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.428916:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052232704 00000100:00100000:3.0:1746129753.428923:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052232704 00000100:00100000:3.0:1746129753.428972:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9901 00000100:00100000:3.0:1746129753.428979:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+12:28648:x1830949052232704:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129753.428996:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129753.429010:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05c00/0x48868a4e439499a3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f850 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.429084:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e439499aa lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129753.429095:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e439499aa lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129753.429105:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e439499aa lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129753.429116:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e439499aa lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129753.429121:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e439499aa lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129753.429126:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e439499aa lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129753.429131:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bf04200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129753.429134:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e439499aa lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129753.429139:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e439499aa lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129753.429147:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129753.429150:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129753.429153:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e439499aa lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129753.429157:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e439499aa lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129753.429178:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05c00/0x48868a4e439499a3 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f850 expref: 13 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.429184:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05c00/0x48868a4e439499a3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f850 expref: 13 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.429190:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf05c00, rc 0) 00000100:00100000:3.0:1746129753.429226:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+12:28648:x1830949052232704:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 248us (430us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129753.429232:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9901 00000100:00100000:0.0:1746129753.431490:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.432457:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.433100:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052232832 00000100:00100000:3.0:1746129753.433108:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052232832 00000100:00100000:3.0:1746129753.433143:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11020 00000100:00100000:3.0:1746129753.433150:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:28646:x1830949052232832:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129753.433165:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129753.433178:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e439499b1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f857 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.433200:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5600/0x48868a4e43949925 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f80a expref: 31 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.433208:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801360b3600/0x48868a4e43949964 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f834 expref: 11 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.433214:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2800/0x48868a4e4394992c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f811 expref: 23 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.433220:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.433221:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.433224:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e439499b1 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4128768->4194303] (req 4128768->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f857 expref: 23 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.433247:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2800/0x48868a4e4394992c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f811 expref: 23 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.433262:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2800/0x48868a4e4394992c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f811 expref: 23 pid: 4589 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746129753.433272:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053320192:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129753.433349:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801360b3600/0x48868a4e43949964 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f834 expref: 11 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.433357:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801360b3600/0x48868a4e43949964 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f834 expref: 11 pid: 7975 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746129753.433375:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053320320:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129753.433397:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5600/0x48868a4e43949925 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f80a expref: 31 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.433405:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5600/0x48868a4e43949925 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f80a expref: 31 pid: 7975 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746129753.433412:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131460a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053320448:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129753.433425:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129753.433717:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052233088 00000100:00100000:2.0:1746129753.433721:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052233088 00000100:00100000:2.0:1746129753.433745:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3894 00000100:00100000:2.0:1746129753.433750:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6141239f-0c60-480d-830c-e22ba61457b0+12:28648:x1830949052233088:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:2.0:1746129753.433911:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6141239f-0c60-480d-830c-e22ba61457b0+13:28648:x1830949052233088:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 159us (1455us total) trans 8589943685 rc 0/0 00000100:00100000:2.0:1746129753.433917:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3894 00000100:00100000:0.0:1746129753.436524:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.436613:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053320192:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129753.436622:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053320320:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129753.436629:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131460a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053320448:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129753.436655:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e439499b1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4128768->4194303] (req 4128768->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f857 expref: 23 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.436670:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf04800, rc 0) 00000100:00100000:3.0:1746129753.436700:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:28646:x1830949052232832:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3551us (5215us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129753.436707:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11020 00000100:00100000:1.0:1746129753.436777:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052233216 00000100:00100000:1.0:1746129753.436783:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052233216 00010000:00010000:1.0:1746129753.436802:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801360b3600/0x48868a4e43949964 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f834 expref: 12 pid: 7975 timeout: 799 lvb_type: 1 00000100:00100000:1.0:1746129753.437318:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5305 00000100:00100000:1.0:1746129753.437325:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949052233216:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129753.437335:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129753.437352:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801360b3600/0x48868a4e43949964 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f834 expref: 12 pid: 7975 timeout: 799 lvb_type: 1 00010000:00010000:1.0:1746129753.437360:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801360b3600/0x48868a4e43949964 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f834 expref: 12 pid: 7975 timeout: 799 lvb_type: 1 00010000:00010000:1.0:1746129753.437388:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801360b3600/0x48868a4e43949964 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f834 expref: 12 pid: 7975 timeout: 799 lvb_type: 1 00010000:00010000:1.0:1746129753.437400:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129753.437415:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052233216:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 91us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129753.437420:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5305 00000100:00100000:0.0:1746129753.438352:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.438417:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052233344 00000100:00100000:2.0:1746129753.438422:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052233344 00010000:00010000:2.0:1746129753.438439:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2800/0x48868a4e4394992c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f811 expref: 23 pid: 4589 timeout: 799 lvb_type: 1 00000100:00100000:2.0:1746129753.438456:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5306 00000100:00100000:2.0:1746129753.438462:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1962:x1830949052233344:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129753.438470:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129753.438480:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2800/0x48868a4e4394992c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f811 expref: 23 pid: 4589 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746129753.438487:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2800/0x48868a4e4394992c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f811 expref: 23 pid: 4589 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746129753.438499:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2800/0x48868a4e4394992c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f811 expref: 23 pid: 4589 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746129753.438509:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129753.438529:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052233344:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 68us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129753.438533:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5306 00000100:00100000:0.0:1746129753.443428:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.443515:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052233472 00000100:00100000:2.0:1746129753.443523:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052233472 00010000:00010000:2.0:1746129753.443550:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5600/0x48868a4e43949925 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f80a expref: 32 pid: 7975 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746129753.443580:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5307 00000100:00100000:2.0:1746129753.443587:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1963:x1830949052233472:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129753.443598:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129753.443617:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5600/0x48868a4e43949925 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f80a expref: 32 pid: 7975 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746129753.443628:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5600/0x48868a4e43949925 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f80a expref: 32 pid: 7975 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746129753.443645:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5600/0x48868a4e43949925 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f80a expref: 32 pid: 7975 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746129753.443656:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129753.443658:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129753.443677:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e439499b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f857 expref: 21 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.443685:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e439499b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f857 expref: 21 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.443711:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e439499b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f857 expref: 21 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129753.443721:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c042680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053320576:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129753.444728:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129753.446781:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.446864:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052233728 00000100:00100000:2.0:1746129753.446870:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052233728 00000100:00100000:2.0:1746129753.446909:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9902 00000100:00100000:2.0:1746129753.446914:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:28651:x1830949052233728:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129753.446933:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.446945:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e400/0x48868a4e439499b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f85e expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.447027:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98ea00/0x48868a4e439499bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.447036:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98ea00/0x48868a4e439499bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.447045:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98ea00/0x48868a4e439499bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.447054:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fc00/0x48868a4e439499c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.447059:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fc00/0x48868a4e439499c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.447068:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fc00/0x48868a4e439499c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.448254:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f200/0x48868a4e439499cd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.448265:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f200/0x48868a4e439499cd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.448272:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f200/0x48868a4e439499cd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:2.0:1746129753.448284:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129753.448828:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98ea00/0x48868a4e439499bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.448835:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98ea00/0x48868a4e439499bf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.448841:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98ea00/0x48868a4e439499bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00000100:00100000:0.0:1746129753.449324:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129753.449384:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f98ea00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129753.449389:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98ea00/0x48868a4e439499bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.449395:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98ea00/0x48868a4e439499bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.449405:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129753.449408:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129753.449411:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98ea00/0x48868a4e439499bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.449415:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98ea00/0x48868a4e439499bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.449426:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fc00/0x48868a4e439499c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.449430:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fc00/0x48868a4e439499c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.449435:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fc00/0x48868a4e439499c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.449443:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f98fc00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129753.449445:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fc00/0x48868a4e439499c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.449449:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fc00/0x48868a4e439499c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.449455:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f888800) 00010000:00010000:2.0:1746129753.449457:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129753.449459:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fc00/0x48868a4e439499c6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.449463:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fc00/0x48868a4e439499c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.449499:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e400/0x48868a4e439499b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f85e expref: 291 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.449510:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f200/0x48868a4e439499cd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f85e expref: 290 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.449516:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129753.449517:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129753.449519:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f98f200, rc 0) 00000100:00100000:2.0:1746129753.449559:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:28651:x1830949052233728:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2644us (2782us total) trans 8589943686 rc 0/0 00000100:00100000:2.0:1746129753.449566:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9902 00000100:00100000:2.0:1746129753.449593:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052233984 00000100:00100000:2.0:1746129753.449597:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052233984 00002000:00100000:2.0:1746129753.449622:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4128768->4132863) req@ffff880094d8ca80 x1830949052233984/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.449631:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8ca80 with x1830949052233984 ext(4128768->4132863) 00002000:00010000:2.0:1746129753.449634:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8ca80 00000100:00100000:2.0:1746129753.449647:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4123 00000100:00100000:2.0:1746129753.449652:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052233984:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129753.449751:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052233984:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 98us (429us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129753.449757:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4123 00002000:00100000:2.0:1746129753.449762:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4128768->4132863) req@ffff880094d8ca80 x1830949052233984/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/4536 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.449768:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8ca80 with x1830949052233984 ext(4128768->4132863) 00002000:00010000:2.0:1746129753.449771:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8ca80 00000100:00100000:3.0:1746129753.449841:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c042680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053320576:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129753.449872:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129753.449911:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949052233472:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6324us (6490us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129753.449918:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5307 00000100:00100000:0.0:1746129753.452411:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.452477:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052234112 00000100:00100000:3.0:1746129753.452483:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052234112 00000100:00100000:3.0:1746129753.452515:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11021 00000100:00100000:3.0:1746129753.452521:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:28646:x1830949052234112:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129753.452533:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129753.452548:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e439499db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f865 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.452570:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ec00/0x48868a4e4394993a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f81f expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.452577:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf04600/0x48868a4e4394996b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f83b expref: 11 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.452588:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.452589:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.452592:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e439499db lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->3436543] (req 3145728->3436543) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f865 expref: 21 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.452614:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bf04600/0x48868a4e4394996b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f83b expref: 11 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.452624:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bf04600/0x48868a4e4394996b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f83b expref: 11 pid: 4589 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746129753.452634:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131460a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053320704:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129753.453391:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ec00/0x48868a4e4394993a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f81f expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.453402:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ec00/0x48868a4e4394993a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f81f expref: 21 pid: 4589 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746129753.453411:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053320832:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129753.453447:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129753.458921:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.459229:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052234240 00000100:00100000:2.0:1746129753.459237:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052234240 00010000:00010000:2.0:1746129753.459267:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf04600/0x48868a4e4394996b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f83b expref: 12 pid: 4589 timeout: 799 lvb_type: 1 00000100:00100000:2.0:1746129753.459294:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5308 00000100:00100000:2.0:1746129753.459301:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949052234240:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129753.459314:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129753.459333:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bf04600/0x48868a4e4394996b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f83b expref: 12 pid: 4589 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746129753.459343:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bf04600/0x48868a4e4394996b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f83b expref: 12 pid: 4589 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746129753.459362:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129753.459406:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949052234240:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 105us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129753.459411:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5308 00010000:00010000:3.0:1746129753.459499:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf04600/0x48868a4e4394996b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f83b expref: 11 pid: 4589 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746129753.459514:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131460a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053320704:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129753.462244:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053320832:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129753.462280:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e439499db lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->3436543] (req 3145728->3436543) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f865 expref: 21 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.462297:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf04400, rc 0) 00000100:00100000:3.0:1746129753.462351:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:28646:x1830949052234112:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 9827us (9943us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129753.462358:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11021 00000100:00100000:0.0:1746129753.464292:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129753.465294:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052234368 00000100:00100000:1.0:1746129753.465304:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052234368 00010000:00010000:1.0:1746129753.465338:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ec00/0x48868a4e4394993a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f81f expref: 21 pid: 4589 timeout: 799 lvb_type: 0 00000100:00100000:1.0:1746129753.465389:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5309 00000100:00100000:1.0:1746129753.465399:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1963:x1830949052234368:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129753.465415:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129753.465436:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ec00/0x48868a4e4394993a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f81f expref: 21 pid: 4589 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746129753.465447:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ec00/0x48868a4e4394993a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f81f expref: 21 pid: 4589 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746129753.465469:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ec00/0x48868a4e4394993a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f81f expref: 21 pid: 4589 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746129753.465498:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129753.465500:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129753.465508:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e439499db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f865 expref: 20 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129753.465516:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e439499db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f865 expref: 20 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129753.465553:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e439499db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f865 expref: 20 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129753.465567:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053320960:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129753.465673:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129753.472564:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.472730:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052234624 00000100:00100000:3.0:1746129753.472738:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052234624 00002000:00100000:3.0:1746129753.472774:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3432448->3436543) req@ffff88012c040a80 x1830949052234624/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129753.472784:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c040a80 with x1830949052234624 ext(3432448->3436543) 00002000:00010000:3.0:1746129753.472788:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c040a80 00000100:00100000:3.0:1746129753.472806:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4124 00000100:00100000:3.0:1746129753.472813:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1962:x1830949052234624:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129753.472939:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053320960:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129753.472954:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129753.472988:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1963:x1830949052234368:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7592us (8705us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129753.472996:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5309 00000100:00100000:3.0:1746129753.473545:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949052234624:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 729us (1025us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129753.473550:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4124 00002000:00100000:3.0:1746129753.473556:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3432448->3436543) req@ffff88012c040a80 x1830949052234624/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/4536 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129753.473563:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c040a80 with x1830949052234624 ext(3432448->3436543) 00002000:00010000:3.0:1746129753.473565:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c040a80 00000100:00100000:0.0:1746129753.478995:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.479175:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052234880 00000100:00100000:3.0:1746129753.479184:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052234880 00000100:00100000:3.0:1746129753.483428:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3895 00000100:00100000:3.0:1746129753.483450:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28646:x1830949052234880:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129753.483769:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28646:x1830949052234880:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 325us (4777us total) trans 8589943687 rc 0/0 00000100:00100000:3.0:1746129753.483776:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3895 00000100:00100000:0.0:1746129753.544469:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.544531:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052235136 00000100:00100000:2.0:1746129753.544539:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052235136 00000100:00100000:2.0:1746129753.544590:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9903 00000100:00100000:2.0:1746129753.544597:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28656:x1830949052235136:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129753.544617:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.544631:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fa00/0x48868a4e439499e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f86c expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.544711:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e200/0x48868a4e439499e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.544722:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e200/0x48868a4e439499e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.544730:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e200/0x48868a4e439499e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.544740:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f400/0x48868a4e439499f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.544745:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f400/0x48868a4e439499f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.544750:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f400/0x48868a4e439499f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.544833:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e400/0x48868a4e439499f7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.544840:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e400/0x48868a4e439499f7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.544877:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e400/0x48868a4e439499f7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:2.0:1746129753.544886:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129753.544953:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e200/0x48868a4e439499e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.544958:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e200/0x48868a4e439499e9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.544963:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e200/0x48868a4e439499e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.544968:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f98e200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129753.544971:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e200/0x48868a4e439499e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.544976:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e200/0x48868a4e439499e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.544985:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129753.544987:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129753.544991:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e200/0x48868a4e439499e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.544995:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e200/0x48868a4e439499e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.545021:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f400/0x48868a4e439499f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.545026:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f400/0x48868a4e439499f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.545030:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f400/0x48868a4e439499f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.545034:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f98f400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129753.545036:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f400/0x48868a4e439499f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.545040:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f400/0x48868a4e439499f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.545046:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f888800) 00010000:00010000:2.0:1746129753.545048:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129753.545050:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f400/0x48868a4e439499f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.545054:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f400/0x48868a4e439499f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.545085:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98fa00/0x48868a4e439499e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f86c expref: 17 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.545095:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e400/0x48868a4e439499f7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f86c expref: 16 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.545100:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129753.545102:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129753.545104:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f98e400, rc 0) 00000100:00100000:2.0:1746129753.545152:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28656:x1830949052235136:12345-192.168.204.31@tcp:101:cat.0 Request processed in 555us (688us total) trans 8589943688 rc 0/0 00000100:00100000:2.0:1746129753.545158:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9903 00000100:00100000:0.0:1746129753.554971:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.555628:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052235392 00000100:00100000:2.0:1746129753.555638:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052235392 00000100:00100000:2.0:1746129753.556903:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3896 00000100:00100000:2.0:1746129753.556917:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28656:x1830949052235392:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129753.564110:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28656:x1830949052235392:12345-192.168.204.31@tcp:35:cat.0 Request processed in 7187us (9135us total) trans 8589943689 rc 0/0 00000100:00100000:2.0:1746129753.564121:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3896 00000100:00100000:0.0:1746129753.571301:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.571591:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.572354:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052235520 00000100:00100000:3.0:1746129753.572373:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052235520 00000100:00100000:3.0:1746129753.572435:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052235648 00000100:00100000:3.0:1746129753.572437:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052235648 00000100:00100000:3.0:1746129753.572453:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11022 00000100:00100000:3.0:1746129753.572460:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949052235520:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129753.572477:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129753.572491:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf04a00/0x48868a4e43949a05 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f873 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129753.572515:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11023 00000100:00100000:2.0:1746129753.572521:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1964:x1830949052235648:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129753.572528:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129753.572530:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053321088:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129753.572534:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f98f600/0x48868a4e43949a0c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f87a expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129753.572554:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c043100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053321216:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129753.572594:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129753.572810:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1600 going to sleep for 11 seconds 00002000:00010000:2.0:1746129753.576673:0:7975:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime: 1746129753 -> 1746129754 00002000:00010000:2.0:1746129753.576679:0:7975:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746129753 -> 1746129754 00002000:00010000:2.0:1746129753.576681:0:7975:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime: 1746129753 -> 1746129754 00000100:00100000:2.0:1746129753.576702:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c043100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053321216:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129753.577086:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f98f600/0x48868a4e43949a0c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f87a expref: 23 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.577101:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f98f600/0x48868a4e43949a0c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f87a expref: 23 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.577114:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f98f600, rc 0) 00002000:00010000:3.0:1746129753.577799:0:7976:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime: 1746129753 -> 1746129754 00002000:00010000:3.0:1746129753.577803:0:7976:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime: 1746129753 -> 1746129754 00002000:00010000:3.0:1746129753.577805:0:7976:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime: 1746129753 -> 1746129754 00000100:00100000:3.0:1746129753.577820:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053321088:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129753.577838:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bf04a00/0x48868a4e43949a05 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f873 expref: 32 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.577866:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bf04a00/0x48868a4e43949a05 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f873 expref: 32 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.577880:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf04a00, rc 0) 00000100:00100000:2.0:1746129753.578268:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1964:x1830949052235648:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5744us (6675us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129753.578276:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11023 00000100:00100000:3.0:1746129753.578339:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949052235520:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5878us (7045us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129753.578344:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11022 00000100:00100000:0.0:1746129753.588829:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.588892:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.588925:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.588958:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052235904 00000100:00100000:0.0:1746129753.588965:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052235904 00002000:00100000:0.0:1746129753.588999:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a8fd0a80 x1830949052235904/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129753.589007:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd0a80 with x1830949052235904 ext(2097152->3145727) 00002000:00010000:0.0:1746129753.589012:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8fd0a80 00000100:00100000:0.0:1746129753.589030:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052236160 00000100:00100000:0.0:1746129753.589032:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052236160 00002000:00100000:0.0:1746129753.589040:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4128767) req@ffff8800a8fd0700 x1830949052236160/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129753.589045:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd0700 with x1830949052236160 ext(3145728->4128767) 00002000:00010000:0.0:1746129753.589047:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8fd0700 00000100:00100000:0.0:1746129753.589053:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052236416 00000100:00100000:0.0:1746129753.589055:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052236416 00002000:00100000:0.0:1746129753.589064:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800a8fd3800 x1830949052236416/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129753.589069:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd3800 with x1830949052236416 ext(2097152->3145727) 00002000:00010000:0.0:1746129753.589071:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8fd3800 00000100:00100000:0.0:1746129753.589081:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4125 00000100:00100000:0.0:1746129753.589086:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1961:x1830949052235904:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129753.590904:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4126 00000100:00100000:2.0:1746129753.590915:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1961:x1830949052236160:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129753.591914:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4127 00000100:00100000:2.0:1746129753.591923:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949052236416:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129753.597055:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.597077:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.597108:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.597141:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.597169:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052236800 00000100:00100000:0.0:1746129753.597176:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052236800 00000100:00100000:0.0:1746129753.597204:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052237056 00000100:00100000:0.0:1746129753.597205:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052237056 00000100:00100000:0.0:1746129753.597214:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052236928 00000100:00100000:0.0:1746129753.597215:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052236928 00000100:00100000:0.0:1746129753.597228:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11024 00000100:00100000:0.0:1746129753.597234:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:28651:x1830949052236800:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129753.597249:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129753.597264:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f907000/0x48868a4e43949a13 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f881 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.597288:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f000/0x48868a4e4394978f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f746 expref: 24 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129753.597297:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f906000/0x48868a4e43949806 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f77e expref: 21 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129753.597303:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e439497c0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f72a expref: 10 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129753.597309:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129753.597311:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129753.597314:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f907000/0x48868a4e43949a13 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1990656->2097151] (req 1990656->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f881 expref: 24 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.597341:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e439497c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f72a expref: 10 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129753.597351:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e439497c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f72a expref: 10 pid: 3623 timeout: 799 lvb_type: 1 00000100:00100000:0.0:1746129753.597371:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094768000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053321344:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129753.597441:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f906000/0x48868a4e43949806 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f77e expref: 21 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129753.597449:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f906000/0x48868a4e43949806 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f77e expref: 21 pid: 10930 timeout: 799 lvb_type: 1 00000100:00100000:2.0:1746129753.597451:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11025 00000100:00100000:0.0:1746129753.597456:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009476aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053321472:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129753.597458:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1964:x1830949052237056:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129753.597464:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.597471:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f98f600/0x48868a4e43949a1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f88f expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.597480:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f000/0x48868a4e4394978f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f746 expref: 25 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129753.597486:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f000/0x48868a4e4394978f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f746 expref: 25 pid: 1140 timeout: 799 lvb_type: 1 00000100:00100000:2.0:1746129753.597492:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c043100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053321728:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129753.597492:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094768e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053321600:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129753.597506:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce780 going to sleep for 11 seconds 00000100:00100000:2.0:1746129753.597507:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129753.597527:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11026 00000100:00100000:2.0:1746129753.597532:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949052236928:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129753.597538:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.597715:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f98f800/0x48868a4e43949a21 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f888 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129753.597739:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c042a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053321856:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129753.597764:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129753.600566:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052236544 00000100:00100000:1.0:1746129753.600576:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052236544 00002000:00100000:1.0:1746129753.600609:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3436544->4194303) req@ffff8800a8fd2680 x1830949052236544/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129753.600618:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd2680 with x1830949052236544 ext(3436544->4194303) 00002000:00010000:1.0:1746129753.600623:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8fd2680 00000100:00100000:1.0:1746129753.602607:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4128 00000100:00100000:1.0:1746129753.602620:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052236544:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129753.606192:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1961:x1830949052235904:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17095us (17360us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129753.606206:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4125 00002000:00100000:0.0:1746129753.606215:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a8fd0a80 x1830949052235904/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/440 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129753.606223:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd0a80 with x1830949052235904 ext(2097152->3145727) 00002000:00010000:0.0:1746129753.606228:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8fd0a80 00000100:00100000:0.0:1746129753.606752:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094768000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053321344:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129753.606823:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009476aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053321472:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129753.606864:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094768e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053321600:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129753.606888:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f907000/0x48868a4e43949a13 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1990656->2097151] (req 1990656->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f881 expref: 25 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.606901:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f907000, rc 0) 00000100:00100000:0.0:1746129753.606918:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:28651:x1830949052236800:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 9685us (9840us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129753.606924:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11024 00000100:00100000:3.0:1746129753.607951:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c043100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053321728:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129753.607970:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f98f600/0x48868a4e43949a1a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f88f expref: 24 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.607979:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f98f600/0x48868a4e43949a1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f88f expref: 24 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.607992:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f98f600, rc 0) 00000100:00100000:3.0:1746129753.608014:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949052237056:12345-192.168.204.31@tcp:101:cat.0 Request processed in 10556us (10905us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129753.608020:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11025 00000100:00100000:0.0:1746129753.610149:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.610770:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.610800:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.610819:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052237184 00000100:00100000:0.0:1746129753.610826:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052237184 00000100:00100000:2.0:1746129753.610838:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052237312 00000100:00100000:2.0:1746129753.610843:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052237312 00010000:00010000:0.0:1746129753.610874:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e439497c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f72a expref: 11 pid: 3623 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746129753.610878:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f906000/0x48868a4e43949806 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f77e expref: 24 pid: 10930 timeout: 799 lvb_type: 1 00000100:00100000:0.0:1746129753.610896:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052237440 00000100:00100000:0.0:1746129753.610899:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052237440 00000100:00100000:2.0:1746129753.610905:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5310 00010000:00010000:0.0:1746129753.610909:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f000/0x48868a4e4394978f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f746 expref: 23 pid: 1140 timeout: 799 lvb_type: 1 00000100:00100000:2.0:1746129753.610912:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052237184:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129753.610922:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129753.610923:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5311 00000100:00100000:3.0:1746129753.610931:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1ae8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1961:x1830949052237312:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129753.610933:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5312 00010000:00010000:2.0:1746129753.610938:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e439497c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f72a expref: 11 pid: 3623 timeout: 799 lvb_type: 1 00010000:00010000:3.0:1746129753.610939:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129753.610940:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949052237440:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129753.610946:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e439497c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f72a expref: 11 pid: 3623 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746129753.610950:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129753.610956:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f906000/0x48868a4e43949806 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f77e expref: 24 pid: 10930 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746129753.610965:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e439497c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f72a expref: 11 pid: 3623 timeout: 799 lvb_type: 1 00010000:00010000:3.0:1746129753.610966:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f906000/0x48868a4e43949806 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f77e expref: 24 pid: 10930 timeout: 799 lvb_type: 1 00010000:00010000:3.0:1746129753.610982:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f906000/0x48868a4e43949806 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f77e expref: 24 pid: 10930 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746129753.610984:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129753.610990:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129753.611015:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052237184:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 103us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129753.611019:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1ae8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1961:x1830949052237312:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 89us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129753.611022:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5310 00000100:00100000:3.0:1746129753.611025:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5311 00000100:00100000:2.0:1746129753.611318:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949052236160:12345-192.168.204.31@tcp:3:cat.0 Request processed in 20405us (22425us total) trans 0 rc 983040/983040 00000100:00100000:2.0:1746129753.611326:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4126 00002000:00100000:2.0:1746129753.611335:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4128767) req@ffff8800a8fd0700 x1830949052236160/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/440 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 983040/983040 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.611343:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd0700 with x1830949052236160 ext(3145728->4128767) 00002000:00010000:2.0:1746129753.611347:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8fd0700 00010000:00010000:0.0:1746129753.611355:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f000/0x48868a4e4394978f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f746 expref: 23 pid: 1140 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746129753.611375:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f000/0x48868a4e4394978f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f746 expref: 23 pid: 1140 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746129753.611387:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f000/0x48868a4e4394978f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f746 expref: 23 pid: 1140 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746129753.611398:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129753.611399:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129753.611405:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f907000/0x48868a4e43949a13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f881 expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.611412:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f907000/0x48868a4e43949a13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f881 expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.611437:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f907000/0x48868a4e43949a13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f881 expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129753.611447:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094768000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053321984:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129753.611472:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c042a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053321856:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129753.611485:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce780 going to sleep for 11 seconds 00010000:00010000:3.0:1746129753.611490:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f98f800/0x48868a4e43949a21 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f888 expref: 32 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.611500:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f98f800/0x48868a4e43949a21 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f888 expref: 32 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.611508:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f98f800, rc 0) 00000100:00100000:3.0:1746129753.611530:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949052236928:12345-192.168.204.31@tcp:101:cat.0 Request processed in 13998us (14388us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129753.611535:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11026 00000100:00100000:2.0:1746129753.617260:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1961:x1830949052236416:12345-192.168.204.31@tcp:3:cat.0 Request processed in 25330us (28324us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129753.617273:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4127 00002000:00100000:2.0:1746129753.617282:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800a8fd3800 x1830949052236416/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/440 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.617292:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd3800 with x1830949052236416 ext(2097152->3145727) 00002000:00010000:2.0:1746129753.617297:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8fd3800 00000100:00100000:0.0:1746129753.621507:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129753.621770:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949052236544:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19151us (24719us total) trans 0 rc 757760/757760 00000100:00100000:1.0:1746129753.621779:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4128 00002000:00100000:1.0:1746129753.621789:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3436544->4194303) req@ffff8800a8fd2680 x1830949052236544/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/440 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 757760/757760 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129753.621797:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd2680 with x1830949052236544 ext(3436544->4194303) 00002000:00010000:1.0:1746129753.621802:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8fd2680 00000100:00100000:3.0:1746129753.622161:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052237696 00000100:00100000:3.0:1746129753.622168:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052237696 00000100:00100000:3.0:1746129753.622204:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11027 00000100:00100000:3.0:1746129753.622211:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:28660:x1830949052237696:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129753.622223:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129753.622237:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf05a00/0x48868a4e43949a28 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f896 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.622261:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e439499b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f857 expref: 21 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.622267:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129753.622268:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129753.622272:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf05a00/0x48868a4e43949a28 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f896 expref: 32 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.622293:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e439499b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f857 expref: 21 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.622303:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e439499b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f857 expref: 21 pid: 7976 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746129753.622311:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053322112:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129753.624833:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129753.625090:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094768000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053321984:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129753.625105:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129753.625156:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1964:x1830949052237440:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 14215us (14353us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129753.625166:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5312 00000100:00100000:0.0:1746129753.626803:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.626873:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.626947:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052237952 00000100:00100000:2.0:1746129753.626954:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052237952 00000100:00100000:2.0:1746129753.626988:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11028 00000100:00100000:2.0:1746129753.626995:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:28651:x1830949052237952:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129753.627009:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.627023:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f98f400/0x48868a4e43949a2f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f89d expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.627047:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6ec00/0x48868a4e43949781 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f74d expref: 34 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.627053:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e055c00/0x48868a4e4394981b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f785 expref: 21 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.627059:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f200/0x48868a4e439497b2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f731 expref: 10 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.627064:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129753.627066:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129753.627068:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f98f400/0x48868a4e43949a2f lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->1753087] (req 1048576->1753087) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f89d expref: 34 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.627092:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f200/0x48868a4e439497b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f731 expref: 10 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.627101:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f200/0x48868a4e439497b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f731 expref: 10 pid: 3623 timeout: 799 lvb_type: 1 00000100:00100000:2.0:1746129753.627111:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c041c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053322240:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129753.627176:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052237824 00000100:00100000:1.0:1746129753.627179:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052237824 00002000:00100000:1.0:1746129753.627201:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880094768000 x1830949052237824/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129753.627271:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094768000 with x1830949052237824 ext(4194304->4964351) 00010000:00010000:1.0:1746129753.627277:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e439499b1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f857 expref: 22 pid: 7976 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746129753.627288:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e439499b1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f857 expref: 22 pid: 7976 timeout: 799 lvb_type: 0 00002000:00010000:1.0:1746129753.627294:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094768000 00000100:00100000:1.0:1746129753.627315:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 600 00000100:00100000:1.0:1746129753.627320:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052237824:12345-192.168.204.31@tcp:3:cat.0 00010000:00010000:2.0:1746129753.628973:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e055c00/0x48868a4e4394981b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f785 expref: 23 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.628984:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e055c00/0x48868a4e4394981b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f785 expref: 23 pid: 20441 timeout: 799 lvb_type: 1 00000100:00100000:2.0:1746129753.628996:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c040700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053322368:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129753.630260:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6ec00/0x48868a4e43949781 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f74d expref: 34 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.630274:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6ec00/0x48868a4e43949781 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f74d expref: 34 pid: 1140 timeout: 799 lvb_type: 1 00000100:00100000:2.0:1746129753.630283:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c040000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053322496:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129753.630313:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129753.633963:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.634045:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052238208 00000100:00100000:2.0:1746129753.634053:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052238208 00000100:00100000:2.0:1746129753.634141:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9904 00000100:00100000:2.0:1746129753.634149:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28662:x1830949052238208:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129753.634168:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.634181:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e600/0x48868a4e43949a36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f8a4 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.634254:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949a3d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.634266:0:14314:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4394999c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f849 expref: 12 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.634272:0:14314:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f200/0x48868a4e439499cd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f85e expref: 289 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.634278:0:14314:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e400/0x48868a4e439499f7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f86c expref: 18 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.634283:0:14314:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949a3d lrc: 6/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.634308:0:14314:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e400/0x48868a4e439499f7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f86c expref: 18 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.634317:0:14314:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e400/0x48868a4e439499f7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f86c expref: 18 pid: 14314 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746129753.634327:0:14314:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c041f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053322624:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129753.635220:0:14314:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f200/0x48868a4e439499cd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f85e expref: 289 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.635229:0:14314:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f200/0x48868a4e439499cd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f85e expref: 289 pid: 14314 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746129753.635237:0:14314:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c041180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053322752:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129753.636248:0:14314:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4394999c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f849 expref: 12 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.636257:0:14314:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4394999c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f849 expref: 12 pid: 15044 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746129753.636265:0:14314:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c040380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053322880:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129753.636311:0:14314:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129753.638242:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.638457:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053322112:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129753.638479:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bf05a00/0x48868a4e43949a28 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f896 expref: 34 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.638493:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf05a00, rc 0) 00000100:00100000:3.0:1746129753.638535:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:28660:x1830949052237696:12345-192.168.204.31@tcp:101:cat.0 Request processed in 16324us (17036us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129753.638543:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11027 00000100:00100000:2.0:1746129753.638909:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c041c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053322240:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129753.638926:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052238336 00000100:00100000:2.0:1746129753.638930:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052238336 00002000:00100000:2.0:1746129753.638961:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4128768->4194303) req@ffff88009476a300 x1830949052238336/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.638970:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476a300 with x1830949052238336 ext(4128768->4194303) 00010000:00010000:2.0:1746129753.638976:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e439499b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f857 expref: 24 pid: 7976 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746129753.638985:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e439499b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f857 expref: 24 pid: 7976 timeout: 799 lvb_type: 0 00002000:00010000:2.0:1746129753.638990:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009476a300 00000100:00100000:2.0:1746129753.639018:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 601 00000100:00100000:1.0:1746129753.639455:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1962:x1830949052237824:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12134us (12657us total) trans 0 rc 770048/770048 00000100:00100000:1.0:1746129753.639462:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 600 00002000:00100000:1.0:1746129753.639467:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880094768000 x1830949052237824/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/440 e 0 to 0 dl 1746129764 ref 1 fl Complete:H/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129753.639474:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094768000 with x1830949052237824 ext(4194304->4964351) 00010000:00010000:1.0:1746129753.639478:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e439499b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f857 expref: 23 pid: 7976 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746129753.639485:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e439499b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f857 expref: 23 pid: 7976 timeout: 799 lvb_type: 0 00002000:00010000:1.0:1746129753.639489:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094768000 00000100:00100000:2.0:1746129753.639535:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052238336:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129753.639823:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.639922:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.639942:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052238464 00000100:00100000:0.0:1746129753.639945:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052238464 00010000:00010000:0.0:1746129753.639960:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f200/0x48868a4e439497b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f731 expref: 11 pid: 3623 timeout: 799 lvb_type: 1 00000100:00100000:0.0:1746129753.639973:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052238976 00000100:00100000:0.0:1746129753.639975:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052238976 00010000:00010000:0.0:1746129753.639982:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e055c00/0x48868a4e4394981b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f785 expref: 24 pid: 20441 timeout: 799 lvb_type: 1 00000100:00100000:0.0:1746129753.639993:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5313 00000100:00100000:0.0:1746129753.639998:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052238464:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129753.640007:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129753.640019:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f200/0x48868a4e439497b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f731 expref: 11 pid: 3623 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746129753.640028:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f200/0x48868a4e439497b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f731 expref: 11 pid: 3623 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746129753.640044:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f200/0x48868a4e439497b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f731 expref: 11 pid: 3623 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746129753.640057:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129753.640074:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052238464:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 76us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129753.640079:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5313 00000100:00100000:0.0:1746129753.640088:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5314 00000100:00100000:0.0:1746129753.640092:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1963:x1830949052238976:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129753.640098:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129753.640104:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e055c00/0x48868a4e4394981b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f785 expref: 24 pid: 20441 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746129753.640110:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e055c00/0x48868a4e4394981b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f785 expref: 24 pid: 20441 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746129753.640119:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129753.640131:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1963:x1830949052238976:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 38us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129753.640134:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5314 00010000:00010000:3.0:1746129753.640371:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e055c00/0x48868a4e4394981b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f785 expref: 23 pid: 20441 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746129753.640395:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c040700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053322368:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129753.644748:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.644798:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.645232:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052238720 00000100:00100000:3.0:1746129753.645239:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052238720 00000100:00100000:3.0:1746129753.645268:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052238592 00000100:00100000:3.0:1746129753.645269:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052238592 00000100:00100000:3.0:1746129753.645294:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11029 00000100:00100000:3.0:1746129753.645301:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1961:x1830949052238720:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129753.645315:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129753.645327:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf04a00/0x48868a4e43949a44 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f8b2 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.645345:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.645353:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bf04a00/0x48868a4e43949a44 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8b2 expref: 24 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.645376:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bf04a00/0x48868a4e43949a44 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8b2 expref: 24 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.645385:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf04a00, rc 0) 00000100:00100000:0.0:1746129753.645431:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11030 00000100:00100000:0.0:1746129753.645438:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949052238592:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129753.645446:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129753.645454:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135586e00/0x48868a4e43949a4b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f8ab expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129753.645485:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094769f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053323008:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129753.645934:0:14314:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c041f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053322624:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129753.645952:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1961:x1830949052238720:12345-192.168.204.31@tcp:101:cat.0 Request processed in 650us (1209us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129753.645958:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11029 00000100:00100000:2.0:1746129753.645986:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.645988:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c040000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053322496:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129753.646009:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f98f400/0x48868a4e43949a2f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->1753087] (req 1048576->1753087) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f89d expref: 33 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.646024:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f98f400, rc 0) 00000100:00100000:3.0:1746129753.646041:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:28651:x1830949052237952:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 19047us (19169us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129753.646046:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11028 00000100:00100000:3.0:1746129753.646056:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052238848 00000100:00100000:3.0:1746129753.646058:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052238848 00000100:00100000:3.0:1746129753.646069:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11031 00000100:00100000:3.0:1746129753.646074:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1962:x1830949052238848:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129753.646079:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129753.646085:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf04c00/0x48868a4e43949a52 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f8b9 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129753.646105:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053323136:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129753.646269:0:14314:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c041180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053322752:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129753.646327:0:14314:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c040380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053322880:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129753.646343:0:14314:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949a3d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000100:00100000:2.0:1746129753.646382:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.646404:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.646418:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052239104 00000100:00100000:2.0:1746129753.646421:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052239104 00000100:00100000:1.0:1746129753.646448:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052239232 00000100:00100000:1.0:1746129753.646451:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052239232 00000100:00100000:3.0:1746129753.646452:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00010000:00010000:1.0:1746129753.646468:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f200/0x48868a4e439499cd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f85e expref: 290 pid: 14314 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746129753.646491:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce780 going to sleep for 11 seconds 00000100:00100000:1.0:1746129753.646500:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5315 00000100:00100000:1.0:1746129753.646508:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:1962:x1830949052239232:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129753.646513:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129753.646516:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129753.646521:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f200/0x48868a4e439499cd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f85e expref: 290 pid: 14314 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746129753.646526:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052239360 00000100:00100000:0.0:1746129753.646528:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052239360 00010000:00010000:1.0:1746129753.646530:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f200/0x48868a4e439499cd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f85e expref: 290 pid: 14314 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746129753.646538:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4394999c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f849 expref: 13 pid: 15044 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746129753.646544:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f200/0x48868a4e439499cd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f85e expref: 290 pid: 14314 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746129753.646551:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5316 00000100:00100000:0.0:1746129753.646555:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949052239360:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129753.646558:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129753.646561:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129753.646562:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949a3d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129753.646564:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4394999c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f849 expref: 13 pid: 15044 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746129753.646569:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949a3d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129753.646573:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129753.646579:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4394999c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f849 expref: 13 pid: 15044 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746129753.646590:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4394999c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f849 expref: 13 pid: 15044 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746129753.646597:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129753.646600:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949a3d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129753.646612:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949a3d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129753.646616:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129753.646627:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949052239360:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 71us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129753.646631:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5316 00000100:00100000:0.0:1746129753.646670:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.646679:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052239488 00000100:00100000:0.0:1746129753.646681:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052239488 00010000:00010000:0.0:1746129753.646689:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6ec00/0x48868a4e43949781 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f74d expref: 33 pid: 1140 timeout: 799 lvb_type: 1 00000100:00100000:0.0:1746129753.646700:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5317 00000100:00100000:0.0:1746129753.646704:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130565c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1963:x1830949052239488:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129753.646709:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129753.646720:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6ec00/0x48868a4e43949781 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f74d expref: 33 pid: 1140 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746129753.646727:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6ec00/0x48868a4e43949781 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f74d expref: 33 pid: 1140 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746129753.646737:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6ec00/0x48868a4e43949781 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f74d expref: 33 pid: 1140 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746129753.646745:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129753.646746:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129753.646751:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f98f400/0x48868a4e43949a2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f89d expref: 32 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.646758:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f98f400/0x48868a4e43949a2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f89d expref: 32 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.646773:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f98f400/0x48868a4e43949a2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f89d expref: 32 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129753.646780:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094769500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053323264:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129753.646795:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19cef00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129753.647110:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:1962:x1830949052239232:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 602us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129753.647115:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5315 00010000:00010000:2.0:1746129753.647560:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e400/0x48868a4e439499f7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f86c expref: 19 pid: 14314 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746129753.647591:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5318 00000100:00100000:2.0:1746129753.647596:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949052239104:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129753.647603:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129753.647607:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e400/0x48868a4e439499f7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f86c expref: 19 pid: 14314 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746129753.647614:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e400/0x48868a4e439499f7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f86c expref: 19 pid: 14314 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746129753.647625:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e400/0x48868a4e439499f7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f86c expref: 19 pid: 14314 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746129753.647636:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129753.647639:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949a3d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.647644:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949a3d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.647649:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949a3d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.647660:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129753.647677:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052239104:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 81us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129753.647682:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5318 00010000:00010000:2.0:1746129753.647704:0:14314:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949a3d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.647713:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949a3d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:2.0:1746129753.647725:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129753.647827:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e600/0x48868a4e43949a36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8a4 expref: 19 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.647837:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949a3d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8a4 expref: 18 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.647842:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129753.647843:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129753.647845:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310ed600, rc 0) 00000100:00100000:2.0:1746129753.648066:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28662:x1830949052238208:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 13732us (13924us total) trans 8589943690 rc 0/0 00000100:00100000:2.0:1746129753.648077:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9904 00000100:00100000:1.0:1746129753.651443:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:1962:x1830949052238336:12345-192.168.204.31@tcp:4:cat.0 Request processed in 12264us (13192us total) trans 17179873175 rc 0/0 00000100:00100000:1.0:1746129753.651455:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 601 00002000:00100000:1.0:1746129753.651466:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4128768->4194303) req@ffff88009476a300 x1830949052238336/t17179873175(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1746129764 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129753.651475:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476a300 with x1830949052238336 ext(4128768->4194303) 00010000:00010000:1.0:1746129753.651484:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e439499b1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f857 expref: 25 pid: 7976 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746129753.651496:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e439499b1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f857 expref: 25 pid: 7976 timeout: 799 lvb_type: 0 00002000:00010000:1.0:1746129753.651501:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009476a300 00000100:00100000:0.0:1746129753.653892:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094769500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053323264:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129753.653908:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129753.653941:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130565c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1963:x1830949052239488:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7235us (7269us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129753.653949:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5317 00000100:00100000:3.0:1746129753.654114:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053323136:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129753.654136:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bf04c00/0x48868a4e43949a52 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8b9 expref: 24 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.654148:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bf04c00/0x48868a4e43949a52 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8b9 expref: 24 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.654157:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf04c00, rc 0) 00000100:00100000:3.0:1746129753.654183:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1962:x1830949052238848:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8108us (8196us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129753.654192:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11031 00002000:00010000:2.0:1746129753.656087:0:20441:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime: 1746129753 -> 1746129754 00002000:00010000:2.0:1746129753.656092:0:20441:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime: 1746129753 -> 1746129754 00002000:00010000:2.0:1746129753.656094:0:20441:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime: 1746129753 -> 1746129754 00000100:00100000:2.0:1746129753.656110:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094769f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053323008:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129753.656129:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135586e00/0x48868a4e43949a4b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8ab expref: 20 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.656139:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135586e00/0x48868a4e43949a4b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8ab expref: 20 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.656147:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135586e00, rc 0) 00000100:00100000:2.0:1746129753.656181:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949052238592:12345-192.168.204.31@tcp:101:cat.0 Request processed in 10743us (11382us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129753.656188:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11030 00000100:00100000:2.0:1746129753.660758:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.660837:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052239616 00000100:00100000:0.0:1746129753.660844:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052239616 00010000:00010000:0.0:1746129753.660890:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e439499b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f857 expref: 23 pid: 7976 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746129753.663291:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5319 00000100:00100000:0.0:1746129753.663303:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1961:x1830949052239616:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129753.663318:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129753.663340:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e439499b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f857 expref: 23 pid: 7976 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746129753.663355:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e439499b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f857 expref: 23 pid: 7976 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746129753.663388:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e439499b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f857 expref: 23 pid: 7976 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746129753.663403:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129753.663405:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129753.663410:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bf05a00/0x48868a4e43949a28 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f896 expref: 31 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.663417:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf05a00/0x48868a4e43949a28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f896 expref: 31 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.663455:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012bf05a00/0x48868a4e43949a28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f896 expref: 31 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129753.663465:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009476aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053323392:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129753.663540:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ceb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129753.663626:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.663804:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052239744 00000100:00100000:2.0:1746129753.663809:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052239744 00000100:00100000:2.0:1746129753.663838:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11032 00000100:00100000:2.0:1746129753.663845:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:28656:x1830949052239744:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129753.663870:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.663879:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801310ecc00/0x48868a4e43949a60 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f8c0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.663892:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129753.663894:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129753.663897:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801310ecc00/0x48868a4e43949a60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8c0 expref: 24 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.663907:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801310ecc00/0x48868a4e43949a60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8c0 expref: 24 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.663914:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310ecc00, rc 0) 00000100:00100000:2.0:1746129753.663938:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:28656:x1830949052239744:12345-192.168.204.31@tcp:101:cat.0 Request processed in 94us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129753.663943:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11032 00000100:00100000:0.0:1746129753.671685:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.671717:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052240128 00000100:00100000:0.0:1746129753.671723:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052240128 00002000:00100000:0.0:1746129753.671760:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880094768a80 x1830949052240128/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129753.671769:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094768a80 with x1830949052240128 ext(2097152->3145727) 00002000:00010000:0.0:1746129753.671775:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094768a80 00000100:00100000:0.0:1746129753.671792:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4129 00000100:00100000:0.0:1746129753.671798:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949052240128:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129753.673638:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009476aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053323392:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129753.673654:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129753.673696:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1961:x1830949052239616:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 10395us (12944us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129753.673705:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5319 00000100:00100000:0.0:1746129753.682952:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.685042:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052240000 00000100:00100000:2.0:1746129753.685052:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052240000 00002000:00100000:2.0:1746129753.685090:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1748992->1753087) req@ffff880094769c00 x1830949052240000/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.685104:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769c00 with x1830949052240000 ext(1748992->1753087) 00002000:00010000:2.0:1746129753.685110:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094769c00 00000100:00100000:2.0:1746129753.686011:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4130 00000100:00100000:2.0:1746129753.686020:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949052240000:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129753.688546:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949052240000:12345-192.168.204.31@tcp:3:cat.0 Request processed in 2518us (5594us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129753.688558:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4130 00002000:00100000:2.0:1746129753.688570:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1748992->1753087) req@ffff880094769c00 x1830949052240000/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/4536 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.688578:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769c00 with x1830949052240000 ext(1748992->1753087) 00002000:00010000:2.0:1746129753.688584:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094769c00 00000100:00100000:0.0:1746129753.689024:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.689577:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052240512 00000100:00100000:2.0:1746129753.689584:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052240512 00002000:00100000:2.0:1746129753.689609:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880094769500 x1830949052240512/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.689616:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769500 with x1830949052240512 ext(4194304->4964351) 00002000:00010000:2.0:1746129753.689620:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094769500 00000100:00100000:0.0:1746129753.691093:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949052240128:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19290us (19412us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129753.691101:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4129 00002000:00100000:0.0:1746129753.691109:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880094768a80 x1830949052240128/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/440 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129753.691115:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094768a80 with x1830949052240128 ext(2097152->3145727) 00002000:00010000:0.0:1746129753.691119:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094768a80 00000100:00100000:0.0:1746129753.691134:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4131 00000100:00100000:0.0:1746129753.691141:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1961:x1830949052240512:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129753.698565:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.698763:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052240768 00000100:00100000:2.0:1746129753.698771:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052240768 00000100:00100000:2.0:1746129753.698811:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3897 00000100:00100000:2.0:1746129753.698817:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:28651:x1830949052240768:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129753.699766:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:28651:x1830949052240768:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 946us (1205us total) trans 8589943691 rc 0/0 00000100:00100000:2.0:1746129753.699776:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3897 00000100:00100000:0.0:1746129753.706679:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1961:x1830949052240512:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15530us (17647us total) trans 0 rc 770048/770048 00000100:00100000:0.0:1746129753.706689:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4131 00002000:00100000:0.0:1746129753.706699:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880094769500 x1830949052240512/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/440 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129753.706708:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769500 with x1830949052240512 ext(4194304->4964351) 00002000:00010000:0.0:1746129753.706713:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094769500 00000100:00100000:2.0:1746129753.706951:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.707477:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052240896 00000100:00100000:0.0:1746129753.707488:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052240896 00000100:00100000:0.0:1746129753.707528:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11033 00000100:00100000:0.0:1746129753.707534:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:28660:x1830949052240896:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129753.707546:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129753.707561:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a149600/0x48868a4e43949a67 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f8c7 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.707584:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e439499db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f865 expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.707590:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129753.707591:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129753.707594:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a149600/0x48868a4e43949a67 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8c7 expref: 23 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.707616:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e439499db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f865 expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.707625:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e439499db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f865 expref: 18 pid: 7976 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746129753.707634:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009476aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053323520:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129753.708906:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129753.710960:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129753.711055:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009476aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053323520:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129753.711082:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a149600/0x48868a4e43949a67 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8c7 expref: 23 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129753.711097:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a149600, rc 0) 00000100:00100000:1.0:1746129753.711136:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:28660:x1830949052240896:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3601us (4187us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129753.711144:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11033 00000100:00100000:2.0:1746129753.711226:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052241024 00000100:00100000:2.0:1746129753.711232:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052241024 00002000:00100000:2.0:1746129753.711266:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->3436543) req@ffff880094769f80 x1830949052241024/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.711274:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769f80 with x1830949052241024 ext(3145728->3436543) 00010000:00010000:2.0:1746129753.711281:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e439499db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f865 expref: 19 pid: 7976 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746129753.711292:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e439499db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f865 expref: 19 pid: 7976 timeout: 799 lvb_type: 0 00002000:00010000:2.0:1746129753.711298:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094769f80 00000100:00100000:2.0:1746129753.712267:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 602 00000100:00100000:2.0:1746129753.712280:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1963:x1830949052241024:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129753.713459:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129753.713611:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052241280 00000100:00100000:1.0:1746129753.713616:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052241280 00000100:00100000:1.0:1746129753.713652:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11034 00000100:00100000:1.0:1746129753.713658:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1962:x1830949052241280:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129753.713667:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129753.713680:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a148800/0x48868a4e43949a6e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f8d5 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129753.713721:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053323648:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129753.713786:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129753.720278:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.720298:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.722486:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052241152 00000100:00100000:3.0:1746129753.722499:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052241152 00000100:00100000:3.0:1746129753.722557:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052241408 00000100:00100000:3.0:1746129753.722561:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052241408 00000100:00100000:3.0:1746129753.722592:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11035 00000100:00100000:3.0:1746129753.722602:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052241152:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129753.722622:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129753.722639:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf04e00/0x48868a4e43949a75 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f8ce expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129753.722692:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053323776:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129753.722791:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129753.722819:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11036 00000100:00100000:3.0:1746129753.722826:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1962:x1830949052241408:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129753.722835:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129753.722844:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf04200/0x48868a4e43949a7c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f8dc expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129753.722911:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131460a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053323904:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129753.722960:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68780 going to sleep for 11 seconds 00002000:00010000:1.0:1746129753.723433:0:7975:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime: 1746129753 -> 1746129754 00002000:00010000:1.0:1746129753.723436:0:7975:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime: 1746129753 -> 1746129754 00002000:00010000:1.0:1746129753.723437:0:7975:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime: 1746129753 -> 1746129754 00000100:00100000:1.0:1746129753.723451:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053323648:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129753.723470:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a148800/0x48868a4e43949a6e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8d5 expref: 24 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129753.723480:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a148800/0x48868a4e43949a6e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8d5 expref: 24 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129753.723493:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a148800, rc 0) 00000100:00100000:1.0:1746129753.723538:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1962:x1830949052241280:12345-192.168.204.31@tcp:101:cat.0 Request processed in 9879us (10079us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129753.723543:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11034 00000100:00100000:3.0:1746129753.726094:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:1963:x1830949052241024:12345-192.168.204.31@tcp:4:cat.0 Request processed in 13811us (15135us total) trans 21474840325 rc 0/0 00000100:00100000:3.0:1746129753.726103:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 602 00002000:00100000:3.0:1746129753.726112:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->3436543) req@ffff880094769f80 x1830949052241024/t21474840325(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1746129764 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129753.726120:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769f80 with x1830949052241024 ext(3145728->3436543) 00010000:00010000:3.0:1746129753.726128:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e439499db lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f865 expref: 25 pid: 7976 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746129753.726139:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e439499db lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f865 expref: 25 pid: 7976 timeout: 799 lvb_type: 0 00002000:00010000:3.0:1746129753.726145:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094769f80 00000100:00100000:2.0:1746129753.727994:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131460a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053323904:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129753.728021:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bf04200/0x48868a4e43949a7c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8dc expref: 24 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.728032:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf04200/0x48868a4e43949a7c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8dc expref: 24 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.728044:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf04200, rc 0) 00000100:00100000:2.0:1746129753.728075:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1962:x1830949052241408:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5249us (7775us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129753.728083:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11036 00000100:00100000:3.0:1746129753.729622:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053323776:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129753.729648:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bf04e00/0x48868a4e43949a75 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8ce expref: 22 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.729660:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf04e00/0x48868a4e43949a75 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8ce expref: 22 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.730553:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf04e00, rc 0) 00000100:00100000:3.0:1746129753.733586:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1962:x1830949052241152:12345-192.168.204.31@tcp:101:cat.0 Request processed in 10974us (13304us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129753.733598:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11035 00000100:00100000:0.0:1746129753.735767:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129753.735839:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052241536 00000100:00100000:1.0:1746129753.735866:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052241536 00010000:00010000:1.0:1746129753.735893:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e439499db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f865 expref: 21 pid: 7976 timeout: 799 lvb_type: 0 00000100:00100000:1.0:1746129753.736489:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5320 00000100:00100000:1.0:1746129753.736499:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1963:x1830949052241536:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129753.736512:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129753.736531:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e439499db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f865 expref: 21 pid: 7976 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746129753.736543:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e439499db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f865 expref: 21 pid: 7976 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746129753.736562:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e439499db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f865 expref: 21 pid: 7976 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746129753.736583:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129753.736585:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129753.736591:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a149600/0x48868a4e43949a67 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8c7 expref: 22 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129753.736600:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a149600/0x48868a4e43949a67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8c7 expref: 22 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129753.736632:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a149600/0x48868a4e43949a67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8c7 expref: 22 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129753.736643:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053324032:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129753.737626:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129753.737833:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.738179:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052241792 00000100:00100000:3.0:1746129753.738186:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052241792 00000100:00100000:3.0:1746129753.738235:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11037 00000100:00100000:3.0:1746129753.738244:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1963:x1830949052241792:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129753.738259:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129753.738277:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8fece00/0x48868a4e43949a83 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f8ea expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129753.738320:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053324160:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129753.738378:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129753.738973:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129753.739035:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.739385:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052241664 00000100:00100000:2.0:1746129753.739391:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052241664 00000100:00100000:2.0:1746129753.739420:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052241920 00000100:00100000:2.0:1746129753.739423:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052241920 00000100:00100000:2.0:1746129753.739437:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11038 00000100:00100000:2.0:1746129753.739443:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1963:x1830949052241664:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129753.739451:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.739462:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801310eca00/0x48868a4e43949a8a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f8e3 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129753.739498:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c040380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053324288:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129753.739594:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11039 00000100:00100000:1.0:1746129753.739603:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1963:x1830949052241920:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129753.739612:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129753.739621:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135587000/0x48868a4e43949a91 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f8f1 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129753.739634:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129753.739635:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129753.739644:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135587000/0x48868a4e43949a91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8f1 expref: 24 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129753.739658:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135587000/0x48868a4e43949a91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8f1 expref: 24 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129753.739668:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135587000, rc 0) 00000100:00100000:2.0:1746129753.740254:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129753.740445:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1963:x1830949052241920:12345-192.168.204.31@tcp:101:cat.0 Request processed in 843us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129753.740451:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11039 00000100:00100000:1.0:1746129753.745473:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053324032:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129753.745491:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129753.745548:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1963:x1830949052241536:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 9050us (9785us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129753.745556:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5320 00000100:00100000:3.0:1746129753.745703:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053324160:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129753.745725:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8fece00/0x48868a4e43949a83 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8ea expref: 24 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.745736:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fece00/0x48868a4e43949a83 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8ea expref: 24 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.745747:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fece00, rc 0) 00000100:00100000:3.0:1746129753.745764:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1963:x1830949052241792:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7523us (7935us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129753.745770:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11037 00000100:00100000:3.0:1746129753.747049:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c040380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053324288:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129753.747068:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801310eca00/0x48868a4e43949a8a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8e3 expref: 22 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.747078:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801310eca00/0x48868a4e43949a8a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8e3 expref: 22 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.747085:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310eca00, rc 0) 00000100:00100000:3.0:1746129753.747109:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1963:x1830949052241664:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7666us (8139us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129753.747117:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11038 00000100:00100000:0.0:1746129753.750358:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.752068:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052242304 00000100:00100000:3.0:1746129753.752076:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052242304 00002000:00100000:3.0:1746129753.752115:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009b00df80 x1830949052242304/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129753.752123:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00df80 with x1830949052242304 ext(3145728->4194303) 00002000:00010000:3.0:1746129753.752128:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00df80 00000100:00100000:3.0:1746129753.752155:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4132 00000100:00100000:3.0:1746129753.752161:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949052242304:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129753.754944:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.754981:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.756419:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052242432 00000100:00100000:3.0:1746129753.756428:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052242432 00002000:00100000:3.0:1746129753.756463:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012c040000 x1830949052242432/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129753.756472:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c040000 with x1830949052242432 ext(2097152->3145727) 00002000:00010000:3.0:1746129753.756476:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c040000 00000100:00100000:3.0:1746129753.756503:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052242560 00000100:00100000:3.0:1746129753.756505:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052242560 00002000:00100000:3.0:1746129753.756513:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012c040700 x1830949052242560/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129753.756518:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c040700 with x1830949052242560 ext(3145728->4194303) 00002000:00010000:3.0:1746129753.756520:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c040700 00000100:00100000:3.0:1746129753.756534:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4133 00000100:00100000:3.0:1746129753.756539:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1964:x1830949052242432:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129753.757475:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4134 00000100:00100000:3.0:1746129753.757482:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1964:x1830949052242560:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129753.786999:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1964:x1830949052242432:12345-192.168.204.31@tcp:3:cat.0 Request processed in 30451us (32054us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129753.787009:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4133 00002000:00100000:2.0:1746129753.787019:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012c040000 x1830949052242432/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/440 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.787027:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c040000 with x1830949052242432 ext(2097152->3145727) 00002000:00010000:2.0:1746129753.787032:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c040000 00000100:00100000:3.0:1746129753.787399:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949052242304:12345-192.168.204.31@tcp:3:cat.0 Request processed in 35237us (37048us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129753.787406:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4132 00002000:00100000:3.0:1746129753.787411:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009b00df80 x1830949052242304/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/440 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129753.787417:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00df80 with x1830949052242304 ext(3145728->4194303) 00002000:00010000:3.0:1746129753.787420:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00df80 00000100:00100000:0.0:1746129753.794220:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.794260:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949052242560:12345-192.168.204.31@tcp:3:cat.0 Request processed in 36777us (39277us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129753.794270:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4134 00002000:00100000:3.0:1746129753.794280:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012c040700 x1830949052242560/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/440 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129753.794289:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c040700 with x1830949052242560 ext(3145728->4194303) 00002000:00010000:3.0:1746129753.794294:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c040700 00000100:00100000:3.0:1746129753.794317:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052242944 00000100:00100000:3.0:1746129753.794322:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052242944 00002000:00100000:3.0:1746129753.794349:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009b00ed80 x1830949052242944/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129753.794355:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00ed80 with x1830949052242944 ext(4194304->4964351) 00002000:00010000:3.0:1746129753.794367:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00ed80 00000100:00100000:3.0:1746129753.794383:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4135 00000100:00100000:3.0:1746129753.794389:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1963:x1830949052242944:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129753.799127:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.799995:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052243072 00000100:00100000:3.0:1746129753.800005:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052243072 00000100:00100000:3.0:1746129753.800648:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11040 00000100:00100000:3.0:1746129753.800657:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:28662:x1830949052243072:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129753.800670:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129753.800684:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec400/0x48868a4e43949a98 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f8f8 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.800705:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6e600/0x48868a4e43949773 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f70e expref: 32 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.800711:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f907800/0x48868a4e439497ff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f770 expref: 24 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.800717:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6fc00/0x48868a4e4394979d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f71c expref: 9 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.800722:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.800723:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.800726:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec400/0x48868a4e43949a98 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [741376->1048575] (req 741376->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8f8 expref: 24 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.800749:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6fc00/0x48868a4e4394979d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f71c expref: 9 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.800759:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6fc00/0x48868a4e4394979d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f71c expref: 9 pid: 1140 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746129753.800774:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053324416:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129753.801504:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1963:x1830949052242944:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7112us (7288us total) trans 0 rc 770048/770048 00000100:00100000:0.0:1746129753.801512:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4135 00002000:00100000:0.0:1746129753.801520:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009b00ed80 x1830949052242944/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/440 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129753.801528:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00ed80 with x1830949052242944 ext(4194304->4964351) 00002000:00010000:0.0:1746129753.801532:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00ed80 00010000:00010000:3.0:1746129753.801598:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f907800/0x48868a4e439497ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f770 expref: 24 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.801606:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f907800/0x48868a4e439497ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f770 expref: 24 pid: 10930 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746129753.801614:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053324544:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129753.801642:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6e600/0x48868a4e43949773 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f70e expref: 31 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.801650:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6e600/0x48868a4e43949773 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f70e expref: 31 pid: 8437 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746129753.801657:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053324672:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129753.801680:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129753.805574:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053324416:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129753.805583:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053324544:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129753.805589:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053324672:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129753.805613:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec400/0x48868a4e43949a98 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [741376->1048575] (req 741376->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8f8 expref: 24 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.805631:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fec400, rc 0) 00000100:00100000:3.0:1746129753.805675:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:28662:x1830949052243072:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5020us (6556us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129753.805682:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11040 00000100:00100000:0.0:1746129753.806143:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.806177:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.806219:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.806247:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052243200 00000100:00100000:0.0:1746129753.806252:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052243200 00010000:00010000:0.0:1746129753.806273:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6fc00/0x48868a4e4394979d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f71c expref: 10 pid: 1140 timeout: 799 lvb_type: 1 00000100:00100000:2.0:1746129753.806324:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052243456 00000100:00100000:2.0:1746129753.806327:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052243456 00000100:00100000:1.0:1746129753.806339:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052243328 00010000:00010000:2.0:1746129753.806342:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6e600/0x48868a4e43949773 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f70e expref: 32 pid: 8437 timeout: 799 lvb_type: 1 00000100:00100000:1.0:1746129753.806342:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052243328 00010000:00010000:1.0:1746129753.806352:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f907800/0x48868a4e439497ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f770 expref: 24 pid: 10930 timeout: 799 lvb_type: 1 00000100:00100000:2.0:1746129753.806356:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5321 00000100:00100000:2.0:1746129753.806375:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052243200:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129753.806385:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129753.806393:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5322 00000100:00100000:1.0:1746129753.806398:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949052243456:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129753.806403:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6fc00/0x48868a4e4394979d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f71c expref: 10 pid: 1140 timeout: 799 lvb_type: 1 00010000:00010000:1.0:1746129753.806405:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129753.806411:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6fc00/0x48868a4e4394979d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f71c expref: 10 pid: 1140 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746129753.806448:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5323 00000100:00100000:3.0:1746129753.806454:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1962:x1830949052243328:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129753.806461:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129753.806768:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f907800/0x48868a4e439497ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f770 expref: 24 pid: 10930 timeout: 799 lvb_type: 1 00010000:00010000:1.0:1746129753.806768:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6e600/0x48868a4e43949773 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f70e expref: 32 pid: 8437 timeout: 799 lvb_type: 1 00010000:00010000:1.0:1746129753.806775:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6e600/0x48868a4e43949773 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f70e expref: 32 pid: 8437 timeout: 799 lvb_type: 1 00010000:00010000:1.0:1746129753.806791:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6e600/0x48868a4e43949773 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f70e expref: 32 pid: 8437 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746129753.806796:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6fc00/0x48868a4e4394979d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f71c expref: 10 pid: 1140 timeout: 799 lvb_type: 1 00010000:00010000:1.0:1746129753.806815:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129753.806818:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f907800/0x48868a4e439497ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f770 expref: 24 pid: 10930 timeout: 799 lvb_type: 1 00010000:00010000:3.0:1746129753.806828:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f907800/0x48868a4e439497ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f770 expref: 24 pid: 10930 timeout: 799 lvb_type: 1 00010000:00010000:3.0:1746129753.806843:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.806869:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.806876:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec400/0x48868a4e43949a98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8f8 expref: 23 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.806884:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec400/0x48868a4e43949a98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8f8 expref: 23 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.806909:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec400/0x48868a4e43949a98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8f8 expref: 23 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129753.806921:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053324800:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129753.806979:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129753.807086:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1964:x1830949052243456:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 687us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129753.807092:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5322 00000100:00100000:3.0:1746129753.807200:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129753.807233:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052243200:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 856us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129753.807239:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5321 00000100:00100000:0.0:1746129753.808545:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.808648:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052243584 00000100:00100000:3.0:1746129753.808654:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052243584 00000100:00100000:3.0:1746129753.808691:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11041 00000100:00100000:3.0:1746129753.808822:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949052243584:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129753.808836:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129753.808940:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fe00/0x48868a4e43949a9f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f8ff expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129753.808982:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053324928:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129753.809231:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129753.809557:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053324800:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129753.809569:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129753.809593:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1962:x1830949052243328:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3138us (3372us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129753.809600:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5323 00000100:00100000:0.0:1746129753.809955:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.810008:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052243840 00000100:00100000:2.0:1746129753.810014:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052243840 00002000:00100000:2.0:1746129753.810040:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e8:0x0] (741376->745471) req@ffff88009b00d880 x1830949052243840/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.810049:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00d880 with x1830949052243840 ext(741376->745471) 00002000:00010000:2.0:1746129753.810052:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00d880 00000100:00100000:2.0:1746129753.810066:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4136 00000100:00100000:2.0:1746129753.810076:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1961:x1830949052243840:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129753.810195:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1961:x1830949052243840:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 118us (239us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129753.810201:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4136 00002000:00100000:2.0:1746129753.810206:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e8:0x0] (741376->745471) req@ffff88009b00d880 x1830949052243840/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/4536 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.810213:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00d880 with x1830949052243840 ext(741376->745471) 00002000:00010000:2.0:1746129753.810215:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00d880 00002000:00010000:3.0:1746129753.811079:0:7976:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime: 1746129753 -> 1746129754 00002000:00010000:3.0:1746129753.811082:0:7976:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime: 1746129753 -> 1746129754 00002000:00010000:3.0:1746129753.811084:0:7976:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime: 1746129753 -> 1746129754 00000100:00100000:3.0:1746129753.811095:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053324928:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129753.811114:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fe00/0x48868a4e43949a9f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8ff expref: 32 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.811129:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fe00/0x48868a4e43949a9f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8ff expref: 32 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.811138:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1fe00, rc 0) 00000100:00100000:3.0:1746129753.811161:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949052243584:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2342us (2619us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129753.811166:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11041 00000100:00100000:0.0:1746129753.813817:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.813886:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.813968:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052243968 00000100:00100000:2.0:1746129753.813975:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052243968 00000100:00100000:2.0:1746129753.814003:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052244096 00000100:00100000:2.0:1746129753.814005:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052244096 00000100:00100000:2.0:1746129753.814020:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11042 00000100:00100000:2.0:1746129753.814026:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949052243968:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129753.814041:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.814054:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e43949aa6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f906 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129753.814093:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c041c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053325056:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129753.814152:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129753.814168:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11043 00000100:00100000:2.0:1746129753.814173:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:28662:x1830949052244096:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129753.814180:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.814188:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e43949aad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f90d expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.814206:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f800/0x48868a4e4394977a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f715 expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.814213:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f907600/0x48868a4e43949814 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f777 expref: 22 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.814219:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801310ec000/0x48868a4e439497ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f723 expref: 9 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.814224:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129753.814225:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129753.814228:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e43949aad lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->1597439] (req 1048576->1597439) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f90d expref: 22 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.814244:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801310ec000/0x48868a4e439497ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f723 expref: 9 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.814253:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801310ec000/0x48868a4e439497ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f723 expref: 9 pid: 7976 timeout: 799 lvb_type: 1 00000100:00100000:2.0:1746129753.814260:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c040380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053325184:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129753.814288:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f907600/0x48868a4e43949814 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f777 expref: 22 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.814295:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f907600/0x48868a4e43949814 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f777 expref: 22 pid: 20441 timeout: 799 lvb_type: 1 00000100:00100000:2.0:1746129753.814303:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053325312:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129753.814324:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f800/0x48868a4e4394977a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f715 expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.814331:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f800/0x48868a4e4394977a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f715 expref: 22 pid: 8437 timeout: 799 lvb_type: 1 00000100:00100000:2.0:1746129753.814338:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053325440:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129753.814353:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129753.816570:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c040380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053325184:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129753.816707:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c041c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053325056:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129753.816729:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e43949aa6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f906 expref: 32 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.816740:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e43949aa6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f906 expref: 32 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.816749:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf04800, rc 0) 00000100:00100000:2.0:1746129753.816998:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053325312:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129753.817169:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949052243968:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3141us (3358us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129753.817176:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11042 00000100:00100000:0.0:1746129753.820919:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.820954:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.821018:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052244352 00000100:00100000:3.0:1746129753.821025:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052244352 00010000:00010000:3.0:1746129753.821053:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f800/0x48868a4e4394977a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f715 expref: 23 pid: 8437 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746129753.821085:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052244480 00000100:00100000:3.0:1746129753.821088:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052244480 00000100:00100000:0.0:1746129753.821093:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129753.821098:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f907600/0x48868a4e43949814 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f777 expref: 23 pid: 20441 timeout: 799 lvb_type: 1 00000100:00100000:0.0:1746129753.821865:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052244224 00000100:00100000:0.0:1746129753.821869:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052244224 00010000:00010000:0.0:1746129753.821884:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801310ec000/0x48868a4e439497ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f723 expref: 10 pid: 7976 timeout: 799 lvb_type: 1 00000100:00100000:0.0:1746129753.821900:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5324 00000100:00100000:0.0:1746129753.821906:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949052244352:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129753.821917:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129753.821933:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f800/0x48868a4e4394977a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f715 expref: 23 pid: 8437 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746129753.821944:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f800/0x48868a4e4394977a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f715 expref: 23 pid: 8437 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746129753.821965:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129753.821994:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949052244352:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 88us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129753.821999:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5324 00000100:00100000:0.0:1746129753.822014:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5325 00000100:00100000:0.0:1746129753.822018:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130565850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1961:x1830949052244480:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129753.822023:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129753.822028:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f907600/0x48868a4e43949814 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f777 expref: 23 pid: 20441 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746129753.822035:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f907600/0x48868a4e43949814 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f777 expref: 23 pid: 20441 timeout: 799 lvb_type: 1 00000100:00100000:1.0:1746129753.822099:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5326 00000100:00100000:1.0:1746129753.822107:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949052244224:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129753.822115:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129753.822352:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f800/0x48868a4e4394977a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f715 expref: 22 pid: 8437 timeout: 799 lvb_type: 1 00000100:00100000:2.0:1746129753.822386:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053325440:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129753.823411:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f907600/0x48868a4e43949814 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f777 expref: 23 pid: 20441 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746129753.823430:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129753.823444:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e43949aad lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->1597439] (req 1048576->1597439) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f90d expref: 22 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129753.823454:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130565850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949052244480:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1435us (2499us total) trans 0 rc 0/0 00010000:00010000:2.0:1746129753.823456:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf04400, rc 0) 00000100:00100000:0.0:1746129753.823460:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5325 00000100:00100000:2.0:1746129753.823478:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:28662:x1830949052244096:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 9305us (9593us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129753.823484:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11043 00010000:00010000:1.0:1746129753.823537:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801310ec000/0x48868a4e439497ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f723 expref: 10 pid: 7976 timeout: 799 lvb_type: 1 00010000:00010000:1.0:1746129753.823547:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801310ec000/0x48868a4e439497ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f723 expref: 10 pid: 7976 timeout: 799 lvb_type: 1 00010000:00010000:1.0:1746129753.823559:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801310ec000/0x48868a4e439497ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f723 expref: 10 pid: 7976 timeout: 799 lvb_type: 1 00010000:00010000:1.0:1746129753.823576:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129753.823578:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129753.823583:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e43949aad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1597439) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f90d expref: 21 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129753.823589:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e43949aad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1597439) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f90d expref: 21 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129753.823742:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e43949aad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1597439) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f90d expref: 20 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129753.823797:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053325568:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129753.823866:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129753.827317:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053325568:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129753.827331:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129753.827383:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949052244224:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5277us (6289us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129753.827390:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5326 00000100:00100000:0.0:1746129753.829411:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.830079:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052244736 00000100:00100000:2.0:1746129753.830086:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052244736 00002000:00100000:2.0:1746129753.830116:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1593344->1597439) req@ffff8800934d4700 x1830949052244736/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.830122:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4700 with x1830949052244736 ext(1593344->1597439) 00002000:00010000:2.0:1746129753.830126:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800934d4700 00000100:00100000:2.0:1746129753.830153:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4137 00000100:00100000:2.0:1746129753.830160:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1961:x1830949052244736:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129753.830312:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1961:x1830949052244736:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 152us (906us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129753.830318:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4137 00002000:00100000:2.0:1746129753.830323:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1593344->1597439) req@ffff8800934d4700 x1830949052244736/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/4536 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.830329:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4700 with x1830949052244736 ext(1593344->1597439) 00002000:00010000:2.0:1746129753.830331:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800934d4700 00000100:00100000:0.0:1746129753.833795:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.833979:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052244992 00000100:00100000:2.0:1746129753.834100:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052244992 00000100:00100000:2.0:1746129753.834193:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9905 00000100:00100000:2.0:1746129753.834201:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:28666:x1830949052244992:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129753.834217:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.834230:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00800/0x48868a4e43949ab4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f914 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.834316:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e43949abb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.834331:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e43949abb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.834339:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e43949abb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.834350:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00400/0x48868a4e43949ac2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.834354:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00400/0x48868a4e43949ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.834371:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00400/0x48868a4e43949ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.834457:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f8400/0x48868a4e43949ac9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.834464:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f8400/0x48868a4e43949ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.834470:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f8400/0x48868a4e43949ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:2.0:1746129753.834478:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129753.834542:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e43949abb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.834547:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e43949abb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.834553:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e43949abb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.834562:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa01c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129753.834565:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e43949abb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.834571:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e43949abb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.834581:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129753.834583:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129753.834586:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e43949abb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.834591:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e43949abb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.834618:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00400/0x48868a4e43949ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.834622:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00400/0x48868a4e43949ac2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.834626:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00400/0x48868a4e43949ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.834630:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa00400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129753.834632:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00400/0x48868a4e43949ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.834637:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00400/0x48868a4e43949ac2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.834642:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800946c6700) 00010000:00010000:2.0:1746129753.834644:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129753.834646:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00400/0x48868a4e43949ac2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.834650:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00400/0x48868a4e43949ac2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129753.834682:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00800/0x48868a4e43949ab4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f914 expref: 293 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.834691:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f8400/0x48868a4e43949ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f914 expref: 292 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.834696:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129753.834698:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129753.834700:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924f8400, rc 0) 00000100:00100000:2.0:1746129753.834751:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:28666:x1830949052244992:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 550us (963us total) trans 8589943692 rc 0/0 00000100:00100000:2.0:1746129753.834757:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9905 00000100:00100000:0.0:1746129753.864723:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.865139:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052245120 00000100:00100000:2.0:1746129753.865154:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052245120 00000100:00100000:2.0:1746129753.865220:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9906 00000100:00100000:2.0:1746129753.865229:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+12:28669:x1830949052245120:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129753.865258:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.865276:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00800/0x48868a4e43949ad7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f91b expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.865331:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00400/0x48868a4e43949ade lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.865342:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00400/0x48868a4e43949ade lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.865352:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00400/0x48868a4e43949ade lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.865378:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e43949ae5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.865385:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e43949ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.865390:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e43949ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.865510:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e43949aec lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.865521:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949a3d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8a4 expref: 17 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.865527:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e43949aec lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.865555:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949a3d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8a4 expref: 17 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.865565:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949a3d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8a4 expref: 17 pid: 14314 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746129753.865576:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053325696:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129753.865688:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129753.870835:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053325696:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129753.870884:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e43949aec lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000100:00100000:0.0:1746129753.871086:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.871176:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052245376 00000100:00100000:2.0:1746129753.871182:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052245376 00000100:00100000:2.0:1746129753.871227:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3898 00000100:00100000:2.0:1746129753.871234:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:7658:x1830949052245376:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746129753.871417:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:7658:x1830949052245376:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 182us (332us total) trans 8589943693 rc 0/0 00000100:00100000:2.0:1746129753.871423:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3898 00000100:00100000:0.0:1746129753.873678:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129753.874981:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052245504 00000100:00100000:1.0:1746129753.874990:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052245504 00010000:00010000:1.0:1746129753.875023:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949a3d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8a4 expref: 19 pid: 14314 timeout: 799 lvb_type: 0 00000100:00100000:1.0:1746129753.875058:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5327 00000100:00100000:1.0:1746129753.875067:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949052245504:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129753.875084:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129753.875090:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949a3d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8a4 expref: 19 pid: 14314 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746129753.875100:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949a3d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8a4 expref: 19 pid: 14314 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746129753.875119:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ed600/0x48868a4e43949a3d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8a4 expref: 19 pid: 14314 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746129753.875147:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129753.875153:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e43949aec lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129753.875161:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e43949aec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129753.875168:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e43949aec lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129753.876123:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129753.876173:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052245504:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1106us (2500us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129753.876180:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5327 00010000:00010000:2.0:1746129753.877801:0:15044:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e43949aec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.877812:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e43949aec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:2.0:1746129753.877866:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:2.0:1746129753.877871:0:15044:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129753.877886:0:15044:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e43949aec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.877898:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e43949aec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.877906:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00400/0x48868a4e43949ade lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.877910:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00400/0x48868a4e43949ade lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.877915:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00400/0x48868a4e43949ade lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.877923:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa00400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129753.877926:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00400/0x48868a4e43949ade lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.877931:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00400/0x48868a4e43949ade lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.877942:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129753.877945:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129753.877948:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00400/0x48868a4e43949ade lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.877952:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00400/0x48868a4e43949ade lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.877972:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e43949ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.877978:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e43949ae5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.877981:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e43949ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.877985:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa01c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129753.877987:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e43949ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.877992:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e43949ae5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.877997:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800acd4cd00) 00010000:00010000:2.0:1746129753.877999:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129753.878002:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e43949ae5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.878006:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e43949ae5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.878039:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00800/0x48868a4e43949ad7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f91b expref: 14 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.878049:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e43949aec lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f91b expref: 13 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.878054:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129753.878056:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129753.878058:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa01800, rc 0) 00000100:00100000:2.0:1746129753.878105:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+13:28669:x1830949052245120:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 12876us (13390us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129753.878113:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9906 00000100:00100000:0.0:1746129753.881716:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.882581:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.883372:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.884223:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.884243:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052245632 00000100:00100000:2.0:1746129753.884252:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052245632 00000100:00100000:3.0:1746129753.884303:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052245888 00000100:00100000:3.0:1746129753.884307:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052245888 00000100:00100000:3.0:1746129753.884332:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052246144 00000100:00100000:3.0:1746129753.884334:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052246144 00000100:00100000:3.0:1746129753.884373:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11044 00000100:00100000:3.0:1746129753.884381:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949052245632:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129753.884399:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129753.884415:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e43949af3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f922 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129753.884462:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053325824:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129753.884525:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129753.884543:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11045 00000100:00100000:3.0:1746129753.884549:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949052245888:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129753.884556:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129753.884566:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf04200/0x48868a4e43949afa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f930 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129753.884587:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053325952:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129753.884608:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129753.884634:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11046 00000100:00100000:3.0:1746129753.884639:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052246144:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129753.884646:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129753.884652:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf04a00/0x48868a4e43949b01 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f93e expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.884662:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.884664:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.884672:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf04a00/0x48868a4e43949b01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f93e expref: 12 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.884684:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bf04a00/0x48868a4e43949b01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f93e expref: 12 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.884693:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf04a00, rc 0) 00000100:00100000:3.0:1746129753.884713:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949052246144:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 73us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129753.884718:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11046 00000100:00100000:2.0:1746129753.886745:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052245760 00000100:00100000:2.0:1746129753.886752:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052245760 00000100:00100000:2.0:1746129753.886785:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11047 00000100:00100000:2.0:1746129753.886791:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052245760:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129753.886800:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.886812:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801305e2400/0x48868a4e43949b08 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f929 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129753.886844:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053326080:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129753.886924:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1300 going to sleep for 11 seconds 00000100:00100000:2.0:1746129753.886960:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.887044:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.887074:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052246016 00000100:00100000:2.0:1746129753.887077:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052246016 00000100:00100000:2.0:1746129753.887092:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052246272 00000100:00100000:2.0:1746129753.887094:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052246272 00000100:00100000:2.0:1746129753.887105:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11048 00000100:00100000:2.0:1746129753.887109:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949052246016:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129753.887116:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.887126:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x48868a4e43949b0f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f937 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129753.887147:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053326208:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129753.887169:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129753.887182:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11049 00000100:00100000:2.0:1746129753.887186:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949052246272:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129753.887191:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.887197:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e43949b16 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f945 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.887206:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129753.887207:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129753.887213:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e43949b16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f945 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.887223:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e43949b16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f945 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.887232:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10000, rc 0) 00000100:00100000:2.0:1746129753.887247:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+14:1962:x1830949052246272:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 61us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129753.887251:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11049 00000100:00100000:3.0:1746129753.888784:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053325824:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129753.888807:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e43949af3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f922 expref: 13 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.888817:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e43949af3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f922 expref: 13 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.888829:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf04800, rc 0) 00000100:00100000:3.0:1746129753.888871:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949052245632:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4491us (7162us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129753.888877:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11044 00000100:00100000:3.0:1746129753.888926:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053325952:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129753.888940:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bf04200/0x48868a4e43949afa lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f930 expref: 13 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.888949:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf04200/0x48868a4e43949afa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f930 expref: 13 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.888955:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf04200, rc 0) 00000100:00100000:3.0:1746129753.888971:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949052245888:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4423us (6390us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129753.888975:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11045 00000100:00100000:3.0:1746129753.905112:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00010000:2.0:1746129753.905171:0:20441:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime: 1746129753 -> 1746129754 00002000:00010000:2.0:1746129753.905175:0:20441:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime: 1746129753 -> 1746129754 00002000:00010000:2.0:1746129753.905177:0:20441:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime: 1746129753 -> 1746129754 00000100:00100000:2.0:1746129753.905193:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053326080:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129753.905217:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801305e2400/0x48868a4e43949b08 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f929 expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129753.905225:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052246400 00000100:00100000:3.0:1746129753.905229:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052246400 00010000:00010000:2.0:1746129753.905229:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801305e2400/0x48868a4e43949b08 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f929 expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.905240:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801305e2400, rc 0) 00000100:00100000:3.0:1746129753.905257:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11050 00000100:00100000:3.0:1746129753.905262:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:28666:x1830949052246400:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129753.905274:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129753.905274:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052245760:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 18484us (21053us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129753.905279:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11047 00010000:00010000:3.0:1746129753.905284:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb5aa00/0x48868a4e43949b1d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f94c expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.905303:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bf05a00/0x48868a4e43949a28 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f896 expref: 32 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.905310:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bf04a00/0x48868a4e43949b01 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f93e expref: 11 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.905316:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801310ecc00/0x48868a4e43949a60 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8c0 expref: 22 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.905322:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746129753.905323:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053326208:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129753.905324:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.905327:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb5aa00/0x48868a4e43949b1d lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2494464->3026943] (req 2494464->3026943) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f94c expref: 32 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.905335:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x48868a4e43949b0f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f937 expref: 11 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.905341:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10400/0x48868a4e43949b0f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f937 expref: 11 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.905347:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801310ecc00/0x48868a4e43949a60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8c0 expref: 22 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.905352:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10400, rc 0) 00010000:00010000:3.0:1746129753.905370:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801310ecc00/0x48868a4e43949a60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8c0 expref: 22 pid: 20441 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746129753.905380:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053326336:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129753.905382:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052246016:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 18272us (18422us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129753.905386:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11048 00010000:00010000:3.0:1746129753.905429:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bf04a00/0x48868a4e43949b01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f93e expref: 9 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.905436:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bf04a00/0x48868a4e43949b01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f93e expref: 9 pid: 4589 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746129753.905443:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053326464:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129753.905464:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bf05a00/0x48868a4e43949a28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f896 expref: 32 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.905471:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bf05a00/0x48868a4e43949a28 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f896 expref: 32 pid: 8435 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746129753.905482:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131460000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053326592:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129753.905495:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129753.913818:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.913892:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.914078:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052247040 00000100:00100000:2.0:1746129753.914086:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052247040 00000100:00100000:2.0:1746129753.914130:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9907 00000100:00100000:2.0:1746129753.914137:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+13:28669:x1830949052247040:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129753.914153:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.914168:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f5ca00/0x48868a4e43949b24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f95a expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.914243:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e43949b2b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.914255:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e43949aec lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f91b expref: 14 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.914261:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e43949b2b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.914285:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e43949aec lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f91b expref: 14 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.914294:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e43949aec lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f91b expref: 14 pid: 15044 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746129753.914303:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053326720:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129753.914354:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129753.914443:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.914448:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053326336:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129753.914457:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053326464:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129753.914464:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131460000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053326592:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129753.914469:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.914483:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052247168 00010000:00010000:2.0:1746129753.914483:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eb5aa00/0x48868a4e43949b1d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2494464->3026943] (req 2494464->3026943) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f94c expref: 32 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129753.914485:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052247168 00010000:00010000:2.0:1746129753.914494:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb5aa00, rc 0) 00010000:00010000:3.0:1746129753.914499:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801310ecc00/0x48868a4e43949a60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8c0 expref: 23 pid: 20441 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746129753.914512:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052247296 00000100:00100000:3.0:1746129753.914513:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052247296 00000100:00100000:2.0:1746129753.914513:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:28666:x1830949052246400:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 9250us (9407us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129753.914519:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11050 00010000:00010000:3.0:1746129753.914520:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf05a00/0x48868a4e43949a28 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f896 expref: 33 pid: 8435 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746129753.914529:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052246784 00000100:00100000:3.0:1746129753.914530:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052246784 00010000:00010000:3.0:1746129753.914536:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf04a00/0x48868a4e43949b01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f93e expref: 10 pid: 4589 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746129753.914555:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5328 00000100:00100000:3.0:1746129753.914561:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131463800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1961:x1830949052247168:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129753.914564:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5329 00010000:00010000:3.0:1746129753.914568:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129753.914570:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131462d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949052247296:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129753.914575:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129753.914581:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801310ecc00/0x48868a4e43949a60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8c0 expref: 23 pid: 20441 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746129753.914581:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bf05a00/0x48868a4e43949a28 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f896 expref: 32 pid: 8435 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746129753.914589:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bf05a00/0x48868a4e43949a28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f896 expref: 32 pid: 8435 timeout: 799 lvb_type: 0 00000100:00100000:1.0:1746129753.914626:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5330 00000100:00100000:1.0:1746129753.914633:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131463480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+10:1964:x1830949052246784:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129753.914640:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129753.914794:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801310ecc00/0x48868a4e43949a60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8c0 expref: 23 pid: 20441 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746129753.914821:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bf05a00/0x48868a4e43949a28 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f896 expref: 32 pid: 8435 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746129753.914834:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129753.914872:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131462d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1964:x1830949052247296:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 302us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129753.914877:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5329 00010000:00010000:1.0:1746129753.915120:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bf04a00/0x48868a4e43949b01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f93e expref: 10 pid: 4589 timeout: 799 lvb_type: 1 00010000:00010000:3.0:1746129753.915123:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801310ecc00/0x48868a4e43949a60 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8c0 expref: 23 pid: 20441 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746129753.915132:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bf04a00/0x48868a4e43949b01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f93e expref: 10 pid: 4589 timeout: 799 lvb_type: 1 00010000:00010000:3.0:1746129753.915138:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129753.915142:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bf04a00/0x48868a4e43949b01 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f93e expref: 10 pid: 4589 timeout: 799 lvb_type: 1 00010000:00010000:1.0:1746129753.915151:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129753.915153:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746129753.915155:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131463800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949052247168:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 595us (1263us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129753.915157:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eb5aa00/0x48868a4e43949b1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2494464->3026943) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f94c expref: 30 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129753.915160:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5328 00010000:00010000:1.0:1746129753.915163:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb5aa00/0x48868a4e43949b1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2494464->3026943) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f94c expref: 30 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129753.915694:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012eb5aa00/0x48868a4e43949b1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2494464->3026943) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f94c expref: 30 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129753.915705:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053326848:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129753.917461:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b51f5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129753.918657:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.918683:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052246656 00000100:00100000:0.0:1746129753.918688:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052246656 00000100:00100000:0.0:1746129753.918723:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9908 00000100:00100000:0.0:1746129753.918731:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28672:x1830949052246656:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129753.918751:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129753.918766:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04800/0x48868a4e43949b32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f953 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.918868:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04e00/0x48868a4e43949b39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129753.918877:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04e00/0x48868a4e43949b39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129753.918888:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04e00/0x48868a4e43949b39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129753.918898:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04600/0x48868a4e43949b40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129753.918902:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04600/0x48868a4e43949b40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129753.918906:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04600/0x48868a4e43949b40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129753.918986:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9e00/0x48868a4e43949b47 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129753.918992:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9e00/0x48868a4e43949b47 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129753.918997:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9e00/0x48868a4e43949b47 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:0.0:1746129753.919003:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129753.919124:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04e00/0x48868a4e43949b39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129753.919130:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04e00/0x48868a4e43949b39 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129753.919135:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04e00/0x48868a4e43949b39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129753.919141:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bf04e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129753.919144:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04e00/0x48868a4e43949b39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129753.919150:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04e00/0x48868a4e43949b39 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129753.919157:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:0.0:1746129753.919160:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129753.919162:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04e00/0x48868a4e43949b39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129753.919167:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04e00/0x48868a4e43949b39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129753.919175:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04600/0x48868a4e43949b40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129753.919178:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04600/0x48868a4e43949b40 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129753.919183:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04600/0x48868a4e43949b40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129753.919186:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bf04600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129753.919187:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04600/0x48868a4e43949b40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129753.919191:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04600/0x48868a4e43949b40 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129753.919195:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5099200) 00010000:00010000:0.0:1746129753.919196:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129753.919198:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04600/0x48868a4e43949b40 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129753.919201:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04600/0x48868a4e43949b40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129753.919226:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04800/0x48868a4e43949b32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f953 expref: 21 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.919234:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9e00/0x48868a4e43949b47 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f953 expref: 20 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.919239:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129753.919241:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746129753.919243:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924f9e00, rc 0) 00000100:00100000:0.0:1746129753.919273:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:28672:x1830949052246656:12345-192.168.204.31@tcp:101:cat.0 Request processed in 543us (620us total) trans 8589943694 rc 0/0 00000100:00100000:0.0:1746129753.919278:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9908 00000100:00100000:0.0:1746129753.922033:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.922105:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.922231:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052247680 00000100:00100000:3.0:1746129753.922239:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052247680 00000100:00100000:3.0:1746129753.922274:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3899 00000100:00100000:3.0:1746129753.922281:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d63050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:28672:x1830949052247680:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:3.0:1746129753.922443:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d63050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:28672:x1830949052247680:12345-192.168.204.31@tcp:35:cat.0 Request processed in 161us (418us total) trans 8589943695 rc 0/0 00000100:00100000:3.0:1746129753.922449:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3899 00000100:00100000:3.0:1746129753.922501:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052247424 00000100:00100000:3.0:1746129753.922504:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052247424 00010000:00010000:3.0:1746129753.922523:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e43949aec lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f91b expref: 15 pid: 15044 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746129753.922541:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5331 00000100:00100000:3.0:1746129753.922545:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052247424:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129753.922553:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129753.922558:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e43949aec lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f91b expref: 15 pid: 15044 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746129753.922566:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e43949aec lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f91b expref: 15 pid: 15044 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746129753.922581:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129753.922585:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e43949b2b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129753.922592:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e43949b2b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129753.922597:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e43949b2b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129753.922608:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129753.922622:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052247424:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 77us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129753.922627:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5331 00010000:00010000:2.0:1746129753.922988:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e43949aec lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f91b expref: 14 pid: 15044 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746129753.923002:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053326720:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129753.923015:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e43949b2b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.923022:0:15044:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e43949b2b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.923026:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e43949b2b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:2.0:1746129753.923039:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129753.923099:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f5ca00/0x48868a4e43949b24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f95a expref: 15 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.923113:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e43949b2b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f95a expref: 14 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.923118:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129753.923120:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129753.923122:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11c00, rc 0) 00000100:00100000:2.0:1746129753.923144:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+14:28669:x1830949052247040:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 9008us (9334us total) trans 8589943696 rc 0/0 00000100:00100000:2.0:1746129753.923149:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9907 00000100:00100000:0.0:1746129753.925604:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.925626:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052247936 00000100:00100000:0.0:1746129753.925631:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052247936 00002000:00100000:0.0:1746129753.925663:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2494464->2498559) req@ffff880135d8e300 x1830949052247936/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129753.925673:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8e300 with x1830949052247936 ext(2494464->2498559) 00002000:00010000:0.0:1746129753.925677:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135d8e300 00000100:00100000:0.0:1746129753.925693:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4138 00000100:00100000:0.0:1746129753.925698:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949052247936:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129753.925820:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949052247936:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 120us (221us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129753.925829:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4138 00002000:00100000:0.0:1746129753.925834:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2494464->2498559) req@ffff880135d8e300 x1830949052247936/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/4536 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129753.925840:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8e300 with x1830949052247936 ext(2494464->2498559) 00002000:00010000:0.0:1746129753.925842:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135d8e300 00000100:00100000:0.0:1746129753.925949:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053326848:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129753.925962:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129753.925982:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131463480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+9:1964:x1830949052246784:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 11350us (11511us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129753.925988:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5330 00000100:00100000:0.0:1746129753.926656:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.926696:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.926718:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.927441:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052248064 00000100:00100000:3.0:1746129753.927447:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052248064 00000100:00100000:3.0:1746129753.927470:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052248192 00000100:00100000:3.0:1746129753.927472:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052248192 00000100:00100000:3.0:1746129753.927483:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11051 00000100:00100000:3.0:1746129753.927488:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1961:x1830949052248064:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:0.0:1746129753.927491:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11052 00000100:00100000:0.0:1746129753.927496:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052248192:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129753.927498:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129753.927502:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129753.927510:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a238c00/0x48868a4e43949b5c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f961 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.927510:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e43949b63 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f968 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129753.927542:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131462680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053326976:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129753.927542:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053327104:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129753.927591:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129753.927717:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052248448 00000100:00100000:2.0:1746129753.927721:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052248448 00000100:00100000:2.0:1746129753.927745:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9909 00000100:00100000:2.0:1746129753.927750:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+14:28669:x1830949052248448:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129753.927761:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.927770:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e43949b6a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f976 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.927826:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801305e2a00/0x48868a4e43949b71 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.927837:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e43949b2b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f95a expref: 15 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.927843:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801305e2a00/0x48868a4e43949b71 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.927883:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e43949b2b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f95a expref: 15 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.927893:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e43949b2b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f95a expref: 15 pid: 15044 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746129753.927901:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053327232:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129753.927927:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129753.932195:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129753.932306:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.932416:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.932442:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.932467:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052248704 00000100:00100000:0.0:1746129753.932473:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052248704 00010000:00010000:0.0:1746129753.932502:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e43949b2b lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f95a expref: 16 pid: 15044 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746129753.932524:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5332 00000100:00100000:0.0:1746129753.932531:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130565450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+16:1964:x1830949052248704:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129753.932542:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129753.932547:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e43949b2b lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f95a expref: 16 pid: 15044 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746129753.932556:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e43949b2b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f95a expref: 16 pid: 15044 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746129753.932574:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129753.932578:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801305e2a00/0x48868a4e43949b71 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129753.932586:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801305e2a00/0x48868a4e43949b71 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129753.932592:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801305e2a00/0x48868a4e43949b71 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129753.932605:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129753.932625:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130565450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+16:1964:x1830949052248704:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 94us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129753.932630:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5332 00000100:00100000:2.0:1746129753.932749:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052248832 00000100:00100000:2.0:1746129753.932752:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052248832 00002000:00100000:2.0:1746129753.932780:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3022848->3026943) req@ffff8800a02fd880 x1830949052248832/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.932794:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02fd880 with x1830949052248832 ext(3022848->3026943) 00002000:00010000:2.0:1746129753.932797:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a02fd880 00000100:00100000:2.0:1746129753.932810:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4139 00000100:00100000:2.0:1746129753.932815:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949052248832:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129753.932958:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949052248832:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 143us (541us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129753.932963:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4139 00002000:00100000:2.0:1746129753.932968:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3022848->3026943) req@ffff8800a02fd880 x1830949052248832/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/4536 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.932974:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02fd880 with x1830949052248832 ext(3022848->3026943) 00002000:00010000:2.0:1746129753.932976:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a02fd880 00000100:00100000:2.0:1746129753.932991:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052248320 00000100:00100000:2.0:1746129753.932993:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052248320 00000100:00100000:2.0:1746129753.933007:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11053 00000100:00100000:2.0:1746129753.933011:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1961:x1830949052248320:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129753.933018:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129753.933027:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acc1f400/0x48868a4e43949b78 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f96f expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129753.933055:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053327360:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129753.933078:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c19c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746129753.933101:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e43949b2b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f95a expref: 15 pid: 15044 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746129753.933113:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053327232:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129753.933125:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801305e2a00/0x48868a4e43949b71 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.933131:0:15044:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801305e2a00/0x48868a4e43949b71 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.933135:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801305e2a00/0x48868a4e43949b71 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:2.0:1746129753.933167:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:2.0:1746129753.933171:0:15044:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129753.933181:0:15044:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801305e2a00/0x48868a4e43949b71 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129753.933204:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e43949b6a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f976 expref: 15 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.933215:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801305e2a00/0x48868a4e43949b71 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f976 expref: 14 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129753.933221:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129753.933223:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129753.933225:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801305e2a00, rc 0) 00000100:00100000:2.0:1746129753.933243:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+14:28669:x1830949052248448:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5493us (6523us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129753.933248:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9909 00000100:00100000:3.0:1746129753.935801:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131462680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053326976:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129753.935826:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a238c00/0x48868a4e43949b5c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f961 expref: 22 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.935837:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a238c00/0x48868a4e43949b5c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f961 expref: 22 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.935845:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a238c00, rc 0) 00000100:00100000:3.0:1746129753.935902:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1961:x1830949052248064:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8412us (9246us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129753.935908:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11051 00000100:00100000:0.0:1746129753.936842:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.936897:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053327104:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129753.936913:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e43949b63 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f968 expref: 25 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129753.936923:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bf04800/0x48868a4e43949b63 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f968 expref: 25 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129753.936930:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf04800, rc 0) 00000100:00100000:0.0:1746129753.936949:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1962:x1830949052248192:12345-192.168.204.31@tcp:101:cat.0 Request processed in 9453us (10252us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129753.936955:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11052 00000100:00100000:0.0:1746129753.936969:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052248960 00000100:00100000:0.0:1746129753.936973:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052248960 00000100:00100000:0.0:1746129753.937052:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11054 00000100:00100000:0.0:1746129753.937058:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+9:1963:x1830949052248960:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129753.937071:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129753.937081:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf04e00/0x48868a4e43949b7f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f97d expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129753.937116:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053327488:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129753.937153:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129753.937179:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.937209:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.937267:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.937279:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052249088 00000100:00100000:0.0:1746129753.937282:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052249088 00000100:00100000:1.0:1746129753.937317:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052249216 00000100:00100000:1.0:1746129753.937320:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052249216 00000100:00100000:3.0:1746129753.937353:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052249344 00000100:00100000:3.0:1746129753.937367:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052249344 00000100:00100000:3.0:1746129753.937385:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11055 00000100:00100000:3.0:1746129753.937390:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949052249344:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129753.937396:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129753.937402:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a239400/0x48868a4e43949b86 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f992 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129753.937421:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131462680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053327616:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129753.937444:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129753.938166:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053327360:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129753.938187:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acc1f400/0x48868a4e43949b78 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f96f expref: 23 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.938195:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1f400/0x48868a4e43949b78 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f96f expref: 23 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129753.938203:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1f400, rc 0) 00000100:00100000:2.0:1746129753.940051:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949052248320:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7030us (7739us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129753.940059:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11053 00000100:00100000:0.0:1746129753.940448:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11056 00000100:00100000:1.0:1746129753.941170:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11057 00000100:00100000:1.0:1746129753.941177:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949052249216:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129753.941190:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129753.941202:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e1ab400/0x48868a4e43949b8d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f98b expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129753.941243:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053327744:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129753.941296:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b51f59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129753.941326:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129753.941413:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129753.941427:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052249472 00000100:00100000:1.0:1746129753.941432:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052249472 00000100:00100000:2.0:1746129753.941521:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052249728 00000100:00100000:2.0:1746129753.941524:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052249728 00000100:00100000:2.0:1746129753.941549:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3900 00000100:00100000:2.0:1746129753.941554:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:28666:x1830949052249728:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129753.941690:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:28666:x1830949052249728:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 135us (363us total) trans 8589943697 rc 0/0 00000100:00100000:2.0:1746129753.941696:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3900 00000100:00100000:0.0:1746129753.942324:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+12:1963:x1830949052249088:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:0.0:1746129753.942490:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131462680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053327616:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129753.942512:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a239400/0x48868a4e43949b86 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f992 expref: 13 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129753.942522:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a239400/0x48868a4e43949b86 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f992 expref: 13 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129753.942530:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a239400, rc 0) 00000100:00100000:0.0:1746129753.942547:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+12:1963:x1830949052249344:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5157us (5280us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129753.942553:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11055 00010000:00010000:0.0:1746129753.942590:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129753.942597:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a238a00/0x48868a4e43949b94 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f984 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129753.942621:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053327872:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129753.942645:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129753.942671:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053327488:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129753.942683:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bf04e00/0x48868a4e43949b7f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f97d expref: 11 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129753.942690:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bf04e00/0x48868a4e43949b7f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f97d expref: 11 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129753.942696:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf04e00, rc 0) 00000100:00100000:0.0:1746129753.942709:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+10:1963:x1830949052248960:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5651us (5870us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129753.942713:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11054 00000100:00100000:1.0:1746129753.943462:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11058 00000100:00100000:1.0:1746129753.943469:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+9:1964:x1830949052249472:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129753.943476:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129753.943485:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa400/0x48868a4e43949b9b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f999 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129753.943507:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053328000:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129753.943535:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b51f5600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129753.947868:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.947937:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129753.947957:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052249984 00000100:00100000:2.0:1746129753.947963:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052249984 00002000:00100000:2.0:1746129753.948001:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e8:0x0] (0->741375) req@ffff88009328ad80 x1830949052249984/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.948010:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328ad80 with x1830949052249984 ext(0->741375) 00002000:00010000:2.0:1746129753.948015:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009328ad80 00000100:00100000:2.0:1746129753.948043:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052250240 00000100:00100000:2.0:1746129753.948046:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052250240 00002000:00100000:2.0:1746129753.948059:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1597440->2097151) req@ffff880093288380 x1830949052250240/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.948065:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288380 with x1830949052250240 ext(1597440->2097151) 00002000:00010000:2.0:1746129753.948068:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093288380 00000100:00100000:2.0:1746129753.948080:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4140 00000100:00100000:2.0:1746129753.948086:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949052249984:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129753.948927:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4141 00000100:00100000:2.0:1746129753.948935:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1961:x1830949052250240:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129753.949427:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053327744:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129753.949453:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e1ab400/0x48868a4e43949b8d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f98b expref: 13 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129753.949463:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e1ab400/0x48868a4e43949b8d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f98b expref: 13 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129753.949471:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1ab400, rc 0) 00000100:00100000:0.0:1746129753.949521:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+12:1963:x1830949052249216:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 8343us (12310us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129753.949526:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11057 00000100:00100000:1.0:1746129753.958325:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053328000:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129753.958353:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa400/0x48868a4e43949b9b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f999 expref: 10 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129753.958380:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa400/0x48868a4e43949b9b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f999 expref: 10 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129753.958404:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1aa400, rc 0) 00000100:00100000:1.0:1746129753.958446:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+9:1964:x1830949052249472:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 14977us (17032us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129753.958457:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11058 00000100:00100000:0.0:1746129753.960319:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053327872:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129753.960764:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949052249984:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12676us (12918us total) trans 0 rc 741376/741376 00000100:00100000:3.0:1746129753.960772:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4140 00002000:00100000:3.0:1746129753.960780:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e8:0x0] (0->741375) req@ffff88009328ad80 x1830949052249984/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/440 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129753.960790:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328ad80 with x1830949052249984 ext(0->741375) 00002000:00010000:3.0:1746129753.960794:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009328ad80 00010000:00010000:0.0:1746129753.962567:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a238a00/0x48868a4e43949b94 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f984 expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129753.962583:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a238a00/0x48868a4e43949b94 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f984 expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129753.962594:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a238a00, rc 0) 00000100:00100000:0.0:1746129753.962632:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+10:1963:x1830949052249088:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 22175us (25451us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129753.962638:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11056 00000100:00100000:2.0:1746129753.965167:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1961:x1830949052250240:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16226us (17223us total) trans 0 rc 499712/499712 00000100:00100000:2.0:1746129753.965177:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4141 00002000:00100000:2.0:1746129753.965186:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e6:0x0] (1597440->2097151) req@ffff880093288380 x1830949052250240/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/440 e 0 to 0 dl 1746129764 ref 1 fl Complete:/200/0 rc 499712/499712 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129753.965194:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288380 with x1830949052250240 ext(1597440->2097151) 00002000:00010000:2.0:1746129753.965199:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093288380 00000100:00100000:0.0:1746129753.977368:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.977492:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.977514:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052250496 00000100:00100000:0.0:1746129753.977521:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052250496 00000100:00100000:0.0:1746129753.977552:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052250752 00000100:00100000:0.0:1746129753.977554:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052250752 00000100:00100000:0.0:1746129753.977567:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9910 00000100:00100000:0.0:1746129753.977573:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+14:28669:x1830949052250496:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129753.977587:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129753.977608:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238000/0x48868a4e43949ba2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f9a0 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.977686:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a239400/0x48868a4e43949ba9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129753.977697:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a239400/0x48868a4e43949ba9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129753.977707:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a239400/0x48868a4e43949ba9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:0.0:1746129753.977717:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129753.977798:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238000/0x48868a4e43949ba2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9a0 expref: 17 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.977809:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a239400/0x48868a4e43949ba9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9a0 expref: 16 pid: 16808 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129753.977816:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9911 00010000:00010000:0.0:1746129753.977816:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129753.977818:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129753.977821:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a239400, rc 0) 00000100:00100000:3.0:1746129753.977822:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:28675:x1830949052250752:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129753.977831:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129753.977838:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091b90600/0x48868a4e43949bb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f9a7 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129753.977881:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+16:28669:x1830949052250496:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 307us (529us total) trans 8589943698 rc 0/0 00000100:00100000:0.0:1746129753.977887:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9910 00010000:00010000:3.0:1746129753.977916:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091b90000/0x48868a4e43949bbe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.977923:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091b90000/0x48868a4e43949bbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.977930:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091b90000/0x48868a4e43949bbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.977938:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f7600/0x48868a4e43949bc5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.977943:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f7600/0x48868a4e43949bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.977948:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f7600/0x48868a4e43949bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.978053:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f6400/0x48868a4e43949bcc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.978061:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a239400/0x48868a4e43949ba9 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9a0 expref: 15 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.978067:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f6400/0x48868a4e43949bcc lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.978176:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a239400/0x48868a4e43949ba9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9a0 expref: 15 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.978186:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a239400/0x48868a4e43949ba9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9a0 expref: 15 pid: 16808 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746129753.978194:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131460e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053328128:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129753.978239:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129753.979293:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.979309:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052250880 00000100:00100000:0.0:1746129753.979313:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052250880 00000100:00100000:0.0:1746129753.979339:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11059 00000100:00100000:0.0:1746129753.979344:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:28672:x1830949052250880:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129753.979353:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129753.979376:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a238c00/0x48868a4e43949bd3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f9ae expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.979395:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f907000/0x48868a4e43949a13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f881 expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.979401:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129753.979403:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129753.979405:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a238c00/0x48868a4e43949bd3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9ae expref: 22 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.979423:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f907000/0x48868a4e43949a13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f881 expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.979431:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f907000/0x48868a4e43949a13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f881 expref: 21 pid: 4589 timeout: 800 lvb_type: 0 00000100:00100000:0.0:1746129753.979439:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053328256:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129753.979497:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129753.981400:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131460e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053328128:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129753.981417:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f6400/0x48868a4e43949bcc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:0.0:1746129753.981716:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.981744:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.981763:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.981787:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.981800:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.981805:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052251008 00000100:00100000:3.0:1746129753.981808:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052251008 00000100:00100000:3.0:1746129753.981830:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052251264 00000100:00100000:3.0:1746129753.981832:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052251264 00000100:00100000:0.0:1746129753.981840:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.981843:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052251520 00000100:00100000:3.0:1746129753.981845:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052251520 00000100:00100000:3.0:1746129753.981869:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052251136 00000100:00100000:3.0:1746129753.981871:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052251136 00000100:00100000:3.0:1746129753.981879:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052251392 00000100:00100000:3.0:1746129753.981880:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052251392 00000100:00100000:3.0:1746129753.981887:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052251648 00000100:00100000:3.0:1746129753.981889:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052251648 00000100:00100000:3.0:1746129753.981899:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11060 00000100:00100000:3.0:1746129753.981903:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949052251008:12345-192.168.204.31@tcp:1:lfs.0 00000100:00100000:0.0:1746129753.981908:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.981926:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11061 00010000:00010000:3.0:1746129753.981931:0:8435:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8800/0x48868a4e43949bda lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129753.981931:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+12:1963:x1830949052251264:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:3.0:1746129753.981943:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec400/0x48868a4e43949a98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8f8 expref: 21 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.981944:0:1140:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130a4c400/0x48868a4e43949be1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.981950:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129753.981951:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129753.981951:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129753.981953:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8800/0x48868a4e43949bda lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.981954:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a238c00/0x48868a4e43949bd3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9ae expref: 22 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.981959:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746129753.981961:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a4c400/0x48868a4e43949be1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.981973:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec400/0x48868a4e43949a98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8f8 expref: 21 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.981981:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec400/0x48868a4e43949a98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8f8 expref: 21 pid: 7976 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746129753.981986:0:1140:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a238c00/0x48868a4e43949bd3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9ae expref: 22 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129753.981990:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131460e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053328384:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129753.981993:0:1140:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880130a4c400/0x48868a4e43949be1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129753.982007:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11062 00000100:00100000:0.0:1746129753.982011:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949052251520:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:0.0:1746129753.982025:0:4589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130a4c800/0x48868a4e43949be8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.982033:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eb5aa00/0x48868a4e43949b1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2494464->3026943) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f94c expref: 30 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.982038:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1746129753.982039:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00010000:00010000:0.0:1746129753.982039:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129753.982041:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a4c800/0x48868a4e43949be8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129753.982052:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11063 00010000:00010000:0.0:1746129753.982053:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012eb5aa00/0x48868a4e43949b1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2494464->3026943) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f94c expref: 30 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129753.982056:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+12:1963:x1830949052251136:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:0.0:1746129753.982060:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012eb5aa00/0x48868a4e43949b1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2494464->3026943) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f94c expref: 30 pid: 7976 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746129753.982068:0:10930:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9000/0x48868a4e43949bef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129753.982068:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd45880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053328640:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129753.982076:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e43949aad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1597439) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f90d expref: 22 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.982085:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1746129753.982085:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ceb40 going to sleep for 11 seconds 00010000:00010000:3.0:1746129753.982086:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129753.982087:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9000/0x48868a4e43949bef lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129753.982095:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052251776 00000100:00100000:0.0:1746129753.982097:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052251776 00010000:00010000:3.0:1746129753.982099:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e43949aad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1597439) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f90d expref: 22 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.982105:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e43949aad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1597439) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f90d expref: 22 pid: 20441 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746129753.982109:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a239400/0x48868a4e43949ba9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9a0 expref: 16 pid: 16808 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746129753.982113:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131460380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053328768:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129753.982124:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5333 00000100:00100000:0.0:1746129753.982128:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+16:1961:x1830949052251776:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129753.982129:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68840 going to sleep for 11 seconds 00010000:00010000:0.0:1746129753.982135:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129753.982140:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11064 00010000:00010000:0.0:1746129753.982140:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a239400/0x48868a4e43949ba9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9a0 expref: 16 pid: 16808 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746129753.982144:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949052251392:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:0.0:1746129753.982148:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a239400/0x48868a4e43949ba9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9a0 expref: 16 pid: 16808 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746129753.982155:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8400/0x48868a4e43949bf6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.982162:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f98f400/0x48868a4e43949a2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f89d expref: 30 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.982162:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a239400/0x48868a4e43949ba9 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9a0 expref: 16 pid: 16808 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746129753.982167:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129753.982168:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129753.982170:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8400/0x48868a4e43949bf6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.982172:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129753.982177:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f6400/0x48868a4e43949bcc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.982184:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f98f400/0x48868a4e43949a2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f89d expref: 30 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.982184:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f6400/0x48868a4e43949bcc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129753.982189:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f6400/0x48868a4e43949bcc lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.982191:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f98f400/0x48868a4e43949a2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f89d expref: 30 pid: 7975 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746129753.982198:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131462300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053328896:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129753.982201:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129753.982214:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68300 going to sleep for 11 seconds 00000100:00100000:3.0:1746129753.982230:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11065 00000100:00100000:3.0:1746129753.982235:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+12:1963:x1830949052251648:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:3.0:1746129753.982248:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099ccb800/0x48868a4e43949bfd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.982257:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a149600/0x48868a4e43949a67 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8c7 expref: 21 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.982264:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e43949b16 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f945 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.982270:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135587000/0x48868a4e43949a91 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8f1 expref: 22 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.982274:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.982275:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129753.982277:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ccb800/0x48868a4e43949bfd lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.982290:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135587000/0x48868a4e43949a91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8f1 expref: 22 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.982297:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135587000/0x48868a4e43949a91 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8f1 expref: 22 pid: 7975 timeout: 800 lvb_type: 1 00000100:00100000:3.0:1746129753.982303:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131460700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053329024:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129753.983761:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e43949b16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f945 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129753.983772:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e43949b16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f945 expref: 12 pid: 8437 timeout: 800 lvb_type: 1 00000100:00100000:3.0:1746129753.983781:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053329152:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129753.983810:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a149600/0x48868a4e43949a67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8c7 expref: 21 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.983818:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a149600/0x48868a4e43949a67 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8c7 expref: 21 pid: 7975 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746129753.983825:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131463b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053329280:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129753.983832:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129753.983839:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68c00 going to sleep for 11 seconds 00010000:00010000:3.0:1746129753.983868:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f6400/0x48868a4e43949bcc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.983877:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f6400/0x48868a4e43949bcc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129753.983889:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129753.983972:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f6400/0x48868a4e43949bcc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.983979:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f6400/0x48868a4e43949bcc lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.983984:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f6400/0x48868a4e43949bcc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.983989:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b7f6400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129753.983992:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f6400/0x48868a4e43949bcc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.983998:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f6400/0x48868a4e43949bcc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.984008:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129753.984011:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129753.984014:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f6400/0x48868a4e43949bcc lrc: 2/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.984018:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f6400/0x48868a4e43949bcc lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.984032:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091b90000/0x48868a4e43949bbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.984037:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091b90000/0x48868a4e43949bbe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.984045:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091b90000/0x48868a4e43949bbe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.984049:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091b90000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129753.984051:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091b90000/0x48868a4e43949bbe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.984056:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091b90000/0x48868a4e43949bbe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.984062:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129753.984065:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129753.984066:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091b90000/0x48868a4e43949bbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.984070:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091b90000/0x48868a4e43949bbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.984088:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f7600/0x48868a4e43949bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.984093:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f7600/0x48868a4e43949bc5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.984098:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f7600/0x48868a4e43949bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.984101:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b7f7600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129753.984103:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f7600/0x48868a4e43949bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.984108:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f7600/0x48868a4e43949bc5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.984116:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88013265ba00) 00010000:00010000:3.0:1746129753.984118:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129753.984119:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f7600/0x48868a4e43949bc5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.984123:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f7600/0x48868a4e43949bc5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129753.984159:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091b90600/0x48868a4e43949bb7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9a7 expref: 23 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.984166:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091b90600/0x48868a4e43949bb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9a7 expref: 23 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129753.984173:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091b90600, rc 0) 00000100:00100000:3.0:1746129753.984196:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:28675:x1830949052250752:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6374us (6704us total) trans 8589943699 rc 301/301 00000100:00100000:3.0:1746129753.984202:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9911 00000100:00100000:0.0:1746129753.985902:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053328256:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129753.985924:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a238c00/0x48868a4e43949bd3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9ae expref: 22 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129753.985937:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a238c00, rc 0) 00000100:00100000:0.0:1746129753.985966:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:28672:x1830949052250880:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6622us (6674us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129753.985972:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11059 00000100:00100000:0.0:1746129753.986060:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949052251776:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3929us (4149us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129753.986066:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5333 00000100:00100000:0.0:1746129753.987062:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd45880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053328640:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129753.987086:0:4589:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880130a4c800/0x48868a4e43949be8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129753.987912:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131460380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053328768:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129753.987926:0:10930:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9000/0x48868a4e43949bef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129753.987945:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131462300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053328896:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129753.987952:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8400/0x48868a4e43949bf6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129753.987970:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131460e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053328384:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129753.987977:0:8435:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8800/0x48868a4e43949bda lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129753.987990:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131460700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053329024:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129753.987996:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053329152:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129753.988002:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131463b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053329280:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129753.988014:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099ccb800/0x48868a4e43949bfd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129753.988647:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.988665:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.988715:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.988735:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052251904 00000100:00100000:0.0:1746129753.988740:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052251904 00002000:00100000:0.0:1746129753.988773:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1990656->2097151) req@ffff88009fd46a00 x1830949052251904/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129753.988780:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd46a00 with x1830949052251904 ext(1990656->2097151) 00010000:00010000:0.0:1746129753.988787:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f907000/0x48868a4e43949a13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f881 expref: 22 pid: 4589 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746129753.988797:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f907000/0x48868a4e43949a13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f881 expref: 22 pid: 4589 timeout: 800 lvb_type: 0 00002000:00010000:0.0:1746129753.988803:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fd46a00 00000100:00100000:0.0:1746129753.988816:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052252032 00000100:00100000:0.0:1746129753.988818:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052252032 00002000:00100000:0.0:1746129753.988829:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e8:0x0] (741376->1048575) req@ffff88009fd45880 x1830949052252032/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129753.988835:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd45880 with x1830949052252032 ext(741376->1048575) 00010000:00010000:0.0:1746129753.988840:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec400/0x48868a4e43949a98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8f8 expref: 22 pid: 7976 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746129753.988862:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec400/0x48868a4e43949a98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8f8 expref: 22 pid: 7976 timeout: 800 lvb_type: 0 00002000:00010000:0.0:1746129753.988868:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fd45880 00000100:00100000:0.0:1746129753.988877:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052252416 00000100:00100000:0.0:1746129753.988879:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052252416 00002000:00100000:0.0:1746129753.988890:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1597439) req@ffff88009fd47100 x1830949052252416/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129753.988896:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd47100 with x1830949052252416 ext(1048576->1597439) 00010000:00010000:0.0:1746129753.988900:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e43949aad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1597439) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f90d expref: 22 pid: 20441 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746129753.988907:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e43949aad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1597439) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f90d expref: 22 pid: 20441 timeout: 800 lvb_type: 0 00002000:00010000:0.0:1746129753.988912:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fd47100 00000100:00100000:0.0:1746129753.988923:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 603 00000100:00100000:0.0:1746129753.988929:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052251904:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:0.0:1746129753.989072:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 604 00000100:00100000:0.0:1746129753.989077:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052252032:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129753.989305:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 605 00000100:00100000:0.0:1746129753.989311:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052252416:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129753.989787:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052252288 00000100:00100000:0.0:1746129753.989791:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052252288 00010000:00010000:0.0:1746129753.989806:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e43949b16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f945 expref: 13 pid: 8437 timeout: 800 lvb_type: 1 00000100:00100000:0.0:1746129753.989822:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5334 00000100:00100000:0.0:1746129753.989827:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949052252288:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129753.989835:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129753.989866:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e43949b16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f945 expref: 13 pid: 8437 timeout: 800 lvb_type: 1 00010000:00010000:0.0:1746129753.989875:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e43949b16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f945 expref: 13 pid: 8437 timeout: 800 lvb_type: 1 00010000:00010000:0.0:1746129753.989891:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e43949b16 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f945 expref: 13 pid: 8437 timeout: 800 lvb_type: 1 00010000:00010000:0.0:1746129753.989903:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129753.989925:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949052252288:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 97us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129753.989930:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5334 00000100:00100000:0.0:1746129753.996617:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.996756:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129753.996788:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052252672 00000100:00100000:0.0:1746129753.996794:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052252672 00010000:00010000:0.0:1746129753.996819:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135587000/0x48868a4e43949a91 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8f1 expref: 24 pid: 7975 timeout: 800 lvb_type: 1 00000100:00100000:0.0:1746129753.996858:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5335 00000100:00100000:0.0:1746129753.996864:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1962:x1830949052252672:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129753.996875:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129753.996891:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135587000/0x48868a4e43949a91 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8f1 expref: 24 pid: 7975 timeout: 800 lvb_type: 1 00010000:00010000:0.0:1746129753.996900:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135587000/0x48868a4e43949a91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8f1 expref: 24 pid: 7975 timeout: 800 lvb_type: 1 00010000:00010000:0.0:1746129753.996917:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135587000/0x48868a4e43949a91 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8f1 expref: 24 pid: 7975 timeout: 800 lvb_type: 1 00010000:00010000:0.0:1746129753.996928:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129753.996955:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1962:x1830949052252672:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 91us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129753.996960:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5335 00000100:00100000:3.0:1746129753.997227:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052252544 00000100:00100000:3.0:1746129753.997231:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052252544 00002000:00100000:3.0:1746129753.997253:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1753087) req@ffff88009fd45f80 x1830949052252544/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1746129764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129753.997262:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd45f80 with x1830949052252544 ext(1048576->1753087) 00010000:00010000:3.0:1746129753.997268:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f98f400/0x48868a4e43949a2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f89d expref: 31 pid: 7975 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746129753.997277:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f98f400/0x48868a4e43949a2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f89d expref: 31 pid: 7975 timeout: 800 lvb_type: 0 00002000:00010000:3.0:1746129753.997282:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fd45f80 00000100:00100000:3.0:1746129753.997294:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 606 00000100:00100000:3.0:1746129753.997299:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949052252544:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:2.0:1746129754.001092:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.001430:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.002564:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052251904:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 13632us (18728us total) trans 21474840326 rc 0/0 00000100:00100000:2.0:1746129754.002574:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 603 00002000:00100000:2.0:1746129754.002583:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1990656->2097151) req@ffff88009fd46a00 x1830949052251904/t21474840326(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1746129764 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.002598:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd46a00 with x1830949052251904 ext(1990656->2097151) 00010000:00010000:2.0:1746129754.002606:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f907000/0x48868a4e43949a13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f881 expref: 24 pid: 4589 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.002619:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f907000/0x48868a4e43949a13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f881 expref: 24 pid: 4589 timeout: 800 lvb_type: 0 00002000:00010000:2.0:1746129754.002625:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fd46a00 00000100:00100000:2.0:1746129754.002643:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052252160 00000100:00100000:2.0:1746129754.002648:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052252160 00002000:00100000:2.0:1746129754.002672:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2494464->3026943) req@ffff88009328bb80 x1830949052252160/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.002679:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328bb80 with x1830949052252160 ext(2494464->3026943) 00010000:00010000:2.0:1746129754.002684:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012eb5aa00/0x48868a4e43949b1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2494464->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f94c expref: 33 pid: 7976 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.002691:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012eb5aa00/0x48868a4e43949b1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2494464->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f94c expref: 33 pid: 7976 timeout: 800 lvb_type: 0 00002000:00010000:2.0:1746129754.002696:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009328bb80 00000100:00100000:2.0:1746129754.005540:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 607 00000100:00100000:2.0:1746129754.005558:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1963:x1830949052252160:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:0.0:1746129754.007078:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.007386:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052252800 00000100:00100000:0.0:1746129754.007394:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052252800 00010000:00010000:0.0:1746129754.007426:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a149600/0x48868a4e43949a67 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8c7 expref: 24 pid: 7975 timeout: 800 lvb_type: 0 00000100:00100000:0.0:1746129754.007453:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052252928 00000100:00100000:0.0:1746129754.007456:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052252928 00010000:00010000:0.0:1746129754.007470:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f907000/0x48868a4e43949a13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f881 expref: 25 pid: 4589 timeout: 800 lvb_type: 0 00000100:00100000:0.0:1746129754.007495:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5336 00000100:00100000:0.0:1746129754.007503:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1963:x1830949052252800:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129754.007516:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129754.007537:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a149600/0x48868a4e43949a67 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8c7 expref: 25 pid: 7975 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746129754.007547:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a149600/0x48868a4e43949a67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8c7 expref: 25 pid: 7975 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746129754.007568:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a149600/0x48868a4e43949a67 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8c7 expref: 25 pid: 7975 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746129754.007583:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.007585:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.007589:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099ccb800/0x48868a4e43949bfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.007597:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ccb800/0x48868a4e43949bfd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.007620:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129754.007657:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949052252800:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 153us (6225us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129754.007663:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5336 00000100:00100000:0.0:1746129754.007681:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5337 00000100:00100000:0.0:1746129754.007687:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949052252928:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129754.007695:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129754.007707:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f907000/0x48868a4e43949a13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f881 expref: 23 pid: 4589 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746129754.007715:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f907000/0x48868a4e43949a13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f881 expref: 23 pid: 4589 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746129754.007727:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f907000/0x48868a4e43949a13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f881 expref: 23 pid: 4589 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746129754.007740:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.007741:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.007746:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a238c00/0x48868a4e43949bd3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9ae expref: 22 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.007752:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a238c00/0x48868a4e43949bd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9ae expref: 22 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.007782:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a238c00/0x48868a4e43949bd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9ae expref: 22 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.007793:0:10980:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a238c00/0x48868a4e43949bd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9ae expref: 22 pid: 20441 timeout: 800 lvb_type: 0 00000100:00100000:0.0:1746129754.007804:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053329408:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129754.008895:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129754.010649:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1962:x1830949052252032:12345-192.168.204.31@tcp:4:cat.0 Request processed in 21566us (21999us total) trans 17179873176 rc 0/0 00000100:00100000:0.0:1746129754.010659:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 604 00002000:00100000:0.0:1746129754.010667:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e8:0x0] (741376->1048575) req@ffff88009fd45880 x1830949052252032/t17179873176(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1746129764 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129754.010676:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd45880 with x1830949052252032 ext(741376->1048575) 00010000:00010000:0.0:1746129754.010683:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec400/0x48868a4e43949a98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8f8 expref: 24 pid: 7976 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746129754.010692:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec400/0x48868a4e43949a98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8f8 expref: 24 pid: 7976 timeout: 800 lvb_type: 0 00002000:00010000:0.0:1746129754.010698:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fd45880 00010000:00010000:3.0:1746129754.016465:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099ccb800/0x48868a4e43949bfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.016479:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ccb800/0x48868a4e43949bfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.016506:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099ccb800/0x48868a4e43949bfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.016512:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099ccb800/0x48868a4e43949bfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.016517:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099ccb800/0x48868a4e43949bfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.016522:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099ccb800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129754.016525:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099ccb800/0x48868a4e43949bfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.016531:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099ccb800/0x48868a4e43949bfd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.016546:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099ccb800/0x48868a4e43949bfd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.016551:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099ccb800/0x48868a4e43949bfd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129754.017193:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949052251648:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 34953us (35347us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129754.017202:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11065 00000100:00100000:3.0:1746129754.019467:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd47b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053329408:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129754.019486:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129754.019522:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949052252928:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 11831us (12443us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129754.019531:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5337 00000100:00100000:3.0:1746129754.019711:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.019747:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052253056 00000100:00100000:2.0:1746129754.019753:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052253056 00010000:00010000:2.0:1746129754.019798:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec400/0x48868a4e43949a98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8f8 expref: 24 pid: 7976 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746129754.019819:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5338 00000100:00100000:2.0:1746129754.019827:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131463b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1961:x1830949052253056:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129754.019837:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129754.019870:0:10980:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2055 -> 2057 00010000:00010000:2.0:1746129754.019876:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec400/0x48868a4e43949a98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8f8 expref: 24 pid: 7976 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.019885:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec400/0x48868a4e43949a98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8f8 expref: 24 pid: 7976 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.019904:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec400/0x48868a4e43949a98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f8f8 expref: 24 pid: 7976 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.019914:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129754.019916:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129754.019920:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8800/0x48868a4e43949bda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.019928:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8800/0x48868a4e43949bda lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.019945:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129754.019965:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131463b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1961:x1830949052253056:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 139us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129754.019971:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5338 00010000:00010000:2.0:1746129754.019992:0:8435:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8800/0x48868a4e43949bda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.019998:0:8435:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8800/0x48868a4e43949bda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.020014:0:8435:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8800/0x48868a4e43949bda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.020020:0:8435:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8800/0x48868a4e43949bda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.020027:0:8435:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8800/0x48868a4e43949bda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.020032:0:8435:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ffb8800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129754.020035:0:8435:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8800/0x48868a4e43949bda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.020041:0:8435:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8800/0x48868a4e43949bda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.020050:0:8435:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8800/0x48868a4e43949bda lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.020055:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8800/0x48868a4e43949bda lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129754.020102:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949052251008:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 38197us (38387us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129754.020109:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11060 00000100:00100000:0.0:1746129754.023431:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.023779:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052253312 00000100:00100000:0.0:1746129754.023785:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052253312 00002000:00100000:0.0:1746129754.023814:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009fd45500 x1830949052253312/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129754.023822:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd45500 with x1830949052253312 ext(1048576->2097151) 00010000:00010000:0.0:1746129754.023829:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a238c00/0x48868a4e43949bd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9ae expref: 23 pid: 20441 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746129754.023840:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a238c00/0x48868a4e43949bd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9ae expref: 23 pid: 20441 timeout: 800 lvb_type: 0 00002000:00010000:0.0:1746129754.023860:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fd45500 00000100:00100000:0.0:1746129754.023875:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 608 00000100:00100000:0.0:1746129754.023881:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1961:x1830949052253312:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129754.041937:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:1962:x1830949052252416:12345-192.168.204.31@tcp:4:cat.0 Request processed in 52616us (53261us total) trans 21474840327 rc 0/0 00000100:00100000:0.0:1746129754.041948:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 605 00002000:00100000:0.0:1746129754.041959:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1597439) req@ffff88009fd47100 x1830949052252416/t21474840327(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1746129764 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129754.041968:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd47100 with x1830949052252416 ext(1048576->1597439) 00010000:00010000:0.0:1746129754.041977:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e43949aad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1597439) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f90d expref: 25 pid: 20441 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746129754.041988:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e43949aad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1597439) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f90d expref: 25 pid: 20441 timeout: 800 lvb_type: 0 00002000:00010000:0.0:1746129754.041995:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fd47100 00010000:00010000:3.0:1746129754.042287:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746129754.045248:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949052252544:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 47940us (48483us total) trans 17179873177 rc 0/0 00000100:00100000:3.0:1746129754.045260:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 606 00002000:00100000:3.0:1746129754.045270:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1753087) req@ffff88009fd45f80 x1830949052252544/t17179873177(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:494/0 lens 488/448 e 0 to 0 dl 1746129764 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.045278:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd45f80 with x1830949052252544 ext(1048576->1753087) 00010000:00010000:3.0:1746129754.045286:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f98f400/0x48868a4e43949a2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f89d expref: 35 pid: 7975 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746129754.045298:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f98f400/0x48868a4e43949a2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f89d expref: 35 pid: 7975 timeout: 800 lvb_type: 0 00002000:00010000:3.0:1746129754.045304:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fd45f80 00000100:00100000:1.0:1746129754.056697:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.056746:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.056800:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.057222:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1961:x1830949052253312:12345-192.168.204.31@tcp:3:cat.0 Request processed in 33340us (33797us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129754.057232:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 608 00002000:00100000:1.0:1746129754.057241:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009fd45500 x1830949052253312/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129754.057249:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd45500 with x1830949052253312 ext(1048576->2097151) 00010000:00010000:1.0:1746129754.057257:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a238c00/0x48868a4e43949bd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9ae expref: 23 pid: 20441 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746129754.057268:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a238c00/0x48868a4e43949bd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9ae expref: 23 pid: 20441 timeout: 800 lvb_type: 0 00002000:00010000:1.0:1746129754.057273:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fd45500 00000100:00100000:0.0:1746129754.057300:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1963:x1830949052252160:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 51750us (56215us total) trans 17179873178 rc 0/0 00000100:00100000:0.0:1746129754.057305:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 607 00002000:00100000:0.0:1746129754.057310:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2494464->3026943) req@ffff88009328bb80 x1830949052252160/t17179873178(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/448 e 0 to 0 dl 1746129765 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129754.057316:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328bb80 with x1830949052252160 ext(2494464->3026943) 00010000:00010000:0.0:1746129754.057321:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012eb5aa00/0x48868a4e43949b1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2494464->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f94c expref: 35 pid: 7976 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746129754.057329:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012eb5aa00/0x48868a4e43949b1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2494464->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f94c expref: 35 pid: 7976 timeout: 800 lvb_type: 0 00002000:00010000:0.0:1746129754.057334:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009328bb80 00000100:00100000:2.0:1746129754.057396:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052253696 00000100:00100000:2.0:1746129754.057402:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052253696 00010000:00010000:2.0:1746129754.057433:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f98f400/0x48868a4e43949a2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f89d expref: 35 pid: 7975 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746129754.057450:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052253824 00000100:00100000:2.0:1746129754.057452:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052253824 00010000:00010000:2.0:1746129754.057461:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e43949aad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1597439) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f90d expref: 23 pid: 20441 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746129754.057474:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5339 00000100:00100000:2.0:1746129754.057479:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130565050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949052253696:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129754.057491:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129754.057507:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f98f400/0x48868a4e43949a2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f89d expref: 35 pid: 7975 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.057517:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f98f400/0x48868a4e43949a2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f89d expref: 35 pid: 7975 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.057539:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f98f400/0x48868a4e43949a2f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f89d expref: 35 pid: 7975 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.057552:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129754.057554:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129754.057559:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8400/0x48868a4e43949bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.057568:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8400/0x48868a4e43949bf6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.057590:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129754.057619:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130565050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949052253696:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 138us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129754.057624:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5339 00000100:00100000:2.0:1746129754.057683:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5340 00000100:00100000:2.0:1746129754.057689:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1961:x1830949052253824:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129754.057696:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129754.057708:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e43949aad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1597439) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f90d expref: 23 pid: 20441 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.057717:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e43949aad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1597439) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f90d expref: 23 pid: 20441 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.057729:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf04400/0x48868a4e43949aad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1597439) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f90d expref: 23 pid: 20441 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.057739:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129754.057740:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129754.057743:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9000/0x48868a4e43949bef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.057753:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9000/0x48868a4e43949bef lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.057770:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129754.057793:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949052253824:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 103us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129754.057799:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5340 00000100:00100000:3.0:1746129754.058445:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052253568 00000100:00100000:3.0:1746129754.058449:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052253568 00000100:00100000:3.0:1746129754.058480:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9912 00000100:00100000:3.0:1746129754.058487:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:28678:x1830949052253568:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129754.058505:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129754.058521:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3c7800/0x48868a4e43949c0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f9b5 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.058611:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f7f600/0x48868a4e43949c12 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.058624:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130f7f600/0x48868a4e43949c12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.058632:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130f7f600/0x48868a4e43949c12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.058645:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d600/0x48868a4e43949c19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.058651:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d600/0x48868a4e43949c19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.058657:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d600/0x48868a4e43949c19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.058760:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d000/0x48868a4e43949c20 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.058771:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d000/0x48868a4e43949c20 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.058777:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d000/0x48868a4e43949c20 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129754.058787:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129754.058889:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d000/0x48868a4e43949c20 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.058900:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d000/0x48868a4e43949c20 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.058906:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d000/0x48868a4e43949c20 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.058911:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a0d000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129754.058914:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d000/0x48868a4e43949c20 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.058919:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d000/0x48868a4e43949c20 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.058929:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129754.058932:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129754.058935:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d000/0x48868a4e43949c20 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.058940:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d000/0x48868a4e43949c20 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.058953:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f7f600/0x48868a4e43949c12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.058958:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130f7f600/0x48868a4e43949c12 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.058962:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130f7f600/0x48868a4e43949c12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.058966:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130f7f600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129754.058968:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f7f600/0x48868a4e43949c12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.058975:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f7f600/0x48868a4e43949c12 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.058981:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129754.058983:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129754.058985:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130f7f600/0x48868a4e43949c12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.058989:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130f7f600/0x48868a4e43949c12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.058999:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d600/0x48868a4e43949c19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.059003:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d600/0x48868a4e43949c19 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.059007:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d600/0x48868a4e43949c19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.059011:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a0d600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129754.059012:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d600/0x48868a4e43949c19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.059016:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d600/0x48868a4e43949c19 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.059022:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800acd6ae00) 00010000:00010000:3.0:1746129754.059024:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129754.059025:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d600/0x48868a4e43949c19 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.059030:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d600/0x48868a4e43949c19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129754.059066:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3c7800/0x48868a4e43949c0b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9b5 expref: 295 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.059073:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3c7800/0x48868a4e43949c0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9b5 expref: 295 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.059080:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3c7800, rc 0) 00000100:00100000:3.0:1746129754.059139:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:28678:x1830949052253568:12345-192.168.204.31@tcp:101:cat.0 Request processed in 651us (2390us total) trans 8589943700 rc 301/301 00000100:00100000:3.0:1746129754.059145:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9912 00010000:00010000:3.0:1746129754.059174:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8400/0x48868a4e43949bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.059182:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8400/0x48868a4e43949bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.059200:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8400/0x48868a4e43949bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.059206:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8400/0x48868a4e43949bf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.059211:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8400/0x48868a4e43949bf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.059216:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ffb8400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129754.059219:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8400/0x48868a4e43949bf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.059225:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8400/0x48868a4e43949bf6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.059236:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8400/0x48868a4e43949bf6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.059241:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8400/0x48868a4e43949bf6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129754.059290:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+10:1963:x1830949052251392:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 77143us (77486us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129754.059297:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11064 00010000:00010000:3.0:1746129754.059323:0:10930:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9000/0x48868a4e43949bef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.059330:0:10930:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9000/0x48868a4e43949bef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.059346:0:10930:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9000/0x48868a4e43949bef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.059352:0:10930:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9000/0x48868a4e43949bef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.059371:0:10930:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9000/0x48868a4e43949bef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.059380:0:10930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ffb9000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129754.059382:0:10930:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9000/0x48868a4e43949bef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.059386:0:10930:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9000/0x48868a4e43949bef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.059393:0:10930:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9000/0x48868a4e43949bef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.059398:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9000/0x48868a4e43949bef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129754.059428:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+10:1963:x1830949052251136:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 77371us (77640us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129754.059433:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11063 00000100:00100000:1.0:1746129754.076289:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.076360:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129754.076410:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052254080 00000100:00100000:3.0:1746129754.076418:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052254080 00000100:00100000:3.0:1746129754.076453:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3901 00000100:00100000:3.0:1746129754.076460:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:28678:x1830949052254080:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:3.0:1746129754.076619:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:28678:x1830949052254080:12345-192.168.204.31@tcp:35:cat.0 Request processed in 159us (334us total) trans 8589943701 rc 0/0 00000100:00100000:3.0:1746129754.076625:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3901 00000100:00100000:0.0:1746129754.076774:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052254208 00000100:00100000:0.0:1746129754.076778:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052254208 00010000:00010000:0.0:1746129754.076797:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb5aa00/0x48868a4e43949b1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2494464->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f94c expref: 34 pid: 7976 timeout: 800 lvb_type: 0 00000100:00100000:0.0:1746129754.076817:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5341 00000100:00100000:0.0:1746129754.076822:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1963:x1830949052254208:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129754.076830:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129754.076864:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012eb5aa00/0x48868a4e43949b1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2494464->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f94c expref: 34 pid: 7976 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746129754.076874:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012eb5aa00/0x48868a4e43949b1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2494464->3026943) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f94c expref: 34 pid: 7976 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746129754.077477:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb5aa00/0x48868a4e43949b1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2494464->3026943) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f94c expref: 34 pid: 7976 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746129754.077489:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.077490:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.077494:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a4c800/0x48868a4e43949be8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.077501:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a4c800/0x48868a4e43949be8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.077522:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129754.077544:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1963:x1830949052254208:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 722us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129754.077550:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5341 00010000:00010000:0.0:1746129754.077567:0:4589:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880130a4c800/0x48868a4e43949be8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.077574:0:4589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a4c800/0x48868a4e43949be8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.077589:0:4589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130a4c800/0x48868a4e43949be8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.077595:0:4589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130a4c800/0x48868a4e43949be8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.077601:0:4589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130a4c800/0x48868a4e43949be8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.077605:0:4589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a4c800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129754.077608:0:4589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130a4c800/0x48868a4e43949be8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.077893:0:4589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130a4c800/0x48868a4e43949be8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.077905:0:4589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130a4c800/0x48868a4e43949be8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.077910:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a4c800/0x48868a4e43949be8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129754.077941:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+9:1963:x1830949052251520:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 95928us (96176us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129754.077946:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11062 00000100:00100000:1.0:1746129754.088905:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.088969:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052255488 00000100:00100000:2.0:1746129754.088976:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052255488 00000100:00100000:2.0:1746129754.089017:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9913 00000100:00100000:2.0:1746129754.089023:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:28680:x1830949052255488:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129754.089040:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129754.089054:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801363cec00/0x48868a4e43949c2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f9ed expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.089132:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801363ce400/0x48868a4e43949c35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089141:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801363ce400/0x48868a4e43949c35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089149:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801363ce400/0x48868a4e43949c35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089158:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801363cfc00/0x48868a4e43949c3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089163:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801363cfc00/0x48868a4e43949c3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089170:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801363cfc00/0x48868a4e43949c3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089248:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801363cee00/0x48868a4e43949c43 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089255:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801363cee00/0x48868a4e43949c43 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089260:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801363cee00/0x48868a4e43949c43 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:2.0:1746129754.089267:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129754.089319:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801363cee00/0x48868a4e43949c43 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089324:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801363cee00/0x48868a4e43949c43 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089330:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801363cee00/0x48868a4e43949c43 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089334:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801363cee00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129754.089337:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801363cee00/0x48868a4e43949c43 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089342:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801363cee00/0x48868a4e43949c43 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089350:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129754.089362:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129754.089365:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801363cee00/0x48868a4e43949c43 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089373:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801363cee00/0x48868a4e43949c43 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089383:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801363ce400/0x48868a4e43949c35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089387:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801363ce400/0x48868a4e43949c35 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089392:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801363ce400/0x48868a4e43949c35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089395:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801363ce400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129754.089397:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801363ce400/0x48868a4e43949c35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089401:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801363ce400/0x48868a4e43949c35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089406:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129754.089408:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129754.089410:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801363ce400/0x48868a4e43949c35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089413:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801363ce400/0x48868a4e43949c35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089418:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801363cfc00/0x48868a4e43949c3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089422:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801363cfc00/0x48868a4e43949c3c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089426:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801363cfc00/0x48868a4e43949c3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089429:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801363cfc00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129754.089431:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801363cfc00/0x48868a4e43949c3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089435:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801363cfc00/0x48868a4e43949c3c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089439:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e29a000) 00010000:00010000:2.0:1746129754.089441:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129754.089442:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801363cfc00/0x48868a4e43949c3c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089446:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801363cfc00/0x48868a4e43949c3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.089471:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801363cec00/0x48868a4e43949c2e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9ed expref: 297 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.089477:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801363cec00/0x48868a4e43949c2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9ed expref: 297 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.089483:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801363cec00, rc 0) 00000100:00100000:2.0:1746129754.089520:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:28680:x1830949052255488:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 496us (621us total) trans 8589943702 rc 301/301 00000100:00100000:2.0:1746129754.089525:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9913 00000100:00100000:0.0:1746129754.098912:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.098943:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.100333:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.100373:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.100399:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.100424:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.100438:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.100470:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.100502:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052254336 00000100:00100000:0.0:1746129754.100511:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052254336 00000100:00100000:0.0:1746129754.100560:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052254592 00000100:00100000:0.0:1746129754.100564:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052254592 00000100:00100000:0.0:1746129754.100582:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052254464 00000100:00100000:0.0:1746129754.100585:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052254464 00000100:00100000:0.0:1746129754.100600:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052254848 00000100:00100000:0.0:1746129754.100602:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052254848 00000100:00100000:0.0:1746129754.100616:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052254976 00000100:00100000:0.0:1746129754.100618:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052254976 00000100:00100000:0.0:1746129754.100628:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052255104 00000100:00100000:0.0:1746129754.100631:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052255104 00000100:00100000:0.0:1746129754.100638:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052255232 00000100:00100000:0.0:1746129754.100640:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052255232 00000100:00100000:0.0:1746129754.100652:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11066 00000100:00100000:0.0:1746129754.100660:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949052254336:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129754.100677:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129754.100698:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ee00/0x48868a4e43949c51 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f9bc expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129754.100722:0:4589:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e8:0x0] initial LVB size: 1048576, mtime: 0x6813d35a, atime: 0x6813d35a, ctime: 0x6813d35a, blocks: 0x809 00010000:00010000:0.0:1746129754.100740:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.100742:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.100752:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ee00/0x48868a4e43949c51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9bc expref: 36 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.100767:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ee00/0x48868a4e43949c51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9bc expref: 36 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.100777:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1ee00, rc 0) 00000100:00100000:0.0:1746129754.100826:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949052254336:12345-192.168.204.31@tcp:101:cat.0 Request processed in 165us (1920us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129754.100832:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11066 00000100:00100000:0.0:1746129754.100878:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11067 00000100:00100000:0.0:1746129754.100885:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:28672:x1830949052254592:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129754.100894:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129754.100904:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fa00/0x48868a4e43949c58 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f9ca expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129754.100919:0:4589:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3ea:0x0] initial LVB size: 2097152, mtime: 0x6813d35a, atime: 0x6813d359, ctime: 0x6813d35a, blocks: 0x821 00010000:00010000:0.0:1746129754.100931:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.100933:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.100938:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fa00/0x48868a4e43949c58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9ca expref: 24 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.100948:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fa00/0x48868a4e43949c58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9ca expref: 24 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.100955:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1fa00, rc 0) 00000100:00100000:0.0:1746129754.100980:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:28672:x1830949052254592:12345-192.168.204.31@tcp:101:cat.0 Request processed in 94us (2036us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129754.100985:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11067 00000100:00100000:0.0:1746129754.100998:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11068 00000100:00100000:0.0:1746129754.101004:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052254464:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129754.101012:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129754.101024:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949c5f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f9c3 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129754.101037:0:4589:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e6:0x0] initial LVB size: 2097152, mtime: 0x6813d35a, atime: 0x6813d35a, ctime: 0x6813d35a, blocks: 0x821 00010000:00010000:0.0:1746129754.101047:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.101048:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.101053:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949c5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9c3 expref: 25 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.101067:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949c5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9c3 expref: 25 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.101074:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1ea00, rc 0) 00000100:00100000:0.0:1746129754.101098:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949052254464:12345-192.168.204.31@tcp:101:cat.0 Request processed in 93us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129754.101103:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11068 00000100:00100000:0.0:1746129754.101116:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11069 00000100:00100000:0.0:1746129754.101122:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052254848:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129754.101129:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129754.101137:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fc00/0x48868a4e43949c66 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f9d1 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.101148:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.101157:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fc00/0x48868a4e43949c66 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9d1 expref: 25 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.101165:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fc00/0x48868a4e43949c66 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9d1 expref: 25 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.101174:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1fc00, rc 0) 00000100:00100000:0.0:1746129754.101196:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052254848:12345-192.168.204.31@tcp:101:cat.0 Request processed in 74us (796us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129754.101201:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11069 00000100:00100000:0.0:1746129754.101214:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11070 00000100:00100000:0.0:1746129754.101220:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949052254976:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129754.101227:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129754.101234:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acc1e000/0x48868a4e43949c6d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f9d8 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.101244:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.101245:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.101250:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acc1e000/0x48868a4e43949c6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9d8 expref: 36 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.101259:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acc1e000/0x48868a4e43949c6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9d8 expref: 36 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.101266:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1e000, rc 0) 00000100:00100000:0.0:1746129754.101287:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949052254976:12345-192.168.204.31@tcp:101:cat.0 Request processed in 67us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129754.101292:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11070 00000100:00100000:0.0:1746129754.101306:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11071 00000100:00100000:0.0:1746129754.101311:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949052255104:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129754.101318:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129754.101328:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acc1f400/0x48868a4e43949c74 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f9df expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129754.101340:0:4589:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3eb:0x0] initial LVB size: 4960928, mtime: 0x6813d35a, atime: 0x6813d35a, ctime: 0x6813d35a, blocks: 0x1629 00010000:00010000:0.0:1746129754.101349:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.101350:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.101370:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acc1f400/0x48868a4e43949c74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9df expref: 36 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.101381:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acc1f400/0x48868a4e43949c74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9df expref: 36 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.101388:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1f400, rc 0) 00000100:00100000:0.0:1746129754.101410:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1962:x1830949052255104:12345-192.168.204.31@tcp:101:cat.0 Request processed in 98us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129754.101415:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11071 00000100:00100000:0.0:1746129754.101426:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11072 00000100:00100000:0.0:1746129754.101431:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949052255232:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129754.101436:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129754.101445:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43949c7b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f9e6 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129754.101455:0:4589:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e8:0x0] initial LVB size: 4194304, mtime: 0x6813d35a, atime: 0x6813d35a, ctime: 0x6813d35a, blocks: 0x1029 00010000:00010000:0.0:1746129754.101461:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.101462:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.101466:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43949c7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9e6 expref: 24 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.101473:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43949c7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9e6 expref: 24 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.101479:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1f200, rc 0) 00000100:00100000:0.0:1746129754.101493:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949052255232:12345-192.168.204.31@tcp:101:cat.0 Request processed in 62us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129754.101500:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11072 00000100:00100000:0.0:1746129754.101516:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052254720 00000100:00100000:0.0:1746129754.101518:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052254720 00010000:00010000:0.0:1746129754.101530:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a238c00/0x48868a4e43949bd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9ae expref: 22 pid: 20441 timeout: 800 lvb_type: 0 00000100:00100000:0.0:1746129754.101544:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5342 00000100:00100000:0.0:1746129754.101549:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052254720:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129754.101555:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129754.101563:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a238c00/0x48868a4e43949bd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9ae expref: 22 pid: 20441 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746129754.101572:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a238c00/0x48868a4e43949bd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9ae expref: 22 pid: 20441 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746129754.101584:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a238c00/0x48868a4e43949bd3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9ae expref: 22 pid: 20441 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746129754.101591:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.101592:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.101596:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a4c400/0x48868a4e43949be1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.101602:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a4c400/0x48868a4e43949be1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.101616:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129754.101628:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1962:x1830949052254720:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 79us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129754.101633:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5342 00010000:00010000:0.0:1746129754.101658:0:1140:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880130a4c400/0x48868a4e43949be1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.101665:0:1140:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a4c400/0x48868a4e43949be1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.101680:0:1140:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130a4c400/0x48868a4e43949be1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.101686:0:1140:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130a4c400/0x48868a4e43949be1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.101693:0:1140:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130a4c400/0x48868a4e43949be1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.101699:0:1140:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a4c400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129754.101702:0:1140:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130a4c400/0x48868a4e43949be1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.101708:0:1140:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130a4c400/0x48868a4e43949be1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.101716:0:1140:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130a4c400/0x48868a4e43949be1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.101727:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a4c400/0x48868a4e43949be1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129754.101751:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+9:1963:x1830949052251264:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 119820us (120006us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129754.101756:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11061 00000100:00100000:0.0:1746129754.112680:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129754.114570:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052255744 00000100:00100000:3.0:1746129754.114582:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052255744 00000100:00100000:3.0:1746129754.114643:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9914 00000100:00100000:3.0:1746129754.114653:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6141239f-0c60-480d-830c-e22ba61457b0+15:28669:x1830949052255744:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:3.0:1746129754.114701:0:14313:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1746129754.114729:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801305e2a00/0x48868a4e43949b71 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f976 expref: 15 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.114749:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25fc00/0x48868a4e43949884 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7af expref: 14 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.114758:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129754.114762:0:14313:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129754.114831:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6141239f-0c60-480d-830c-e22ba61457b0+13:28669:x1830949052255744:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 178us (2160us total) trans 0 rc -116/-116 00000100:00100000:3.0:1746129754.114837:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9914 00000100:00080000:2.0:1746129754.115157:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746129754.131682:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.131705:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.131720:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.131782:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.131804:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052256000 00000100:00100000:1.0:1746129754.131811:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052256000 00002000:00100000:1.0:1746129754.131845:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88008f4dc380 x1830949052256000/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129754.131868:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4dc380 with x1830949052256000 ext(1048576->2097151) 00002000:00010000:1.0:1746129754.131873:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f4dc380 00000100:00100000:1.0:1746129754.131887:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052256384 00000100:00100000:1.0:1746129754.131890:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052256384 00002000:00100000:1.0:1746129754.131902:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88008f4ddf80 x1830949052256384/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129754.131908:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ddf80 with x1830949052256384 ext(1048576->2097151) 00002000:00010000:1.0:1746129754.131911:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f4ddf80 00000100:00100000:1.0:1746129754.131919:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052256512 00000100:00100000:1.0:1746129754.131921:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052256512 00002000:00100000:1.0:1746129754.131930:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88008f4ddc00 x1830949052256512/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129754.131937:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ddc00 with x1830949052256512 ext(0->1048575) 00002000:00010000:1.0:1746129754.131939:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f4ddc00 00000100:00100000:1.0:1746129754.131949:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4142 00000100:00100000:1.0:1746129754.131955:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1962:x1830949052256000:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129754.132981:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4143 00000100:00100000:1.0:1746129754.132988:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949052256384:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129754.136647:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052256768 00000100:00100000:3.0:1746129754.136656:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052256768 00000100:00100000:3.0:1746129754.136689:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3902 00000100:00100000:3.0:1746129754.136695:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6141239f-0c60-480d-830c-e22ba61457b0+13:28669:x1830949052256768:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1746129754.136866:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6141239f-0c60-480d-830c-e22ba61457b0+14:28669:x1830949052256768:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 170us (5160us total) trans 8589943703 rc 0/0 00000100:00100000:3.0:1746129754.136872:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3902 00000100:00100000:3.0:1746129754.136894:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4144 00000100:00100000:3.0:1746129754.136899:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949052256512:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129754.155949:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1962:x1830949052256000:12345-192.168.204.31@tcp:3:cat.0 Request processed in 23985us (24266us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129754.155960:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4142 00002000:00100000:0.0:1746129754.155969:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88008f4dc380 x1830949052256000/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129754.155978:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4dc380 with x1830949052256000 ext(1048576->2097151) 00002000:00010000:0.0:1746129754.155983:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f4dc380 00000100:00100000:1.0:1746129754.160325:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.160699:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949052256384:12345-192.168.204.31@tcp:3:cat.0 Request processed in 27710us (28975us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129754.160710:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4143 00002000:00100000:0.0:1746129754.160722:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88008f4ddf80 x1830949052256384/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129754.160731:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ddf80 with x1830949052256384 ext(1048576->2097151) 00002000:00010000:0.0:1746129754.160737:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f4ddf80 00000001:00080000:3.0:1746129754.167496:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873173 is committed 00000001:00080000:3.0:1746129754.167515:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873164 is committed 00000001:00080000:3.0:1746129754.167531:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873127 is committed 00000001:00080000:3.0:1746129754.167542:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873175 is committed 00000001:00080000:3.0:1746129754.167556:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873150 is committed 00000001:00080000:3.0:1746129754.167569:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873170 is committed 00000001:00080000:3.0:1746129754.167579:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873152 is committed 00000100:00100000:2.0:1746129754.168777:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052257024 00000100:00100000:2.0:1746129754.168786:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052257024 00000100:00100000:2.0:1746129754.168888:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3903 00000100:00100000:2.0:1746129754.168899:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6141239f-0c60-480d-830c-e22ba61457b0+14:28669:x1830949052257024:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:2.0:1746129754.169110:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6141239f-0c60-480d-830c-e22ba61457b0+15:28669:x1830949052257024:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 211us (8787us total) trans 8589943704 rc 0/0 00000100:00100000:2.0:1746129754.169117:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3903 00000100:00100000:3.0:1746129754.189721:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949052256512:12345-192.168.204.31@tcp:3:cat.0 Request processed in 52813us (57930us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129754.189735:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4144 00002000:00100000:3.0:1746129754.189744:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88008f4ddc00 x1830949052256512/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.189752:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ddc00 with x1830949052256512 ext(0->1048575) 00002000:00010000:3.0:1746129754.189757:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f4ddc00 00000100:00100000:0.0:1746129754.190239:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.190255:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.190268:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.190279:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.190296:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.190941:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052257280 00000100:00100000:2.0:1746129754.190948:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052257280 00000100:00100000:2.0:1746129754.190976:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052257536 00000100:00100000:2.0:1746129754.190978:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052257536 00000100:00100000:0.0:1746129754.190988:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052257152 00000100:00100000:0.0:1746129754.190992:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052257152 00000100:00100000:2.0:1746129754.190998:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052257408 00000100:00100000:2.0:1746129754.191000:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052257408 00000100:00100000:0.0:1746129754.191009:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052257664 00000100:00100000:0.0:1746129754.191011:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052257664 00000100:00100000:2.0:1746129754.191014:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11073 00000100:00100000:2.0:1746129754.191019:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1961:x1830949052257280:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:0.0:1746129754.191023:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11074 00000100:00100000:0.0:1746129754.191028:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1961:x1830949052257536:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129754.191032:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129754.191035:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129754.191045:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009536f200/0x48868a4e43949c82 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f9fb expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.191045:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e43949c89 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fa09 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.191060:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.191060:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129754.191062:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.191062:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129754.191068:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009536f200/0x48868a4e43949c82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9fb expref: 24 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.191068:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e43949c89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa09 expref: 10 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129754.191079:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009536f200/0x48868a4e43949c82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9fb expref: 24 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.191079:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e43949c89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa09 expref: 10 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129754.191087:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009536f200, rc 0) 00010000:00010000:0.0:1746129754.191088:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:2.0:1746129754.191110:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1961:x1830949052257280:12345-192.168.204.31@tcp:101:cat.0 Request processed in 91us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129754.191115:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11073 00000100:00100000:2.0:1746129754.191125:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11075 00000100:00100000:2.0:1746129754.191129:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052257152:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129754.191134:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129754.191134:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11076 00010000:00010000:2.0:1746129754.191140:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009536f000/0x48868a4e43949c90 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34f9f4 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129754.191141:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1961:x1830949052257408:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129754.191147:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129754.191149:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.191151:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129754.191152:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009536f000/0x48868a4e43949c90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9f4 expref: 11 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129754.191159:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5244600/0x48868a4e43949c97 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fa02 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.191160:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009536f000/0x48868a4e43949c90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9f4 expref: 11 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129754.191165:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009536f000, rc 0) 00002000:00010000:1.0:1746129754.191175:0:1140:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e7:0x0] initial LVB size: 2097152, mtime: 0x6813d35a, atime: 0x6813d359, ctime: 0x6813d35a, blocks: 0x81f 00010000:00010000:1.0:1746129754.191184:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.191191:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.191196:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5244600/0x48868a4e43949c97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa02 expref: 24 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129754.191204:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5244600/0x48868a4e43949c97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa02 expref: 24 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129754.191211:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5244600, rc 0) 00000100:00100000:3.0:1746129754.191212:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11077 00000100:00100000:3.0:1746129754.191219:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1961:x1830949052257664:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129754.191225:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129754.191231:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1b5f400/0x48868a4e43949c9e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fa10 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.191238:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129754.191239:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129754.191243:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1b5f400/0x48868a4e43949c9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa10 expref: 25 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129754.191256:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1b5f400/0x48868a4e43949c9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa10 expref: 25 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129754.191262:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1b5f400, rc 0) 00000100:00100000:0.0:1746129754.191492:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052257536:12345-192.168.204.31@tcp:101:cat.0 Request processed in 461us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129754.191497:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11074 00000100:00100000:1.0:1746129754.192700:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:1961:x1830949052257408:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1557us (2417us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129754.192707:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11076 00000100:00100000:3.0:1746129754.193119:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1961:x1830949052257664:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1898us (2819us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129754.193124:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11077 00000100:00100000:2.0:1746129754.193231:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052257152:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2099us (2960us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129754.193237:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11075 00000100:00100000:0.0:1746129754.203521:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.203693:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052257792 00000100:00100000:2.0:1746129754.203701:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052257792 00000100:00100000:2.0:1746129754.203733:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11078 00000100:00100000:2.0:1746129754.203739:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:28678:x1830949052257792:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129754.203753:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129754.203771:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009536fa00/0x48868a4e43949ca5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fa17 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.203789:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129754.203791:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129754.203798:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009536fa00/0x48868a4e43949ca5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa17 expref: 25 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.203811:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009536fa00/0x48868a4e43949ca5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa17 expref: 25 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.203820:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009536fa00, rc 0) 00000100:00100000:2.0:1746129754.203877:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:28678:x1830949052257792:12345-192.168.204.31@tcp:101:cat.0 Request processed in 137us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129754.203882:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11078 00000100:00100000:0.0:1746129754.216262:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.222636:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052257920 00000100:00100000:1.0:1746129754.222647:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052257920 00000100:00100000:1.0:1746129754.222692:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11079 00000100:00100000:1.0:1746129754.222702:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:28680:x1830949052257920:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129754.222718:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129754.222736:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43949cac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fa1e expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.222763:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43949c7b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9e6 expref: 26 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129754.222776:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1b5f400/0x48868a4e43949c9e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa10 expref: 23 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129754.222781:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.222783:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.222787:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43949cac lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3022848->3145727] (req 3022848->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa1e expref: 26 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.222817:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1b5f400/0x48868a4e43949c9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa10 expref: 23 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129754.222829:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b1b5f400/0x48868a4e43949c9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa10 expref: 23 pid: 3624 timeout: 800 lvb_type: 1 00000100:00100000:1.0:1746129754.222841:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053329536:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129754.222977:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43949c7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9e6 expref: 26 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129754.222987:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43949c7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9e6 expref: 26 pid: 4589 timeout: 800 lvb_type: 1 00000100:00100000:1.0:1746129754.222996:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053329664:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129754.223025:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8e480 going to sleep for 11 seconds 00000100:00100000:1.0:1746129754.229297:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.229331:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.229345:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129754.229494:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052258176 00000100:00100000:3.0:1746129754.229501:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052258176 00002000:00100000:3.0:1746129754.229536:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88008f4dce00 x1830949052258176/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.229545:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4dce00 with x1830949052258176 ext(2097152->3145727) 00002000:00010000:3.0:1746129754.229550:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f4dce00 00000100:00100000:3.0:1746129754.229563:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052258432 00000100:00100000:3.0:1746129754.229565:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052258432 00002000:00100000:3.0:1746129754.229572:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88008f4dd880 x1830949052258432/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.229578:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4dd880 with x1830949052258432 ext(3145728->4194303) 00002000:00010000:3.0:1746129754.229580:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f4dd880 00000100:00100000:3.0:1746129754.229585:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052258688 00000100:00100000:3.0:1746129754.229586:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052258688 00002000:00100000:3.0:1746129754.229593:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88008f4dd180 x1830949052258688/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.229599:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4dd180 with x1830949052258688 ext(2097152->3145727) 00010000:00010000:3.0:1746129754.229604:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b1b5f400/0x48868a4e43949c9e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa10 expref: 24 pid: 3624 timeout: 800 lvb_type: 1 00000100:00100000:1.0:1746129754.229687:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.229827:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.229884:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052258944 00000100:00100000:1.0:1746129754.229890:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052258944 00002000:00100000:1.0:1746129754.229913:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88008f4dd500 x1830949052258944/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129754.229920:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4dd500 with x1830949052258944 ext(3145728->4194303) 00010000:00010000:1.0:1746129754.229925:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b1b5f400/0x48868a4e43949c9e lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa10 expref: 25 pid: 3624 timeout: 800 lvb_type: 1 00010000:00010000:1.0:1746129754.229933:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b1b5f400/0x48868a4e43949c9e lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa10 expref: 25 pid: 3624 timeout: 800 lvb_type: 1 00002000:00010000:1.0:1746129754.229938:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f4dd500 00000100:00100000:1.0:1746129754.229960:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 609 00000100:00100000:1.0:1746129754.229968:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:1962:x1830949052258944:12345-192.168.204.31@tcp:3:cat.0 00010000:00010000:3.0:1746129754.230795:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b1b5f400/0x48868a4e43949c9e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa10 expref: 24 pid: 3624 timeout: 800 lvb_type: 1 00002000:00010000:3.0:1746129754.230804:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f4dd180 00000100:00100000:3.0:1746129754.230821:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 610 00000100:00100000:3.0:1746129754.230828:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:1962:x1830949052258688:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129754.231988:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4145 00000100:00100000:1.0:1746129754.231997:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052258176:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129754.232207:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4146 00000100:00100000:3.0:1746129754.232213:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052258432:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129754.232247:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052259072 00000100:00100000:1.0:1746129754.232251:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052259072 00010000:00010000:1.0:1746129754.232268:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43949c7b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9e6 expref: 27 pid: 4589 timeout: 800 lvb_type: 1 00000100:00100000:1.0:1746129754.232283:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5343 00000100:00100000:1.0:1746129754.232288:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949052259072:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129754.232295:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129754.232306:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43949c7b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9e6 expref: 27 pid: 4589 timeout: 800 lvb_type: 1 00010000:00010000:1.0:1746129754.232315:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43949c7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9e6 expref: 27 pid: 4589 timeout: 800 lvb_type: 1 00010000:00010000:1.0:1746129754.232332:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129754.232364:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949052259072:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 76us (2539us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129754.232370:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5343 00000100:00100000:1.0:1746129754.241588:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129754.241691:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052259456 00000100:00100000:3.0:1746129754.241699:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052259456 00002000:00100000:3.0:1746129754.241733:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff8800936dfb80 x1830949052259456/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.241742:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dfb80 with x1830949052259456 ext(1048576->2097151) 00002000:00010000:3.0:1746129754.241746:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dfb80 00000100:00100000:3.0:1746129754.241763:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4147 00000100:00100000:3.0:1746129754.241771:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052259456:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129754.242208:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.242449:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052259584 00000100:00100000:2.0:1746129754.242454:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052259584 00002000:00100000:2.0:1746129754.242471:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800936df800 x1830949052259584/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.242480:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936df800 with x1830949052259584 ext(1048576->2097151) 00002000:00010000:2.0:1746129754.242483:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936df800 00000100:00100000:2.0:1746129754.242495:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4148 00000100:00100000:2.0:1746129754.242499:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949052259584:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129754.242571:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053329536:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129754.242583:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43949c7b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9e6 expref: 27 pid: 4589 timeout: 800 lvb_type: 1 00000100:00100000:1.0:1746129754.242594:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053329664:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129754.242616:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43949cac lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3022848->3145727] (req 3022848->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa1e expref: 26 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.242628:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5244000, rc 0) 00000100:00100000:1.0:1746129754.242656:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:28680:x1830949052257920:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 19957us (26399us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129754.242662:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11079 00000100:00100000:0.0:1746129754.243436:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1962:x1830949052258944:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13468us (13749us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129754.243444:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 609 00002000:00100000:0.0:1746129754.243450:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88008f4dd500 x1830949052258944/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129754.243457:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4dd500 with x1830949052258944 ext(3145728->4194303) 00010000:00010000:0.0:1746129754.243462:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b1b5f400/0x48868a4e43949c9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa10 expref: 26 pid: 3624 timeout: 800 lvb_type: 1 00010000:00010000:0.0:1746129754.243474:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b1b5f400/0x48868a4e43949c9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa10 expref: 26 pid: 3624 timeout: 800 lvb_type: 1 00002000:00010000:0.0:1746129754.243479:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f4dd500 00000100:00100000:3.0:1746129754.259893:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1962:x1830949052258688:12345-192.168.204.31@tcp:3:cat.0 Request processed in 29057us (30536us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129754.259904:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 610 00002000:00100000:3.0:1746129754.259916:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88008f4dd180 x1830949052258688/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.259925:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4dd180 with x1830949052258688 ext(2097152->3145727) 00010000:00010000:3.0:1746129754.259934:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b1b5f400/0x48868a4e43949c9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa10 expref: 24 pid: 3624 timeout: 800 lvb_type: 1 00010000:00010000:3.0:1746129754.259947:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b1b5f400/0x48868a4e43949c9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa10 expref: 24 pid: 3624 timeout: 800 lvb_type: 1 00002000:00010000:3.0:1746129754.259958:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f4dd180 00000100:00100000:2.0:1746129754.261763:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052258176:12345-192.168.204.31@tcp:3:cat.0 Request processed in 29762us (32465us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129754.261772:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4145 00002000:00100000:2.0:1746129754.261781:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88008f4dce00 x1830949052258176/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.261789:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4dce00 with x1830949052258176 ext(2097152->3145727) 00002000:00010000:2.0:1746129754.261794:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f4dce00 00000100:00100000:1.0:1746129754.262292:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949052258432:12345-192.168.204.31@tcp:3:cat.0 Request processed in 30078us (32959us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129754.262298:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4146 00002000:00100000:1.0:1746129754.262303:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88008f4dd880 x1830949052258432/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129754.262309:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4dd880 with x1830949052258432 ext(3145728->4194303) 00002000:00010000:1.0:1746129754.262312:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f4dd880 00000100:00100000:0.0:1746129754.266290:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949052259584:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 23783us (24075us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129754.266299:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4148 00002000:00100000:0.0:1746129754.266309:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800936df800 x1830949052259584/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129754.266317:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936df800 with x1830949052259584 ext(1048576->2097151) 00002000:00010000:0.0:1746129754.266322:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936df800 00000100:00100000:0.0:1746129754.273099:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.273126:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052259712 00000100:00100000:0.0:1746129754.273133:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052259712 00000100:00100000:0.0:1746129754.273163:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11080 00000100:00100000:0.0:1746129754.273169:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:28672:x1830949052259712:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129754.273196:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129754.273210:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e43949cb3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fa25 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.273231:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.273237:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43949cac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3022848->3145727] (req 3022848->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa1e expref: 24 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.273625:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129754.273630:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e43949cb3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa25 expref: 25 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.273661:0:8435:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43949cac lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3022848->3145727] (req 3022848->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa1e expref: 24 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.274791:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e43949cb3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa25 expref: 25 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.274802:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11800, rc 0) 00000100:00100000:0.0:1746129754.274923:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:28672:x1830949052259712:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1751us (1828us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129754.274931:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11080 00000100:00100000:0.0:1746129754.274974:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.275081:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052259840 00000100:00100000:0.0:1746129754.275085:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052259840 00010000:00010000:0.0:1746129754.275103:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1b5f400/0x48868a4e43949c9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa10 expref: 25 pid: 3624 timeout: 800 lvb_type: 1 00000100:00100000:0.0:1746129754.275120:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5344 00000100:00100000:0.0:1746129754.275124:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:1961:x1830949052259840:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129754.275134:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129754.275150:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b1b5f400/0x48868a4e43949c9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa10 expref: 25 pid: 3624 timeout: 800 lvb_type: 1 00010000:00010000:0.0:1746129754.275158:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b1b5f400/0x48868a4e43949c9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa10 expref: 25 pid: 3624 timeout: 800 lvb_type: 1 00010000:00010000:0.0:1746129754.275174:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1b5f400/0x48868a4e43949c9e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa10 expref: 25 pid: 3624 timeout: 800 lvb_type: 1 00010000:00010000:0.0:1746129754.275185:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.275187:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.275192:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43949cac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa1e expref: 24 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.275197:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43949cac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa1e expref: 24 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.275215:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43949cac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa1e expref: 24 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.275224:0:7108:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43949cac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa1e expref: 24 pid: 8435 timeout: 800 lvb_type: 0 00000100:00100000:0.0:1746129754.275233:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053329920:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129754.275275:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b51f5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129754.275361:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052259456:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 33580us (33768us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129754.275368:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4147 00002000:00100000:3.0:1746129754.275376:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff8800936dfb80 x1830949052259456/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.275384:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dfb80 with x1830949052259456 ext(1048576->2097151) 00002000:00010000:3.0:1746129754.275387:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dfb80 00000100:00100000:1.0:1746129754.279346:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053329920:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129754.279359:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129754.279369:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129754.279406:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1961:x1830949052259840:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4280us (4431us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129754.279415:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5344 00000100:00100000:3.0:1746129754.279429:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052260096 00000100:00100000:3.0:1746129754.279434:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052260096 00002000:00100000:3.0:1746129754.280014:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3022848->3026943) req@ffff8800a02fc380 x1830949052260096/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.280023:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02fc380 with x1830949052260096 ext(3022848->3026943) 00010000:00010000:3.0:1746129754.280030:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43949cac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa1e expref: 25 pid: 8435 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746129754.280042:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43949cac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa1e expref: 25 pid: 8435 timeout: 800 lvb_type: 0 00002000:00010000:3.0:1746129754.280048:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a02fc380 00000100:00100000:3.0:1746129754.280062:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 611 00000100:00100000:3.0:1746129754.280068:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949052260096:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129754.280193:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949052260096:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 125us (842us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129754.280199:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 611 00002000:00100000:3.0:1746129754.280203:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3022848->3026943) req@ffff8800a02fc380 x1830949052260096/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/4536 e 0 to 0 dl 1746129765 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.280209:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02fc380 with x1830949052260096 ext(3022848->3026943) 00010000:00010000:3.0:1746129754.280213:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43949cac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa1e expref: 25 pid: 8435 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746129754.280220:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43949cac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa1e expref: 25 pid: 8435 timeout: 800 lvb_type: 0 00002000:00010000:3.0:1746129754.280225:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a02fc380 00000100:00100000:1.0:1746129754.287211:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.290186:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.290221:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.290280:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052260224 00000100:00100000:1.0:1746129754.290446:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052260224 00000100:00100000:1.0:1746129754.290485:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11081 00000100:00100000:1.0:1746129754.290491:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28675:x1830949052260224:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129754.290505:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129754.290517:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43949cba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fa2c expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.290537:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1f400/0x48868a4e43949c74 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9df expref: 23 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129754.290544:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e43949c89 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa09 expref: 11 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129754.290554:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.290555:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.290559:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43949cba lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2822144->3145727] (req 2822144->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa2c expref: 11 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.290581:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e43949c89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa09 expref: 11 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129754.290590:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e43949c89 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa09 expref: 11 pid: 7975 timeout: 800 lvb_type: 1 00000100:00100000:1.0:1746129754.290599:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053330048:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129754.290650:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800acc1f400/0x48868a4e43949c74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9df expref: 23 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129754.290657:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800acc1f400/0x48868a4e43949c74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9df expref: 23 pid: 4589 timeout: 800 lvb_type: 1 00000100:00100000:1.0:1746129754.290662:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053330176:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129754.290673:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129754.291496:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052260480 00000100:00100000:3.0:1746129754.291500:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052260480 00002000:00100000:3.0:1746129754.291525:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3022848->3145727) req@ffff88009328a680 x1830949052260480/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.291533:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328a680 with x1830949052260480 ext(3022848->3145727) 00010000:00010000:3.0:1746129754.291539:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43949cac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa1e expref: 25 pid: 8435 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746129754.291548:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43949cac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa1e expref: 25 pid: 8435 timeout: 800 lvb_type: 0 00002000:00010000:3.0:1746129754.291553:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009328a680 00000100:00100000:3.0:1746129754.291564:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052260736 00000100:00100000:3.0:1746129754.291566:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052260736 00002000:00100000:3.0:1746129754.291577:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880093289f80 x1830949052260736/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.291583:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289f80 with x1830949052260736 ext(2097152->3145727) 00010000:00010000:3.0:1746129754.291587:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1f400/0x48868a4e43949c74 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9df expref: 24 pid: 4589 timeout: 800 lvb_type: 1 00010000:00010000:3.0:1746129754.291594:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800acc1f400/0x48868a4e43949c74 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9df expref: 24 pid: 4589 timeout: 800 lvb_type: 1 00002000:00010000:3.0:1746129754.291598:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093289f80 00000100:00100000:3.0:1746129754.291620:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 612 00000100:00100000:3.0:1746129754.291626:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949052260480:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129754.291893:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 613 00000100:00100000:2.0:1746129754.291901:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949052260736:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129754.295776:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053330048:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129754.295787:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053330176:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129754.295810:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43949cba lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2822144->3145727] (req 2822144->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa2c expref: 11 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.295829:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1aac00, rc 0) 00000100:00100000:1.0:1746129754.295882:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28675:x1830949052260224:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5389us (8676us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129754.295890:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11081 00000100:00100000:3.0:1746129754.296026:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949052260480:12345-192.168.204.31@tcp:4:cat.0 Request processed in 4398us (5842us total) trans 21474840328 rc 0/0 00000100:00100000:3.0:1746129754.296033:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 612 00002000:00100000:3.0:1746129754.296039:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3022848->3145727) req@ffff88009328a680 x1830949052260480/t21474840328(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/448 e 0 to 0 dl 1746129765 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.296046:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328a680 with x1830949052260480 ext(3022848->3145727) 00010000:00010000:3.0:1746129754.296053:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43949cac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa1e expref: 27 pid: 8435 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746129754.296063:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43949cac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa1e expref: 27 pid: 8435 timeout: 800 lvb_type: 0 00002000:00010000:3.0:1746129754.296068:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009328a680 00000100:00100000:1.0:1746129754.302311:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.302377:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129754.302837:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949052260736:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10934us (12612us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129754.302866:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 613 00002000:00100000:3.0:1746129754.302877:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880093289f80 x1830949052260736/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.302885:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289f80 with x1830949052260736 ext(2097152->3145727) 00010000:00010000:3.0:1746129754.302893:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1f400/0x48868a4e43949c74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9df expref: 24 pid: 4589 timeout: 800 lvb_type: 1 00010000:00010000:3.0:1746129754.302904:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800acc1f400/0x48868a4e43949c74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9df expref: 24 pid: 4589 timeout: 800 lvb_type: 1 00002000:00010000:3.0:1746129754.302911:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093289f80 00000100:00100000:0.0:1746129754.303951:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052260864 00000100:00100000:0.0:1746129754.303959:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052260864 00010000:00010000:0.0:1746129754.303981:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e43949c89 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa09 expref: 11 pid: 7975 timeout: 800 lvb_type: 1 00000100:00100000:0.0:1746129754.304001:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052260992 00000100:00100000:0.0:1746129754.304003:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052260992 00010000:00010000:0.0:1746129754.304014:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43949cac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa1e expref: 27 pid: 8435 timeout: 800 lvb_type: 0 00000100:00100000:0.0:1746129754.304027:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5345 00000100:00100000:0.0:1746129754.304033:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052260864:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129754.304043:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129754.304058:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e43949c89 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa09 expref: 11 pid: 7975 timeout: 800 lvb_type: 1 00010000:00010000:0.0:1746129754.304066:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e43949c89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa09 expref: 11 pid: 7975 timeout: 800 lvb_type: 1 00010000:00010000:0.0:1746129754.304084:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e43949c89 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa09 expref: 11 pid: 7975 timeout: 800 lvb_type: 1 00010000:00010000:0.0:1746129754.304099:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129754.304120:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052260864:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 86us (1816us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129754.304125:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5345 00000100:00100000:0.0:1746129754.304141:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5346 00000100:00100000:0.0:1746129754.304145:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130564c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949052260992:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129754.304153:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129754.304165:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43949cac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa1e expref: 27 pid: 8435 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746129754.304172:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43949cac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa1e expref: 27 pid: 8435 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746129754.304186:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43949cac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa1e expref: 27 pid: 8435 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746129754.304196:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.304197:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.304203:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e43949cb3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa25 expref: 23 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.304209:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e43949cb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa25 expref: 23 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.304235:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e43949cb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa25 expref: 23 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129754.304246:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ff480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053330304:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129754.304299:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129754.309261:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ff480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053330304:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129754.309277:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129754.309311:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130564c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949052260992:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5163us (6932us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129754.309320:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5346 00000100:00100000:1.0:1746129754.311664:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.311693:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.311753:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052261120 00000100:00100000:0.0:1746129754.311760:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052261120 00000100:00100000:1.0:1746129754.311768:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.311784:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052261376 00000100:00100000:1.0:1746129754.311788:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052261376 00010000:00010000:1.0:1746129754.311806:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800acc1f400/0x48868a4e43949c74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9df expref: 24 pid: 4589 timeout: 800 lvb_type: 1 00000100:00100000:1.0:1746129754.311827:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5347 00000100:00100000:0.0:1746129754.311832:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052261248 00000100:00100000:1.0:1746129754.311833:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949052261376:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129754.311834:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052261248 00010000:00010000:1.0:1746129754.311844:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129754.311863:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11082 00000100:00100000:0.0:1746129754.311869:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:28678:x1830949052261120:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129754.311880:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129754.311893:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x48868a4e43949cc1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fa33 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.311910:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.311912:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.311917:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x48868a4e43949cc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa33 expref: 27 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.311930:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x48868a4e43949cc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa33 expref: 27 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.311937:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:0.0:1746129754.311970:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:28678:x1830949052261120:12345-192.168.204.31@tcp:101:cat.0 Request processed in 101us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129754.311975:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11082 00000100:00100000:2.0:1746129754.311982:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.311986:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11083 00000100:00100000:0.0:1746129754.311991:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:28680:x1830949052261248:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129754.311996:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129754.312004:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11600/0x48868a4e43949cc8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fa3a expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.312014:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.312016:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.312019:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11600/0x48868a4e43949cc8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->3649535] (req 3145728->3649535) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa3a expref: 26 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.312025:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11600/0x48868a4e43949cc8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->3649535] (req 3145728->3649535) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa3a expref: 26 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.312032:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11600, rc 0) 00000100:00100000:2.0:1746129754.312042:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052261632 00000100:00100000:2.0:1746129754.312046:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052261632 00000100:00100000:0.0:1746129754.312049:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:28680:x1830949052261248:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 58us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129754.312053:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11083 00002000:00100000:2.0:1746129754.312068:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880093288a80 x1830949052261632/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.312076:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288a80 with x1830949052261632 ext(2097152->3145727) 00002000:00010000:2.0:1746129754.312080:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093288a80 00000100:00100000:2.0:1746129754.312092:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4149 00000100:00100000:2.0:1746129754.312096:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1963:x1830949052261632:12345-192.168.204.31@tcp:3:multiop.0 00010000:00010000:1.0:1746129754.312310:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800acc1f400/0x48868a4e43949c74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9df expref: 25 pid: 4589 timeout: 800 lvb_type: 1 00010000:00010000:1.0:1746129754.312320:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800acc1f400/0x48868a4e43949c74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9df expref: 25 pid: 4589 timeout: 800 lvb_type: 1 00010000:00010000:1.0:1746129754.312333:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1f400/0x48868a4e43949c74 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9df expref: 25 pid: 4589 timeout: 800 lvb_type: 1 00010000:00010000:1.0:1746129754.312345:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.312346:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.312360:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43949cba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2822144->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa2c expref: 9 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.312367:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43949cba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2822144->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa2c expref: 9 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.312373:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.312374:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.312377:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11600/0x48868a4e43949cc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3649535) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa3a expref: 24 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.312383:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11600/0x48868a4e43949cc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3649535) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa3a expref: 24 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.312406:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11600/0x48868a4e43949cc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3649535) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa3a expref: 24 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129754.312417:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053330432:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129754.312474:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43949cba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2822144->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa2c expref: 9 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129754.312482:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053330560:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129754.312501:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4efdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129754.324044:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129754.324127:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052262144 00000100:00100000:3.0:1746129754.324134:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052262144 00002000:00100000:3.0:1746129754.324168:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2822144->2826239) req@ffff88009328b480 x1830949052262144/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.324177:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328b480 with x1830949052262144 ext(2822144->2826239) 00002000:00010000:3.0:1746129754.324182:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009328b480 00000100:00100000:3.0:1746129754.324211:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4150 00000100:00100000:3.0:1746129754.324218:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949052262144:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129754.325292:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949052262144:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 1071us (1255us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129754.325299:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4150 00002000:00100000:3.0:1746129754.325306:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2822144->2826239) req@ffff88009328b480 x1830949052262144/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/4536 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.325314:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328b480 with x1830949052262144 ext(2822144->2826239) 00002000:00010000:3.0:1746129754.325317:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009328b480 00000100:00100000:1.0:1746129754.325474:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053330432:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129754.325484:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053330560:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129754.325502:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129754.325526:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949052261376:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 13692us (13757us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129754.325533:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5347 00000001:00080000:3.0:1746129754.328918:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840327 is committed 00000001:00080000:3.0:1746129754.328931:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840323 is committed 00000001:00080000:3.0:1746129754.328936:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840321 is committed 00000001:00080000:3.0:1746129754.328943:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840314 is committed 00000001:00080000:3.0:1746129754.328957:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840324 is committed 00000001:00080000:3.0:1746129754.328966:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840318 is committed 00000001:00080000:3.0:1746129754.328982:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840326 is committed 00000100:00100000:0.0:1746129754.336292:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.336329:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.336378:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.336395:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052261888 00000100:00100000:0.0:1746129754.336396:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052262400 00000100:00100000:1.0:1746129754.336403:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052261888 00000100:00100000:0.0:1746129754.336403:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052262400 00002000:00100000:1.0:1746129754.336433:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800a02fdc00 x1830949052261888/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129754.336433:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8800a02ff480 x1830949052262400/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129754.336441:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02fdc00 with x1830949052261888 ext(2097152->3145727) 00002000:00100000:0.0:1746129754.336441:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02ff480 with x1830949052262400 ext(3145728->4194303) 00002000:00010000:0.0:1746129754.336445:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a02ff480 00002000:00010000:1.0:1746129754.336446:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a02fdc00 00000100:00100000:0.0:1746129754.337413:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052262656 00000100:00100000:0.0:1746129754.337418:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052262656 00002000:00100000:0.0:1746129754.337436:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800a02ff100 x1830949052262656/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129754.337449:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02ff100 with x1830949052262656 ext(3145728->4194303) 00002000:00010000:0.0:1746129754.337452:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a02ff100 00000100:00100000:1.0:1746129754.338043:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4151 00000100:00100000:1.0:1746129754.338057:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1962:x1830949052262400:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129754.338084:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4152 00000100:00100000:3.0:1746129754.338094:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1962:x1830949052261888:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129754.339129:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4153 00000100:00100000:3.0:1746129754.339137:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052262656:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129754.340195:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1963:x1830949052261632:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 28095us (28210us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129754.340203:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4149 00002000:00100000:2.0:1746129754.340210:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880093288a80 x1830949052261632/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.340218:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288a80 with x1830949052261632 ext(2097152->3145727) 00002000:00010000:2.0:1746129754.340222:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093288a80 00000100:00100000:3.0:1746129754.350331:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949052261888:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12231us (14039us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129754.350341:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4152 00002000:00100000:3.0:1746129754.350363:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800a02fdc00 x1830949052261888/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.350371:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02fdc00 with x1830949052261888 ext(2097152->3145727) 00002000:00010000:3.0:1746129754.350376:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a02fdc00 00000100:00100000:3.0:1746129754.352982:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052262656:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12834us (15591us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129754.352994:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4153 00002000:00100000:3.0:1746129754.353005:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800a02ff100 x1830949052262656/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.353013:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02ff100 with x1830949052262656 ext(3145728->4194303) 00002000:00010000:3.0:1746129754.353018:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a02ff100 00000100:00100000:3.0:1746129754.357032:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949052262400:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18973us (20693us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129754.357042:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4151 00002000:00100000:3.0:1746129754.357052:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8800a02ff480 x1830949052262400/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.357060:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02ff480 with x1830949052262400 ext(3145728->4194303) 00002000:00010000:3.0:1746129754.357065:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a02ff480 00000100:00100000:0.0:1746129754.358098:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129754.358153:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052262784 00000100:00100000:3.0:1746129754.358161:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052262784 00000100:00100000:3.0:1746129754.358198:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11084 00000100:00100000:3.0:1746129754.358204:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28672:x1830949052262784:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129754.358217:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129754.358232:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a2ee00/0x48868a4e43949ccf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fa41 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.358254:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11600/0x48868a4e43949cc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3649535) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa3a expref: 23 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.358261:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129754.358262:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129754.358265:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a2ee00/0x48868a4e43949ccf lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa41 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.358291:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11600/0x48868a4e43949cc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3649535) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa3a expref: 23 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.358300:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11600/0x48868a4e43949cc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3649535) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa3a expref: 23 pid: 8435 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746129754.358310:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053330688:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129754.358382:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129754.359250:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.359309:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052262912 00000100:00100000:0.0:1746129754.359313:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052262912 00000100:00100000:0.0:1746129754.359332:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11085 00000100:00100000:0.0:1746129754.359337:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28675:x1830949052262912:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129754.359345:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129754.359364:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43949cd6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fa48 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.359380:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e43949cb3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa25 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.359386:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x48868a4e43949cc1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa33 expref: 14 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.359391:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.359393:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.359395:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43949cd6 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->2654207] (req 2097152->2654207) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa48 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.359411:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x48868a4e43949cc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa33 expref: 14 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.359419:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x48868a4e43949cc1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa33 expref: 14 pid: 8435 timeout: 800 lvb_type: 0 00000100:00100000:0.0:1746129754.359427:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136887480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053330816:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129754.359462:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e43949cb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa25 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.359469:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e43949cb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa25 expref: 9 pid: 8435 timeout: 800 lvb_type: 0 00000100:00100000:0.0:1746129754.359476:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136884000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053330944:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129754.359491:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130803540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129754.361147:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129754.361202:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052263168 00000100:00100000:3.0:1746129754.361207:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052263168 00000100:00100000:3.0:1746129754.361238:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3904 00000100:00100000:3.0:1746129754.361244:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:28680:x1830949052263168:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:0.0:1746129754.361363:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136887480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053330816:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129754.361373:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053330688:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129754.361394:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a2ee00/0x48868a4e43949ccf lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa41 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.361419:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a2ee00, rc 0) 00000001:00080000:3.0:1746129754.361507:0:14316:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589943705 00000100:00100000:3.0:1746129754.361580:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:28680:x1830949052263168:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 334us (444us total) trans 8589943706 rc 0/0 00000100:00100000:3.0:1746129754.361586:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3904 00000020:00080000:3.0:1746129754.361590:0:14316:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1746129754.362495:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28672:x1830949052262784:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4288us (4398us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129754.362502:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11084 00000100:00100000:0.0:1746129754.364553:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.364589:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.364698:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136884000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053330944:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129754.364722:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43949cd6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->2654207] (req 2097152->2654207) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa48 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.364736:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:1.0:1746129754.364750:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052263424 00000100:00100000:1.0:1746129754.364756:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052263424 00010000:00010000:1.0:1746129754.364780:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x48868a4e43949cc1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa33 expref: 15 pid: 8435 timeout: 800 lvb_type: 0 00000100:00100000:1.0:1746129754.364802:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5348 00000100:00100000:1.0:1746129754.364809:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136884a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949052263424:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129754.364819:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129754.364823:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28675:x1830949052262912:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5484us (5574us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129754.364829:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11085 00010000:00010000:1.0:1746129754.364835:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x48868a4e43949cc1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa33 expref: 15 pid: 8435 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746129754.364865:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x48868a4e43949cc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa33 expref: 15 pid: 8435 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746129754.364884:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x48868a4e43949cc1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa33 expref: 15 pid: 8435 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746129754.364901:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129754.364918:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136884a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1964:x1830949052263424:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 110us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129754.364923:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5348 00000100:00100000:3.0:1746129754.364952:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052263296 00000100:00100000:3.0:1746129754.364957:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052263296 00002000:00100000:3.0:1746129754.364986:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3649535) req@ffff880136884e00 x1830949052263296/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.364994:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136884e00 with x1830949052263296 ext(3145728->3649535) 00010000:00010000:3.0:1746129754.365001:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11600/0x48868a4e43949cc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3649535) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa3a expref: 24 pid: 8435 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746129754.365016:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11600/0x48868a4e43949cc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3649535) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa3a expref: 24 pid: 8435 timeout: 800 lvb_type: 0 00002000:00010000:3.0:1746129754.365022:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136884e00 00000100:00100000:3.0:1746129754.365035:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 614 00000100:00100000:3.0:1746129754.365040:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1964:x1830949052263296:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129754.368556:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.370400:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052263552 00000100:00100000:1.0:1746129754.370409:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052263552 00000100:00100000:1.0:1746129754.370451:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11086 00000100:00100000:1.0:1746129754.370459:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:28678:x1830949052263552:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:0.0:1746129754.370468:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129754.370477:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129754.370492:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b538ae00/0x48868a4e43949cdd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fa4f expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.370513:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.370515:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.370521:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b538ae00/0x48868a4e43949cdd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa4f expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.370533:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b538ae00/0x48868a4e43949cdd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa4f expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.370549:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b538ae00, rc 0) 00000100:00100000:1.0:1746129754.370586:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:28678:x1830949052263552:12345-192.168.204.31@tcp:101:cat.0 Request processed in 128us (2037us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129754.370591:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11086 00000100:00100000:1.0:1746129754.370614:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052263680 00000100:00100000:1.0:1746129754.370616:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052263680 00010000:00010000:1.0:1746129754.370632:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e43949cb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa25 expref: 9 pid: 8435 timeout: 800 lvb_type: 0 00000100:00100000:1.0:1746129754.370647:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5349 00000100:00100000:1.0:1746129754.370652:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136887480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1964:x1830949052263680:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129754.370660:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129754.370675:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e43949cb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa25 expref: 9 pid: 8435 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746129754.370682:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e43949cb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa25 expref: 9 pid: 8435 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746129754.370694:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e43949cb3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa25 expref: 9 pid: 8435 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746129754.370701:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.370702:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.370706:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43949cd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2654207) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa48 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.370718:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43949cd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2654207) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa48 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.370738:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43949cd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2654207) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa48 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129754.370747:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053331072:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129754.370805:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4efdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129754.374191:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1964:x1830949052263296:12345-192.168.204.31@tcp:4:cat.0 Request processed in 9141us (9592us total) trans 17179873179 rc 0/0 00000100:00100000:3.0:1746129754.374201:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 614 00002000:00100000:3.0:1746129754.374211:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3649535) req@ffff880136884e00 x1830949052263296/t17179873179(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/448 e 0 to 0 dl 1746129765 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.374220:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136884e00 with x1830949052263296 ext(3145728->3649535) 00010000:00010000:3.0:1746129754.374228:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11600/0x48868a4e43949cc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3649535) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa3a expref: 26 pid: 8435 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746129754.374240:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11600/0x48868a4e43949cc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3649535) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa3a expref: 26 pid: 8435 timeout: 800 lvb_type: 0 00002000:00010000:3.0:1746129754.374246:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136884e00 00000100:00100000:0.0:1746129754.380177:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.380297:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053331072:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129754.380320:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129754.380372:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136887480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1964:x1830949052263680:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 9718us (9904us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129754.380382:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5349 00000100:00100000:1.0:1746129754.380406:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052263808 00000100:00100000:1.0:1746129754.380410:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052263808 00010000:00010000:1.0:1746129754.380429:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11600/0x48868a4e43949cc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3649535) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa3a expref: 26 pid: 8435 timeout: 800 lvb_type: 0 00000100:00100000:1.0:1746129754.380446:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5350 00000100:00100000:1.0:1746129754.380451:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136886a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949052263808:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129754.380460:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746129754.380577:0:7109:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129754 -> 1746129755 00002000:00010000:1.0:1746129754.380580:0:7109:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129754 -> 1746129755 00010000:00010000:1.0:1746129754.380586:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11600/0x48868a4e43949cc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3649535) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa3a expref: 26 pid: 8435 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746129754.380597:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11600/0x48868a4e43949cc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3649535) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa3a expref: 26 pid: 8435 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746129754.380614:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11600/0x48868a4e43949cc8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3649535) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa3a expref: 26 pid: 8435 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746129754.380734:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129754.380753:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052264064 00000100:00100000:3.0:1746129754.380756:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052264064 00002000:00100000:3.0:1746129754.380779:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880131460700 x1830949052264064/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.380793:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131460700 with x1830949052264064 ext(3145728->4194303) 00002000:00010000:3.0:1746129754.380796:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131460700 00010000:00010000:1.0:1746129754.380826:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.380828:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.380835:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a2ee00/0x48868a4e43949ccf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa41 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.380842:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a2ee00/0x48868a4e43949ccf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa41 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129754.380903:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4154 00000100:00100000:3.0:1746129754.380909:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949052264064:12345-192.168.204.31@tcp:3:cat.0 00010000:00010000:1.0:1746129754.380977:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093a2ee00/0x48868a4e43949ccf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa41 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129754.380987:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053331200:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129754.381038:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4efdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129754.388150:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053331200:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129754.388344:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129754.388395:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136886a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949052263808:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7941us (8222us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129754.388403:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5350 00000100:00100000:0.0:1746129754.394481:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.394514:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129754.394616:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052264320 00000100:00100000:2.0:1746129754.394620:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052264576 00000100:00100000:3.0:1746129754.394624:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052264320 00000100:00100000:2.0:1746129754.394625:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052264576 00002000:00100000:3.0:1746129754.394655:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2650112->2654207) req@ffff880136886300 x1830949052264320/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.394656:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880136884380 x1830949052264576/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.394663:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136886300 with x1830949052264320 ext(2650112->2654207) 00002000:00100000:2.0:1746129754.394663:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136884380 with x1830949052264576 ext(3145728->4194303) 00002000:00010000:3.0:1746129754.394668:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136886300 00002000:00010000:2.0:1746129754.394668:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136884380 00000100:00100000:2.0:1746129754.394684:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4155 00000100:00100000:2.0:1746129754.394691:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052264576:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129754.394699:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4156 00000100:00100000:3.0:1746129754.394705:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1961:x1830949052264320:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129754.394817:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1961:x1830949052264320:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 112us (342us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129754.394822:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4156 00002000:00100000:3.0:1746129754.394827:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2650112->2654207) req@ffff880136886300 x1830949052264320/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/4536 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.394833:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136886300 with x1830949052264320 ext(2650112->2654207) 00002000:00010000:3.0:1746129754.394836:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136886300 00000100:00100000:1.0:1746129754.395748:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949052264064:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14835us (15010us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129754.395756:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4154 00002000:00100000:1.0:1746129754.395762:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880131460700 x1830949052264064/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129754.395768:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131460700 with x1830949052264064 ext(3145728->4194303) 00002000:00010000:1.0:1746129754.395772:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131460700 00000100:00100000:0.0:1746129754.402089:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.402133:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.402160:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052264832 00000100:00100000:1.0:1746129754.402168:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052264832 00000100:00100000:1.0:1746129754.402199:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052264704 00000100:00100000:1.0:1746129754.402201:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052264704 00000100:00100000:1.0:1746129754.402215:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11087 00000100:00100000:2.0:1746129754.402219:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11088 00000100:00100000:1.0:1746129754.402221:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949052264832:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:2.0:1746129754.402225:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949052264704:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129754.402237:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129754.402237:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129754.402251:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6ea00/0x48868a4e43949ce4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fa56 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.402251:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b538b600/0x48868a4e43949ceb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fa5d expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.402274:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6ea00/0x48868a4e43949ce4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa56 expref: 26 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129754.402274:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b538b600/0x48868a4e43949ceb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa5d expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129754.402283:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6ea00/0x48868a4e43949ce4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa56 expref: 26 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129754.402283:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b538b600/0x48868a4e43949ceb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa5d expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129754.402297:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b538b600, rc 0) 00010000:00010000:2.0:1746129754.402308:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d6ea00, rc 0) 00000100:00100000:2.0:1746129754.402332:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949052264704:12345-192.168.204.31@tcp:101:cat.0 Request processed in 106us (198us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129754.402332:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949052264832:12345-192.168.204.31@tcp:101:cat.0 Request processed in 110us (250us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129754.402337:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11087 00000100:00100000:2.0:1746129754.402339:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11088 00000100:00100000:0.0:1746129754.405072:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129754.406243:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052265088 00000100:00100000:3.0:1746129754.406252:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052265088 00000100:00100000:0.0:1746129754.406778:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.407523:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052265216 00000100:00100000:1.0:1746129754.407528:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052265216 00000100:00100000:1.0:1746129754.407557:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11089 00000100:00100000:1.0:1746129754.407564:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:28678:x1830949052265216:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129754.407577:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129754.407867:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b538a400/0x48868a4e43949cf2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fa64 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.407887:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.407888:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.407895:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b538a400/0x48868a4e43949cf2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa64 expref: 26 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.407907:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b538a400/0x48868a4e43949cf2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa64 expref: 26 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.407916:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b538a400, rc 0) 00000100:00100000:1.0:1746129754.407953:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:28678:x1830949052265216:12345-192.168.204.31@tcp:101:cat.0 Request processed in 390us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129754.407958:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11089 00000100:00100000:3.0:1746129754.407987:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3905 00000100:00100000:3.0:1746129754.407995:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d62450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:28675:x1830949052265088:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129754.408148:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d62450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:28675:x1830949052265088:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 154us (3081us total) trans 8589943707 rc 0/0 00000100:00100000:3.0:1746129754.408153:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3905 00000100:00100000:2.0:1746129754.408665:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052264576:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 13973us (14148us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129754.408673:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4155 00002000:00100000:2.0:1746129754.408679:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880136884380 x1830949052264576/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.408687:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136884380 with x1830949052264576 ext(3145728->4194303) 00002000:00010000:2.0:1746129754.408690:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136884380 00000100:00100000:0.0:1746129754.423969:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.424056:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052265472 00000100:00100000:2.0:1746129754.424064:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052265472 00002000:00100000:2.0:1746129754.424101:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880136885180 x1830949052265472/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.424110:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136885180 with x1830949052265472 ext(4194304->4964351) 00002000:00010000:2.0:1746129754.424116:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136885180 00000100:00100000:2.0:1746129754.424148:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4157 00000100:00100000:2.0:1746129754.424155:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949052265472:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129754.431836:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.431894:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052265600 00000100:00100000:1.0:1746129754.431902:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052265600 00000100:00100000:1.0:1746129754.431945:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11090 00000100:00100000:1.0:1746129754.431953:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28672:x1830949052265600:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129754.431968:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129754.431981:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b538bc00/0x48868a4e43949cf9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fa6b expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.432006:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.432008:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.432014:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b538bc00/0x48868a4e43949cf9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa6b expref: 9 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.432027:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b538bc00/0x48868a4e43949cf9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa6b expref: 9 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.432035:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b538bc00, rc 0) 00000100:00100000:1.0:1746129754.432082:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28672:x1830949052265600:12345-192.168.204.31@tcp:101:cat.0 Request processed in 130us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129754.432088:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11090 00000100:00100000:0.0:1746129754.437186:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.437280:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052265856 00000100:00100000:1.0:1746129754.437288:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052265856 00002000:00100000:1.0:1746129754.437339:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880136887800 x1830949052265856/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129754.437365:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136887800 with x1830949052265856 ext(3145728->4194303) 00002000:00010000:1.0:1746129754.437381:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136887800 00000100:00100000:1.0:1746129754.437407:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4158 00000100:00100000:1.0:1746129754.437414:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1961:x1830949052265856:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129754.438002:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949052265472:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13846us (14039us total) trans 0 rc 770048/770048 00000100:00100000:2.0:1746129754.438010:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4157 00002000:00100000:2.0:1746129754.438015:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880136885180 x1830949052265472/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.438022:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136885180 with x1830949052265472 ext(4194304->4964351) 00002000:00010000:2.0:1746129754.438026:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136885180 00000100:00100000:0.0:1746129754.446729:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.447056:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052265984 00000100:00100000:0.0:1746129754.447091:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.447095:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052265984 00000100:00100000:1.0:1746129754.447212:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052266112 00000100:00100000:1.0:1746129754.447216:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052266112 00000100:00100000:1.0:1746129754.447253:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11091 00000100:00100000:1.0:1746129754.447328:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949052265984:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129754.447364:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129754.447388:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b538a000/0x48868a4e43949d00 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fa72 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.447428:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b538a000/0x48868a4e43949d00 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa72 expref: 27 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129754.447437:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b538a000/0x48868a4e43949d00 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa72 expref: 27 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129754.447483:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b538a000, rc 0) 00000100:00100000:1.0:1746129754.447548:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949052265984:12345-192.168.204.31@tcp:101:cat.0 Request processed in 232us (825us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129754.447586:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11092 00000100:00100000:0.0:1746129754.447595:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1963:x1830949052266112:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129754.447603:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129754.447624:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x48868a4e43949d07 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fa79 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.447640:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x48868a4e43949d07 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa79 expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.447648:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x48868a4e43949d07 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa79 expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.447658:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:0.0:1746129754.447676:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1963:x1830949052266112:12345-192.168.204.31@tcp:101:cat.0 Request processed in 83us (685us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129754.447682:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11092 00000100:00100000:1.0:1746129754.448500:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11091 00000100:00100000:1.0:1746129754.449140:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1961:x1830949052265856:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 11725us (11980us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129754.449147:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4158 00002000:00100000:1.0:1746129754.449164:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880136887800 x1830949052265856/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129754.449172:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136887800 with x1830949052265856 ext(3145728->4194303) 00002000:00010000:1.0:1746129754.449176:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136887800 00000100:00100000:0.0:1746129754.452422:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.453360:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052266240 00000100:00100000:2.0:1746129754.453380:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052266240 00000100:00100000:2.0:1746129754.453906:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11093 00000100:00100000:2.0:1746129754.453922:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1964:x1830949052266240:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129754.453943:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129754.453957:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f400/0x48868a4e43949d0e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fa80 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.453992:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f400/0x48868a4e43949d0e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa80 expref: 27 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129754.454003:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f400/0x48868a4e43949d0e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa80 expref: 27 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129754.454229:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d6f400, rc 0) 00000100:00100000:2.0:1746129754.454322:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1964:x1830949052266240:12345-192.168.204.31@tcp:101:cat.0 Request processed in 400us (1934us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129754.454327:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11093 00000100:00100000:2.0:1746129754.454950:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.454978:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.455013:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.455213:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052266624 00000100:00100000:0.0:1746129754.455217:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052266624 00000100:00100000:0.0:1746129754.455268:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052266368 00000100:00100000:0.0:1746129754.455270:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052266368 00000100:00100000:0.0:1746129754.455283:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052266496 00000100:00100000:0.0:1746129754.455284:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052266496 00000100:00100000:0.0:1746129754.455310:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11094 00000100:00100000:0.0:1746129754.455328:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949052266624:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129754.455353:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129754.455364:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e43949d15 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fa87 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.455398:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e43949d15 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa87 expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.455415:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e43949d15 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa87 expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.455426:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11800, rc 0) 00000100:00100000:0.0:1746129754.455461:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949052266624:12345-192.168.204.31@tcp:101:cat.0 Request processed in 145us (512us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129754.455466:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11094 00000100:00100000:0.0:1746129754.455488:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11095 00000100:00100000:0.0:1746129754.455494:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052266368:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129754.455501:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129754.455518:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x48868a4e43949d1c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fa8e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.455534:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x48868a4e43949d1c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa8e expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.455550:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x48868a4e43949d1c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa8e expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.455557:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10000, rc 0) 00000100:00100000:0.0:1746129754.455584:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052266368:12345-192.168.204.31@tcp:101:cat.0 Request processed in 90us (605us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129754.455590:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11095 00000100:00100000:0.0:1746129754.455609:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11096 00000100:00100000:0.0:1746129754.455614:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052266496:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129754.455621:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129754.455625:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb11200/0x48868a4e43949d23 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fa95 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.455654:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb11200/0x48868a4e43949d23 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa95 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.455662:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11200/0x48868a4e43949d23 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa95 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.455668:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11200, rc 0) 00000100:00100000:0.0:1746129754.455683:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052266496:12345-192.168.204.31@tcp:101:cat.0 Request processed in 69us (670us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129754.455690:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11096 00000100:00100000:0.0:1746129754.463703:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.463951:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052266880 00000100:00100000:1.0:1746129754.463960:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052266880 00002000:00100000:1.0:1746129754.463996:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880136885c00 x1830949052266880/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129754.464010:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136885c00 with x1830949052266880 ext(4194304->4964351) 00002000:00010000:1.0:1746129754.464014:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136885c00 00000100:00100000:1.0:1746129754.464044:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4159 00000100:00100000:1.0:1746129754.464052:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052266880:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129754.472951:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052266880:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8892us (9249us total) trans 0 rc 770048/770048 00000100:00100000:1.0:1746129754.472962:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4159 00002000:00100000:1.0:1746129754.472971:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880136885c00 x1830949052266880/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129754.472979:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136885c00 with x1830949052266880 ext(4194304->4964351) 00002000:00010000:1.0:1746129754.472984:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136885c00 00000100:00100000:0.0:1746129754.478045:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.478092:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.478203:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052267008 00000100:00100000:2.0:1746129754.478210:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052267008 00000100:00100000:2.0:1746129754.478254:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052267136 00000100:00100000:2.0:1746129754.478256:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052267136 00000100:00100000:2.0:1746129754.478626:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11097 00000100:00100000:2.0:1746129754.478634:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949052267008:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129754.478650:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129754.478665:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013558a800/0x48868a4e43949d2a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fa9c expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.478692:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013558a800/0x48868a4e43949d2a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa9c expref: 12 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129754.478702:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013558a800/0x48868a4e43949d2a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa9c expref: 12 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129754.478717:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013558a800, rc 0) 00000100:00100000:3.0:1746129754.478801:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11098 00000100:00100000:3.0:1746129754.478809:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1964:x1830949052267136:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129754.478817:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129754.478826:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4eb7800/0x48868a4e43949d31 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34faa3 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.478840:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4eb7800/0x48868a4e43949d31 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34faa3 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129754.478873:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4eb7800/0x48868a4e43949d31 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34faa3 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129754.478885:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4eb7800, rc 0) 00000100:00100000:2.0:1746129754.479269:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949052267008:12345-192.168.204.31@tcp:101:cat.0 Request processed in 634us (1229us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129754.479275:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11097 00000100:00100000:3.0:1746129754.479333:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1964:x1830949052267136:12345-192.168.204.31@tcp:101:cat.0 Request processed in 525us (1240us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129754.479338:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11098 00000100:00100000:0.0:1746129754.483093:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.483145:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129754.483409:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052267264 00000100:00100000:3.0:1746129754.483417:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052267264 00000100:00100000:3.0:1746129754.483448:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052267392 00000100:00100000:3.0:1746129754.483449:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052267392 00000100:00100000:3.0:1746129754.483462:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11099 00000100:00100000:3.0:1746129754.483469:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052267264:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129754.483482:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129754.483497:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4ce00/0x48868a4e43949d38 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34faaa expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.483521:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4ce00/0x48868a4e43949d38 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34faaa expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129754.483530:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4ce00/0x48868a4e43949d38 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34faaa expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129754.483539:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e4ce00, rc 0) 00000100:00100000:3.0:1746129754.483572:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052267264:12345-192.168.204.31@tcp:101:cat.0 Request processed in 104us (486us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129754.483576:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11099 00000100:00100000:3.0:1746129754.483591:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11100 00000100:00100000:3.0:1746129754.483595:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052267392:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129754.483601:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129754.483608:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4d800/0x48868a4e43949d3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fab1 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.483619:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4d800/0x48868a4e43949d3f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fab1 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129754.483625:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4d800/0x48868a4e43949d3f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fab1 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129754.483631:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e4d800, rc 0) 00000100:00100000:3.0:1746129754.483641:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052267392:12345-192.168.204.31@tcp:101:cat.0 Request processed in 46us (496us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129754.483645:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11100 00000100:00100000:0.0:1746129754.599996:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.600250:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052267648 00000100:00100000:2.0:1746129754.600259:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052267648 00000100:00100000:2.0:1746129754.600310:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9915 00000100:00100000:2.0:1746129754.600317:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:28691:x1830949052267648:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129754.600338:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129754.600382:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013558ba00/0x48868a4e43949d46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fab8 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.600534:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013558a800/0x48868a4e43949d4d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.600548:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013558a800/0x48868a4e43949d4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.600556:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013558a800/0x48868a4e43949d4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.600567:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013558a000/0x48868a4e43949d54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.600571:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013558a000/0x48868a4e43949d54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.600576:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013558a000/0x48868a4e43949d54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.600707:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013558b000/0x48868a4e43949d5b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.600714:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013558b000/0x48868a4e43949d5b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.600720:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013558b000/0x48868a4e43949d5b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:2.0:1746129754.600727:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129754.600793:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013558a800/0x48868a4e43949d4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.600799:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013558a800/0x48868a4e43949d4d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.600804:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013558a800/0x48868a4e43949d4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.600812:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013558a800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129754.600815:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013558a800/0x48868a4e43949d4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.600820:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013558a800/0x48868a4e43949d4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.600829:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129754.600831:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129754.600834:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013558a800/0x48868a4e43949d4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.600839:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013558a800/0x48868a4e43949d4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.601253:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013558a000/0x48868a4e43949d54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.601259:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013558a000/0x48868a4e43949d54 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.601263:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013558a000/0x48868a4e43949d54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.601268:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013558a000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129754.601270:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013558a000/0x48868a4e43949d54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.601274:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013558a000/0x48868a4e43949d54 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.601281:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e29ae00) 00010000:00010000:2.0:1746129754.601282:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129754.601285:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013558a000/0x48868a4e43949d54 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.601288:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013558a000/0x48868a4e43949d54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129754.601322:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013558ba00/0x48868a4e43949d46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fab8 expref: 301 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.601332:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013558b000/0x48868a4e43949d5b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fab8 expref: 300 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.601338:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129754.601339:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129754.601342:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013558b000, rc 0) 00000100:00100000:2.0:1746129754.601402:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:28691:x1830949052267648:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1084us (1412us total) trans 8589943708 rc 0/0 00000100:00100000:2.0:1746129754.601408:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9915 00000100:00100000:0.0:1746129754.602894:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129754.602976:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052267904 00000100:00100000:3.0:1746129754.602983:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052267904 00000100:00100000:3.0:1746129754.603025:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3906 00000100:00100000:3.0:1746129754.603032:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:28691:x1830949052267904:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:3.0:1746129754.603166:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+301:28691:x1830949052267904:12345-192.168.204.31@tcp:35:cat.0 Request processed in 134us (276us total) trans 8589943709 rc 0/0 00000100:00100000:3.0:1746129754.603172:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3906 00000100:00100000:0.0:1746129754.605064:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.605103:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.605135:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.605162:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052268032 00000100:00100000:0.0:1746129754.605167:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052268032 00000100:00100000:0.0:1746129754.605189:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052268160 00000100:00100000:0.0:1746129754.605191:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052268160 00000100:00100000:0.0:1746129754.605202:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11101 00000100:00100000:0.0:1746129754.605207:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949052268032:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129754.605219:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129754.605232:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x48868a4e43949d69 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fabf expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.605256:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x48868a4e43949d69 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fabf expref: 27 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.605265:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x48868a4e43949d69 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fabf expref: 27 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.605280:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10000, rc 0) 00000100:00100000:0.0:1746129754.605308:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949052268032:12345-192.168.204.31@tcp:101:cat.0 Request processed in 100us (205us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129754.605313:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11101 00000100:00100000:0.0:1746129754.605324:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11102 00000100:00100000:0.0:1746129754.605328:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1963:x1830949052268160:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129754.605334:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129754.605342:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb11600/0x48868a4e43949d70 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fac6 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.605368:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb11600/0x48868a4e43949d70 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fac6 expref: 16 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.605375:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11600/0x48868a4e43949d70 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fac6 expref: 16 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.605381:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11600, rc 0) 00000100:00100000:0.0:1746129754.605395:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1963:x1830949052268160:12345-192.168.204.31@tcp:101:cat.0 Request processed in 67us (260us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129754.605400:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11102 00000100:00100000:3.0:1746129754.605714:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052268416 00000100:00100000:3.0:1746129754.605718:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052268416 00000100:00100000:3.0:1746129754.605740:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9916 00000100:00100000:3.0:1746129754.605744:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+301:28690:x1830949052268416:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129754.605754:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129754.605763:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c400/0x48868a4e43949d77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34facd expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.605827:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4d800/0x48868a4e43949d7e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129754.605838:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013558b000/0x48868a4e43949d5b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fab8 expref: 302 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.605844:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4d800/0x48868a4e43949d7e lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129754.605887:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013558b000/0x48868a4e43949d5b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fab8 expref: 302 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.605899:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013558b000/0x48868a4e43949d5b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fab8 expref: 302 pid: 15044 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746129754.605907:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131460e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053331328:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129754.605953:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129754.608894:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131460e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053331328:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129754.608915:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4d800/0x48868a4e43949d7e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000100:00100000:0.0:1746129754.609094:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.610921:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052268544 00000100:00100000:1.0:1746129754.610930:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052268544 00010000:00010000:1.0:1746129754.610960:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013558b000/0x48868a4e43949d5b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fab8 expref: 303 pid: 15044 timeout: 800 lvb_type: 0 00000100:00100000:1.0:1746129754.610998:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5351 00000100:00100000:1.0:1746129754.611005:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+303:1962:x1830949052268544:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129754.611017:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129754.611022:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013558b000/0x48868a4e43949d5b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fab8 expref: 303 pid: 15044 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746129754.611032:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013558b000/0x48868a4e43949d5b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fab8 expref: 303 pid: 15044 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746129754.611056:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013558b000/0x48868a4e43949d5b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fab8 expref: 303 pid: 15044 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746129754.611087:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129754.611091:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4d800/0x48868a4e43949d7e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129754.611099:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4d800/0x48868a4e43949d7e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129754.611104:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4d800/0x48868a4e43949d7e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129754.611131:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129754.611176:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+302:1962:x1830949052268544:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 171us (2082us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129754.611181:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5351 00010000:00010000:3.0:1746129754.611708:0:15044:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4d800/0x48868a4e43949d7e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129754.611714:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4d800/0x48868a4e43949d7e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:3.0:1746129754.611730:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129754.611872:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c400/0x48868a4e43949d77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34facd expref: 303 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.611888:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4d800/0x48868a4e43949d7e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34facd expref: 302 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.611894:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129754.611896:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129754.611898:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e4d800, rc 0) 00000100:00100000:3.0:1746129754.611925:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+302:28690:x1830949052268416:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6180us (6866us total) trans 8589943710 rc 0/0 00000100:00100000:3.0:1746129754.611934:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9916 00000100:00100000:0.0:1746129754.614722:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.615382:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052268672 00000100:00100000:1.0:1746129754.615390:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052268672 00000100:00100000:1.0:1746129754.615426:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11103 00000100:00100000:1.0:1746129754.615433:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:28691:x1830949052268672:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129754.615448:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129754.615461:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b538ac00/0x48868a4e43949d8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fad4 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.615483:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43949cba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2822144->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa2c expref: 10 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.615495:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129754.615497:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129754.615500:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b538ac00/0x48868a4e43949d8c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fad4 expref: 27 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.615524:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43949cba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2822144->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa2c expref: 10 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.615536:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43949cba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2822144->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa2c expref: 10 pid: 8435 timeout: 800 lvb_type: 0 00000100:00100000:1.0:1746129754.615546:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053331456:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129754.615895:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4efdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129754.624777:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.625008:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053331456:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129754.625035:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b538ac00/0x48868a4e43949d8c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fad4 expref: 27 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.625049:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b538ac00, rc 0) 00000100:00100000:1.0:1746129754.626020:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:28691:x1830949052268672:12345-192.168.204.31@tcp:101:cat.0 Request processed in 10584us (11302us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129754.626032:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11103 00000100:00100000:2.0:1746129754.626738:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052268800 00000100:00100000:2.0:1746129754.626745:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052268800 00002000:00100000:2.0:1746129754.626775:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (2822144->3145727) req@ffff88009c137800 x1830949052268800/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.626784:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c137800 with x1830949052268800 ext(2822144->3145727) 00010000:00010000:2.0:1746129754.626791:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43949cba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa2c expref: 11 pid: 8435 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.626801:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43949cba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa2c expref: 11 pid: 8435 timeout: 800 lvb_type: 0 00002000:00010000:2.0:1746129754.626811:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c137800 00000100:00100000:2.0:1746129754.626835:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 615 00000100:00100000:2.0:1746129754.626840:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052268800:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129754.634593:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949052268800:12345-192.168.204.31@tcp:4:cat.0 Request processed in 7744us (9814us total) trans 17179873180 rc 0/0 00000100:00100000:2.0:1746129754.634603:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 615 00002000:00100000:2.0:1746129754.634612:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (2822144->3145727) req@ffff88009c137800 x1830949052268800/t17179873180(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/448 e 0 to 0 dl 1746129765 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.634621:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c137800 with x1830949052268800 ext(2822144->3145727) 00010000:00010000:2.0:1746129754.634631:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43949cba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa2c expref: 13 pid: 8435 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.634644:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43949cba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa2c expref: 13 pid: 8435 timeout: 800 lvb_type: 0 00002000:00010000:2.0:1746129754.634650:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c137800 00000100:00100000:0.0:1746129754.640952:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.640996:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129754.641238:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052269056 00000100:00100000:3.0:1746129754.641246:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052269056 00000100:00100000:1.0:1746129754.641472:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052269184 00000100:00100000:1.0:1746129754.641477:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052269184 00010000:00010000:1.0:1746129754.641498:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43949cba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa2c expref: 13 pid: 8435 timeout: 800 lvb_type: 0 00000100:00100000:1.0:1746129754.641538:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5352 00000100:00100000:1.0:1746129754.641545:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c136d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949052269184:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129754.641557:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746129754.641574:0:10980:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129754 -> 1746129755 00010000:00010000:1.0:1746129754.641579:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43949cba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa2c expref: 13 pid: 8435 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746129754.641589:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43949cba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2822144->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa2c expref: 13 pid: 8435 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746129754.641609:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43949cba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2822144->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa2c expref: 13 pid: 8435 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746129754.641623:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.641625:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.641631:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b538ac00/0x48868a4e43949d8c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fad4 expref: 26 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.641638:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b538ac00/0x48868a4e43949d8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fad4 expref: 26 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.641664:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b538ac00/0x48868a4e43949d8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fad4 expref: 26 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129754.641674:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053331584:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129754.641738:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4efdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129754.642124:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9917 00000100:00100000:3.0:1746129754.642132:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:28694:x1830949052269056:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129754.642148:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129754.642160:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb6c00/0x48868a4e43949d93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fadb expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.642239:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c400/0x48868a4e43949d9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129754.642249:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c400/0x48868a4e43949d9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129754.642257:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c400/0x48868a4e43949d9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129754.642266:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c800/0x48868a4e43949da1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129754.642271:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c800/0x48868a4e43949da1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129754.642275:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c800/0x48868a4e43949da1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129754.642371:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4ce00/0x48868a4e43949da8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129754.642378:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4ce00/0x48868a4e43949da8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129754.642385:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4ce00/0x48868a4e43949da8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:3.0:1746129754.642391:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129754.642456:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c400/0x48868a4e43949d9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129754.642462:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c400/0x48868a4e43949d9a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129754.642467:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c400/0x48868a4e43949d9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129754.642472:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4e4c400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129754.642476:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c400/0x48868a4e43949d9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129754.642481:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c400/0x48868a4e43949d9a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129754.642488:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129754.642491:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129754.642494:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c400/0x48868a4e43949d9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129754.642498:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c400/0x48868a4e43949d9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129754.642519:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c800/0x48868a4e43949da1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129754.642523:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c800/0x48868a4e43949da1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129754.642531:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c800/0x48868a4e43949da1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129754.642535:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4e4c800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129754.642537:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c800/0x48868a4e43949da1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129754.642542:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c800/0x48868a4e43949da1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129754.642547:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e2d8f00) 00010000:00010000:3.0:1746129754.642549:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129754.642551:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c800/0x48868a4e43949da1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129754.642555:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c800/0x48868a4e43949da1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129754.642584:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb6c00/0x48868a4e43949d93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fadb expref: 26 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.642594:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4ce00/0x48868a4e43949da8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fadb expref: 25 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.642599:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129754.642601:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129754.642603:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e4ce00, rc 0) 00000100:00100000:3.0:1746129754.642629:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:28694:x1830949052269056:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 499us (1685us total) trans 8589943711 rc 0/0 00000100:00100000:3.0:1746129754.642635:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9917 00000100:00100000:2.0:1746129754.643936:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053331584:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129754.643956:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129754.643994:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c136d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052269184:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2448us (2995us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129754.644002:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5352 00000100:00100000:3.0:1746129754.653381:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129754.653435:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129754.653463:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052269568 00000100:00100000:3.0:1746129754.653471:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052269568 00000100:00100000:3.0:1746129754.653527:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 573 00000100:00100000:3.0:1746129754.653535:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130564850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:1962:x1830949052269568:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129754.653549:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129754.653570:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4ce00/0x48868a4e43949da8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fadb expref: 25 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.653584:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129754.653588:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129754.653619:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130564850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1962:x1830949052269568:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 86us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129754.653625:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 573 00000100:00100000:2.0:1746129754.653877:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052269440 00000100:00100000:2.0:1746129754.653881:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052269440 00002000:00100000:2.0:1746129754.653909:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880131460e00 x1830949052269440/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.653918:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131460e00 with x1830949052269440 ext(2097152->3145727) 00002000:00010000:2.0:1746129754.653922:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131460e00 00000100:00100000:2.0:1746129754.653943:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4160 00000100:00100000:2.0:1746129754.653948:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949052269440:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129754.661038:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746129754.661054:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053331712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746129754.661104:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129754.661140:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053331712 00000100:00100000:2.0:1746129754.661146:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053331712 00000100:00100000:2.0:1746129754.661184:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1746129754.661190:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1830949053331712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746129754.661207:0:8438:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 320012288 pending 1703936 free 3853516800 avail 3836739584 00000100:00080000:1.0:1746129754.661229:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746129754.661235:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1830949053331712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129754.661241:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1746129754.661269:0:3296:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840318 gen 2 00000004:00080000:2.0:1746129754.661273:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c6d80, transno 21474840282 00000004:00080000:2.0:1746129754.661279:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c5880, transno 21474840283 00000004:00080000:2.0:1746129754.661281:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c6a00, transno 21474840284 00000004:00080000:2.0:1746129754.661283:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c6300, transno 21474840285 00000004:00080000:2.0:1746129754.661284:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c5180, transno 21474840286 00000004:00080000:2.0:1746129754.661286:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c5500, transno 21474840287 00000004:00080000:2.0:1746129754.661288:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c6680, transno 21474840288 00000004:00080000:2.0:1746129754.661289:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c5f80, transno 21474840289 00000004:00080000:2.0:1746129754.661291:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c7480, transno 21474840290 00000004:00080000:2.0:1746129754.661294:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d634000, transno 21474840291 00000004:00080000:2.0:1746129754.661296:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c4380, transno 21474840292 00000004:00080000:2.0:1746129754.661298:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d635f80, transno 21474840293 00000004:00080000:2.0:1746129754.661299:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c7800, transno 21474840294 00000004:00080000:2.0:1746129754.661301:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d637b80, transno 21474840295 00000004:00080000:2.0:1746129754.661302:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c7b80, transno 21474840296 00000004:00080000:2.0:1746129754.661304:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d634a80, transno 21474840297 00000004:00080000:2.0:1746129754.661306:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d4000, transno 21474840303 00000004:00080000:2.0:1746129754.661308:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423d880, transno 21474840304 00000004:00080000:2.0:1746129754.661310:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d7b80, transno 21474840305 00000004:00080000:2.0:1746129754.661313:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130505c00, transno 21474840306 00000004:00080000:2.0:1746129754.661315:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d4a80, transno 21474840307 00000004:00080000:2.0:1746129754.661317:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d6d80, transno 21474840308 00000004:00080000:2.0:1746129754.661319:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d5c00, transno 21474840309 00000004:00080000:2.0:1746129754.661320:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d7800, transno 21474840310 00000004:00080000:2.0:1746129754.661322:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00d500, transno 21474840311 00000004:00080000:2.0:1746129754.661324:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00e680, transno 21474840312 00000004:00080000:2.0:1746129754.661326:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936df100, transno 21474840313 00000004:00080000:2.0:1746129754.661329:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936dea00, transno 21474840314 00000004:00080000:2.0:1746129754.661330:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04d880, transno 21474840315 00000004:00080000:2.0:1746129754.661332:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b00c000, transno 21474840316 00000004:00080000:2.0:1746129754.661334:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936de680, transno 21474840317 00000004:00080000:2.0:1746129754.661335:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936df480, transno 21474840318 00000100:00100000:2.0:1746129754.661355:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053331712:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1746129754.661688:0:14357:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 32 done 00000100:00100000:2.0:1746129754.667952:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949052269440:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13996us (14573us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129754.667963:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4160 00002000:00100000:2.0:1746129754.667971:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880131460e00 x1830949052269440/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.667980:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131460e00 with x1830949052269440 ext(2097152->3145727) 00002000:00010000:2.0:1746129754.667985:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131460e00 00000100:00100000:0.0:1746129754.674428:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.674552:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052269696 00000100:00100000:1.0:1746129754.674562:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052269696 00000100:00100000:1.0:1746129754.674693:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11104 00000100:00100000:1.0:1746129754.674703:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:28691:x1830949052269696:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129754.674722:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129754.674740:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ee00/0x48868a4e43949db6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fae2 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.674769:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43949cd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2654207) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa48 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.674776:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129754.674778:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129754.674782:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ee00/0x48868a4e43949db6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fae2 expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.674811:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43949cd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2654207) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa48 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.674823:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43949cd6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2654207) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa48 expref: 8 pid: 8437 timeout: 800 lvb_type: 0 00000100:00100000:1.0:1746129754.674834:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053331840:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129754.674985:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4efd300 going to sleep for 11 seconds 00000100:00100000:1.0:1746129754.676740:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053331840:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129754.676760:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ee00/0x48868a4e43949db6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fae2 expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.676771:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3ee00, rc 0) 00000100:00100000:1.0:1746129754.677663:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:28691:x1830949052269696:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2955us (3238us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129754.677672:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11104 00000100:00100000:3.0:1746129754.678427:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746129754.678442:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053331968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746129754.678482:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129754.680148:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.680374:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052269824 00000100:00100000:2.0:1746129754.680381:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052269824 00002000:00100000:2.0:1746129754.680417:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->2654207) req@ffff88009c135180 x1830949052269824/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.680425:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c135180 with x1830949052269824 ext(2097152->2654207) 00010000:00010000:2.0:1746129754.680433:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43949cd6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2654207) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa48 expref: 9 pid: 8437 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.680445:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43949cd6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2654207) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa48 expref: 9 pid: 8437 timeout: 800 lvb_type: 0 00002000:00010000:2.0:1746129754.680451:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c135180 00000100:00100000:2.0:1746129754.680473:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 616 00000100:00100000:2.0:1746129754.680482:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052269824:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129754.683396:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053331968 00000100:00100000:2.0:1746129754.683406:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053331968 00000100:00080000:1.0:1746129754.685495:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746129754.686363:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1746129754.686379:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1830949053331968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746129754.686409:0:8438:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 345440256 pending 8519680 free 3852468224 avail 3835691008 00000100:00100000:3.0:1746129754.686484:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1830949053331968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (7999us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129754.686491:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1746129754.686554:0:3299:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873170 gen 2 00000004:00080000:3.0:1746129754.686561:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009206df80, transno 17179873114 00000004:00080000:3.0:1746129754.687215:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c043800, transno 17179873115 00000004:00080000:3.0:1746129754.687220:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009206d180, transno 17179873116 00000004:00080000:3.0:1746129754.687222:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c040e00, transno 17179873117 00000004:00080000:3.0:1746129754.687224:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009206e680, transno 17179873118 00000004:00080000:3.0:1746129754.687226:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c041880, transno 17179873119 00000004:00080000:3.0:1746129754.687228:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a4dc00, transno 17179873120 00000004:00080000:3.0:1746129754.687230:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c042300, transno 17179873121 00000004:00080000:3.0:1746129754.687232:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c043480, transno 17179873122 00000004:00080000:3.0:1746129754.687234:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093288e00, transno 17179873129 00000004:00080000:3.0:1746129754.687236:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093288000, transno 17179873130 00000004:00080000:3.0:1746129754.687238:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093289500, transno 17179873131 00000004:00080000:3.0:1746129754.687240:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8e7480, transno 17179873132 00000004:00080000:3.0:1746129754.687242:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009328b800, transno 17179873133 00000004:00080000:3.0:1746129754.687244:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8e7b80, transno 17179873134 00000004:00080000:3.0:1746129754.687246:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009328aa00, transno 17179873135 00000004:00080000:3.0:1746129754.687248:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8e5880, transno 17179873136 00000004:00080000:3.0:1746129754.687250:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fbeed80, transno 17179873137 00000004:00080000:3.0:1746129754.687253:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba1b480, transno 17179873138 00000004:00080000:3.0:1746129754.687255:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d8ca80, transno 17179873139 00000004:00080000:3.0:1746129754.687257:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d6a00, transno 17179873140 00000004:00080000:3.0:1746129754.687259:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d8f480, transno 17179873141 00000004:00080000:3.0:1746129754.687261:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d5880, transno 17179873142 00000004:00080000:3.0:1746129754.687263:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d8ea00, transno 17179873143 00000004:00080000:3.0:1746129754.687265:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130507480, transno 17179873144 00000004:00080000:3.0:1746129754.687267:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d8dc00, transno 17179873145 00000004:00080000:3.0:1746129754.687269:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d8fb80, transno 17179873146 00000004:00080000:3.0:1746129754.687271:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f6a7480, transno 17179873153 00000004:00080000:3.0:1746129754.687273:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba87480, transno 17179873154 00000004:00080000:3.0:1746129754.687275:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f6a5880, transno 17179873155 00000004:00080000:3.0:1746129754.687278:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f6a5f80, transno 17179873156 00000004:00080000:3.0:1746129754.687281:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb5f80, transno 17179873157 00000004:00080000:3.0:1746129754.687283:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f6a7b80, transno 17179873158 00000004:00080000:3.0:1746129754.687285:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f6a6680, transno 17179873159 00000004:00080000:3.0:1746129754.687287:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f6a4000, transno 17179873160 00000004:00080000:3.0:1746129754.687289:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba86680, transno 17179873161 00000004:00080000:3.0:1746129754.687292:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04d500, transno 17179873162 00000004:00080000:3.0:1746129754.687294:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04c000, transno 17179873163 00000004:00080000:3.0:1746129754.687296:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04ce00, transno 17179873164 00000004:00080000:3.0:1746129754.687298:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04f100, transno 17179873165 00000004:00080000:3.0:1746129754.687300:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04ed80, transno 17179873166 00000004:00080000:3.0:1746129754.687302:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04dc00, transno 17179873167 00000004:00080000:3.0:1746129754.687304:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04c380, transno 17179873168 00000004:00080000:3.0:1746129754.687306:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04c700, transno 17179873169 00000004:00080000:3.0:1746129754.687308:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5493800, transno 17179873170 00000100:00100000:3.0:1746129754.687322:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053331968:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1746129754.689403:0:14359:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 45 done 00000100:00100000:2.0:1746129754.695285:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052269824:12345-192.168.204.31@tcp:4:cat.0 Request processed in 14796us (15133us total) trans 21474840329 rc 0/0 00000100:00100000:2.0:1746129754.695296:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 616 00002000:00100000:2.0:1746129754.695306:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->2654207) req@ffff88009c135180 x1830949052269824/t21474840329(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/448 e 0 to 0 dl 1746129765 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.695314:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c135180 with x1830949052269824 ext(2097152->2654207) 00010000:00010000:2.0:1746129754.695323:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43949cd6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2654207) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa48 expref: 11 pid: 8437 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.695336:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43949cd6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2654207) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa48 expref: 11 pid: 8437 timeout: 800 lvb_type: 0 00000100:00100000:0.0:1746129754.695775:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3298:1830949053332480:0@lo:400:kworker.0 00000100:00100000:0.0:1746129754.695813:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129754.695837:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746129754.695841:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ea7f7eb-2f74-477e-bfed-16dc08365411:3298:1830949053332096:0@lo:400:kworker.0 00000100:00100000:0.0:1746129754.695872:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129754.695907:0:14312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053332096 00000100:00100000:0.0:1746129754.695912:0:14312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053332096 00000100:00100000:0.0:1746129754.695936:0:14312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1746129754.695941:0:14312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008edfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ea7f7eb-2f74-477e-bfed-16dc08365411+18:3298:x1830949053332096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746129754.695969:0:14312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008edfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ea7f7eb-2f74-477e-bfed-16dc08365411+18:3298:x1830949053332096:12345-0@lo:400:kworker.0 Request processed in 28us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129754.695974:0:14312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1746129754.696004:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ea7f7eb-2f74-477e-bfed-16dc08365411:3298:1830949053332096:0@lo:400:kworker.0 00000100:00100000:1.0:1746129754.696383:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3296:1830949053332224:0@lo:400:kworker.0 00000100:00100000:1.0:1746129754.696405:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129754.696432:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746129754.696437:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3296:1830949053332352:0@lo:400:kworker.0 00000100:00100000:1.0:1746129754.696452:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129754.696471:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053332480 00000100:00100000:1.0:1746129754.696474:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053332480 00000100:00100000:1.0:1746129754.696494:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053332224 00000100:00100000:1.0:1746129754.696496:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053332224 00000100:00100000:1.0:1746129754.696509:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053332352 00000100:00100000:1.0:1746129754.696511:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053332352 00000100:00100000:1.0:1746129754.696523:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1746129754.696528:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1830949053332480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746129754.696553:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1830949053332480:12345-0@lo:400:kworker.0 Request processed in 25us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129754.696558:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1746129754.696567:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1746129754.696571:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830949053332224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746129754.696590:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830949053332224:12345-0@lo:400:kworker.0 Request processed in 19us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129754.696594:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1746129754.696600:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1746129754.696604:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1830949053332352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746129754.696620:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1830949053332352:12345-0@lo:400:kworker.0 Request processed in 16us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129754.696624:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:1.0:1746129754.696637:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746129754.696653:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3296:1830949053332352:0@lo:400:kworker.0 00000100:00100000:1.0:1746129754.696661:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3296:1830949053332224:0@lo:400:kworker.0 00000100:00100000:0.0:1746129754.696742:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3298:1830949053332480:0@lo:400:kworker.0 00002000:00010000:2.0:1746129754.697540:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c135180 00000100:00100000:0.0:1746129754.700423:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.700507:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052269952 00000100:00100000:2.0:1746129754.700514:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052269952 00010000:00010000:2.0:1746129754.700542:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43949cd6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2654207) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa48 expref: 11 pid: 8437 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746129754.701191:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5353 00000100:00100000:2.0:1746129754.701200:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052269952:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129754.701212:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129754.701228:0:7109:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129754 -> 1746129755 00010000:00010000:2.0:1746129754.701234:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43949cd6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2654207) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa48 expref: 11 pid: 8437 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.701245:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43949cd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2654207) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa48 expref: 11 pid: 8437 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.701263:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43949cd6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2654207) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa48 expref: 11 pid: 8437 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.702330:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129754.702333:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129754.702351:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ee00/0x48868a4e43949db6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fae2 expref: 15 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.702360:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ee00/0x48868a4e43949db6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fae2 expref: 15 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.702391:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ee00/0x48868a4e43949db6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fae2 expref: 15 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129754.702402:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053332608:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129754.705222:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129754.715709:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.715757:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.716047:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053332608:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129754.716061:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129754.716092:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052269952:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 14894us (15676us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129754.716101:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5353 00000100:00100000:3.0:1746129754.716391:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052270336 00000100:00100000:3.0:1746129754.716398:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052270336 00002000:00100000:3.0:1746129754.716427:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009c134a80 x1830949052270336/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.716436:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c134a80 with x1830949052270336 ext(3145728->4194303) 00002000:00010000:3.0:1746129754.716440:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c134a80 00000100:00100000:3.0:1746129754.716450:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052270464 00000100:00100000:3.0:1746129754.716455:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052270464 00002000:00100000:3.0:1746129754.716463:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009c136a00 x1830949052270464/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.716468:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c136a00 with x1830949052270464 ext(2097152->3145727) 00002000:00010000:3.0:1746129754.716470:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c136a00 00000100:00100000:3.0:1746129754.716483:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4161 00000100:00100000:3.0:1746129754.716488:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949052270336:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129754.717538:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4162 00000100:00100000:3.0:1746129754.717544:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1963:x1830949052270464:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129754.724706:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.724779:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052270720 00000100:00100000:1.0:1746129754.724787:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052270720 00000100:00100000:1.0:1746129754.724821:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9918 00000100:00100000:1.0:1746129754.724829:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:28697:x1830949052270720:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129754.724868:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129754.724887:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66600/0x48868a4e43949dbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fae9 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.724971:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43949dc4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129754.724981:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43949dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129754.724989:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43949dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129754.724999:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67800/0x48868a4e43949dcb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129754.725004:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67800/0x48868a4e43949dcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129754.725007:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67800/0x48868a4e43949dcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129754.725087:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4ce00/0x48868a4e43949dd2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129754.725095:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4ce00/0x48868a4e43949dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129754.725100:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4ce00/0x48868a4e43949dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:1.0:1746129754.725107:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129754.725170:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43949dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129754.725176:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43949dc4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129754.725180:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43949dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129754.725185:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fb66800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129754.725187:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43949dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129754.725192:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43949dc4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129754.725201:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129754.725203:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129754.725207:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43949dc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129754.725211:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e43949dc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129754.725224:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67800/0x48868a4e43949dcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129754.725228:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67800/0x48868a4e43949dcb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129754.725231:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67800/0x48868a4e43949dcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129754.725234:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fb67800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129754.725236:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67800/0x48868a4e43949dcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129754.725240:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67800/0x48868a4e43949dcb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129754.725244:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009b767000) 00010000:00010000:1.0:1746129754.725245:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129754.725247:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67800/0x48868a4e43949dcb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129754.725250:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb67800/0x48868a4e43949dcb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129754.725289:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66600/0x48868a4e43949dbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fae9 expref: 27 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.725299:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4ce00/0x48868a4e43949dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fae9 expref: 26 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.725304:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129754.725306:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129754.725307:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e4ce00, rc 0) 00000100:00100000:1.0:1746129754.725353:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:28697:x1830949052270720:12345-192.168.204.31@tcp:101:cat.0 Request processed in 514us (644us total) trans 8589943712 rc 0/0 00000100:00100000:1.0:1746129754.725358:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9918 00000100:00100000:1.0:1746129754.728958:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.728984:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052270848 00000100:00100000:1.0:1746129754.728990:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052270848 00000100:00100000:1.0:1746129754.729021:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11105 00000100:00100000:1.0:1746129754.729028:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28694:x1830949052270848:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129754.729042:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129754.729056:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4c400/0x48868a4e43949de0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34faf0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.729078:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b538ac00/0x48868a4e43949d8c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fad4 expref: 28 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.729084:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.729086:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.729089:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4c400/0x48868a4e43949de0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2408448->3002367] (req 2408448->3002367) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34faf0 expref: 13 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.729119:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b538ac00/0x48868a4e43949d8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fad4 expref: 28 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.729129:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b538ac00/0x48868a4e43949d8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fad4 expref: 28 pid: 1140 timeout: 800 lvb_type: 0 00000100:00100000:1.0:1746129754.729140:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053332736:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129754.730608:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4efd300 going to sleep for 11 seconds 00000100:00100000:3.0:1746129754.733197:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949052270336:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16700us (17486us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129754.733207:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4161 00002000:00100000:3.0:1746129754.733216:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009c134a80 x1830949052270336/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.733225:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c134a80 with x1830949052270336 ext(3145728->4194303) 00010000:00010000:3.0:1746129754.733233:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b538ac00/0x48868a4e43949d8c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fad4 expref: 27 pid: 1140 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746129754.733245:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b538ac00/0x48868a4e43949d8c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fad4 expref: 27 pid: 1140 timeout: 800 lvb_type: 0 00002000:00010000:3.0:1746129754.733251:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c134a80 00000100:00100000:1.0:1746129754.735176:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.735193:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052271104 00000100:00100000:1.0:1746129754.735199:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052271104 00000100:00100000:0.0:1746129754.735862:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053332736:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129754.735883:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4c400/0x48868a4e43949de0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2408448->3002367] (req 2408448->3002367) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34faf0 expref: 13 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.735897:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e4c400, rc 0) 00000100:00100000:0.0:1746129754.735926:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28694:x1830949052270848:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6899us (6975us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129754.735933:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11105 00000100:00100000:0.0:1746129754.735970:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129754.736388:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1963:x1830949052270464:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18844us (20630us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129754.736395:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4162 00002000:00100000:3.0:1746129754.736402:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009c136a00 x1830949052270464/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.736410:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c136a00 with x1830949052270464 ext(2097152->3145727) 00002000:00010000:3.0:1746129754.736413:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c136a00 00000100:00100000:2.0:1746129754.737513:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3907 00000100:00100000:2.0:1746129754.737523:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:28697:x1830949052271104:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129754.737667:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+27:28697:x1830949052271104:12345-192.168.204.31@tcp:35:cat.0 Request processed in 146us (2497us total) trans 8589943713 rc 0/0 00000100:00100000:2.0:1746129754.737672:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3907 00000100:00100000:2.0:1746129754.737689:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052271232 00000100:00100000:2.0:1746129754.737692:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052271232 00000100:00100000:2.0:1746129754.737710:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 574 00000100:00100000:2.0:1746129754.737714:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c137b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+27:1964:x1830949052271232:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129754.737721:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129754.737736:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4ce00/0x48868a4e43949dd2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fae9 expref: 27 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.737747:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129754.737750:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129754.737762:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c137b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1964:x1830949052271232:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 47us (1791us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129754.737767:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 574 00000100:00100000:1.0:1746129754.739461:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129754.739660:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052271360 00000100:00100000:3.0:1746129754.739665:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052271360 00010000:00010000:3.0:1746129754.739685:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b538ac00/0x48868a4e43949d8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fad4 expref: 27 pid: 1140 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746129754.739701:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5354 00000100:00100000:3.0:1746129754.739705:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949052271360:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129754.739714:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129754.739728:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b538ac00/0x48868a4e43949d8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fad4 expref: 27 pid: 1140 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746129754.739737:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b538ac00/0x48868a4e43949d8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fad4 expref: 27 pid: 1140 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746129754.739752:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b538ac00/0x48868a4e43949d8c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fad4 expref: 27 pid: 1140 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746129754.739766:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129754.739767:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129754.739773:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4c400/0x48868a4e43949de0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2408448->3145727] (req 2408448->3002367) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34faf0 expref: 12 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.739780:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4c400/0x48868a4e43949de0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2408448->3145727] (req 2408448->3002367) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34faf0 expref: 12 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.739802:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4c400/0x48868a4e43949de0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2408448->3145727] (req 2408448->3002367) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34faf0 expref: 12 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129754.739815:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131462300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053332864:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129754.739874:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a95840c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129754.743450:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.743484:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.743521:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.743531:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052271744 00000100:00100000:1.0:1746129754.743538:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052271744 00000100:00100000:1.0:1746129754.743573:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052271872 00000100:00100000:1.0:1746129754.743575:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052271872 00000100:00100000:1.0:1746129754.743588:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11106 00000100:00100000:3.0:1746129754.743592:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131462300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053332864:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129754.743593:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949052271744:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129754.743605:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129754.743606:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129754.743618:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5800/0x48868a4e43949de7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34faf7 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129754.743636:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949052271360:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3930us (4179us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129754.743639:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5800/0x48868a4e43949de7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34faf7 expref: 14 pid: 1140 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129754.743643:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5354 00010000:00010000:1.0:1746129754.743649:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5800/0x48868a4e43949de7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34faf7 expref: 14 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129754.743660:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a49b5800, rc 0) 00000100:00100000:1.0:1746129754.743675:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949052271744:12345-192.168.204.31@tcp:101:cat.0 Request processed in 82us (190us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129754.743679:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11106 00000100:00100000:1.0:1746129754.743687:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11107 00000100:00100000:1.0:1746129754.743692:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052271872:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129754.743698:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129754.743706:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a49b5a00/0x48868a4e43949dee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fafe expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.743718:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.743719:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746129754.743956:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052271616 00000100:00100000:2.0:1746129754.743960:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052271616 00002000:00100000:2.0:1746129754.743982:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (2408448->2412543) req@ffff88009c134700 x1830949052271616/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.743990:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c134700 with x1830949052271616 ext(2408448->2412543) 00002000:00010000:2.0:1746129754.743994:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c134700 00000100:00100000:2.0:1746129754.744007:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4163 00000100:00100000:2.0:1746129754.744011:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949052271616:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129754.744120:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949052271616:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 108us (676us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129754.744125:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4163 00002000:00100000:2.0:1746129754.744130:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (2408448->2412543) req@ffff88009c134700 x1830949052271616/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/4536 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.744137:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c134700 with x1830949052271616 ext(2408448->2412543) 00002000:00010000:2.0:1746129754.744140:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c134700 00010000:00010000:1.0:1746129754.744186:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a49b5a00/0x48868a4e43949dee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fafe expref: 11 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129754.744201:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a49b5a00/0x48868a4e43949dee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fafe expref: 11 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129754.744208:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a49b5a00, rc 0) 00000100:00100000:1.0:1746129754.744223:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052271872:12345-192.168.204.31@tcp:101:cat.0 Request processed in 531us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129754.744227:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11107 00000100:00100000:1.0:1746129754.744255:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.744267:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052272000 00000100:00100000:1.0:1746129754.744269:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052272000 00000100:00100000:1.0:1746129754.744280:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11108 00000100:00100000:1.0:1746129754.744284:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:28691:x1830949052272000:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129754.744290:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129754.744295:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5600/0x48868a4e43949df5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fb05 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.744305:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.744306:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.744310:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5600/0x48868a4e43949df5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb05 expref: 27 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.744318:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5600/0x48868a4e43949df5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb05 expref: 27 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.744324:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a49b5600, rc 0) 00000100:00100000:1.0:1746129754.744337:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:28691:x1830949052272000:12345-192.168.204.31@tcp:101:cat.0 Request processed in 52us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129754.744351:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11108 00000100:00100000:0.0:1746129754.747925:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129754.749291:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052272256 00000100:00100000:3.0:1746129754.749303:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052272256 00002000:00100000:3.0:1746129754.749355:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009c137100 x1830949052272256/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.749365:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c137100 with x1830949052272256 ext(3145728->4194303) 00002000:00010000:3.0:1746129754.749370:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c137100 00000100:00100000:3.0:1746129754.749409:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4164 00000100:00100000:3.0:1746129754.749417:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949052272256:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129754.749777:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.751684:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052272512 00000100:00100000:2.0:1746129754.751691:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052272512 00002000:00100000:2.0:1746129754.751722:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (2998272->3002367) req@ffff88009c134e00 x1830949052272512/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.751730:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c134e00 with x1830949052272512 ext(2998272->3002367) 00002000:00010000:2.0:1746129754.751734:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c134e00 00000100:00100000:2.0:1746129754.751762:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4165 00000100:00100000:2.0:1746129754.751769:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1964:x1830949052272512:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129754.751896:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1964:x1830949052272512:12345-192.168.204.31@tcp:3:cat.0 Request processed in 127us (2119us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129754.751901:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4165 00002000:00100000:2.0:1746129754.751907:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (2998272->3002367) req@ffff88009c134e00 x1830949052272512/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/4536 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.751912:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c134e00 with x1830949052272512 ext(2998272->3002367) 00002000:00010000:2.0:1746129754.751915:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c134e00 00000100:00100000:2.0:1746129754.756511:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.756531:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.756533:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052272896 00000100:00100000:0.0:1746129754.756541:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052272896 00000100:00100000:2.0:1746129754.756565:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:0.0:1746129754.756571:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880135d8d880 x1830949052272896/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746129754.756577:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052273024 00000100:00100000:2.0:1746129754.756579:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052273024 00002000:00100000:0.0:1746129754.756580:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8d880 with x1830949052272896 ext(0->1048575) 00002000:00010000:0.0:1746129754.756584:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135d8d880 00002000:00100000:2.0:1746129754.756593:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff880135d8f800 x1830949052273024/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.756600:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8f800 with x1830949052273024 ext(1048576->2097151) 00002000:00010000:2.0:1746129754.756603:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d8f800 00000100:00100000:3.0:1746129754.758124:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052273280 00000100:00100000:3.0:1746129754.758132:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052273280 00002000:00100000:3.0:1746129754.758160:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880135d8f100 x1830949052273280/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.758167:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8f100 with x1830949052273280 ext(1048576->2097151) 00002000:00010000:3.0:1746129754.758172:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d8f100 00000100:00100000:3.0:1746129754.758194:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4166 00000100:00100000:3.0:1746129754.758200:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949052272896:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129754.759388:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4167 00000100:00100000:2.0:1746129754.759397:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052273024:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129754.762041:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4168 00000100:00100000:1.0:1746129754.762053:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949052273280:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129754.763741:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.763784:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052273536 00000100:00100000:0.0:1746129754.763790:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052273536 00000100:00100000:0.0:1746129754.763824:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3908 00000100:00100000:0.0:1746129754.763831:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:28694:x1830949052273536:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:0.0:1746129754.764006:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+27:28694:x1830949052273536:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 175us (270us total) trans 8589943714 rc 0/0 00000100:00100000:0.0:1746129754.764012:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3908 00000100:00100000:3.0:1746129754.765240:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949052272256:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15820us (17317us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129754.765249:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4164 00002000:00100000:3.0:1746129754.765257:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009c137100 x1830949052272256/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.765267:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c137100 with x1830949052272256 ext(3145728->4194303) 00002000:00010000:3.0:1746129754.765271:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c137100 00000100:00100000:0.0:1746129754.771899:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.772810:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052273664 00000100:00100000:1.0:1746129754.772818:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052273664 00000100:00100000:2.0:1746129754.772885:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11109 00000100:00100000:2.0:1746129754.772899:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949052273664:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129754.772914:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129754.772927:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd84600/0x48868a4e43949dfc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fb0c expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.772958:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd84600/0x48868a4e43949dfc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb0c expref: 28 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129754.772968:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd84600/0x48868a4e43949dfc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb0c expref: 28 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129754.772987:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd84600, rc 0) 00000100:00100000:2.0:1746129754.773028:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949052273664:12345-192.168.204.31@tcp:101:cat.0 Request processed in 132us (1138us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129754.773034:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11109 00000100:00100000:3.0:1746129754.776454:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949052272896:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18241us (19937us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129754.776466:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4166 00002000:00100000:3.0:1746129754.776475:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880135d8d880 x1830949052272896/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129754.776483:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8d880 with x1830949052272896 ext(0->1048575) 00002000:00010000:3.0:1746129754.776488:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135d8d880 00000100:00100000:0.0:1746129754.777155:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.777229:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052273792 00000100:00100000:2.0:1746129754.777236:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052273792 00000100:00100000:2.0:1746129754.777277:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11110 00000100:00100000:2.0:1746129754.777285:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a340450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949052273792:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129754.777296:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129754.777310:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43949e03 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fb13 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.777332:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43949e03 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb13 expref: 28 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129754.777355:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43949e03 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb13 expref: 28 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129754.777374:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd85600, rc 0) 00000100:00100000:2.0:1746129754.777396:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a340450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949052273792:12345-192.168.204.31@tcp:101:cat.0 Request processed in 112us (243us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129754.777402:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11110 00000100:00100000:0.0:1746129754.784754:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.785263:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052273024:12345-192.168.204.31@tcp:3:cat.0 Request processed in 25866us (28728us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129754.785273:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4167 00002000:00100000:2.0:1746129754.785283:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff880135d8f800 x1830949052273024/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.785291:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8f800 with x1830949052273024 ext(1048576->2097151) 00002000:00010000:2.0:1746129754.785295:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d8f800 00000100:00100000:1.0:1746129754.785594:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052273280:12345-192.168.204.31@tcp:3:cat.0 Request processed in 23544us (29026us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129754.785600:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4168 00002000:00100000:1.0:1746129754.785605:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880135d8f100 x1830949052273280/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129754.785611:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8f100 with x1830949052273280 ext(1048576->2097151) 00002000:00010000:1.0:1746129754.785614:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d8f100 00000100:00100000:3.0:1746129754.785704:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052273920 00000100:00100000:3.0:1746129754.785711:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052273920 00000100:00100000:3.0:1746129754.785737:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11111 00000100:00100000:3.0:1746129754.785743:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:28690:x1830949052273920:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129754.785756:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129754.785769:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9800/0x48868a4e43949e0a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fb1a expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.785790:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ee00/0x48868a4e43949db6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fae2 expref: 17 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.785802:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a49b5a00/0x48868a4e43949dee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fafe expref: 10 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129754.785809:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129754.785810:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129754.785814:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9800/0x48868a4e43949e0a lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb1a expref: 17 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.785841:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a49b5a00/0x48868a4e43949dee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fafe expref: 10 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129754.785866:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a49b5a00/0x48868a4e43949dee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fafe expref: 10 pid: 1140 timeout: 800 lvb_type: 1 00000100:00100000:3.0:1746129754.785876:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131462300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053332992:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129754.785938:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ee00/0x48868a4e43949db6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fae2 expref: 17 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.785945:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ee00/0x48868a4e43949db6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fae2 expref: 17 pid: 1140 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746129754.785952:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053333120:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129754.785967:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a95840c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129754.786144:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.786355:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052274048 00000100:00100000:1.0:1746129754.786359:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052274048 00000100:00100000:1.0:1746129754.786388:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11112 00000100:00100000:1.0:1746129754.786394:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949052274048:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129754.786640:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129754.786650:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f76200/0x48868a4e43949e11 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fb21 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.786666:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f76200/0x48868a4e43949e11 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb21 expref: 28 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129754.786674:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f76200/0x48868a4e43949e11 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb21 expref: 28 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129754.786693:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f76200, rc 0) 00000100:00100000:1.0:1746129754.786710:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949052274048:12345-192.168.204.31@tcp:101:cat.0 Request processed in 316us (566us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129754.786714:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11112 00000100:00100000:0.0:1746129754.789247:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.789449:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129754.789606:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131462300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053332992:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129754.789619:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053333120:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129754.789641:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9800/0x48868a4e43949e0a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb1a expref: 17 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.789656:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffb9800, rc 0) 00000100:00100000:3.0:1746129754.789692:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:28690:x1830949052273920:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3948us (4944us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129754.789699:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11111 00000100:00100000:2.0:1746129754.789784:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052274176 00000100:00100000:2.0:1746129754.789789:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052274176 00010000:00010000:2.0:1746129754.789808:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a49b5a00/0x48868a4e43949dee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fafe expref: 11 pid: 1140 timeout: 800 lvb_type: 1 00000100:00100000:2.0:1746129754.789835:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052274304 00000100:00100000:2.0:1746129754.789837:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052274304 00010000:00010000:2.0:1746129754.789867:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ee00/0x48868a4e43949db6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fae2 expref: 17 pid: 1140 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746129754.790175:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5355 00000100:00100000:2.0:1746129754.790182:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949052274176:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129754.790192:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129754.790211:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a49b5a00/0x48868a4e43949dee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fafe expref: 11 pid: 1140 timeout: 800 lvb_type: 1 00010000:00010000:2.0:1746129754.790219:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a49b5a00/0x48868a4e43949dee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fafe expref: 11 pid: 1140 timeout: 800 lvb_type: 1 00010000:00010000:2.0:1746129754.790235:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a49b5a00/0x48868a4e43949dee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fafe expref: 11 pid: 1140 timeout: 800 lvb_type: 1 00010000:00010000:2.0:1746129754.790247:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129754.790359:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5356 00000100:00100000:1.0:1746129754.790365:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1964:x1830949052274304:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129754.790371:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129754.790378:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ee00/0x48868a4e43949db6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fae2 expref: 17 pid: 1140 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746129754.790386:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ee00/0x48868a4e43949db6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fae2 expref: 17 pid: 1140 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746129754.790395:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ee00/0x48868a4e43949db6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fae2 expref: 17 pid: 1140 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746129754.790403:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.790404:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.790409:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9800/0x48868a4e43949e0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb1a expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.790415:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9800/0x48868a4e43949e0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb1a expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.790437:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9800/0x48868a4e43949e0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb1a expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129754.790445:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053333248:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129754.790749:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949052274176:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 567us (1508us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129754.790755:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5355 00000100:00100000:1.0:1746129754.790836:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4efd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129754.792831:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053333248:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129754.792873:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129754.792910:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1964:x1830949052274304:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2544us (3460us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129754.792918:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5356 00000100:00100000:0.0:1746129754.793860:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.794161:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052274560 00000100:00100000:2.0:1746129754.794167:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052274560 00002000:00100000:2.0:1746129754.794199:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2490368->2494463) req@ffff88009c134380 x1830949052274560/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.794207:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c134380 with x1830949052274560 ext(2490368->2494463) 00002000:00010000:2.0:1746129754.794211:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c134380 00000100:00100000:2.0:1746129754.794235:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4169 00000100:00100000:2.0:1746129754.794241:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1961:x1830949052274560:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129754.794366:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1961:x1830949052274560:12345-192.168.204.31@tcp:3:cat.0 Request processed in 125us (522us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129754.794372:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4169 00002000:00100000:2.0:1746129754.794376:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2490368->2494463) req@ffff88009c134380 x1830949052274560/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/4536 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.794383:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c134380 with x1830949052274560 ext(2490368->2494463) 00002000:00010000:2.0:1746129754.794385:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c134380 00000100:00100000:0.0:1746129754.796798:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.797179:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052274688 00000100:00100000:2.0:1746129754.797186:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052274688 00000100:00100000:2.0:1746129754.797219:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11113 00000100:00100000:2.0:1746129754.797225:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28697:x1830949052274688:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129754.797238:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129754.797251:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd85e00/0x48868a4e43949e18 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fb28 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.797275:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4c400/0x48868a4e43949de0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2408448->3145727] (req 2408448->3002367) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34faf0 expref: 14 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.797281:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129754.797282:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129754.797285:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd85e00/0x48868a4e43949e18 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb28 expref: 14 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.797308:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4c400/0x48868a4e43949de0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2408448->3145727] (req 2408448->3002367) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34faf0 expref: 14 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.797323:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4c400/0x48868a4e43949de0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2408448->3145727] (req 2408448->3002367) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34faf0 expref: 14 pid: 1140 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746129754.797332:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053333376:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129754.797414:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129754.800988:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.801335:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052274816 00000100:00100000:2.0:1746129754.801365:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052274816 00000100:00100000:2.0:1746129754.801409:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11114 00000100:00100000:2.0:1746129754.801415:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:28690:x1830949052274816:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129754.801430:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129754.801443:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43949e1f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fb2f expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.801466:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a2ee00/0x48868a4e43949ccf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa41 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.801472:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5600/0x48868a4e43949df5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb05 expref: 28 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.801478:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746129754.801480:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746129754.801482:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43949e1f lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3145728->3383295] (req 3145728->3383295) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb2f expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129754.801496:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129754.801504:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5600/0x48868a4e43949df5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb05 expref: 28 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129754.801512:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052274944 00010000:00010000:2.0:1746129754.801513:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5600/0x48868a4e43949df5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb05 expref: 28 pid: 1140 timeout: 800 lvb_type: 0 00000100:00100000:0.0:1746129754.801516:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052274944 00000100:00100000:2.0:1746129754.801522:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053333504:192.168.204.31@tcp:104: 00002000:00100000:0.0:1746129754.801541:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2408448->3002367) req@ffff88009328a300 x1830949052274944/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129754.801550:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328a300 with x1830949052274944 ext(2408448->3002367) 00010000:00010000:0.0:1746129754.801556:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4c400/0x48868a4e43949de0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2408448->3145727] (req 2408448->3002367) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34faf0 expref: 15 pid: 1140 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746129754.801565:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4c400/0x48868a4e43949de0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2408448->3145727] (req 2408448->3002367) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34faf0 expref: 15 pid: 1140 timeout: 800 lvb_type: 0 00002000:00010000:0.0:1746129754.801570:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009328a300 00010000:00010000:2.0:1746129754.801582:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a2ee00/0x48868a4e43949ccf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa41 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129754.801582:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 617 00000100:00100000:0.0:1746129754.801587:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1961:x1830949052274944:12345-192.168.204.31@tcp:4:cat.0 00010000:00010000:2.0:1746129754.801589:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a2ee00/0x48868a4e43949ccf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa41 expref: 15 pid: 8436 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746129754.801596:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053333632:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129754.801608:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129754.801678:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053333376:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129754.801691:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd85e00/0x48868a4e43949e18 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb28 expref: 15 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.801699:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd85e00, rc 0) 00000100:00100000:3.0:1746129754.801714:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28697:x1830949052274688:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4490us (4924us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129754.801719:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11113 00000100:00100000:0.0:1746129754.806246:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.806404:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052275072 00000100:00100000:1.0:1746129754.806411:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052275072 00010000:00010000:1.0:1746129754.806440:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5600/0x48868a4e43949df5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb05 expref: 29 pid: 1140 timeout: 800 lvb_type: 0 00000100:00100000:1.0:1746129754.806479:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5357 00000100:00100000:1.0:1746129754.806486:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949052275072:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129754.806497:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129754.806520:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5600/0x48868a4e43949df5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb05 expref: 29 pid: 1140 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746129754.806530:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5600/0x48868a4e43949df5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb05 expref: 29 pid: 1140 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746129754.806550:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129754.806582:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949052275072:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 97us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129754.806588:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5357 00010000:00010000:2.0:1746129754.806754:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a49b5600/0x48868a4e43949df5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb05 expref: 28 pid: 1140 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746129754.807744:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053333504:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129754.807767:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053333632:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129754.807791:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43949e1f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->3383295] (req 3145728->3383295) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb2f expref: 27 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.807802:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd85600, rc 0) 00000100:00100000:2.0:1746129754.807827:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:28690:x1830949052274816:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6411us (6847us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129754.807836:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11114 00000100:00100000:1.0:1746129754.809919:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1961:x1830949052274944:12345-192.168.204.31@tcp:4:cat.0 Request processed in 8325us (8417us total) trans 17179873181 rc 0/0 00000100:00100000:1.0:1746129754.809930:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 617 00002000:00100000:1.0:1746129754.809939:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2408448->3002367) req@ffff88009328a300 x1830949052274944/t17179873181(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/448 e 0 to 0 dl 1746129765 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129754.809947:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328a300 with x1830949052274944 ext(2408448->3002367) 00010000:00010000:1.0:1746129754.809955:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4c400/0x48868a4e43949de0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2408448->3145727] (req 2408448->3002367) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34faf0 expref: 16 pid: 1140 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746129754.809971:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4c400/0x48868a4e43949de0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2408448->3145727] (req 2408448->3002367) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34faf0 expref: 16 pid: 1140 timeout: 800 lvb_type: 0 00002000:00010000:1.0:1746129754.809976:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009328a300 00000100:00100000:0.0:1746129754.810761:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.811586:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052275200 00000100:00100000:1.0:1746129754.811593:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052275200 00010000:00010000:1.0:1746129754.811614:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a2ee00/0x48868a4e43949ccf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa41 expref: 16 pid: 8436 timeout: 800 lvb_type: 0 00000100:00100000:0.0:1746129754.812460:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.813322:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052275328 00000100:00100000:2.0:1746129754.813329:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052275328 00000100:00100000:3.0:1746129754.813348:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5358 00000100:00100000:3.0:1746129754.813357:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130564450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052275200:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129754.813363:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4c400/0x48868a4e43949de0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2408448->3145727] (req 2408448->3002367) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34faf0 expref: 17 pid: 1140 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746129754.813369:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129754.813390:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a2ee00/0x48868a4e43949ccf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa41 expref: 17 pid: 8436 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746129754.813390:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5359 00000100:00100000:2.0:1746129754.813396:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052275328:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129754.813399:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a2ee00/0x48868a4e43949ccf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa41 expref: 17 pid: 8436 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.813403:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129754.813412:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4c400/0x48868a4e43949de0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [2408448->3145727] (req 2408448->3002367) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34faf0 expref: 17 pid: 1140 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.813422:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4c400/0x48868a4e43949de0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 9 type: EXT [2408448->3145727] (req 2408448->3002367) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34faf0 expref: 17 pid: 1140 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.813433:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4c400/0x48868a4e43949de0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 9 type: EXT [2408448->3145727] (req 2408448->3002367) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34faf0 expref: 17 pid: 1140 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.813449:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129754.813451:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129754.813456:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd85e00/0x48868a4e43949e18 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb28 expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.813463:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd85e00/0x48868a4e43949e18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb28 expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.813470:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129754.813471:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129754.813475:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43949e1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->3383295) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb2f expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.813481:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43949e1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->3383295) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb2f expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.813507:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43949e1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->3383295) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb2f expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129754.813518:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053333760:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129754.813807:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a2ee00/0x48868a4e43949ccf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa41 expref: 17 pid: 8436 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746129754.813885:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129754.813943:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130564450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1961:x1830949052275200:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 588us (3185us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129754.813949:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5358 00010000:00010000:2.0:1746129754.814109:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd85e00/0x48868a4e43949e18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb28 expref: 14 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129754.814118:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053333888:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129754.814135:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129754.816035:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053333760:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129754.816046:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053333888:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129754.816059:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129754.816087:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052275328:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2691us (3628us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129754.816096:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5359 00000100:00100000:0.0:1746129754.819392:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.819431:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.819596:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052275584 00000100:00100000:1.0:1746129754.819603:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052275584 00000100:00100000:2.0:1746129754.819626:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052275840 00000100:00100000:2.0:1746129754.819630:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052275840 00002000:00100000:1.0:1746129754.819638:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3379200->3383295) req@ffff880093288e00 x1830949052275584/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.819646:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880093288000 x1830949052275840/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129754.819648:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288e00 with x1830949052275584 ext(3379200->3383295) 00002000:00010000:1.0:1746129754.819652:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093288e00 00002000:00100000:2.0:1746129754.819658:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288000 with x1830949052275840 ext(2097152->3145727) 00002000:00010000:2.0:1746129754.819661:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093288000 00000100:00100000:1.0:1746129754.823042:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4170 00000100:00100000:1.0:1746129754.823059:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949052275584:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129754.823226:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949052275584:12345-192.168.204.31@tcp:3:cat.0 Request processed in 173us (3839us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129754.823232:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4170 00002000:00100000:1.0:1746129754.823239:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3379200->3383295) req@ffff880093288e00 x1830949052275584/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/4536 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129754.823247:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288e00 with x1830949052275584 ext(3379200->3383295) 00002000:00010000:1.0:1746129754.823251:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093288e00 00000100:00100000:1.0:1746129754.823266:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4171 00000100:00100000:1.0:1746129754.823271:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052275840:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129754.839146:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052275840:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15864us (19704us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129754.839162:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4171 00002000:00100000:1.0:1746129754.839194:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880093288000 x1830949052275840/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129754.839203:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288000 with x1830949052275840 ext(2097152->3145727) 00002000:00010000:1.0:1746129754.839209:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093288000 00000100:00100000:0.0:1746129754.844010:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.844075:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052275968 00000100:00100000:2.0:1746129754.844083:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052275968 00000100:00100000:2.0:1746129754.844133:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11115 00000100:00100000:2.0:1746129754.844140:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28697:x1830949052275968:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129754.844155:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129754.844169:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd85a00/0x48868a4e43949e26 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fb36 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.844193:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9800/0x48868a4e43949e0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb1a expref: 15 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.844199:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129754.844201:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129754.844204:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd85a00/0x48868a4e43949e26 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb36 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.844227:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9800/0x48868a4e43949e0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb1a expref: 15 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.844238:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9800/0x48868a4e43949e0a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb1a expref: 15 pid: 1140 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746129754.844248:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053334016:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129754.844325:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129754.846249:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053334016:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129754.846269:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd85a00/0x48868a4e43949e26 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb36 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.846282:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd85a00, rc 0) 00000100:00100000:2.0:1746129754.846318:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28697:x1830949052275968:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2177us (2312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129754.846326:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11115 00000100:00100000:0.0:1746129754.846833:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.847534:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052276096 00000100:00100000:1.0:1746129754.847541:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052276096 00002000:00100000:1.0:1746129754.847574:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2490368->3145727) req@ffff88009328b800 x1830949052276096/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129754.847582:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328b800 with x1830949052276096 ext(2490368->3145727) 00010000:00010000:1.0:1746129754.847588:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9800/0x48868a4e43949e0a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb1a expref: 16 pid: 1140 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746129754.847598:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9800/0x48868a4e43949e0a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb1a expref: 16 pid: 1140 timeout: 800 lvb_type: 0 00002000:00010000:1.0:1746129754.847608:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009328b800 00000100:00100000:1.0:1746129754.847632:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 618 00000100:00100000:1.0:1746129754.847639:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1962:x1830949052276096:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129754.856228:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1962:x1830949052276096:12345-192.168.204.31@tcp:4:cat.0 Request processed in 8581us (9388us total) trans 21474840330 rc 0/0 00000100:00100000:2.0:1746129754.856238:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 618 00002000:00100000:2.0:1746129754.856248:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2490368->3145727) req@ffff88009328b800 x1830949052276096/t21474840330(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/448 e 0 to 0 dl 1746129765 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.856256:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328b800 with x1830949052276096 ext(2490368->3145727) 00010000:00010000:2.0:1746129754.856264:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9800/0x48868a4e43949e0a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb1a expref: 18 pid: 1140 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.856277:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9800/0x48868a4e43949e0a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb1a expref: 18 pid: 1140 timeout: 800 lvb_type: 0 00002000:00010000:2.0:1746129754.856283:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009328b800 00000100:00100000:0.0:1746129754.859120:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.859284:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052276224 00000100:00100000:2.0:1746129754.859292:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052276224 00010000:00010000:2.0:1746129754.859321:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9800/0x48868a4e43949e0a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb1a expref: 18 pid: 1140 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746129754.859369:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5360 00000100:00100000:2.0:1746129754.859376:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1963:x1830949052276224:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129754.859388:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129754.859405:0:10980:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129754 -> 1746129755 00010000:00010000:2.0:1746129754.859410:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9800/0x48868a4e43949e0a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb1a expref: 18 pid: 1140 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.859420:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9800/0x48868a4e43949e0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb1a expref: 18 pid: 1140 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.859438:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9800/0x48868a4e43949e0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb1a expref: 18 pid: 1140 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.859463:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129754.859465:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129754.859471:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd85a00/0x48868a4e43949e26 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb36 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.859478:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd85a00/0x48868a4e43949e26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb36 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.859504:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd85a00/0x48868a4e43949e26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb36 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129754.859514:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053334144:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129754.859594:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129754.865058:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053334144:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129754.865075:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129754.865115:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1963:x1830949052276224:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5738us (6000us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129754.865123:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5360 00000100:00100000:0.0:1746129754.867551:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.868086:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052276480 00000100:00100000:2.0:1746129754.868093:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052276480 00002000:00100000:2.0:1746129754.868125:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880093288700 x1830949052276480/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.868134:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288700 with x1830949052276480 ext(2097152->3145727) 00002000:00010000:2.0:1746129754.868139:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093288700 00000100:00100000:2.0:1746129754.868156:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4172 00000100:00100000:2.0:1746129754.868163:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052276480:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129754.888972:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052276480:12345-192.168.204.31@tcp:3:cat.0 Request processed in 20802us (21420us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129754.888982:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4172 00002000:00100000:2.0:1746129754.888991:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880093288700 x1830949052276480/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.889000:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288700 with x1830949052276480 ext(2097152->3145727) 00002000:00010000:2.0:1746129754.889005:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093288700 00000100:00100000:0.0:1746129754.906695:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.906814:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052276608 00000100:00100000:2.0:1746129754.906822:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052276608 00000100:00100000:2.0:1746129754.906894:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11116 00000100:00100000:2.0:1746129754.906901:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28697:x1830949052276608:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129754.906918:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129754.906933:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43949e2d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fb3d expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.906957:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43949e1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3383295) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb2f expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.906963:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129754.906965:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129754.906968:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43949e2d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb3d expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.906990:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43949e1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3383295) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb2f expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.906999:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43949e1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3383295) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb2f expref: 26 pid: 8436 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746129754.907008:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053334272:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129754.908643:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129754.911106:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053334272:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129754.911129:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43949e2d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb3d expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.911144:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5216c00, rc 0) 00000100:00100000:2.0:1746129754.911621:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28697:x1830949052276608:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4717us (4930us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129754.911632:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11116 00000100:00100000:0.0:1746129754.912756:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.912887:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052276736 00000100:00100000:2.0:1746129754.912893:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052276736 00002000:00100000:2.0:1746129754.912924:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3383295) req@ffff88012b8e4000 x1830949052276736/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.912932:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e4000 with x1830949052276736 ext(3145728->3383295) 00010000:00010000:2.0:1746129754.912939:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43949e1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3383295) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb2f expref: 27 pid: 8436 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.912949:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43949e1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3383295) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb2f expref: 27 pid: 8436 timeout: 800 lvb_type: 0 00002000:00010000:2.0:1746129754.912955:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b8e4000 00000100:00100000:2.0:1746129754.915000:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 619 00000100:00100000:2.0:1746129754.915014:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949052276736:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129754.920732:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949052276736:12345-192.168.204.31@tcp:4:cat.0 Request processed in 5715us (7971us total) trans 17179873182 rc 0/0 00000100:00100000:2.0:1746129754.920742:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 619 00002000:00100000:2.0:1746129754.920750:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3383295) req@ffff88012b8e4000 x1830949052276736/t17179873182(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:495/0 lens 488/448 e 0 to 0 dl 1746129765 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.920757:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e4000 with x1830949052276736 ext(3145728->3383295) 00010000:00010000:2.0:1746129754.920766:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43949e1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3383295) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb2f expref: 29 pid: 8436 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746129754.920783:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43949e1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3383295) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb2f expref: 29 pid: 8436 timeout: 800 lvb_type: 0 00002000:00010000:2.0:1746129754.920789:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b8e4000 00000100:00100000:0.0:1746129754.922550:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.922724:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052276864 00000100:00100000:2.0:1746129754.922731:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052276864 00010000:00010000:2.0:1746129754.922758:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43949e1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3383295) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb2f expref: 29 pid: 8436 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746129754.923928:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5361 00000100:00100000:3.0:1746129754.923939:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1964:x1830949052276864:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129754.923951:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129754.923970:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43949e1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3383295) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb2f expref: 29 pid: 8436 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746129754.923981:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43949e1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3383295) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb2f expref: 29 pid: 8436 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746129754.923999:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd85600/0x48868a4e43949e1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3383295) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb2f expref: 29 pid: 8436 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746129754.924020:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129754.924022:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129754.924027:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43949e2d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb3d expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.924035:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43949e2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb3d expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129754.924063:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43949e2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb3d expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129754.924073:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053334400:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129754.925224:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129754.930276:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129754.930503:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053334400:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129754.930520:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129754.930568:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1964:x1830949052276864:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6632us (8023us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129754.930577:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5361 00000100:00100000:2.0:1746129754.930784:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052277120 00000100:00100000:2.0:1746129754.930790:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052277120 00002000:00100000:2.0:1746129754.930820:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012b8e4e00 x1830949052277120/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.930828:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e4e00 with x1830949052277120 ext(3145728->4194303) 00002000:00010000:2.0:1746129754.930831:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8e4e00 00000100:00100000:2.0:1746129754.930868:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4173 00000100:00100000:2.0:1746129754.930875:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1961:x1830949052277120:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129754.940665:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1961:x1830949052277120:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9781us (10385us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129754.940676:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4173 00002000:00100000:2.0:1746129754.940685:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012b8e4e00 x1830949052277120/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.940694:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e4e00 with x1830949052277120 ext(3145728->4194303) 00002000:00010000:2.0:1746129754.940699:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8e4e00 00000100:00100000:0.0:1746129754.947839:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.948201:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052277376 00000100:00100000:2.0:1746129754.948209:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052277376 00002000:00100000:2.0:1746129754.948241:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88012b8e6d80 x1830949052277376/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/0 e 0 to 0 dl 1746129765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.948250:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e6d80 with x1830949052277376 ext(4194304->4964351) 00002000:00010000:2.0:1746129754.948254:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8e6d80 00000100:00100000:2.0:1746129754.948268:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4174 00000100:00100000:2.0:1746129754.948273:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1963:x1830949052277376:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129754.959918:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1963:x1830949052277376:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11636us (12079us total) trans 0 rc 770048/770048 00000100:00100000:2.0:1746129754.959930:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4174 00002000:00100000:2.0:1746129754.959941:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88012b8e6d80 x1830949052277376/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:495/0 lens 488/440 e 0 to 0 dl 1746129765 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129754.959949:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e6d80 with x1830949052277376 ext(4194304->4964351) 00002000:00010000:2.0:1746129754.959954:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8e6d80 00000100:00100000:0.0:1746129754.982242:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.982323:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052277504 00000100:00100000:2.0:1746129754.982329:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052277504 00000100:00100000:2.0:1746129754.982425:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9919 00000100:00100000:2.0:1746129754.982431:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+15:28704:x1830949052277504:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129754.982450:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129754.982463:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e200/0x48868a4e43949e34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fb44 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.982506:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f600/0x48868a4e43949e3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129754.982519:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f600/0x48868a4e43949e3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129754.982528:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f600/0x48868a4e43949e3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129754.982539:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e43949e42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129754.982543:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e43949e42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129754.982547:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e43949e42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129754.982627:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949e49 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129754.982634:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4d800/0x48868a4e43949d7e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34facd expref: 301 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.982640:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949e49 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129754.982660:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4d800/0x48868a4e43949d7e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34facd expref: 301 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.982669:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4d800/0x48868a4e43949d7e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34facd expref: 301 pid: 15044 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746129754.982678:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053334528:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129754.984566:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129754.986349:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.986409:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052277760 00000100:00100000:1.0:1746129754.986416:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052277760 00000100:00100000:2.0:1746129754.986902:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053334528:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129754.986920:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949e49 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:1.0:1746129754.986990:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3909 00000100:00100000:1.0:1746129754.986996:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+302:27195:x1830949052277760:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746129754.987158:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+303:27195:x1830949052277760:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 162us (823us total) trans 8589943715 rc 0/0 00000100:00100000:1.0:1746129754.987164:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3909 00000100:00100000:0.0:1746129754.988493:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.988592:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052277888 00000100:00100000:2.0:1746129754.988596:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052277888 00010000:00010000:2.0:1746129754.988617:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4d800/0x48868a4e43949d7e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34facd expref: 303 pid: 15044 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746129754.988694:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5362 00000100:00100000:2.0:1746129754.988700:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+303:1962:x1830949052277888:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129754.988710:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129754.988714:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4d800/0x48868a4e43949d7e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34facd expref: 303 pid: 15044 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746129754.988723:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4d800/0x48868a4e43949d7e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34facd expref: 303 pid: 15044 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746129754.988738:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4d800/0x48868a4e43949d7e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34facd expref: 303 pid: 15044 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746129754.988951:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129754.988956:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949e49 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129754.988963:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949e49 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129754.988969:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949e49 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129754.988985:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129754.989009:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+302:1962:x1830949052277888:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 309us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129754.989013:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5362 00010000:00010000:0.0:1746129754.989053:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949e49 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129754.989059:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949e49 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:0.0:1746129754.989089:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:0.0:1746129754.989092:0:1851:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129754.989103:0:1851:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949e49 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129754.989111:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949e49 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129754.989118:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f600/0x48868a4e43949e3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129754.989123:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f600/0x48868a4e43949e3b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129754.989128:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f600/0x48868a4e43949e3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129754.989132:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb6f600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129754.989136:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f600/0x48868a4e43949e3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129754.989142:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f600/0x48868a4e43949e3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129754.989149:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:0.0:1746129754.989151:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129754.989153:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f600/0x48868a4e43949e3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129754.989157:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f600/0x48868a4e43949e3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129754.989168:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e43949e42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129754.989172:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e43949e42 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129754.989176:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e43949e42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129754.989179:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb6fa00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129754.989182:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e43949e42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129754.989185:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e43949e42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129754.989189:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e29ae00) 00010000:00010000:0.0:1746129754.989191:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129754.989193:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e43949e42 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129754.989200:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e43949e42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129754.989224:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e200/0x48868a4e43949e34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb44 expref: 17 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.989232:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949e49 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb44 expref: 16 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.989238:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129754.989239:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129754.989241:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6f400, rc 0) 00000100:00100000:0.0:1746129754.989258:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+16:28704:x1830949052277504:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 6828us (7023us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129754.989263:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9919 00000100:00100000:0.0:1746129754.993659:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.994125:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.994173:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052278016 00000100:00100000:2.0:1746129754.994179:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052278016 00000100:00100000:0.0:1746129754.994571:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.994612:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052278144 00000100:00100000:2.0:1746129754.994615:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052278144 00000100:00100000:2.0:1746129754.994639:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11117 00000100:00100000:2.0:1746129754.994645:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+6:1961:x1830949052278016:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129754.994660:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129754.994673:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ec00/0x48868a4e43949e50 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fb4b expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129754.994704:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052278272 00000100:00100000:0.0:1746129754.994710:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052278272 00000100:00100000:1.0:1746129754.994726:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11118 00000100:00100000:1.0:1746129754.994732:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+7:1961:x1830949052278144:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:0.0:1746129754.994766:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11119 00000100:00100000:0.0:1746129754.994770:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+7:1962:x1830949052278272:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129754.994792:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129754.994803:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e43949e57 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fb52 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129754.994820:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.994822:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129754.994828:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e43949e57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb52 expref: 8 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129754.994843:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e43949e57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb52 expref: 8 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129754.994865:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b22c5000, rc 0) 00000100:00100000:1.0:1746129754.994901:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949052278144:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 170us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129754.994906:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11118 00000100:00100000:1.0:1746129754.994934:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129754.994945:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052278528 00000100:00100000:1.0:1746129754.994947:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052278528 00010000:00010000:2.0:1746129754.995561:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129754.995563:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129754.995569:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ec00/0x48868a4e43949e50 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb4b expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129754.995580:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ec00/0x48868a4e43949e50 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb4b expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129754.995588:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6ec00, rc 0) 00000100:00100000:2.0:1746129754.995606:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949052278016:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 961us (1953us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129754.995611:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11117 00000100:00100000:2.0:1746129754.995623:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11120 00000100:00100000:2.0:1746129754.995629:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+7:1962:x1830949052278528:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129754.995635:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129754.995642:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e43949e5e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fb67 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.995652:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129754.995653:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129754.995657:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e43949e5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb67 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129754.995671:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e43949e5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb67 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129754.995677:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6fe00, rc 0) 00010000:00010000:0.0:1746129754.995689:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129754.995693:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052278528:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 65us (758us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129754.995697:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e43949e65 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fb59 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129754.995698:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11120 00010000:00010000:0.0:1746129754.995708:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.995710:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.995719:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e43949e65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb59 expref: 8 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.995731:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e43949e65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb59 expref: 8 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.995740:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11800, rc 0) 00000100:00100000:0.0:1746129754.995759:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052278272:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 989us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129754.995763:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11119 00000100:00100000:2.0:1746129754.997059:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129754.997793:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129754.998033:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052278400 00000100:00100000:0.0:1746129754.998039:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052278400 00000100:00100000:0.0:1746129754.998063:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052278656 00000100:00100000:0.0:1746129754.998065:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052278656 00000100:00100000:0.0:1746129754.998077:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11121 00000100:00100000:0.0:1746129754.998082:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052278400:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129754.998093:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129754.998105:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e43949e6c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fb60 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129754.998121:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.998122:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129754.998128:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e43949e6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb60 expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.998139:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e43949e6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb60 expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129754.998151:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:0.0:1746129754.998178:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052278400:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 95us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129754.998183:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11121 00000100:00100000:2.0:1746129754.998643:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11122 00000100:00100000:2.0:1746129754.998651:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052278656:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129754.998658:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129754.998667:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e400/0x48868a4e43949e73 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fb6e expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129754.998677:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129754.998679:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129754.998684:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e400/0x48868a4e43949e73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb6e expref: 9 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129754.998694:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e400/0x48868a4e43949e73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb6e expref: 9 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129754.998701:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6e400, rc 0) 00000100:00100000:2.0:1746129754.998717:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052278656:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 69us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129754.998722:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11122 00000100:00100000:0.0:1746129755.005159:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.005600:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052278912 00000100:00100000:2.0:1746129755.005608:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052278912 00000100:00100000:2.0:1746129755.006691:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9920 00000100:00100000:2.0:1746129755.006700:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+16:28704:x1830949052278912:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129755.006721:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129755.006736:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ee00/0x48868a4e43949e7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fb75 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.006817:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e800/0x48868a4e43949e81 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.006829:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949e49 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb44 expref: 17 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.006840:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e800/0x48868a4e43949e81 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.006872:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949e49 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb44 expref: 17 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.006885:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949e49 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb44 expref: 17 pid: 1851 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746129755.006893:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053334656:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129755.006964:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129755.010656:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053334656:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129755.010676:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e800/0x48868a4e43949e81 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129755.011186:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.011450:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052279040 00000100:00100000:2.0:1746129755.011456:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052279040 00010000:00010000:2.0:1746129755.011480:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949e49 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb44 expref: 18 pid: 1851 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746129755.011510:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5363 00000100:00100000:2.0:1746129755.011516:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+18:1961:x1830949052279040:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129755.011527:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129755.011532:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949e49 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb44 expref: 18 pid: 1851 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746129755.011540:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949e49 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb44 expref: 18 pid: 1851 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746129755.011557:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949e49 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb44 expref: 18 pid: 1851 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746129755.011583:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129755.011586:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e800/0x48868a4e43949e81 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.011594:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e800/0x48868a4e43949e81 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.011598:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e800/0x48868a4e43949e81 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.011610:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129755.011638:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+17:1961:x1830949052279040:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 122us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129755.011643:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5363 00010000:00010000:2.0:1746129755.011658:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e800/0x48868a4e43949e81 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.011662:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e800/0x48868a4e43949e81 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129755.011674:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129755.011769:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6ee00/0x48868a4e43949e7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb75 expref: 18 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.011779:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e800/0x48868a4e43949e81 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb75 expref: 17 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.011784:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129755.011786:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129755.011789:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6e800, rc 0) 00000100:00100000:2.0:1746129755.011817:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+17:28704:x1830949052278912:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5119us (6666us total) trans 8589943716 rc 0/0 00000100:00100000:2.0:1746129755.011823:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9920 00000100:00100000:0.0:1746129755.015536:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.015663:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052279168 00000100:00100000:2.0:1746129755.015677:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052279168 00000100:00100000:2.0:1746129755.016395:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9921 00000100:00100000:2.0:1746129755.016404:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+17:28704:x1830949052279168:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129755.016432:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129755.016463:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e43949e8f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fb7c expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.016531:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f600/0x48868a4e43949e96 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.016551:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e800/0x48868a4e43949e81 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb75 expref: 18 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.016558:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f600/0x48868a4e43949e96 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.016587:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e800/0x48868a4e43949e81 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb75 expref: 18 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.016603:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e800/0x48868a4e43949e81 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb75 expref: 18 pid: 1851 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746129755.016612:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053334784:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129755.016691:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129755.020883:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.021033:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053334784:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129755.021051:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f600/0x48868a4e43949e96 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:1.0:1746129755.021105:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052279296 00000100:00100000:1.0:1746129755.021111:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052279296 00010000:00010000:1.0:1746129755.021132:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e800/0x48868a4e43949e81 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb75 expref: 19 pid: 1851 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746129755.021149:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5364 00000100:00100000:1.0:1746129755.021154:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+19:1961:x1830949052279296:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129755.021163:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129755.021167:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e800/0x48868a4e43949e81 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb75 expref: 19 pid: 1851 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.021176:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e800/0x48868a4e43949e81 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb75 expref: 19 pid: 1851 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.021191:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e800/0x48868a4e43949e81 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb75 expref: 19 pid: 1851 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.021705:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129755.021710:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f600/0x48868a4e43949e96 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129755.021718:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f600/0x48868a4e43949e96 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129755.021723:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f600/0x48868a4e43949e96 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129755.021746:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129755.021788:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+18:1961:x1830949052279296:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 633us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129755.021795:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5364 00010000:00010000:2.0:1746129755.021842:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f600/0x48868a4e43949e96 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.021862:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f600/0x48868a4e43949e96 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129755.021894:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:2.0:1746129755.021897:0:1851:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129755.021910:0:1851:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f600/0x48868a4e43949e96 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.021932:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e43949e8f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb7c expref: 18 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.021944:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f600/0x48868a4e43949e96 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb7c expref: 17 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.021949:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129755.021951:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129755.021953:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6f600, rc 0) 00000100:00100000:2.0:1746129755.021973:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+17:28704:x1830949052279168:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5571us (6444us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129755.021978:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9921 00000100:00100000:0.0:1746129755.024721:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.024826:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052279552 00000100:00100000:2.0:1746129755.024833:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052279552 00000100:00100000:2.0:1746129755.024903:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9922 00000100:00100000:2.0:1746129755.024910:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+17:28704:x1830949052279552:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129755.024927:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129755.024943:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f800/0x48868a4e43949e9d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fb83 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.025013:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f200/0x48868a4e43949ea4 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.025023:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f200/0x48868a4e43949ea4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.025032:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f200/0x48868a4e43949ea4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129755.025040:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129755.025126:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f800/0x48868a4e43949e9d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb83 expref: 20 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.025139:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f200/0x48868a4e43949ea4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb83 expref: 19 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.025145:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129755.025148:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129755.025150:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6f200, rc 0) 00000100:00100000:2.0:1746129755.026010:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+19:28704:x1830949052279552:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1097us (1292us total) trans 8589943717 rc 0/0 00000100:00100000:2.0:1746129755.026017:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9922 00000100:00100000:0.0:1746129755.032360:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.032391:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.032412:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.032814:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.033022:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.033147:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052279680 00000100:00100000:2.0:1746129755.033155:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052279680 00000100:00100000:2.0:1746129755.033194:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052279936 00000100:00100000:2.0:1746129755.033196:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052279936 00000100:00100000:2.0:1746129755.033216:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052280192 00000100:00100000:2.0:1746129755.033218:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052280192 00000100:00100000:2.0:1746129755.033230:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052279808 00000100:00100000:2.0:1746129755.033232:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052279808 00000100:00100000:2.0:1746129755.033244:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11123 00000100:00100000:2.0:1746129755.033251:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052279680:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:2.0:1746129755.033289:0:3624:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fa00/0x48868a4e43949eb2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.033306:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ee00/0x48868a4e43949c51 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9bc expref: 27 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129755.033313:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ec00/0x48868a4e43949e50 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb4b expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129755.033319:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009536f000/0x48868a4e43949c90 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9f4 expref: 14 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129755.033324:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129755.033326:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129755.033328:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fa00/0x48868a4e43949eb2 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.033361:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009536f000/0x48868a4e43949c90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9f4 expref: 14 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129755.033373:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009536f000/0x48868a4e43949c90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9f4 expref: 14 pid: 8435 timeout: 801 lvb_type: 1 00000100:00100000:2.0:1746129755.033387:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053334912:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129755.033449:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ec00/0x48868a4e43949e50 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb4b expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129755.033456:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ec00/0x48868a4e43949e50 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb4b expref: 10 pid: 8436 timeout: 801 lvb_type: 1 00000100:00100000:2.0:1746129755.033463:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053335040:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129755.033483:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ee00/0x48868a4e43949c51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9bc expref: 27 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129755.033489:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ee00/0x48868a4e43949c51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9bc expref: 27 pid: 4589 timeout: 801 lvb_type: 1 00000100:00100000:2.0:1746129755.033495:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053335168:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129755.033508:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129755.033526:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11124 00000100:00100000:2.0:1746129755.033531:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052279936:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:2.0:1746129755.033549:0:8435:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095345a00/0x48868a4e43949eb9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.033558:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5244600/0x48868a4e43949c97 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa02 expref: 10 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129755.033567:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e43949e65 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb59 expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129755.033573:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009536fa00/0x48868a4e43949ca5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa17 expref: 16 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.033577:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129755.033578:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129755.033580:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095345a00/0x48868a4e43949eb9 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.033593:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009536fa00/0x48868a4e43949ca5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa17 expref: 16 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.033601:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009536fa00/0x48868a4e43949ca5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa17 expref: 16 pid: 8435 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746129755.033609:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053335296:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129755.033632:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e43949e65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb59 expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129755.033638:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e43949e65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb59 expref: 10 pid: 3624 timeout: 801 lvb_type: 1 00000100:00100000:2.0:1746129755.033645:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053335424:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129755.033663:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5244600/0x48868a4e43949c97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa02 expref: 10 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129755.033669:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b5244600/0x48868a4e43949c97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa02 expref: 10 pid: 1140 timeout: 801 lvb_type: 1 00000100:00100000:2.0:1746129755.033675:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053335552:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129755.033686:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129755.033700:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11125 00000100:00100000:2.0:1746129755.033705:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052280192:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:2.0:1746129755.033719:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095344e00/0x48868a4e43949ec0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.033728:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd85e00/0x48868a4e43949e18 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb28 expref: 14 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.033735:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43949e2d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb3d expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.033740:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e43949e5e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb67 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129755.033746:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b538a400/0x48868a4e43949cf2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa64 expref: 27 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.033751:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746129755.033752:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746129755.033754:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095344e00/0x48868a4e43949ec0 lrc: 7/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.033766:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b538a400/0x48868a4e43949cf2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa64 expref: 27 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.033772:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b538a400/0x48868a4e43949cf2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa64 expref: 27 pid: 10930 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746129755.033779:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053335680:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129755.033802:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e43949e5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb67 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129755.033808:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e43949e5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb67 expref: 10 pid: 8436 timeout: 801 lvb_type: 1 00000100:00100000:2.0:1746129755.033814:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053335808:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129755.033831:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43949e2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb3d expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.033837:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43949e2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb3d expref: 14 pid: 8436 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746129755.033843:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053335936:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129755.033883:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd85e00/0x48868a4e43949e18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb28 expref: 14 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.033890:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd85e00/0x48868a4e43949e18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb28 expref: 14 pid: 1140 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746129755.033897:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053336064:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129755.033908:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129755.034383:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11126 00000100:00100000:1.0:1746129755.034391:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052279808:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:1.0:1746129755.034405:0:10930:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5800/0x48868a4e43949ec7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.034414:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949c5f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9c3 expref: 16 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129755.034421:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e43949e57 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb52 expref: 10 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129755.034427:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009536f200/0x48868a4e43949c82 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9fb expref: 10 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129755.034432:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129755.034434:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129755.034436:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5800/0x48868a4e43949ec7 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.034449:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009536f200/0x48868a4e43949c82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9fb expref: 10 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129755.034456:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009536f200/0x48868a4e43949c82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9fb expref: 10 pid: 8435 timeout: 801 lvb_type: 1 00000100:00100000:1.0:1746129755.034464:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053336192:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129755.034492:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e43949e57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb52 expref: 10 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129755.034500:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e43949e57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb52 expref: 10 pid: 10930 timeout: 801 lvb_type: 1 00000100:00100000:1.0:1746129755.034507:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053336320:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129755.034524:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949c5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9c3 expref: 16 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129755.034531:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949c5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9c3 expref: 16 pid: 4589 timeout: 801 lvb_type: 1 00000100:00100000:1.0:1746129755.034537:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053336448:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129755.034550:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4efd840 going to sleep for 11 seconds 00000100:00080000:1.0:1746129755.034560:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746129755.034563:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129755.035515:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129755.035618:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052280064 00000100:00100000:1.0:1746129755.035623:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052280064 00000100:00100000:1.0:1746129755.035642:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052280320 00000100:00100000:1.0:1746129755.035644:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052280320 00000100:00100000:1.0:1746129755.035655:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11127 00000100:00100000:1.0:1746129755.035660:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052280064:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:1.0:1746129755.035680:0:3623:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3200/0x48868a4e43949ece lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.035691:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fa00/0x48868a4e43949c58 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9ca expref: 14 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.035702:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e43949e6c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb60 expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129755.035708:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1e000/0x48868a4e43949c6d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9d8 expref: 27 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129755.035714:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129755.035716:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129755.035723:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3200/0x48868a4e43949ece lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.035741:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800acc1e000/0x48868a4e43949c6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9d8 expref: 27 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129755.035748:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800acc1e000/0x48868a4e43949c6d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9d8 expref: 27 pid: 4589 timeout: 801 lvb_type: 1 00000100:00100000:1.0:1746129755.035757:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053336576:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129755.035794:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11128 00000100:00100000:3.0:1746129755.035802:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052280320:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:3.0:1746129755.035817:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9a00/0x48868a4e43949ed5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.035826:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd85a00/0x48868a4e43949e26 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb36 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.035832:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e400/0x48868a4e43949e73 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb6e expref: 11 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129755.035838:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b538ae00/0x48868a4e43949cdd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa4f expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.035863:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b538bc00/0x48868a4e43949cf9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa6b expref: 10 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.035868:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746129755.035869:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746129755.035871:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9a00/0x48868a4e43949ed5 lrc: 7/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.035885:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b538bc00/0x48868a4e43949cf9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa6b expref: 10 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.035892:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b538bc00/0x48868a4e43949cf9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa6b expref: 10 pid: 10930 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746129755.035900:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053336704:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129755.035952:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b538ae00/0x48868a4e43949cdd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa4f expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.035958:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b538ae00/0x48868a4e43949cdd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa4f expref: 16 pid: 8437 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746129755.035965:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131462300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053336832:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129755.035984:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e400/0x48868a4e43949e73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb6e expref: 11 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129755.035994:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e400/0x48868a4e43949e73 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb6e expref: 11 pid: 8435 timeout: 801 lvb_type: 1 00000100:00100000:3.0:1746129755.036000:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053336960:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129755.036015:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd85a00/0x48868a4e43949e26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb36 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.036022:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd85a00/0x48868a4e43949e26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb36 expref: 10 pid: 8436 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746129755.036028:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053337088:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129755.036039:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584c00 going to sleep for 11 seconds 00010000:00010000:1.0:1746129755.038052:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e43949e6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb60 expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129755.038067:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e43949e6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb60 expref: 11 pid: 3624 timeout: 801 lvb_type: 1 00000100:00100000:1.0:1746129755.038079:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053337216:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129755.038119:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fa00/0x48868a4e43949c58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9ca expref: 14 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.038126:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fa00/0x48868a4e43949c58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9ca expref: 14 pid: 4589 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746129755.038132:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053337344:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129755.038146:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4efde40 going to sleep for 11 seconds 00010000:00010000:2.0:1746129755.040978:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129755.044176:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.044198:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.044219:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.044288:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052280448 00000100:00100000:3.0:1746129755.044295:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052280448 00010000:00010000:3.0:1746129755.044324:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ec00/0x48868a4e43949e50 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb4b expref: 12 pid: 8436 timeout: 801 lvb_type: 1 00000100:00100000:3.0:1746129755.044351:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052280704 00000100:00100000:3.0:1746129755.044353:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052280704 00010000:00010000:3.0:1746129755.044366:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009536f000/0x48868a4e43949c90 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9f4 expref: 15 pid: 8435 timeout: 801 lvb_type: 1 00000100:00100000:3.0:1746129755.044375:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052280576 00000100:00100000:3.0:1746129755.044377:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052280576 00010000:00010000:3.0:1746129755.044386:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009536fa00/0x48868a4e43949ca5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa17 expref: 17 pid: 8435 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746129755.044402:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5365 00000100:00100000:3.0:1746129755.044408:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130564050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+12:1964:x1830949052280448:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129755.044418:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129755.044433:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ec00/0x48868a4e43949e50 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb4b expref: 12 pid: 8436 timeout: 801 lvb_type: 1 00010000:00010000:3.0:1746129755.044442:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ec00/0x48868a4e43949e50 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb4b expref: 12 pid: 8436 timeout: 801 lvb_type: 1 00010000:00010000:3.0:1746129755.044459:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129755.044488:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130564050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+12:1964:x1830949052280448:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 80us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129755.044492:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5365 00000100:00100000:3.0:1746129755.044523:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5366 00000100:00100000:3.0:1746129755.044526:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1964:x1830949052280704:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129755.044531:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129755.044535:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009536f000/0x48868a4e43949c90 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9f4 expref: 15 pid: 8435 timeout: 801 lvb_type: 1 00010000:00010000:3.0:1746129755.044548:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009536f000/0x48868a4e43949c90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9f4 expref: 15 pid: 8435 timeout: 801 lvb_type: 1 00010000:00010000:3.0:1746129755.044559:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129755.044571:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1964:x1830949052280704:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 41us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129755.044576:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5366 00000100:00100000:3.0:1746129755.044595:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5367 00000100:00100000:3.0:1746129755.044598:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1964:x1830949052280576:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129755.044603:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129755.044612:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009536fa00/0x48868a4e43949ca5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa17 expref: 17 pid: 8435 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746129755.044619:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009536fa00/0x48868a4e43949ca5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa17 expref: 17 pid: 8435 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746129755.044627:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129755.044635:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1964:x1830949052280576:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 37us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129755.044639:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5367 00010000:00010000:3.0:1746129755.044668:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009536fa00/0x48868a4e43949ca5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa17 expref: 16 pid: 8435 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746129755.044684:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053335296:192.168.204.31@tcp:104: 00000100:00080000:1.0:1746129755.044959:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746129755.044962:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746129755.045020:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009536f000/0x48868a4e43949c90 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9f4 expref: 14 pid: 8435 timeout: 801 lvb_type: 1 00000100:00100000:2.0:1746129755.045031:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053334912:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129755.045038:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ec00/0x48868a4e43949e50 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb4b expref: 11 pid: 8436 timeout: 801 lvb_type: 1 00000100:00100000:2.0:1746129755.045044:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053335040:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129755.045050:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053335168:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129755.045068:0:3624:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fa00/0x48868a4e43949eb2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129755.047789:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053335424:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129755.056464:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.056554:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.056572:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.056583:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.056597:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.056617:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052280832 00000100:00100000:0.0:1746129755.056623:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052280832 00010000:00010000:0.0:1746129755.056658:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ee00/0x48868a4e43949c51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9bc expref: 28 pid: 4589 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746129755.056678:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052281344 00000100:00100000:0.0:1746129755.056680:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052281344 00010000:00010000:0.0:1746129755.056694:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5244600/0x48868a4e43949c97 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa02 expref: 11 pid: 1140 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746129755.056703:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052280960 00000100:00100000:0.0:1746129755.056705:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052280960 00010000:00010000:0.0:1746129755.056712:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e43949e65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb59 expref: 12 pid: 3624 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746129755.056721:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5368 00000100:00100000:0.0:1746129755.056728:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949052280832:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129755.056740:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129755.056756:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ee00/0x48868a4e43949c51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9bc expref: 28 pid: 4589 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746129755.056766:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ee00/0x48868a4e43949c51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9bc expref: 28 pid: 4589 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746129755.056784:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ee00/0x48868a4e43949c51 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9bc expref: 28 pid: 4589 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746129755.056800:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129755.056802:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129755.056806:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fa00/0x48868a4e43949eb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129755.056816:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fa00/0x48868a4e43949eb2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129755.056832:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129755.056982:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949052280832:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 253us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129755.056988:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5368 00000100:00100000:0.0:1746129755.057000:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052281216 00000100:00100000:0.0:1746129755.057002:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052281216 00010000:00010000:0.0:1746129755.057012:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e43949e5e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb67 expref: 11 pid: 8436 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746129755.057021:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052281088 00000100:00100000:0.0:1746129755.057022:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052281088 00010000:00010000:0.0:1746129755.057028:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b538a400/0x48868a4e43949cf2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa64 expref: 27 pid: 10930 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746129755.057036:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5369 00000100:00100000:0.0:1746129755.057040:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052281344:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129755.057047:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129755.057058:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b5244600/0x48868a4e43949c97 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa02 expref: 11 pid: 1140 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746129755.057065:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b5244600/0x48868a4e43949c97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa02 expref: 11 pid: 1140 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746129755.057080:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129755.057094:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052281344:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 54us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129755.057099:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5369 00000100:00100000:0.0:1746129755.057107:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5370 00000100:00100000:0.0:1746129755.057111:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+12:1963:x1830949052280960:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129755.057116:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129755.057122:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e43949e65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb59 expref: 12 pid: 3624 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746129755.057130:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e43949e65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb59 expref: 12 pid: 3624 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746129755.057139:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e43949e65 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb59 expref: 12 pid: 3624 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746129755.057147:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129755.057149:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129755.057152:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095345a00/0x48868a4e43949eb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129755.057157:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095345a00/0x48868a4e43949eb9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129755.057165:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129755.057178:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949052280960:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 66us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129755.057183:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5370 00000100:00100000:0.0:1746129755.057192:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5371 00000100:00100000:0.0:1746129755.057196:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949052281216:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129755.057201:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129755.057208:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e43949e5e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb67 expref: 11 pid: 8436 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746129755.057214:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e43949e5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb67 expref: 11 pid: 8436 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746129755.057223:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129755.057235:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949052281216:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 40us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129755.057239:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5371 00000100:00100000:0.0:1746129755.057246:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5372 00000100:00100000:0.0:1746129755.057250:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130567c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949052281088:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129755.057255:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129755.057261:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b538a400/0x48868a4e43949cf2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa64 expref: 27 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746129755.057266:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b538a400/0x48868a4e43949cf2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa64 expref: 27 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746129755.057274:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129755.057284:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130567c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949052281088:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 34us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129755.057288:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5372 00000100:00100000:0.0:1746129755.057480:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.057490:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052281728 00000100:00100000:0.0:1746129755.057492:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052281728 00010000:00010000:0.0:1746129755.057501:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b538bc00/0x48868a4e43949cf9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa6b expref: 11 pid: 10930 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746129755.057511:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5373 00000100:00100000:0.0:1746129755.057515:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052281728:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129755.057519:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129755.057526:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b538bc00/0x48868a4e43949cf9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa6b expref: 11 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746129755.057533:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b538bc00/0x48868a4e43949cf9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa6b expref: 11 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746129755.057541:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129755.057556:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052281728:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 40us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129755.057560:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5373 00000100:00100000:0.0:1746129755.057581:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.057589:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052281600 00000100:00100000:0.0:1746129755.057591:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052281600 00010000:00010000:0.0:1746129755.057599:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009536f200/0x48868a4e43949c82 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9fb expref: 11 pid: 8435 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746129755.057613:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5374 00000100:00100000:0.0:1746129755.057617:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052281600:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129755.057622:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129755.057628:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009536f200/0x48868a4e43949c82 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9fb expref: 11 pid: 8435 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746129755.057634:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009536f200/0x48868a4e43949c82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9fb expref: 11 pid: 8435 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746129755.057643:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129755.057653:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052281600:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 36us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129755.057657:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5374 00000100:00100000:0.0:1746129755.057686:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.057695:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052281856 00000100:00100000:0.0:1746129755.057697:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052281856 00010000:00010000:0.0:1746129755.057705:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b538ae00/0x48868a4e43949cdd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa4f expref: 16 pid: 8437 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746129755.057713:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5375 00000100:00100000:0.0:1746129755.057717:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1961:x1830949052281856:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129755.057722:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129755.057728:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b538ae00/0x48868a4e43949cdd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa4f expref: 16 pid: 8437 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746129755.057740:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b538ae00/0x48868a4e43949cdd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa4f expref: 16 pid: 8437 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746129755.057749:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129755.057761:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1961:x1830949052281856:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 43us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129755.057766:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5375 00000100:00100000:0.0:1746129755.057789:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.057796:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052281472 00000100:00100000:0.0:1746129755.057799:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052281472 00010000:00010000:0.0:1746129755.057806:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e43949e57 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb52 expref: 11 pid: 10930 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746129755.057815:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5376 00000100:00100000:0.0:1746129755.057819:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052281472:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129755.057824:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129755.057829:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e43949e57 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb52 expref: 11 pid: 10930 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746129755.057837:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e43949e57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb52 expref: 11 pid: 10930 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746129755.057845:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129755.057878:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052281472:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 58us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129755.057886:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5376 00000100:00100000:0.0:1746129755.057909:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.057916:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052281984 00000100:00100000:0.0:1746129755.057918:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052281984 00010000:00010000:0.0:1746129755.057925:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949c5f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9c3 expref: 16 pid: 4589 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746129755.057934:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5377 00000100:00100000:0.0:1746129755.057938:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1964:x1830949052281984:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129755.057942:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129755.057947:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949c5f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9c3 expref: 16 pid: 4589 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746129755.057954:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949c5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9c3 expref: 16 pid: 4589 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746129755.057962:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129755.057964:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129755.057966:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5800/0x48868a4e43949ec7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129755.057972:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5800/0x48868a4e43949ec7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129755.057982:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129755.057993:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1964:x1830949052281984:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 54us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129755.058000:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5377 00000100:00100000:0.0:1746129755.058051:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.058059:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052282112 00000100:00100000:0.0:1746129755.058061:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052282112 00010000:00010000:0.0:1746129755.058070:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e400/0x48868a4e43949e73 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb6e expref: 11 pid: 8435 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746129755.058078:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5378 00000100:00100000:0.0:1746129755.058083:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052282112:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129755.058087:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129755.058093:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e400/0x48868a4e43949e73 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb6e expref: 11 pid: 8435 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746129755.058100:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e400/0x48868a4e43949e73 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb6e expref: 11 pid: 8435 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746129755.058109:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129755.058120:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052282112:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 37us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129755.058124:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5378 00000100:00100000:0.0:1746129755.058202:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.058209:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052282240 00000100:00100000:0.0:1746129755.058212:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052282240 00010000:00010000:0.0:1746129755.058220:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43949e2d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb3d expref: 14 pid: 8436 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746129755.058230:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5379 00000100:00100000:0.0:1746129755.058234:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130567850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052282240:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129755.058239:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129755.058246:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43949e2d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb3d expref: 14 pid: 8436 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746129755.058252:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43949e2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb3d expref: 14 pid: 8436 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746129755.058261:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129755.058273:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130567850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052282240:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 38us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129755.058277:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5379 00000100:00100000:0.0:1746129755.058304:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.058313:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052282368 00000100:00100000:0.0:1746129755.058315:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052282368 00000100:00100000:1.0:1746129755.058388:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053336576:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129755.058397:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053337216:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129755.058404:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053337344:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129755.058423:0:3623:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3200/0x48868a4e43949ece lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1746129755.058439:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746129755.058442:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746129755.058457:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009536f200/0x48868a4e43949c82 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9fb expref: 10 pid: 8435 timeout: 801 lvb_type: 1 00000100:00100000:1.0:1746129755.058470:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053336192:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129755.058478:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5000/0x48868a4e43949e57 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb52 expref: 10 pid: 10930 timeout: 801 lvb_type: 1 00000100:00100000:1.0:1746129755.058491:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053336320:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129755.058499:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949c5f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9c3 expref: 15 pid: 4589 timeout: 801 lvb_type: 1 00000100:00100000:1.0:1746129755.058506:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053336448:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129755.058516:0:10930:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5800/0x48868a4e43949ec7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.058522:0:10930:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5800/0x48868a4e43949ec7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.058528:0:10930:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5800/0x48868a4e43949ec7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.058545:0:10930:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5800/0x48868a4e43949ec7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.058551:0:10930:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5800/0x48868a4e43949ec7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.058556:0:10930:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5800/0x48868a4e43949ec7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.058561:0:10930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b22c5800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129755.058564:0:10930:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5800/0x48868a4e43949ec7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.058570:0:10930:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5800/0x48868a4e43949ec7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.058579:0:10930:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5800/0x48868a4e43949ec7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.058584:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5800/0x48868a4e43949ec7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129755.058617:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052279808:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 24228us (25804us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129755.058623:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11126 00000100:00100000:1.0:1746129755.058666:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129755.058675:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052282496 00000100:00100000:1.0:1746129755.058677:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052282496 00010000:00010000:1.0:1746129755.058688:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fa00/0x48868a4e43949c58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9ca expref: 14 pid: 4589 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746129755.058698:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5380 00000100:00100000:1.0:1746129755.058702:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052282496:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129755.058707:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129755.058716:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fa00/0x48868a4e43949c58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9ca expref: 14 pid: 4589 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.058722:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fa00/0x48868a4e43949c58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9ca expref: 14 pid: 4589 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.058731:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fa00/0x48868a4e43949c58 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9ca expref: 14 pid: 4589 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.058738:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129755.058750:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949052282496:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 48us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129755.058754:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5380 00000100:00100000:1.0:1746129755.058776:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129755.058784:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052282880 00000100:00100000:1.0:1746129755.058787:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052282880 00010000:00010000:1.0:1746129755.058795:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd85a00/0x48868a4e43949e26 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb36 expref: 10 pid: 8436 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746129755.058805:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5381 00000100:00100000:1.0:1746129755.058809:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052282880:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129755.058814:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129755.058820:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd85a00/0x48868a4e43949e26 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb36 expref: 10 pid: 8436 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.058827:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd85a00/0x48868a4e43949e26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb36 expref: 10 pid: 8436 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.058836:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129755.058837:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129755.058840:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9a00/0x48868a4e43949ed5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.058872:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9a00/0x48868a4e43949ed5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.058882:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129755.058895:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052282880:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 86us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129755.058900:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5381 00000100:00100000:1.0:1746129755.058922:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129755.058931:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052282752 00000100:00100000:1.0:1746129755.058933:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052282752 00010000:00010000:1.0:1746129755.058942:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd85e00/0x48868a4e43949e18 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb28 expref: 13 pid: 1140 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746129755.058951:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5382 00000100:00100000:1.0:1746129755.058955:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1963:x1830949052282752:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129755.058960:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129755.058965:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd85e00/0x48868a4e43949e18 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb28 expref: 13 pid: 1140 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.058972:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd85e00/0x48868a4e43949e18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb28 expref: 13 pid: 1140 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.058980:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129755.058981:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129755.058983:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095344e00/0x48868a4e43949ec0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.058993:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095344e00/0x48868a4e43949ec0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.059000:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129755.059010:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1963:x1830949052282752:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 54us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129755.059014:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5382 00000100:00100000:1.0:1746129755.059059:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129755.059067:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052282624 00000100:00100000:1.0:1746129755.059075:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052282624 00010000:00010000:1.0:1746129755.059083:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800acc1e000/0x48868a4e43949c6d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9d8 expref: 27 pid: 4589 timeout: 801 lvb_type: 1 00000100:00100000:1.0:1746129755.059091:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5383 00000100:00100000:1.0:1746129755.059094:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949052282624:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129755.059099:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129755.059104:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800acc1e000/0x48868a4e43949c6d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9d8 expref: 27 pid: 4589 timeout: 801 lvb_type: 1 00010000:00010000:1.0:1746129755.059110:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800acc1e000/0x48868a4e43949c6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9d8 expref: 27 pid: 4589 timeout: 801 lvb_type: 1 00010000:00010000:1.0:1746129755.059118:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1e000/0x48868a4e43949c6d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f9d8 expref: 27 pid: 4589 timeout: 801 lvb_type: 1 00010000:00010000:1.0:1746129755.059124:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129755.059134:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949052282624:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 39us (75us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129755.059138:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5383 00010000:00010000:1.0:1746129755.059169:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b538bc00/0x48868a4e43949cf9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa6b expref: 9 pid: 10930 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746129755.059180:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053336704:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129755.059186:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b538ae00/0x48868a4e43949cdd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa4f expref: 14 pid: 8437 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746129755.059195:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131462300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053336832:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129755.059201:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e400/0x48868a4e43949e73 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb6e expref: 8 pid: 8435 timeout: 801 lvb_type: 1 00000100:00100000:1.0:1746129755.059207:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053336960:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129755.059213:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd85a00/0x48868a4e43949e26 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb36 expref: 8 pid: 8436 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746129755.059218:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053337088:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129755.059229:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9a00/0x48868a4e43949ed5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.059234:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9a00/0x48868a4e43949ed5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.059243:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9a00/0x48868a4e43949ed5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.059253:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9a00/0x48868a4e43949ed5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.059258:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9a00/0x48868a4e43949ed5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.059263:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9a00/0x48868a4e43949ed5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.059267:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ffb9a00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129755.059269:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9a00/0x48868a4e43949ed5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.059274:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9a00/0x48868a4e43949ed5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.059280:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9a00/0x48868a4e43949ed5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.059285:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9a00/0x48868a4e43949ed5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129755.059304:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+7:1962:x1830949052280320:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 23504us (23792us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129755.059309:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11128 00010000:00010000:1.0:1746129755.059330:0:3624:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fa00/0x48868a4e43949eb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.059347:0:3624:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fa00/0x48868a4e43949eb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.059359:0:3624:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fa00/0x48868a4e43949eb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.059364:0:3624:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fa00/0x48868a4e43949eb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.059369:0:3624:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fa00/0x48868a4e43949eb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.059373:0:3624:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb6fa00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129755.059375:0:3624:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fa00/0x48868a4e43949eb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.059379:0:3624:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fa00/0x48868a4e43949eb2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.059386:0:3624:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fa00/0x48868a4e43949eb2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.059390:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fa00/0x48868a4e43949eb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129755.059415:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052279680:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 26166us (27064us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129755.059420:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11123 00010000:00010000:1.0:1746129755.059459:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b538a400/0x48868a4e43949cf2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa64 expref: 25 pid: 10930 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746129755.059466:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053335680:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129755.059474:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e43949e5e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb67 expref: 10 pid: 8436 timeout: 801 lvb_type: 1 00000100:00100000:1.0:1746129755.059480:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053335808:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129755.059488:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43949e2d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb3d expref: 12 pid: 8436 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746129755.059494:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053335936:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129755.059503:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd85e00/0x48868a4e43949e18 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb28 expref: 11 pid: 1140 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746129755.059508:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053336064:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129755.059522:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095344e00/0x48868a4e43949ec0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.059527:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095344e00/0x48868a4e43949ec0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.059532:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095344e00/0x48868a4e43949ec0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.059541:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095344e00/0x48868a4e43949ec0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.059547:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095344e00/0x48868a4e43949ec0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.059552:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095344e00/0x48868a4e43949ec0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.059557:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095344e00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129755.059559:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095344e00/0x48868a4e43949ec0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.059564:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095344e00/0x48868a4e43949ec0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.059572:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095344e00/0x48868a4e43949ec0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.059577:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095344e00/0x48868a4e43949ec0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129755.059598:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052280192:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 25894us (27185us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129755.059603:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11125 00010000:00010000:2.0:1746129755.059701:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5244600/0x48868a4e43949c97 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fa02 expref: 7 pid: 1140 timeout: 801 lvb_type: 1 00000100:00100000:2.0:1746129755.059714:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053335552:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129755.059729:0:8435:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095345a00/0x48868a4e43949eb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.059735:0:8435:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095345a00/0x48868a4e43949eb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.059740:0:8435:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095345a00/0x48868a4e43949eb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.059752:0:8435:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095345a00/0x48868a4e43949eb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.059756:0:8435:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095345a00/0x48868a4e43949eb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.059761:0:8435:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095345a00/0x48868a4e43949eb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.059766:0:8435:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095345a00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129755.059768:0:8435:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095345a00/0x48868a4e43949eb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.059773:0:8435:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095345a00/0x48868a4e43949eb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.059781:0:8435:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095345a00/0x48868a4e43949eb9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.059786:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095345a00/0x48868a4e43949eb9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129755.059812:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+6:1962:x1830949052279936:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 26281us (27420us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129755.059817:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11124 00010000:00010000:1.0:1746129755.061681:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e43949e6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb60 expref: 8 pid: 3624 timeout: 801 lvb_type: 1 00000100:00100000:3.0:1746129755.063360:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5384 00000100:00100000:3.0:1746129755.063373:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052282368:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129755.063387:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129755.063409:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e43949e6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb60 expref: 8 pid: 3624 timeout: 801 lvb_type: 1 00010000:00010000:3.0:1746129755.063427:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e43949e6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb60 expref: 8 pid: 3624 timeout: 801 lvb_type: 1 00010000:00010000:3.0:1746129755.063446:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e43949e6c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb60 expref: 8 pid: 3624 timeout: 801 lvb_type: 1 00010000:00010000:3.0:1746129755.063462:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129755.063465:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129755.063469:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3200/0x48868a4e43949ece lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.063476:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3200/0x48868a4e43949ece lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.063495:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129755.063620:0:3623:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3200/0x48868a4e43949ece lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.063628:0:3623:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3200/0x48868a4e43949ece lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.063644:0:3623:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3200/0x48868a4e43949ece lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.063650:0:3623:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3200/0x48868a4e43949ece lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.063656:0:3623:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3200/0x48868a4e43949ece lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.063662:0:3623:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4ff3200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129755.063665:0:3623:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3200/0x48868a4e43949ece lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.063672:0:3623:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3200/0x48868a4e43949ece lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.063681:0:3623:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3200/0x48868a4e43949ece lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.063688:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3200/0x48868a4e43949ece lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129755.064425:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+7:1962:x1830949052282368:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1054us (6117us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129755.064433:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5384 00000100:00100000:1.0:1746129755.064514:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+6:1962:x1830949052280064:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 28852us (31491us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129755.064521:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11127 00000100:00100000:0.0:1746129755.067642:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.067779:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052283136 00000100:00100000:2.0:1746129755.067786:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052283136 00000100:00100000:2.0:1746129755.067905:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9923 00000100:00100000:2.0:1746129755.067913:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+19:28704:x1830949052283136:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:2.0:1746129755.067954:0:1851:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129755.067974:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f600/0x48868a4e43949e96 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb7c expref: 19 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.067988:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129755.067992:0:1851:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129755.068014:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949edc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.068024:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e4394985a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f79a expref: 26 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.068031:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43949861 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a1 expref: 26 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.068037:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3400/0x48868a4e43949876 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a8 expref: 301 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.068043:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e600/0x48868a4e43949902 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7ee expref: 301 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.068052:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f8400/0x48868a4e43949ac9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f914 expref: 301 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.068058:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9e00/0x48868a4e43949b47 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f953 expref: 26 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.068063:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949edc lrc: 9/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.068088:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9e00/0x48868a4e43949b47 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f953 expref: 26 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.068098:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9e00/0x48868a4e43949b47 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f953 expref: 26 pid: 14314 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746129755.068108:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053337472:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129755.069583:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f8400/0x48868a4e43949ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f914 expref: 301 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.069594:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f8400/0x48868a4e43949ac9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f914 expref: 301 pid: 14314 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746129755.069604:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053337600:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129755.069643:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e600/0x48868a4e43949902 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7ee expref: 301 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.069651:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e600/0x48868a4e43949902 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7ee expref: 301 pid: 14314 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746129755.069658:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053337728:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129755.069680:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3400/0x48868a4e43949876 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a8 expref: 301 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.069687:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3400/0x48868a4e43949876 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a8 expref: 301 pid: 14313 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746129755.069693:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053337856:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129755.069713:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43949861 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a1 expref: 26 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.069720:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43949861 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a1 expref: 26 pid: 14314 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746129755.069727:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053337984:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129755.069744:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e4394985a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f79a expref: 26 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.069756:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e4394985a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f79a expref: 26 pid: 15044 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746129755.069763:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053338112:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129755.069780:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129755.071184:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.071230:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053337472:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129755.071279:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052283264 00000100:00100000:1.0:1746129755.071284:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052283264 00000100:00080000:2.0:1746129755.071316:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746129755.071319:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9e00/0x48868a4e43949b47 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f953 expref: 27 pid: 14314 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746129755.071365:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5385 00000100:00100000:1.0:1746129755.071375:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+27:1964:x1830949052283264:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129755.071388:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129755.071393:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9e00/0x48868a4e43949b47 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f953 expref: 27 pid: 14314 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.071401:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9e00/0x48868a4e43949b47 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f953 expref: 27 pid: 14314 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.071418:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9e00/0x48868a4e43949b47 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f953 expref: 27 pid: 14314 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.071429:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129755.071433:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949edc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129755.071443:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129755.071482:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1964:x1830949052283264:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 110us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129755.071488:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5385 00000100:00100000:2.0:1746129755.072035:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053337600:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129755.072049:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053337728:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129755.072055:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053337856:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129755.072060:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053337984:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129755.072066:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053338112:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129755.072088:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949edc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129755.072493:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.072517:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129755.072563:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052283648 00000100:00100000:1.0:1746129755.072566:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052283648 00000100:00100000:0.0:1746129755.072572:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129755.072579:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43949861 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a1 expref: 26 pid: 14314 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746129755.072644:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052283904 00000100:00100000:1.0:1746129755.072646:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052283904 00000100:00100000:0.0:1746129755.072649:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129755.072658:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f8400/0x48868a4e43949ac9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f914 expref: 302 pid: 14314 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746129755.072668:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052283520 00000100:00100000:1.0:1746129755.072670:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052283520 00010000:00010000:1.0:1746129755.072675:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3400/0x48868a4e43949876 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a8 expref: 303 pid: 14313 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746129755.072681:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052283776 00000100:00100000:1.0:1746129755.072683:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052283776 00010000:00010000:1.0:1746129755.072688:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e4394985a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f79a expref: 27 pid: 15044 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746129755.072695:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5386 00000100:00100000:1.0:1746129755.072699:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130567450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+27:1961:x1830949052283648:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129755.072700:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129755.072705:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129755.072709:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43949861 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a1 expref: 27 pid: 14314 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746129755.072714:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052284032 00010000:00010000:1.0:1746129755.072716:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43949861 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a1 expref: 27 pid: 14314 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746129755.072717:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052284032 00010000:00010000:1.0:1746129755.072727:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43949861 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a1 expref: 27 pid: 14314 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.072735:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00000100:00100000:0.0:1746129755.072737:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3910 00010000:00010000:1.0:1746129755.072738:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949edc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129755.072741:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+304:27195:x1830949052284032:12345-192.168.204.31@tcp:35:ldlm_bl.0 00010000:00010000:1.0:1746129755.072743:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129755.072761:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130567450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1961:x1830949052283648:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 61us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129755.072766:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5386 00000100:00100000:1.0:1746129755.072792:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5387 00000100:00100000:1.0:1746129755.072796:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+304:1961:x1830949052283904:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129755.072800:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129755.072803:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f8400/0x48868a4e43949ac9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f914 expref: 304 pid: 14314 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.072809:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f8400/0x48868a4e43949ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f914 expref: 304 pid: 14314 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.072818:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f8400/0x48868a4e43949ac9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f914 expref: 304 pid: 14314 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.072825:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129755.072828:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949edc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129755.072832:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129755.072841:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+304:1961:x1830949052283904:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 45us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129755.072864:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5387 00000100:00100000:1.0:1746129755.072873:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5388 00000100:00100000:1.0:1746129755.072877:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+303:1961:x1830949052283520:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129755.072881:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129755.072884:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3400/0x48868a4e43949876 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a8 expref: 303 pid: 14313 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.072890:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3400/0x48868a4e43949876 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a8 expref: 303 pid: 14313 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.072898:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3400/0x48868a4e43949876 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7a8 expref: 303 pid: 14313 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746129755.072902:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+303:27195:x1830949052284032:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 160us (201us total) trans 8589943718 rc 0/0 00010000:00010000:1.0:1746129755.072904:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129755.072907:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949edc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129755.072908:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3910 00010000:00010000:1.0:1746129755.072911:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129755.072921:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+301:1961:x1830949052283520:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 45us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129755.072925:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5388 00000100:00100000:1.0:1746129755.072932:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5389 00000100:00100000:1.0:1746129755.072935:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:1961:x1830949052283776:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129755.072940:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129755.072943:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e4394985a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f79a expref: 25 pid: 15044 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.072948:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e4394985a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f79a expref: 25 pid: 15044 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.072955:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e4394985a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f79a expref: 25 pid: 15044 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.072961:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129755.072963:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949edc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129755.072967:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129755.072982:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1961:x1830949052283776:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 45us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129755.072986:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5389 00000100:00080000:2.0:1746129755.073005:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129755.074807:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.075042:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052284160 00000100:00100000:3.0:1746129755.075047:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052284160 00010000:00010000:3.0:1746129755.075070:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e600/0x48868a4e43949902 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7ee expref: 301 pid: 14314 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746129755.075136:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5390 00000100:00100000:3.0:1746129755.075144:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+301:1961:x1830949052284160:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129755.075155:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129755.075159:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e600/0x48868a4e43949902 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7ee expref: 301 pid: 14314 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746129755.075169:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e600/0x48868a4e43949902 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7ee expref: 301 pid: 14314 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746129755.075186:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e600/0x48868a4e43949902 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34f7ee expref: 301 pid: 14314 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746129755.075208:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129755.075213:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949edc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.075221:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949edc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.075226:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949edc lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.075244:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129755.075284:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:1961:x1830949052284160:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 141us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129755.075289:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5390 00010000:00010000:2.0:1746129755.075402:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949edc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.075408:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949edc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000040:00080000:2.0:1746129755.076245:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2841, 88 off236856 00000004:00080000:2.0:1746129755.076252:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701134403651ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129755.076292:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2774, 88 off231048 00000004:00080000:2.0:1746129755.076296:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701134448353ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129755.076314:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2775, 88 off231136 00000004:00080000:2.0:1746129755.076316:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701134468398ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129755.076323:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2842, 88 off236944 00000004:00080000:2.0:1746129755.076326:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701134477693ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129755.076333:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2843, 88 off237032 00000004:00080000:2.0:1746129755.076347:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701134499113ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129755.076356:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2776, 88 off231224 00000004:00080000:2.0:1746129755.076359:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701134510793ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129755.076365:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2777, 88 off231312 00000004:00080000:2.0:1746129755.076368:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701134520016ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129755.076374:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2778, 88 off231400 00000004:00080000:2.0:1746129755.076378:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701134530033ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129755.076384:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2844, 88 off237120 00000004:00080000:2.0:1746129755.076386:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701134538428ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129755.076405:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2779, 88 off231488 00000004:00080000:2.0:1746129755.076408:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701134559853ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129755.076414:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2845, 88 off237208 00000004:00080000:2.0:1746129755.076417:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701134568851ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129755.076425:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2780, 88 off231576 00000004:00080000:2.0:1746129755.076428:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701134579876ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129755.076434:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2846, 88 off237296 00000004:00080000:2.0:1746129755.076436:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701134587858ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129755.076443:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2847, 88 off237384 00000004:00080000:2.0:1746129755.076445:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701134597055ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129755.076452:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2848, 88 off237472 00000004:00080000:2.0:1746129755.076455:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701134606828ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129755.076484:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2850, 88 off237656 00000004:00080000:2.0:1746129755.076487:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701134638718ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129755.076496:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2781, 88 off231664 00000004:00080000:2.0:1746129755.076498:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701134650151ns, next at 641623252291ns, rc = 0 00000001:00080000:1.0:1746129755.113940:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943718 is committed 00000001:00080000:1.0:1746129755.113956:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943714 is committed 00000001:00080000:1.0:1746129755.113961:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943698 is committed 00000001:00080000:1.0:1746129755.113983:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943719 is committed 00000004:00080000:1.0:1746129755.113986:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1966 committed 00000004:00080000:1.0:1746129755.113992:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2031 committed 00000004:00080000:1.0:1746129755.113995:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2030 committed 00000004:00080000:1.0:1746129755.113997:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2029 committed 00000004:00080000:1.0:1746129755.113998:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2028 committed 00000004:00080000:1.0:1746129755.114000:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1965 committed 00000004:00080000:1.0:1746129755.114001:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2027 committed 00000004:00080000:1.0:1746129755.114005:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1964 committed 00000004:00080000:1.0:1746129755.114006:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2026 committed 00000004:00080000:1.0:1746129755.114008:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1963 committed 00000004:00080000:1.0:1746129755.114009:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1962 committed 00000004:00080000:1.0:1746129755.114011:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1961 committed 00000004:00080000:1.0:1746129755.114013:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2025 committed 00000004:00080000:1.0:1746129755.114014:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2024 committed 00000004:00080000:1.0:1746129755.114016:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1960 committed 00000004:00080000:1.0:1746129755.114017:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1959 committed 00000004:00080000:1.0:1746129755.114019:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2023 committed 00000100:00100000:1.0:1746129755.114257:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053338624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129755.114305:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129755.114344:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053339136:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129755.114362:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129755.114374:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053339648:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129755.114386:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129755.114396:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053340160:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129755.114407:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129755.114422:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746129755.114427:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053338240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129755.114444:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129755.114455:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053338752:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129755.114466:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129755.114475:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053339264:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129755.114486:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129755.114495:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053339776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129755.114503:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053338624 00000100:00100000:1.0:1746129755.114509:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129755.114510:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053338624 00000100:00100000:1.0:1746129755.114526:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053338368:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129755.114541:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129755.114541:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053339136 00000100:00100000:0.0:1746129755.114543:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053339136 00000100:00100000:1.0:1746129755.114552:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053338880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129755.114554:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053339648 00000100:00100000:0.0:1746129755.114555:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053339648 00000100:00100000:0.0:1746129755.114563:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053340160 00000100:00100000:1.0:1746129755.114564:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129755.114564:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053340160 00000100:00100000:0.0:1746129755.114569:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053338240 00000100:00100000:1.0:1746129755.114571:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053339392:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129755.114571:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053338240 00000100:00100000:0.0:1746129755.114576:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053338752 00000100:00100000:0.0:1746129755.114578:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053338752 00000100:00100000:0.0:1746129755.114583:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053339264 00000100:00100000:1.0:1746129755.114584:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129755.114584:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053339264 00000100:00100000:0.0:1746129755.114589:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053339776 00000100:00100000:0.0:1746129755.114590:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053339776 00000100:00100000:1.0:1746129755.114591:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053339904:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129755.114595:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053338368 00000100:00100000:0.0:1746129755.114597:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053338368 00000100:00100000:0.0:1746129755.114601:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053338880 00000100:00100000:1.0:1746129755.114602:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129755.114603:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053338880 00000100:00100000:0.0:1746129755.114608:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053339392 00000100:00100000:1.0:1746129755.114609:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746129755.114609:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053339392 00000100:00100000:1.0:1746129755.114613:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053338496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129755.114614:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053339904 00000100:00100000:0.0:1746129755.114615:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053339904 00000100:00100000:0.0:1746129755.114623:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11129 00000100:00100000:1.0:1746129755.114624:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129755.114630:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053339008:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129755.114630:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3298:x1830949053338624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129755.114640:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129755.114646:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053339520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129755.114658:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129755.114664:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053340032:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129755.114673:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129755.114686:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053338496 00000100:00100000:1.0:1746129755.114689:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053338496 00000100:00100000:1.0:1746129755.114699:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053339008 00000100:00100000:1.0:1746129755.114701:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053339008 00000100:00100000:1.0:1746129755.114706:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053339520 00000100:00100000:1.0:1746129755.114707:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053339520 00000100:00100000:1.0:1746129755.114713:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053340032 00000100:00100000:1.0:1746129755.114714:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053340032 00000100:00100000:1.0:1746129755.114722:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11130 00000100:00100000:1.0:1746129755.114727:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3298:x1830949053339136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129755.114793:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3298:x1830949053338624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 163us (487us total) trans 21474840331 rc 0/0 00000100:00100000:0.0:1746129755.114798:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11129 00000100:00100000:0.0:1746129755.114811:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11131 00000100:00100000:0.0:1746129755.114815:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3298:x1830949053339648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129755.114816:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3298:x1830949053339136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (452us total) trans 21474840332 rc 0/0 00000100:00100000:1.0:1746129755.114822:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11130 00000100:00100000:1.0:1746129755.114832:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11132 00000100:00100000:1.0:1746129755.114836:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3298:x1830949053340160:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129755.114917:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129755.114920:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129755.114922:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129755.114923:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129755.114925:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129755.114942:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3298:x1830949053340160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (533us total) trans 17179873184 rc 0/0 00000100:00100000:0.0:1746129755.114946:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3298:x1830949053339648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 131us (558us total) trans 17179873183 rc 0/0 00000100:00100000:1.0:1746129755.114947:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11132 00000100:00100000:0.0:1746129755.114951:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11131 00000100:00100000:1.0:1746129755.114956:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11133 00000100:00100000:1.0:1746129755.114960:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3298:x1830949053338240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129755.114961:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11134 00000100:00100000:0.0:1746129755.114966:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3298:x1830949053338752:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129755.115035:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129755.115038:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129755.115039:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129755.115041:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129755.115042:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129755.115059:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3298:x1830949053338752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (591us total) trans 21474840333 rc 0/0 00000100:00100000:0.0:1746129755.115064:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11134 00000100:00100000:0.0:1746129755.115073:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11135 00000100:00100000:0.0:1746129755.115076:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3298:x1830949053339264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129755.115151:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3298:x1830949053339264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (663us total) trans 17179873185 rc 0/0 00000100:00100000:0.0:1746129755.115155:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11135 00000100:00100000:0.0:1746129755.115164:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11136 00000100:00100000:0.0:1746129755.115168:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3298:x1830949053339776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129755.115210:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11137 00000100:00100000:2.0:1746129755.115217:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3296:x1830949053338368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129755.115239:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3298:x1830949053339776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (729us total) trans 17179873186 rc 0/0 00000100:00100000:0.0:1746129755.115244:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11136 00000100:00100000:0.0:1746129755.115253:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11138 00000100:00100000:0.0:1746129755.115257:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3296:x1830949053338880:12345-0@lo:2:osp-syn-0-0.0 00000004:00010000:2.0:1746129755.115276:0:1851:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880094eb4380 reply state ffff88012dca7800 transno 8589943719 ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949edc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:2.0:1746129755.115288:0:1851:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746129755.115293:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11139 00000100:00100000:0.0:1746129755.115297:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3296:x1830949053339392:12345-0@lo:2:osp-syn-1-0.0 00010000:00080000:2.0:1746129755.115365:0:1851:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746129755.115375:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:28704:x1830949052283136:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 47462us (47739us total) trans 8589943719 rc 0/0 00000100:00100000:2.0:1746129755.115380:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9923 00000100:00100000:0.0:1746129755.115391:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949053339392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (805us total) trans 17179873187 rc 0/0 00000100:00100000:0.0:1746129755.115396:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11139 00000100:00100000:0.0:1746129755.115405:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11140 00000100:00100000:0.0:1746129755.115408:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3296:x1830949053339904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129755.115479:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949053339904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (876us total) trans 17179873188 rc 0/0 00000100:00100000:0.0:1746129755.115484:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11140 00000100:00100000:0.0:1746129755.115492:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11141 00000100:00100000:0.0:1746129755.115495:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3296:x1830949053338496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129755.115530:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11142 00000100:00100000:0.0:1746129755.115534:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3296:x1830949053339008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129755.115565:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11143 00000100:00100000:0.0:1746129755.115570:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3296:x1830949053339520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129755.115648:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949053339520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (988us total) trans 17179873189 rc 0/0 00000100:00100000:0.0:1746129755.115653:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11143 00000100:00100000:0.0:1746129755.115664:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11144 00000100:00100000:0.0:1746129755.115668:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3296:x1830949053340032:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746129755.115740:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949edc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129755.115742:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949053340032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (1066us total) trans 17179873190 rc 0/0 00000100:00100000:0.0:1746129755.115747:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11144 00010000:00010000:3.0:1746129755.115749:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949edc lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.115754:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949edc lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.115759:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800acc1ea00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129755.115763:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949edc lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.115769:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949edc lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.115782:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129755.115785:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129755.115789:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949edc lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.115794:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ea00/0x48868a4e43949edc lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00000004:00080000:0.0:1746129755.115943:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d5880/2, rc 0, transno 17179873189 00000100:00100000:0.0:1746129755.115951:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053339520:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129755.115959:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d6d80/2, rc 0, transno 17179873190 00000100:00100000:0.0:1746129755.115962:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053340032:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129755.115969:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d6a00/2, rc 0, transno 17179873187 00000100:00100000:0.0:1746129755.115972:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053339392:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129755.115978:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d4a80/2, rc 0, transno 17179873188 00000100:00100000:0.0:1746129755.115981:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053339904:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129755.116057:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936df480/2, rc 0, transno 21474840333 00000100:00100000:0.0:1746129755.116061:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053338752:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129755.116068:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d4380/2, rc 0, transno 17179873185 00000100:00100000:0.0:1746129755.116070:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053339264:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129755.116076:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d7b80/2, rc 0, transno 17179873186 00000100:00100000:0.0:1746129755.116078:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053339776:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129755.116084:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936ddc00/2, rc 0, transno 21474840331 00000100:00100000:0.0:1746129755.116086:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053338624:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129755.116093:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d4e00/2, rc 0, transno 21474840332 00000100:00100000:0.0:1746129755.116096:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053339136:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129755.116101:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d4000/2, rc 0, transno 17179873183 00000100:00100000:0.0:1746129755.116103:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053339648:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129755.116109:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d5c00/2, rc 0, transno 17179873184 00000100:00100000:0.0:1746129755.116111:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053340160:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129755.116115:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746129755.116121:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053340288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129755.116140:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129755.116172:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053340288 00000100:00100000:0.0:1746129755.116175:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053340288 00000100:00100000:0.0:1746129755.116189:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11145 00000100:00100000:0.0:1746129755.116192:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3298:x1830949053340288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129755.116278:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3298:x1830949053340288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (135us total) trans 17179873191 rc 0/0 00000100:00100000:0.0:1746129755.116283:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11145 00000004:00080000:0.0:1746129755.116302:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eb6d80/2, rc 0, transno 17179873191 00000100:00100000:0.0:1746129755.116305:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053340288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129755.116577:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.116589:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052284288 00000100:00100000:0.0:1746129755.116592:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052284288 00000100:00100000:0.0:1746129755.116607:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9924 00000100:00100000:0.0:1746129755.116611:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+7:28704:x1830949052284288:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129755.116622:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129755.116632:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace23e00/0x48868a4e43949ee3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fb8a expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129755.116662:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace23e00/0x48868a4e43949ee3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb8a expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129755.116670:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace23e00/0x48868a4e43949ee3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb8a expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129755.116681:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129755.116683:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129755.116685:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ace23e00, rc 0) 00000100:00100000:0.0:1746129755.116701:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:28704:x1830949052284288:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 89us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129755.116705:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9924 00000100:00100000:1.0:1746129755.117097:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3298:x1830949053338240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2136us (2656us total) trans 21474840334 rc 0/0 00000100:00100000:1.0:1746129755.117103:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11133 00000004:00080000:0.0:1746129755.117267:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936de680/2, rc 0, transno 21474840334 00000100:00100000:0.0:1746129755.117272:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053338240:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129755.117365:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3296:x1830949053338368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2148us (2822us total) trans 21474840335 rc 0/0 00000100:00100000:2.0:1746129755.117371:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11137 00000100:00100000:1.0:1746129755.117390:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3296:x1830949053338880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2133us (2825us total) trans 21474840336 rc 0/0 00000100:00100000:1.0:1746129755.117395:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11138 00000100:00100000:0.0:1746129755.117412:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949053338496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1915us (2786us total) trans 21474840337 rc 0/0 00000100:00100000:0.0:1746129755.117417:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11141 00000100:00100000:0.0:1746129755.117483:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949053339008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1948us (2841us total) trans 21474840338 rc 0/0 00000100:00100000:0.0:1746129755.117488:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11142 00000004:00080000:0.0:1746129755.117506:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936dd880/2, rc 0, transno 21474840337 00000100:00100000:0.0:1746129755.117510:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053338496:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129755.117515:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d7100/2, rc 0, transno 21474840338 00000100:00100000:0.0:1746129755.117517:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053339008:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129755.117523:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936ded80/2, rc 0, transno 21474840335 00000100:00100000:0.0:1746129755.117525:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053338368:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129755.117889:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936dca80/2, rc 0, transno 21474840336 00000100:00100000:0.0:1746129755.117893:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053338880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129755.120756:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.121024:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052284416 00000100:00100000:2.0:1746129755.121030:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052284416 00000100:00100000:2.0:1746129755.121062:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9925 00000100:00100000:2.0:1746129755.121069:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+8:28704:x1830949052284416:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129755.121083:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129755.121096:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949eea lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fb91 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.121160:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f000/0x48868a4e43949ef1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129755.121171:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f000/0x48868a4e43949ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129755.121181:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f000/0x48868a4e43949ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:2.0:1746129755.121201:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:2.0:1746129755.121205:0:15044:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129755.121215:0:15044:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f000/0x48868a4e43949ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129755.121238:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949eea lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb91 expref: 10 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.121249:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f000/0x48868a4e43949ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb91 expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.121255:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129755.121645:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129755.121649:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6f000, rc 0) 00000100:00100000:2.0:1746129755.121793:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+9:28704:x1830949052284416:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 723us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129755.121800:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9925 00000100:00100000:0.0:1746129755.124883:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.124963:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052284544 00000100:00100000:2.0:1746129755.124969:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052284544 00000100:00100000:2.0:1746129755.125002:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11146 00000100:00100000:2.0:1746129755.125009:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+6:1962:x1830949052284544:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129755.125023:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129755.125038:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fc00/0x48868a4e43949ef8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fb98 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129755.125058:0:7975:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e8:0x0] initial LVB size: 1048576, mtime: 0x6813d35a, atime: 0x6813d35a, ctime: 0x6813d35a, blocks: 0x809 00010000:00010000:2.0:1746129755.125073:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129755.125075:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129755.125082:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fc00/0x48868a4e43949ef8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb98 expref: 7 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129755.125096:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fc00/0x48868a4e43949ef8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb98 expref: 7 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129755.125105:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6fc00, rc 0) 00000100:00100000:2.0:1746129755.125155:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+7:1962:x1830949052284544:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 145us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129755.125161:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11146 00000100:00100000:2.0:1746129755.126972:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.127632:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.127664:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.127679:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.127715:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.127728:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052284672 00000100:00100000:3.0:1746129755.127736:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052284672 00000100:00100000:3.0:1746129755.127772:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052284928 00000100:00100000:3.0:1746129755.127775:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052284928 00000100:00100000:2.0:1746129755.127784:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052285184 00000100:00100000:2.0:1746129755.127786:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052285184 00000100:00100000:3.0:1746129755.127787:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052284800 00000100:00100000:3.0:1746129755.127788:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052284800 00000100:00100000:2.0:1746129755.127799:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052285056 00000100:00100000:2.0:1746129755.127801:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052285056 00000100:00100000:3.0:1746129755.127803:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11147 00000100:00100000:3.0:1746129755.127809:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052284672:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:2.0:1746129755.127811:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11148 00000100:00100000:2.0:1746129755.127815:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052284928:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129755.127821:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129755.127821:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129755.127836:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9e00/0x48868a4e43949f06 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fb9f expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.127836:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e43949eff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fbad expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129755.127873:0:8435:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e6:0x0] initial LVB size: 2097152, mtime: 0x6813d35a, atime: 0x6813d35a, ctime: 0x6813d35a, blocks: 0x81f 00002000:00010000:2.0:1746129755.127873:0:3624:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3ea:0x0] initial LVB size: 2097152, mtime: 0x6813d35a, atime: 0x6813d359, ctime: 0x6813d35a, blocks: 0x821 00010000:00010000:3.0:1746129755.127886:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129755.127886:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129755.127888:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129755.127888:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129755.127895:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9e00/0x48868a4e43949f06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb9f expref: 9 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129755.127895:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e43949eff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbad expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129755.127908:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9e00/0x48868a4e43949f06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb9f expref: 9 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129755.127908:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e43949eff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbad expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129755.127915:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffb9e00, rc 0) 00010000:00010000:2.0:1746129755.127915:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6f600, rc 0) 00000100:00100000:2.0:1746129755.127954:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052284928:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 138us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129755.127959:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11148 00000100:00100000:2.0:1746129755.127987:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11149 00000100:00100000:2.0:1746129755.127991:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052284800:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129755.127997:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129755.128006:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f800/0x48868a4e43949f0d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fba6 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129755.128015:0:3624:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e7:0x0] initial LVB size: 2097152, mtime: 0x6813d35a, atime: 0x6813d359, ctime: 0x6813d35a, blocks: 0x81f 00010000:00010000:2.0:1746129755.128021:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129755.128023:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129755.128026:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f800/0x48868a4e43949f0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fba6 expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129755.128035:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f800/0x48868a4e43949f0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fba6 expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129755.128040:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6f800, rc 0) 00000100:00100000:1.0:1746129755.128069:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11150 00000100:00100000:1.0:1746129755.128077:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052285184:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:0.0:1746129755.128081:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11151 00010000:00010000:1.0:1746129755.128083:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129755.128086:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052285056:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129755.128090:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4a00/0x48868a4e43949f14 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fbbb expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129755.128090:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129755.128096:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801305e2a00/0x48868a4e43949f1b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fbb4 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129755.128100:0:7976:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e8:0x0] initial LVB size: 4194304, mtime: 0x6813d35b, atime: 0x6813d35a, ctime: 0x6813d35b, blocks: 0x1029 00002000:00010000:0.0:1746129755.128105:0:10930:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3eb:0x0] initial LVB size: 4960928, mtime: 0x6813d35b, atime: 0x6813d35b, ctime: 0x6813d35b, blocks: 0x1629 00010000:00010000:1.0:1746129755.128107:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129755.128108:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129755.128110:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129755.128111:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129755.128112:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4a00/0x48868a4e43949f14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbbb expref: 11 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129755.128114:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801305e2a00/0x48868a4e43949f1b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbb4 expref: 9 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129755.128120:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4a00/0x48868a4e43949f14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbbb expref: 11 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129755.128122:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801305e2a00/0x48868a4e43949f1b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbb4 expref: 9 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129755.128126:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b22c4a00, rc 0) 00010000:00010000:0.0:1746129755.128127:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801305e2a00, rc 0) 00000100:00100000:3.0:1746129755.128175:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052284672:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 365us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129755.128176:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052284800:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 184us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129755.128180:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11147 00000100:00100000:0.0:1746129755.128197:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052285056:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 111us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129755.128219:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11149 00000100:00100000:1.0:1746129755.128226:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052285184:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 151us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129755.128230:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11150 00000100:00100000:0.0:1746129755.128345:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11151 00000100:00100000:0.0:1746129755.137130:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.137232:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.137261:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.137272:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.137283:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.137346:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.137367:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052285440 00000100:00100000:0.0:1746129755.137374:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052285440 00000100:00100000:0.0:1746129755.137416:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052285824 00000100:00100000:0.0:1746129755.137419:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052285824 00000100:00100000:0.0:1746129755.137433:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052286080 00000100:00100000:0.0:1746129755.137435:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052286080 00000100:00100000:0.0:1746129755.137445:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052285952 00000100:00100000:0.0:1746129755.137446:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052285952 00000100:00100000:0.0:1746129755.137455:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052286336 00000100:00100000:0.0:1746129755.137456:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052286336 00000100:00100000:0.0:1746129755.137464:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052286464 00000100:00100000:0.0:1746129755.137465:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052286464 00000100:00100000:0.0:1746129755.137475:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4175 00000100:00100000:0.0:1746129755.137481:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052285440:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:0.0:1746129755.137508:0:21601:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094880800/0x48868a4e43949f22 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129755.137521:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129755.137522:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129755.137526:0:21601:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094880800/0x48868a4e43949f22 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129755.137538:0:21601:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094880800/0x48868a4e43949f22 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129755.137762:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4176 00000100:00100000:3.0:1746129755.137769:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052285824:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129755.137785:0:2677:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9a00/0x48868a4e43949f29 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.137792:0:2677:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129755.137793:0:2677:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129755.137795:0:2677:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9a00/0x48868a4e43949f29 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.137802:0:2677:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9a00/0x48868a4e43949f29 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129755.138067:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4177 00000100:00100000:1.0:1746129755.138072:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4178 00000100:00100000:2.0:1746129755.138074:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052286080:12345-192.168.204.31@tcp:3:lfs.0 00000100:00100000:1.0:1746129755.138078:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052285952:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:2.0:1746129755.138088:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009cb6fe00/0x48868a4e43949f30 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.138088:0:8440:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4600/0x48868a4e43949f37 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.138094:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129755.138094:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129755.138096:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129755.138096:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129755.138098:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6fe00/0x48868a4e43949f30 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.138098:0:8440:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4600/0x48868a4e43949f37 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.138105:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb6fe00/0x48868a4e43949f30 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.138106:0:8440:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4600/0x48868a4e43949f37 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129755.139379:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4179 00000100:00100000:1.0:1746129755.139387:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052286336:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:1.0:1746129755.139409:0:25617:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4c00/0x48868a4e43949f3e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.139418:0:25617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129755.139419:0:25617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129755.139422:0:25617:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4c00/0x48868a4e43949f3e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.139430:0:25617:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4c00/0x48868a4e43949f3e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129755.139816:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4180 00000100:00100000:3.0:1746129755.139823:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052286464:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129755.139836:0:21599:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8200/0x48868a4e43949f45 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.139845:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129755.139863:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129755.139866:0:21599:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8200/0x48868a4e43949f45 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.139873:0:21599:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8200/0x48868a4e43949f45 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129755.143147:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.143241:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.143472:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052286848 00000100:00100000:3.0:1746129755.143555:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052286848 00000100:00100000:3.0:1746129755.143597:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052287104 00000100:00100000:3.0:1746129755.143599:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052287104 00000100:00100000:3.0:1746129755.143615:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4181 00000100:00100000:3.0:1746129755.143621:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052286848:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129755.143650:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8600/0x48868a4e43949f4c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.143661:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129755.143662:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129755.143666:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8600/0x48868a4e43949f4c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.143676:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8600/0x48868a4e43949f4c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129755.143800:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4182 00000100:00100000:2.0:1746129755.144377:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949052287104:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:2.0:1746129755.144396:0:21604:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e200/0x48868a4e43949f53 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.144404:0:21604:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129755.144405:0:21604:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129755.144409:0:21604:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e200/0x48868a4e43949f53 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.144418:0:21604:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e200/0x48868a4e43949f53 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.148929:0:8440:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4600/0x48868a4e43949f37 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.148946:0:8440:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4600/0x48868a4e43949f37 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.148954:0:8440:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4600/0x48868a4e43949f37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.148960:0:8440:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b22c4600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129755.148964:0:8440:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4600/0x48868a4e43949f37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.148970:0:8440:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4600/0x48868a4e43949f37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.148985:0:8440:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4600/0x48868a4e43949f37 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.148991:0:8440:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4600/0x48868a4e43949f37 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129755.150259:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949052285952:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 12172us (12977us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129755.150269:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4178 00010000:00010000:3.0:1746129755.156822:0:2677:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9a00/0x48868a4e43949f29 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.156836:0:2677:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9a00/0x48868a4e43949f29 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.156867:0:2677:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9a00/0x48868a4e43949f29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.156873:0:2677:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ffb9a00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129755.156877:0:2677:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9a00/0x48868a4e43949f29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.156883:0:2677:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9a00/0x48868a4e43949f29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.156901:0:2677:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9a00/0x48868a4e43949f29 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.156907:0:2677:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9a00/0x48868a4e43949f29 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129755.156977:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:6141239f-0c60-480d-830c-e22ba61457b0+13:1961:x1830949052285824:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 19204us (19740us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129755.156985:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4176 00010000:00010000:1.0:1746129755.163258:0:25617:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4c00/0x48868a4e43949f3e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.163272:0:25617:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4c00/0x48868a4e43949f3e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.163279:0:25617:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4c00/0x48868a4e43949f3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.163285:0:25617:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b22c4c00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129755.163288:0:25617:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4c00/0x48868a4e43949f3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.163295:0:25617:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4c00/0x48868a4e43949f3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.163310:0:25617:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4c00/0x48868a4e43949f3e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.163320:0:25617:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4c00/0x48868a4e43949f3e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129755.163400:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6141239f-0c60-480d-830c-e22ba61457b0+15:1961:x1830949052286336:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 24009us (26110us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129755.163408:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4179 00010000:00010000:2.0:1746129755.163552:0:8441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009cb6fe00/0x48868a4e43949f30 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.163567:0:8441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6fe00/0x48868a4e43949f30 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.163573:0:8441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cb6fe00/0x48868a4e43949f30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.163578:0:8441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb6fe00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129755.163581:0:8441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cb6fe00/0x48868a4e43949f30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.163587:0:8441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cb6fe00/0x48868a4e43949f30 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.163598:0:8441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cb6fe00/0x48868a4e43949f30 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.163603:0:8441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6fe00/0x48868a4e43949f30 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129755.163653:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052286080:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 25579us (26390us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129755.163660:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4177 00010000:00010000:3.0:1746129755.170071:0:21599:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8200/0x48868a4e43949f45 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.170084:0:21599:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8200/0x48868a4e43949f45 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.170091:0:21599:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8200/0x48868a4e43949f45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.170102:0:21599:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ffb8200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129755.170106:0:21599:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8200/0x48868a4e43949f45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.170113:0:21599:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8200/0x48868a4e43949f45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.170129:0:21599:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8200/0x48868a4e43949f45 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.170136:0:21599:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8200/0x48868a4e43949f45 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129755.170223:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6141239f-0c60-480d-830c-e22ba61457b0+13:1961:x1830949052286464:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 30397us (32872us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129755.170233:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4180 00010000:00010000:2.0:1746129755.175112:0:21601:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094880800/0x48868a4e43949f22 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.175127:0:21601:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094880800/0x48868a4e43949f22 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.175139:0:21601:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094880800/0x48868a4e43949f22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.175144:0:21601:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094880800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129755.175148:0:21601:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094880800/0x48868a4e43949f22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.175154:0:21601:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094880800/0x48868a4e43949f22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.175170:0:21601:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094880800/0x48868a4e43949f22 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.175175:0:21601:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094880800/0x48868a4e43949f22 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129755.175260:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052285440:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 37774us (38132us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129755.175270:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4175 00010000:00010000:3.0:1746129755.181836:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8600/0x48868a4e43949f4c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.181874:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8600/0x48868a4e43949f4c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.181881:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8600/0x48868a4e43949f4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.181888:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ffb8600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129755.181892:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8600/0x48868a4e43949f4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.181899:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8600/0x48868a4e43949f4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.181915:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8600/0x48868a4e43949f4c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.181921:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8600/0x48868a4e43949f4c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129755.182536:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052286848:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 38911us (39393us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129755.182545:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4181 00010000:00010000:2.0:1746129755.185398:0:21604:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e200/0x48868a4e43949f53 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.185410:0:21604:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e200/0x48868a4e43949f53 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.185417:0:21604:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e200/0x48868a4e43949f53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.185428:0:21604:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb6e200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129755.185431:0:21604:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e200/0x48868a4e43949f53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.185437:0:21604:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e200/0x48868a4e43949f53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.185452:0:21604:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e200/0x48868a4e43949f53 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.185458:0:21604:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e200/0x48868a4e43949f53 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129755.187185:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949052287104:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 43371us (43936us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129755.187196:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4182 00000100:00100000:0.0:1746129755.195394:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.195456:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052287360 00000100:00100000:2.0:1746129755.195464:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052287360 00000100:00100000:2.0:1746129755.195513:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9926 00000100:00100000:2.0:1746129755.195521:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+9:28704:x1830949052287360:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:2.0:1746129755.195561:0:15044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129755.195581:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f000/0x48868a4e43949ef1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb91 expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.195611:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129755.195614:0:15044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129755.195642:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949f5a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129755.195652:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949f5a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129755.195659:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949f5a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00010000:2.0:1746129755.195800:0:15044:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880094eb5f80 reply state ffff880131518000 transno 8589943720 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949f5a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000100:00100000:2.0:1746129755.195806:0:15044:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746129755.196734:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+10:28704:x1830949052287360:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 1210us (1342us total) trans 8589943720 rc 0/0 00000100:00100000:2.0:1746129755.196741:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9926 00010000:00010000:2.0:1746129755.202971:0:3283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949f5a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129755.202983:0:3283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949f5a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129755.202990:0:3283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949f5a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129755.202994:0:3283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb6f400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129755.202998:0:3283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949f5a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129755.203003:0:3283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949f5a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129755.203016:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129755.203018:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129755.203021:0:3283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949f5a lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129755.203026:0:3283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e43949f5a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00000100:00100000:0.0:1746129755.204016:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.204048:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.204069:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.204085:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052287488 00000100:00100000:0.0:1746129755.204091:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052287488 00000100:00100000:0.0:1746129755.204117:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052287616 00000100:00100000:0.0:1746129755.204119:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052287616 00000100:00100000:0.0:1746129755.204128:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052287744 00000100:00100000:0.0:1746129755.204129:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052287744 00000100:00100000:0.0:1746129755.204140:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11152 00000100:00100000:0.0:1746129755.204146:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+9:1964:x1830949052287488:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129755.204277:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746129755.204280:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129754 -> 1746129755 00002000:00010000:0.0:1746129755.204282:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129754 -> 1746129755 00002000:00010000:0.0:1746129755.204284:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129754 -> 1746129755 00002000:00010000:0.0:1746129755.204286:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:0.0:1746129755.204316:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+10:1964:x1830949052287488:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 170us (306us total) trans 17179873192 rc 0/0 00000100:00100000:0.0:1746129755.204322:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11152 00000100:00100000:0.0:1746129755.204355:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11153 00000100:00100000:0.0:1746129755.204360:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+10:1964:x1830949052287616:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129755.204438:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129755.204440:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129754 -> 1746129755 00002000:00010000:0.0:1746129755.204442:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129754 -> 1746129755 00002000:00010000:0.0:1746129755.204444:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129754 -> 1746129755 00002000:00010000:0.0:1746129755.204446:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746129755.204460:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052287616:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 99us (411us total) trans 21474840339 rc 0/0 00000100:00100000:0.0:1746129755.204465:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11153 00000100:00100000:0.0:1746129755.204473:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11154 00000100:00100000:0.0:1746129755.204477:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+10:1964:x1830949052287744:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129755.204528:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129755.204530:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129754 -> 1746129755 00002000:00010000:0.0:1746129755.204531:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129753 -> 1746129755 00002000:00010000:0.0:1746129755.204533:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129754 -> 1746129755 00002000:00010000:0.0:1746129755.204534:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746129755.204547:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052287744:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 70us (478us total) trans 21474840340 rc 0/0 00000100:00100000:0.0:1746129755.204551:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11154 00000100:00100000:0.0:1746129755.204573:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.204604:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.204645:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.204672:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052287872 00000100:00100000:0.0:1746129755.204675:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052287872 00000100:00100000:0.0:1746129755.204686:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052288000 00000100:00100000:0.0:1746129755.204688:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052288000 00000100:00100000:0.0:1746129755.204694:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052288128 00000100:00100000:0.0:1746129755.204696:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052288128 00000100:00100000:0.0:1746129755.204705:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11155 00000100:00100000:0.0:1746129755.204710:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052287872:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129755.204764:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129755.204766:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129754 -> 1746129755 00002000:00010000:0.0:1746129755.204768:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746129753 -> 1746129755 00002000:00010000:0.0:1746129755.204770:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129754 -> 1746129755 00002000:00010000:0.0:1746129755.204771:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129755.204787:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+12:1964:x1830949052287872:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 77us (213us total) trans 17179873193 rc 0/0 00000100:00100000:0.0:1746129755.204792:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11155 00000100:00100000:0.0:1746129755.204799:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11156 00000100:00100000:0.0:1746129755.204803:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052288000:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129755.204845:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:0.0:1746129755.204870:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129755 -> 1746129755 00002000:00010000:0.0:1746129755.204871:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129755 -> 1746129755 00002000:00010000:0.0:1746129755.204873:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129755 -> 1746129755 00002000:00010000:0.0:1746129755.204875:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5673 -> 5673 00000100:00100000:0.0:1746129755.204887:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+12:1964:x1830949052288000:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 84us (283us total) trans 17179873194 rc 0/0 00000100:00100000:0.0:1746129755.204892:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11156 00000100:00100000:0.0:1746129755.204900:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11157 00000100:00100000:0.0:1746129755.204904:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052288128:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129755.204950:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746129755.204952:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129755 -> 1746129755 00002000:00010000:0.0:1746129755.204954:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129754 -> 1746129755 00002000:00010000:0.0:1746129755.204956:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129755 -> 1746129755 00002000:00010000:0.0:1746129755.204958:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746129755.204969:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+12:1964:x1830949052288128:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 65us (324us total) trans 21474840341 rc 0/0 00000100:00100000:0.0:1746129755.204974:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11157 00000100:00100000:2.0:1746129755.209351:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.209418:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052288384 00000100:00100000:0.0:1746129755.209433:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052288384 00000100:00100000:0.0:1746129755.209478:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3911 00000100:00100000:0.0:1746129755.209485:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d61c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6141239f-0c60-480d-830c-e22ba61457b0+9:28704:x1830949052288384:12345-192.168.204.31@tcp:35:lfs.0 00000004:00010000:0.0:1746129755.209532:0:14316:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x368:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f200/0x48868a4e43949ea4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb83 expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129755.209568:0:14316:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3800/0x48868a4e43949f61 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 00010000:00010000:0.0:1746129755.209578:0:14316:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace23e00/0x48868a4e43949ee3 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb8a expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129755.209584:0:14316:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3800/0x48868a4e43949f61 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 00010000:00010000:0.0:1746129755.209607:0:14316:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace23e00/0x48868a4e43949ee3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb8a expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129755.209617:0:14316:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace23e00/0x48868a4e43949ee3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb8a expref: 9 pid: 1851 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746129755.209628:0:14316:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136318700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14316:1830949053340416:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129755.212642:0:14316:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b51f5600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129755.217689:0:14316:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136318700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14316:1830949053340416:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129755.217711:0:14316:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3800/0x48868a4e43949f61 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 00000100:00100000:0.0:1746129755.219020:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129755.219181:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052288512 00000100:00100000:1.0:1746129755.219187:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052288512 00010000:00010000:1.0:1746129755.219213:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace23e00/0x48868a4e43949ee3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb8a expref: 10 pid: 1851 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746129755.219399:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5391 00000100:00100000:1.0:1746129755.219406:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949052288512:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129755.219416:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129755.219640:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace23e00/0x48868a4e43949ee3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb8a expref: 10 pid: 1851 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.219651:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace23e00/0x48868a4e43949ee3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb8a expref: 10 pid: 1851 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.219667:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace23e00/0x48868a4e43949ee3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb8a expref: 10 pid: 1851 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.219690:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129755.219693:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3800/0x48868a4e43949f61 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 00010000:00010000:1.0:1746129755.219703:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3800/0x48868a4e43949f61 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14316 initiator: MDT0 00010000:00010000:1.0:1746129755.219708:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3800/0x48868a4e43949f61 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14316 initiator: MDT0 00010000:00010000:1.0:1746129755.220880:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129755.220933:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949052288512:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1525us (1915us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129755.220940:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5391 00010000:00010000:3.0:1746129755.222382:0:14316:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3800/0x48868a4e43949f61 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 00010000:00010000:3.0:1746129755.222393:0:14316:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3800/0x48868a4e43949f61 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 00000040:00080000:3.0:1746129755.225295:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2851, 88 off237744 00000004:00080000:3.0:1746129755.225307:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701283458171ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129755.225366:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2782, 88 off231752 00000004:00080000:3.0:1746129755.225370:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701283522098ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129755.225397:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2783, 88 off231840 00000004:00080000:3.0:1746129755.225400:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701283551760ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129755.225426:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2852, 88 off237832 00000004:00080000:3.0:1746129755.225429:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701283580990ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129755.225438:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2853, 88 off237920 00000004:00080000:3.0:1746129755.225441:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701283593068ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129755.225449:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2784, 88 off231928 00000004:00080000:3.0:1746129755.225451:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701283603350ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129755.225457:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2785, 88 off232016 00000004:00080000:3.0:1746129755.225459:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701283611548ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129755.225466:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2786, 88 off232104 00000004:00080000:3.0:1746129755.225468:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701283620378ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129755.227931:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2854, 88 off238008 00000004:00080000:3.0:1746129755.227944:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701286095710ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129755.227987:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2787, 88 off232192 00000004:00080000:3.0:1746129755.227990:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701286142360ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129755.228005:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2855, 88 off238096 00000004:00080000:3.0:1746129755.228008:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701286159676ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129755.228014:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2788, 88 off232280 00000004:00080000:3.0:1746129755.228017:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701286168840ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129755.228023:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2856, 88 off238184 00000004:00080000:3.0:1746129755.228025:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701286177098ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129755.228032:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2857, 88 off238272 00000004:00080000:3.0:1746129755.228036:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701286188396ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129755.228043:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2858, 88 off238360 00000004:00080000:3.0:1746129755.228045:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701286197308ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129755.228051:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2859, 88 off238448 00000004:00080000:3.0:1746129755.228054:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701286205815ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129755.228060:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2789, 88 off232368 00000004:00080000:3.0:1746129755.228062:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701286214501ns, next at 641623252291ns, rc = 0 00000001:00080000:1.0:1746129755.279932:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943720 is committed 00000001:00080000:1.0:1746129755.279957:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943721 is committed 00000004:00080000:1.0:1746129755.279960:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1974 committed 00000004:00080000:1.0:1746129755.279970:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2040 committed 00000004:00080000:1.0:1746129755.279974:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2039 committed 00000004:00080000:1.0:1746129755.279976:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2038 committed 00000004:00080000:1.0:1746129755.279977:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2037 committed 00000004:00080000:1.0:1746129755.279979:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1973 committed 00000004:00080000:1.0:1746129755.279980:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2036 committed 00000004:00080000:1.0:1746129755.279982:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1972 committed 00000004:00080000:1.0:1746129755.279983:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2035 committed 00000004:00080000:1.0:1746129755.279984:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1971 committed 00000004:00080000:1.0:1746129755.279985:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1970 committed 00000004:00080000:1.0:1746129755.279986:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1969 committed 00000004:00080000:1.0:1746129755.279987:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2034 committed 00000004:00080000:1.0:1746129755.279989:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2033 committed 00000004:00080000:1.0:1746129755.279990:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1968 committed 00000004:00080000:1.0:1746129755.279991:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1967 committed 00000004:00080000:1.0:1746129755.279992:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2032 committed 00000100:00100000:0.0:1746129755.280091:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053340544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129755.280144:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129755.280161:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053340544 00000100:00100000:2.0:1746129755.280167:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053340544 00000100:00100000:0.0:1746129755.280184:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136318380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053341056:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129755.280197:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11158 00000100:00100000:0.0:1746129755.280199:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129755.280203:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949053340544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129755.280209:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053341696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129755.280221:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129755.280231:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053342336:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129755.280243:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129755.280254:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746129755.280258:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053340672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129755.280268:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129755.280277:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053341184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129755.280286:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129755.280294:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053341824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129755.280303:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129755.280311:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053341952:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129755.280320:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129755.280347:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053340800:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129755.280354:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129755.280357:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129755 -> 1746129755 00002000:00010000:2.0:1746129755.280359:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129755 -> 1746129755 00002000:00010000:2.0:1746129755.280361:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129755 -> 1746129755 00000100:00100000:0.0:1746129755.280361:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746129755.280363:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746129755.280370:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053341440:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129755.280380:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129755.280387:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3296:x1830949053340544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 184us (244us total) trans 21474840342 rc 0/0 00000100:00100000:0.0:1746129755.280388:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053341312:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129755.280393:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11158 00000100:00100000:0.0:1746129755.280398:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129755.280405:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053341056 00000100:00100000:0.0:1746129755.280406:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053342080:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129755.280407:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053341056 00000100:00100000:2.0:1746129755.280414:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053341696 00000100:00100000:2.0:1746129755.280416:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053341696 00000100:00100000:0.0:1746129755.280418:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129755.280421:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053342336 00000100:00100000:2.0:1746129755.280423:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053342336 00000100:00100000:0.0:1746129755.280424:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053342464:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129755.280429:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053340672 00000100:00100000:2.0:1746129755.280430:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053340672 00000100:00100000:0.0:1746129755.280434:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129755.280436:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053341184 00000100:00100000:2.0:1746129755.280437:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053341184 00000100:00100000:0.0:1746129755.280441:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1746129755.280443:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053341824 00000100:00100000:2.0:1746129755.280444:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053341824 00000100:00100000:0.0:1746129755.280445:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053340928:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129755.280449:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053341952 00000100:00100000:2.0:1746129755.280450:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053341952 00000100:00100000:2.0:1746129755.280455:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053340800 00000100:00100000:0.0:1746129755.280455:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129755.280456:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053340800 00000100:00100000:0.0:1746129755.280460:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053341568:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129755.280461:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053341440 00000100:00100000:2.0:1746129755.280463:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053341440 00000100:00100000:2.0:1746129755.280468:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053341312 00000100:00100000:2.0:1746129755.280469:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053341312 00000100:00100000:0.0:1746129755.280470:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129755.280474:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053342080 00000100:00100000:2.0:1746129755.280476:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053342080 00000100:00100000:0.0:1746129755.280476:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053342208:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129755.280481:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053342464 00000100:00100000:2.0:1746129755.280483:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053342464 00000100:00100000:0.0:1746129755.280486:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129755.280488:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053340928 00000100:00100000:2.0:1746129755.280489:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053340928 00000100:00100000:2.0:1746129755.280495:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053341568 00000100:00100000:2.0:1746129755.280496:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053341568 00000100:00100000:0.0:1746129755.280498:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053342208 00000100:00100000:0.0:1746129755.280500:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053342208 00000100:00100000:2.0:1746129755.280502:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11159 00000100:00100000:2.0:1746129755.280506:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3296:x1830949053341056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129755.280509:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11160 00000100:00100000:0.0:1746129755.280512:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3296:x1830949053341696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129755.280533:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11161 00000100:00100000:0.0:1746129755.280537:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3296:x1830949053342336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129755.280583:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3296:x1830949053341056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (382us total) trans 21474840343 rc 0/0 00000100:00100000:2.0:1746129755.280589:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11159 00000100:00100000:2.0:1746129755.280598:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11162 00000100:00100000:2.0:1746129755.280601:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3296:x1830949053340672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129755.280620:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3296:x1830949053342336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (375us total) trans 17179873195 rc 0/0 00000100:00100000:0.0:1746129755.280625:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11161 00000100:00100000:0.0:1746129755.280633:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11163 00000100:00100000:0.0:1746129755.280636:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3296:x1830949053341184:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129755.280668:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746129755.280670:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129755 -> 1746129755 00002000:00010000:2.0:1746129755.280672:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129755 -> 1746129755 00002000:00010000:2.0:1746129755.280674:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129755 -> 1746129755 00002000:00010000:2.0:1746129755.280675:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2057 -> 2057 00002000:00010000:0.0:1746129755.280688:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1746129755.280691:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3296:x1830949053340672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (422us total) trans 17179873196 rc 0/0 00002000:00010000:0.0:1746129755.280691:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129755.280692:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129755.280694:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00000100:00100000:2.0:1746129755.280696:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11162 00002000:00010000:0.0:1746129755.280696:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746129755.280704:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11164 00000004:00010000:3.0:1746129755.280708:0:14316:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880094d61c50 reply state ffff880094456800 transno 8589943721 ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3800/0x48868a4e43949f61 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 00000100:00100000:2.0:1746129755.280708:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3296:x1830949053341824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129755.280709:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3296:x1830949053341184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (422us total) trans 21474840344 rc 0/0 00000100:00100000:0.0:1746129755.280713:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11163 00000100:00100000:3.0:1746129755.280717:0:14316:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746129755.280720:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11165 00000100:00100000:0.0:1746129755.280723:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3296:x1830949053341952:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746129755.280724:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129755.280726:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129755.280733:0:14316:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f200/0x48868a4e43949ea4 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb83 expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129755.280760:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746129755.280763:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746129755.280764:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746129755.280766:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746129755.280767:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00080000:3.0:1746129755.280805:0:14316:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746129755.280813:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d61c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6141239f-0c60-480d-830c-e22ba61457b0+7:28704:x1830949052288384:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 71328us (71470us total) trans 8589943721 rc 0/0 00000100:00100000:3.0:1746129755.280819:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3911 00000100:00100000:3.0:1746129755.280880:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11166 00000100:00100000:3.0:1746129755.280887:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949053340800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129755.280964:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129755.280966:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129755 -> 1746129755 00002000:00010000:3.0:1746129755.280969:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129755 -> 1746129755 00002000:00010000:3.0:1746129755.280970:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129755 -> 1746129755 00002000:00010000:3.0:1746129755.280972:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746129755.281638:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11167 00000100:00100000:1.0:1746129755.281646:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3298:x1830949053341440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129755.281771:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3296:x1830949053341824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1062us (1465us total) trans 17179873197 rc 0/0 00000100:00100000:2.0:1746129755.281777:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11164 00000100:00100000:2.0:1746129755.281787:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11168 00000100:00100000:2.0:1746129755.281821:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949053341312:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129755.281905:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129755.281908:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129755 -> 1746129755 00002000:00010000:2.0:1746129755.281909:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746129755 -> 1746129755 00002000:00010000:2.0:1746129755.281911:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129755 -> 1746129755 00002000:00010000:2.0:1746129755.281912:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746129755.281938:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3298:x1830949053341312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 146us (1538us total) trans 17179873198 rc 0/0 00000100:00100000:2.0:1746129755.281943:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11168 00000100:00100000:2.0:1746129755.281963:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11169 00000100:00100000:2.0:1746129755.281968:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949053342080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129755.282035:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3298:x1830949053342080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (1615us total) trans 17179873199 rc 0/0 00000100:00100000:2.0:1746129755.282039:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11169 00000100:00100000:2.0:1746129755.282047:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11170 00000100:00100000:2.0:1746129755.282051:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949053342464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129755.282118:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3298:x1830949053342464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (1682us total) trans 17179873200 rc 0/0 00000100:00100000:2.0:1746129755.282122:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11170 00000100:00100000:2.0:1746129755.282132:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11171 00000100:00100000:2.0:1746129755.282135:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3298:x1830949053340928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129755.282197:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746129755.282199:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129755 -> 1746129755 00002000:00010000:2.0:1746129755.282201:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129755 -> 1746129755 00002000:00010000:2.0:1746129755.282202:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129755 -> 1746129755 00002000:00010000:2.0:1746129755.282204:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746129755.282222:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3298:x1830949053340928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (1766us total) trans 21474840348 rc 0/0 00000100:00100000:2.0:1746129755.282227:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11171 00000100:00100000:2.0:1746129755.282236:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11172 00000100:00100000:2.0:1746129755.282240:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949053341568:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129755.282302:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:2.0:1746129755.282304:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129755 -> 1746129755 00002000:00010000:2.0:1746129755.282306:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129755 -> 1746129755 00002000:00010000:2.0:1746129755.282307:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129755 -> 1746129755 00002000:00010000:2.0:1746129755.282309:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5673 -> 5673 00000100:00100000:2.0:1746129755.282326:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3298:x1830949053341568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (1854us total) trans 17179873201 rc 0/0 00000100:00100000:2.0:1746129755.282341:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11172 00000100:00100000:2.0:1746129755.282350:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11173 00000100:00100000:2.0:1746129755.282355:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949053342208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129755.282422:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3298:x1830949053342208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (1934us total) trans 17179873202 rc 0/0 00000100:00100000:2.0:1746129755.282427:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11173 00000100:00100000:0.0:1746129755.282488:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3296:x1830949053341952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1762us (2165us total) trans 21474840345 rc 0/0 00000100:00100000:0.0:1746129755.282493:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11165 00000100:00100000:2.0:1746129755.282498:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3296:x1830949053341696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1986us (2276us total) trans 21474840349 rc 0/0 00000100:00100000:2.0:1746129755.282503:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11160 00000100:00100000:3.0:1746129755.282505:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3298:x1830949053340800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1619us (2142us total) trans 21474840346 rc 0/0 00000100:00100000:3.0:1746129755.282512:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11166 00000004:00080000:2.0:1746129755.282532:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136319f80/2, rc 0, transno 21474840348 00000100:00100000:2.0:1746129755.282536:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053340928:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129755.282546:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c1c5880/2, rc 0, transno 17179873201 00000100:00100000:2.0:1746129755.282564:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053341568:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129755.282572:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c1c5180/2, rc 0, transno 17179873202 00000100:00100000:2.0:1746129755.282574:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053342208:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129755.282580:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013631ad80/2, rc 0, transno 21474840346 00000100:00100000:2.0:1746129755.282582:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053340800:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129755.282588:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c1c4700/2, rc 0, transno 17179873198 00000100:00100000:2.0:1746129755.282590:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053341312:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129755.282595:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c1c7480/2, rc 0, transno 17179873199 00000100:00100000:2.0:1746129755.282597:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053342080:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129755.282603:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c1c4a80/2, rc 0, transno 17179873200 00000100:00100000:2.0:1746129755.282606:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053342464:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129755.282621:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c1c7b80/2, rc 0, transno 17179873196 00000100:00100000:2.0:1746129755.282623:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053340672:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129755.282629:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136319180/2, rc 0, transno 21474840344 00010000:00010000:3.0:1746129755.282630:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3800/0x48868a4e43949f61 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 00000100:00100000:2.0:1746129755.282631:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053341184:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746129755.282637:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3800/0x48868a4e43949f61 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 00000004:00080000:2.0:1746129755.282637:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c1c4380/2, rc 0, transno 17179873197 00000100:00100000:2.0:1746129755.282639:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053341824:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746129755.282643:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3800/0x48868a4e43949f61 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 00000004:00080000:2.0:1746129755.282645:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136319c00/2, rc 0, transno 21474840345 00000100:00100000:2.0:1746129755.282647:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053341952:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746129755.282649:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801360b3800 already unused, calling callback (ffffffffa1371690) 00000004:00080000:2.0:1746129755.282652:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013631b100/2, rc 0, transno 21474840342 00010000:00010000:3.0:1746129755.282653:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3800/0x48868a4e43949f61 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 00000100:00100000:2.0:1746129755.282654:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053340544:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746129755.282660:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3800/0x48868a4e43949f61 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 00000004:00080000:2.0:1746129755.282660:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136318380/2, rc 0, transno 21474840343 00000100:00100000:2.0:1746129755.282662:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136318380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053341056:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129755.282667:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136319500/2, rc 0, transno 21474840349 00000100:00100000:2.0:1746129755.282669:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053341696:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746129755.282671:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129755.282673:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000004:00080000:2.0:1746129755.282674:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c1c4000/2, rc 0, transno 17179873195 00010000:00010000:3.0:1746129755.282676:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3800/0x48868a4e43949f61 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 00000100:00100000:2.0:1746129755.282676:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053342336:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746129755.282680:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801360b3800/0x48868a4e43949f61 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 00000100:00100000:3.0:1746129755.282972:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053342592:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129755.282997:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129755.283038:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053342592 00000100:00100000:3.0:1746129755.283043:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053342592 00000100:00100000:3.0:1746129755.283062:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11174 00000100:00100000:3.0:1746129755.283067:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3299:x1830949053342592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129755.283152:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3299:x1830949053342592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (154us total) trans 17179873203 rc 0/0 00000100:00100000:3.0:1746129755.283157:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11174 00000004:00080000:3.0:1746129755.283180:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b025c00/2, rc 0, transno 17179873203 00000100:00100000:3.0:1746129755.283184:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053342592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129755.283254:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949053341440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1608us (2871us total) trans 21474840347 rc 0/0 00000100:00100000:1.0:1746129755.283259:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11167 00000004:00080000:3.0:1746129755.283281:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013631bb80/2, rc 0, transno 21474840347 00000100:00100000:3.0:1746129755.283285:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053341440:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129755.286959:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.287004:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052288640 00000100:00100000:2.0:1746129755.287013:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052288640 00000100:00100000:2.0:1746129755.287047:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9927 00000100:00100000:2.0:1746129755.287054:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+6:28704:x1830949052288640:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129755.287074:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129755.287090:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43949f68 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fbc2 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.287133:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43949f68 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbc2 expref: 7 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.287144:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43949f68 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbc2 expref: 7 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.287156:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129755.287158:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129755.287161:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924f9600, rc 0) 00000100:00100000:2.0:1746129755.287195:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6141239f-0c60-480d-830c-e22ba61457b0+7:28704:x1830949052288640:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 142us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129755.287200:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9927 00000100:00100000:0.0:1746129755.302578:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.302619:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052288896 00000100:00100000:3.0:1746129755.302626:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052288896 00000100:00100000:3.0:1746129755.302667:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3912 00000100:00100000:3.0:1746129755.302675:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6141239f-0c60-480d-830c-e22ba61457b0+7:28704:x1830949052288896:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1746129755.302885:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6141239f-0c60-480d-830c-e22ba61457b0+8:28704:x1830949052288896:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 210us (313us total) trans 8589943722 rc 0/0 00000100:00100000:3.0:1746129755.302892:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3912 00000100:00100000:0.0:1746129755.332696:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.333418:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052289152 00000100:00100000:2.0:1746129755.333427:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052289152 00000100:00100000:2.0:1746129755.333462:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9928 00000100:00100000:2.0:1746129755.333469:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:28710:x1830949052289152:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129755.333487:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129755.333502:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f8400/0x48868a4e43949f6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fbc9 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.333585:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e43949f76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.333595:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e43949f76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.333604:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e43949f76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.333615:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949f7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.333620:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949f7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.333624:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949f7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.334274:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9000/0x48868a4e43949f84 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.334282:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9000/0x48868a4e43949f84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.334288:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9000/0x48868a4e43949f84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129755.334296:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129755.334387:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e43949f76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.334393:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e43949f76 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.334397:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e43949f76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.334402:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d79a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129755.334405:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e43949f76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.334411:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e43949f76 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.334420:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129755.334422:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129755.334425:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e43949f76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.334429:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79a00/0x48868a4e43949f76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.334670:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949f7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.334676:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949f7d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.334680:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949f7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.334683:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129c30800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129755.334685:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949f7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.334690:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949f7d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.334697:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012bfcac00) 00010000:00010000:2.0:1746129755.334698:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129755.334701:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949f7d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.334705:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949f7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.334740:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f8400/0x48868a4e43949f6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbc9 expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.334753:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9000/0x48868a4e43949f84 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbc9 expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.334758:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129755.334759:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129755.334761:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffb9000, rc 0) 00000100:00100000:2.0:1746129755.334823:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28710:x1830949052289152:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1353us (2133us total) trans 8589943723 rc 0/0 00000100:00100000:2.0:1746129755.334830:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9928 00000100:00100000:1.0:1746129755.334969:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.335001:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052289408 00000100:00100000:3.0:1746129755.335005:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052289408 00000100:00100000:3.0:1746129755.335034:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9929 00000100:00100000:3.0:1746129755.335039:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+281:28715:x1830949052289408:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129755.335049:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129755.335056:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e43949f92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fbd0 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.335107:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x48868a4e43949f99 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.335114:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x48868a4e43949f99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.335120:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x48868a4e43949f99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.335129:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace23000/0x48868a4e43949fa0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.335134:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace23000/0x48868a4e43949fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.335143:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace23000/0x48868a4e43949fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.335192:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace22e00/0x48868a4e43949fa7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.335198:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace22e00/0x48868a4e43949fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.335203:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace22e00/0x48868a4e43949fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129755.335209:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129755.335245:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x48868a4e43949f99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.335251:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x48868a4e43949f99 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.335255:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x48868a4e43949f99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.335259:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb10c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129755.335261:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x48868a4e43949f99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.335266:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x48868a4e43949f99 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.335272:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129755.335274:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129755.335276:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x48868a4e43949f99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.335284:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x48868a4e43949f99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.335309:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace23000/0x48868a4e43949fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.335314:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace23000/0x48868a4e43949fa0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.335318:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace23000/0x48868a4e43949fa0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.335322:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800ace23000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129755.335324:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace23000/0x48868a4e43949fa0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.335328:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace23000/0x48868a4e43949fa0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.335347:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009baa2800) 00010000:00010000:3.0:1746129755.335349:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129755.335351:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace23000/0x48868a4e43949fa0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.335355:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace23000/0x48868a4e43949fa0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.335379:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e43949f92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbd0 expref: 284 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.335387:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace22e00/0x48868a4e43949fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbd0 expref: 283 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.335397:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129755.335399:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129755.335400:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ace22e00, rc 0) 00000100:00100000:3.0:1746129755.335432:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28715:x1830949052289408:12345-192.168.204.31@tcp:101:cat.0 Request processed in 392us (463us total) trans 8589943724 rc 0/0 00000100:00100000:3.0:1746129755.335437:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9929 00000100:00100000:0.0:1746129755.338582:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129755.339194:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052289536 00000100:00100000:1.0:1746129755.339203:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052289536 00000100:00100000:1.0:1746129755.339268:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11175 00000100:00100000:1.0:1746129755.339278:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28714:x1830949052289536:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129755.339295:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129755.339312:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc8e600/0x48868a4e43949fb5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fbd7 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.339345:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129755.339347:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129755.339356:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc8e600/0x48868a4e43949fb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbd7 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129755.339435:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129755.340472:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc8e600/0x48868a4e43949fb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbd7 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.340484:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc8e600, rc 0) 00000100:00100000:1.0:1746129755.341223:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28714:x1830949052289536:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1943us (2644us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129755.341232:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11175 00000100:00100000:3.0:1746129755.341274:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052289664 00000100:00100000:3.0:1746129755.341280:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052289664 00000100:00100000:3.0:1746129755.341318:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11176 00000100:00100000:3.0:1746129755.341326:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:28715:x1830949052289664:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129755.341351:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129755.341364:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x48868a4e43949fbc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fbde expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.341381:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129755.341383:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129755.341390:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x48868a4e43949fbc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbde expref: 26 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.341401:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x48868a4e43949fbc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbde expref: 26 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.341410:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:3.0:1746129755.341433:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:28715:x1830949052289664:12345-192.168.204.31@tcp:101:cat.0 Request processed in 108us (1997us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129755.341437:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11176 00000100:00100000:3.0:1746129755.341502:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.341570:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052289920 00000100:00100000:3.0:1746129755.341573:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052289920 00000100:00100000:3.0:1746129755.341591:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9930 00000100:00100000:3.0:1746129755.341595:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28711:x1830949052289920:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129755.341606:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129755.341615:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093591a00/0x48868a4e43949fc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fbe5 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.341679:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e43949fca lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129755.341688:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9000/0x48868a4e43949f84 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbc9 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.341695:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace22e00/0x48868a4e43949fa7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbd0 expref: 284 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.341701:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e43949fca lrc: 5/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129755.341724:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace22e00/0x48868a4e43949fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbd0 expref: 284 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.341735:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace22e00/0x48868a4e43949fa7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbd0 expref: 284 pid: 1851 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746129755.341745:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131462d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053342720:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129755.341816:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9000/0x48868a4e43949f84 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbc9 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.341825:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9000/0x48868a4e43949f84 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbc9 expref: 8 pid: 1851 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746129755.341833:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131463800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053342848:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129755.341889:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a266c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129755.346983:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131462d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053342720:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129755.347000:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131463800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053342848:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129755.347026:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e43949fca lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000100:00100000:0.0:1746129755.347285:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.347428:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.347511:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052290048 00000100:00100000:3.0:1746129755.347519:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052290048 00010000:00010000:3.0:1746129755.347551:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9000/0x48868a4e43949f84 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbc9 expref: 9 pid: 1851 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746129755.347588:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052290176 00000100:00100000:3.0:1746129755.347592:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052290176 00010000:00010000:3.0:1746129755.347605:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace22e00/0x48868a4e43949fa7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbd0 expref: 285 pid: 1851 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746129755.347653:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5392 00000100:00100000:3.0:1746129755.347663:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1963:x1830949052290048:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129755.347679:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129755.347686:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9000/0x48868a4e43949f84 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbc9 expref: 9 pid: 1851 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746129755.347700:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9000/0x48868a4e43949f84 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbc9 expref: 9 pid: 1851 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746129755.347719:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9000/0x48868a4e43949f84 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbc9 expref: 9 pid: 1851 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746129755.347737:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129755.347742:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e43949fca lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129755.347748:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e43949fca lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129755.347753:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129755.347796:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1963:x1830949052290048:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 133us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129755.347803:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5392 00000100:00100000:3.0:1746129755.347823:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5393 00000100:00100000:3.0:1746129755.347830:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130567050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:1963:x1830949052290176:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129755.347837:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129755.347842:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace22e00/0x48868a4e43949fa7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbd0 expref: 285 pid: 1851 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746129755.347891:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace22e00/0x48868a4e43949fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbd0 expref: 285 pid: 1851 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746129755.347904:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace22e00/0x48868a4e43949fa7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbd0 expref: 285 pid: 1851 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746129755.347913:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129755.347916:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e43949fca lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129755.347922:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e43949fca lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129755.347928:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e43949fca lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129755.347947:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129755.347970:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130567050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:1963:x1830949052290176:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 140us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129755.347976:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5393 00010000:00010000:3.0:1746129755.348018:0:15044:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e43949fca lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129755.348024:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e43949fca lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:3.0:1746129755.348040:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129755.348170:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093591a00/0x48868a4e43949fc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbe5 expref: 285 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.348185:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e43949fca lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbe5 expref: 284 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.348191:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129755.348193:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129755.348195:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9bc800, rc 0) 00000100:00100000:3.0:1746129755.348229:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28711:x1830949052289920:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6631us (6724us total) trans 8589943725 rc 0/0 00000100:00100000:3.0:1746129755.348235:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9930 00000100:00100000:0.0:1746129755.349166:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.349200:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.349261:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052290560 00000100:00100000:2.0:1746129755.349265:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052290560 00002000:00100000:2.0:1746129755.349289:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012b026680 x1830949052290560/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129755.349296:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b026680 with x1830949052290560 ext(0->1048575) 00002000:00010000:2.0:1746129755.349300:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b026680 00000100:00100000:2.0:1746129755.349312:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4183 00000100:00100000:2.0:1746129755.349317:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052290560:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129755.351894:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052290304 00000100:00100000:3.0:1746129755.351906:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052290304 00000100:00100000:3.0:1746129755.351962:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9931 00000100:00100000:3.0:1746129755.351973:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28715:x1830949052290304:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129755.352004:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129755.352022:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43949fd8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fbec expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.352079:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43949fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbec expref: 285 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.352093:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43949fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbec expref: 285 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.352112:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129755.352115:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129755.352118:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1aa200, rc 0) 00000100:00100000:3.0:1746129755.352185:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28715:x1830949052290304:12345-192.168.204.31@tcp:101:cat.0 Request processed in 212us (3017us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129755.352191:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9931 00000100:00100000:2.0:1746129755.368269:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052290560:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18944us (19060us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129755.368281:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4183 00002000:00100000:2.0:1746129755.368291:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012b026680 x1830949052290560/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/440 e 0 to 0 dl 1746129766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129755.368309:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b026680 with x1830949052290560 ext(0->1048575) 00002000:00010000:2.0:1746129755.368313:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b026680 00000100:00100000:0.0:1746129755.378541:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.380412:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052290816 00000100:00100000:2.0:1746129755.380424:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052290816 00002000:00100000:2.0:1746129755.380466:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012b024380 x1830949052290816/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129755.380476:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b024380 with x1830949052290816 ext(0->1048575) 00002000:00010000:2.0:1746129755.380481:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b024380 00000100:00100000:2.0:1746129755.380501:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4184 00000100:00100000:2.0:1746129755.380508:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949052290816:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129755.382101:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.382138:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052290944 00000100:00100000:0.0:1746129755.382147:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052290944 00000100:00100000:0.0:1746129755.382177:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11177 00000100:00100000:0.0:1746129755.382183:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:28714:x1830949052290944:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129755.382194:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129755.382210:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3200/0x48868a4e43949fdf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fbf3 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129755.382233:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129755.382235:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129755.382241:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3200/0x48868a4e43949fdf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbf3 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129755.382254:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3200/0x48868a4e43949fdf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbf3 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129755.382262:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff3200, rc 0) 00000100:00100000:0.0:1746129755.382299:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28714:x1830949052290944:12345-192.168.204.31@tcp:101:cat.0 Request processed in 115us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129755.382304:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11177 00000100:00100000:0.0:1746129755.393433:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.394079:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052291072 00000100:00100000:2.0:1746129755.394088:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052291072 00000100:00100000:3.0:1746129755.395356:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9932 00000100:00100000:3.0:1746129755.395367:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28714:x1830949052291072:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129755.395387:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129755.395402:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa000/0x48868a4e43949fe6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fbfa expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.395446:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa000/0x48868a4e43949fe6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbfa expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.395456:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa000/0x48868a4e43949fe6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbfa expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.395469:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129755.395471:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129755.395474:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1aa000, rc 0) 00000100:00100000:3.0:1746129755.395525:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28714:x1830949052291072:12345-192.168.204.31@tcp:101:cat.0 Request processed in 162us (2100us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129755.395530:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9932 00000100:00100000:3.0:1746129755.398651:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949052290816:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17630us (19605us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129755.398661:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4184 00002000:00100000:3.0:1746129755.398672:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012b024380 x1830949052290816/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:496/0 lens 488/440 e 0 to 0 dl 1746129766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129755.398680:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b024380 with x1830949052290816 ext(0->1048575) 00002000:00010000:3.0:1746129755.398685:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b024380 00000100:00100000:0.0:1746129755.416003:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.416098:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052291328 00000100:00100000:3.0:1746129755.416106:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052291328 00002000:00100000:3.0:1746129755.416142:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012d635f80 x1830949052291328/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129755.416152:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d635f80 with x1830949052291328 ext(1048576->2097151) 00002000:00010000:3.0:1746129755.416157:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d635f80 00000100:00100000:3.0:1746129755.416185:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4185 00000100:00100000:3.0:1746129755.416195:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1961:x1830949052291328:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129755.421503:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.423696:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052291456 00000100:00100000:3.0:1746129755.423708:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052291456 00000100:00100000:3.0:1746129755.424609:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11178 00000100:00100000:3.0:1746129755.424619:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:28715:x1830949052291456:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129755.424632:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129755.424646:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e1ab400/0x48868a4e43949fed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fc01 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.424667:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129755.424668:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129755.424674:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e1ab400/0x48868a4e43949fed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc01 expref: 15 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.424686:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e1ab400/0x48868a4e43949fed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc01 expref: 15 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.424694:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1ab400, rc 0) 00000100:00100000:3.0:1746129755.426756:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:28715:x1830949052291456:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2130us (5253us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129755.426767:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11178 00000100:00100000:3.0:1746129755.434278:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1961:x1830949052291328:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18077us (18272us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129755.434290:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4185 00002000:00100000:3.0:1746129755.434301:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012d635f80 x1830949052291328/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/440 e 0 to 0 dl 1746129766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129755.434320:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d635f80 with x1830949052291328 ext(1048576->2097151) 00002000:00010000:3.0:1746129755.434325:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d635f80 00000100:00100000:0.0:1746129755.441205:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.441462:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052291712 00000100:00100000:3.0:1746129755.441470:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052291712 00002000:00100000:3.0:1746129755.441510:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012d637b80 x1830949052291712/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129755.441520:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d637b80 with x1830949052291712 ext(1048576->2097151) 00002000:00010000:3.0:1746129755.441524:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d637b80 00000100:00100000:3.0:1746129755.442133:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4186 00000100:00100000:3.0:1746129755.442142:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949052291712:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129755.465935:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.466724:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.466832:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052292096 00000100:00100000:2.0:1746129755.466840:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052292096 00000100:00100000:2.0:1746129755.466998:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9933 00000100:00100000:2.0:1746129755.467006:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28711:x1830949052292096:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129755.467027:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129755.467030:0:1851:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746129755.467053:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43949fd8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbec expref: 285 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.467071:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129755.467075:0:1851:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129755.467085:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9e00/0x48868a4e43949ff4 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fc0f expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.467126:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949ffb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.467142:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43949f68 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbc2 expref: 7 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.467149:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa000/0x48868a4e43949fe6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbfa expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.467154:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949ffb lrc: 5/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.467179:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa000/0x48868a4e43949fe6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbfa expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.467265:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa000/0x48868a4e43949fe6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbfa expref: 8 pid: 15044 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746129755.467276:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053342976:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129755.467369:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43949f68 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbc2 expref: 7 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.467376:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43949f68 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbc2 expref: 7 pid: 15044 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746129755.467384:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053343104:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129755.467627:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129755.472264:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052291840 00000100:00100000:3.0:1746129755.472276:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052291840 00000100:00100000:0.0:1746129755.473955:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11179 00000100:00100000:2.0:1746129755.474052:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28714:x1830949052291840:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129755.474071:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129755.474086:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7600/0x48868a4e4394a002 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fc08 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.474108:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129755.474109:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129755.474116:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7600/0x48868a4e4394a002 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc08 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.474129:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7600/0x48868a4e4394a002 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc08 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.474139:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fb7600, rc 0) 00000100:00100000:2.0:1746129755.474185:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28714:x1830949052291840:12345-192.168.204.31@tcp:101:cat.0 Request processed in 219us (8255us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129755.474191:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11179 00000100:00100000:0.0:1746129755.474741:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129755.474870:0:1851:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.31@tcp) returned -22 from blocking AST (req@ffff8800a02fd500 x1830949053342976) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa000/0x48868a4e43949fe6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbfa expref: 8 pid: 15044 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746129755.474883:0:1851:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa000/0x48868a4e43949fe6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbfa expref: 8 pid: 15044 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746129755.474897:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa000/0x48868a4e43949fe6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbfa expref: 8 pid: 15044 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746129755.475303:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949052291712:12345-192.168.204.31@tcp:3:cat.0 Request processed in 33161us (34105us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129755.475310:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4186 00002000:00100000:2.0:1746129755.475317:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012d637b80 x1830949052291712/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:496/0 lens 488/440 e 0 to 0 dl 1746129766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129755.475324:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d637b80 with x1830949052291712 ext(1048576->2097151) 00002000:00010000:2.0:1746129755.475336:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d637b80 00000100:00100000:0.0:1746129755.475964:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053342976:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129755.476040:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.476068:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052292480 00000100:00100000:0.0:1746129755.476073:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052292480 00010000:00010000:0.0:1746129755.476094:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43949f68 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbc2 expref: 8 pid: 15044 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746129755.476144:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053343104:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129755.476160:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129755.476164:0:1851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949ffb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.476170:0:1851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949ffb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.476176:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949ffb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:2.0:1746129755.476221:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.476236:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052292352 00000100:00100000:2.0:1746129755.476240:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052292352 00000100:00100000:0.0:1746129755.480213:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5394 00000100:00100000:0.0:1746129755.480228:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052292480:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129755.480243:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129755.480253:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43949f68 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbc2 expref: 8 pid: 15044 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746129755.480265:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43949f68 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbc2 expref: 8 pid: 15044 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746129755.480283:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9600/0x48868a4e43949f68 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbc2 expref: 8 pid: 15044 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746129755.480308:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129755.480313:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949ffb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129755.480320:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949ffb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129755.480336:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949ffb lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129755.480359:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129755.480401:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+7:1962:x1830949052292480:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 178us (4360us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129755.480408:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5394 00000100:00100000:0.0:1746129755.480512:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.480572:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052292736 00000100:00100000:0.0:1746129755.480578:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052292736 00000100:00100000:0.0:1746129755.480602:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11180 00000100:00100000:0.0:1746129755.480607:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:28715:x1830949052292736:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129755.480618:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129755.480628:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acc1e000/0x48868a4e4394a009 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fc24 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129755.480642:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129755.480643:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129755.480649:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1e000/0x48868a4e4394a009 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc24 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129755.480659:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1e000/0x48868a4e4394a009 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc24 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129755.480665:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1e000, rc 0) 00000100:00100000:0.0:1746129755.480682:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:28715:x1830949052292736:12345-192.168.204.31@tcp:101:cat.0 Request processed in 75us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129755.480686:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11180 00000100:00100000:1.0:1746129755.480997:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052292608 00000100:00100000:1.0:1746129755.481002:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052292608 00000100:00100000:1.0:1746129755.481014:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9934 00000100:00100000:1.0:1746129755.481020:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28710:x1830949052292352:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129755.481029:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129755.481030:0:14315:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746129755.481032:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 48868a4e43949fe6) 00010000:00010000:1.0:1746129755.481033:0:14315:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129755.481041:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e4394a010 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fc16 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.481074:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e200/0x48868a4e4394a017 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129755.481081:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949ffb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129755.481086:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e200/0x48868a4e4394a017 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129755.481095:0:14315:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949ffb lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129755.481101:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e200/0x48868a4e4394a017 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:1.0:1746129755.481126:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9935 00000100:00100000:1.0:1746129755.481130:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28714:x1830949052292608:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129755.481136:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129755.481141:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e4394a01e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fc1d expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.481167:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e200/0x48868a4e4394a017 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129755.481173:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e4394a01e lrc: 4/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc1d expref: 11 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.481181:0:15044:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e200/0x48868a4e4394a017 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129755.481188:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e4394a01e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc1d expref: 11 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.481197:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129755.481199:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129755.481201:0:15044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e200/0x48868a4e4394a017 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129755.481206:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6fa00, rc 0) 00000100:00100000:1.0:1746129755.481226:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28714:x1830949052292608:12345-192.168.204.31@tcp:101:cat.0 Request processed in 95us (5005us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129755.481231:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9935 00010000:00010000:2.0:1746129755.481486:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949ffb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129755.481492:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949ffb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 1851 initiator: MDT0 00000004:02000000:2.0:1746129755.481521:0:1851:0:(lod_object.c:7771:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00000040:00080000:2.0:1746129755.481988:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2860, 88 off238536 00000004:00080000:2.0:1746129755.481993:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701540144898ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129755.482025:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2790, 88 off232456 00000004:00080000:2.0:1746129755.482027:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701540179608ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129755.482048:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2791, 88 off232544 00000004:00080000:2.0:1746129755.482058:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701540210245ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129755.482064:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2861, 88 off238624 00000004:00080000:2.0:1746129755.482066:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701540218608ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129755.482072:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2862, 88 off238712 00000004:00080000:2.0:1746129755.482074:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701540225845ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129755.482079:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2792, 88 off232632 00000004:00080000:2.0:1746129755.482081:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701540232801ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129755.482086:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2793, 88 off232720 00000004:00080000:2.0:1746129755.482088:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701540240098ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129755.482093:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2794, 88 off232808 00000004:00080000:2.0:1746129755.482095:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701540246798ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129755.482099:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2863, 88 off238800 00000004:00080000:2.0:1746129755.482103:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701540254778ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129755.482107:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2795, 88 off232896 00000004:00080000:2.0:1746129755.482109:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701540261483ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129755.482114:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2864, 88 off238888 00000004:00080000:2.0:1746129755.482116:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701540267921ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129755.482120:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2796, 88 off232984 00000004:00080000:2.0:1746129755.482122:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701540274311ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129755.482127:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2865, 88 off238976 00000004:00080000:2.0:1746129755.482129:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701540280850ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129755.482133:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2866, 88 off239064 00000004:00080000:2.0:1746129755.482135:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701540287663ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129755.482140:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2867, 88 off239152 00000004:00080000:2.0:1746129755.482142:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701540294403ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129755.482147:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2868, 88 off239240 00000004:00080000:2.0:1746129755.482149:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701540301068ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129755.482154:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2797, 88 off233072 00000004:00080000:2.0:1746129755.482156:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701540307838ns, next at 641623252291ns, rc = 0 00000100:00100000:0.0:1746129755.489467:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.489632:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052292864 00000100:00100000:2.0:1746129755.489640:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052292864 00000100:00100000:2.0:1746129755.489674:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9936 00000100:00100000:2.0:1746129755.489680:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:28715:x1830949052292864:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129755.489695:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129755.489710:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4bc00/0x48868a4e4394a025 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fc2b expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.489757:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4bc00/0x48868a4e4394a025 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc2b expref: 288 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.489767:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4bc00/0x48868a4e4394a025 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc2b expref: 288 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.489777:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129755.489779:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129755.489782:0:16808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e200/0x48868a4e4394a017 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129755.489787:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb4bc00, rc 0) 00000100:00100000:2.0:1746129755.490228:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:28715:x1830949052292864:12345-192.168.204.31@tcp:101:cat.0 Request processed in 546us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129755.490234:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9936 00000001:00080000:0.0:1746129755.510145:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943726 is committed 00000004:00080000:0.0:1746129755.510154:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1982 committed 00000004:00080000:0.0:1746129755.510160:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2049 committed 00000004:00080000:0.0:1746129755.510165:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2048 committed 00000004:00080000:0.0:1746129755.510167:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2047 committed 00000004:00080000:0.0:1746129755.510168:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2046 committed 00000004:00080000:0.0:1746129755.510170:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1981 committed 00000004:00080000:0.0:1746129755.510171:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2045 committed 00000004:00080000:0.0:1746129755.510173:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1980 committed 00000004:00080000:0.0:1746129755.510174:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2044 committed 00000004:00080000:0.0:1746129755.510176:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1979 committed 00000004:00080000:0.0:1746129755.510177:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1978 committed 00000004:00080000:0.0:1746129755.510179:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1977 committed 00000004:00080000:0.0:1746129755.510180:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2043 committed 00000004:00080000:0.0:1746129755.510181:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2042 committed 00000004:00080000:0.0:1746129755.510183:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1976 committed 00000004:00080000:0.0:1746129755.510184:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1975 committed 00000004:00080000:0.0:1746129755.510185:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2041 committed 00000001:00080000:0.0:1746129755.510189:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943723 is committed 00000001:00080000:0.0:1746129755.510196:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943722 is committed 00010000:00010000:2.0:1746129755.510313:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949ffb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc0f expref: 285 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.510324:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129755.510336:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746129755.510339:0:1851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e200/0x48868a4e4394a017 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129755.510346:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949ffb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc0f expref: 285 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.510351:0:1851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e200/0x48868a4e4394a017 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129755.510373:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949ffb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc0f expref: 285 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.510383:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949ffb lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc0f expref: 285 pid: 1851 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746129755.510394:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053343488:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129755.510461:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1480 going to sleep for 11 seconds 00000100:00100000:3.0:1746129755.510909:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053343360:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129755.510940:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129755.510956:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053344000:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129755.510970:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129755.510980:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053344512:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129755.510992:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129755.511000:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053345024:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129755.511012:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129755.511025:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1746129755.511029:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053343232:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129755.511044:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129755.511053:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053343872:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129755.511066:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129755.511075:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053344384:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129755.511086:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129755.511094:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053344896:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129755.511104:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129755.511119:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053343616:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129755.511131:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129755.511140:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053344128:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129755.511152:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129755.511161:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053344640:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129755.511174:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129755.511183:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053345152:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129755.511193:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129755.511204:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1746129755.511208:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053343744:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129755.511220:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129755.511226:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053344256:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129755.511238:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129755.511244:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053344768:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129755.511254:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129755.511260:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053345280:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129755.511271:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129755.511289:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053343360 00000100:00100000:3.0:1746129755.511294:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053343360 00000100:00100000:3.0:1746129755.511316:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053344000 00000100:00100000:3.0:1746129755.511318:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053344000 00000100:00100000:3.0:1746129755.511325:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053344512 00000100:00100000:3.0:1746129755.511340:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053344512 00000100:00100000:3.0:1746129755.511348:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053345024 00000100:00100000:3.0:1746129755.511350:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053345024 00000100:00100000:3.0:1746129755.511356:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053343232 00000100:00100000:3.0:1746129755.511358:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053343232 00000100:00100000:3.0:1746129755.511364:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053343872 00000100:00100000:3.0:1746129755.511365:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053343872 00000100:00100000:3.0:1746129755.511371:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053344384 00000100:00100000:3.0:1746129755.511372:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053344384 00000100:00100000:3.0:1746129755.511377:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053344896 00000100:00100000:3.0:1746129755.511379:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053344896 00000100:00100000:3.0:1746129755.511384:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053343616 00000100:00100000:3.0:1746129755.511386:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053343616 00000100:00100000:3.0:1746129755.511390:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053344128 00000100:00100000:3.0:1746129755.511392:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053344128 00000100:00100000:3.0:1746129755.511399:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053344640 00000100:00100000:3.0:1746129755.511400:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053344640 00000100:00100000:3.0:1746129755.511404:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053345152 00000100:00100000:3.0:1746129755.511405:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053345152 00000100:00100000:3.0:1746129755.511410:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053343744 00000100:00100000:3.0:1746129755.511411:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053343744 00000100:00100000:3.0:1746129755.511416:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053344256 00000100:00100000:3.0:1746129755.511418:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053344256 00000100:00100000:3.0:1746129755.511423:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053344768 00000100:00100000:3.0:1746129755.511424:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053344768 00000100:00100000:3.0:1746129755.511429:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053345280 00000100:00100000:3.0:1746129755.511430:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053345280 00000100:00100000:3.0:1746129755.511438:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11181 00000100:00100000:3.0:1746129755.511443:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3297:x1830949053343360:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129755.511594:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746129755.511597:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129755 -> 1746129755 00002000:00010000:3.0:1746129755.511599:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129755 -> 1746129755 00002000:00010000:3.0:1746129755.511601:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129755 -> 1746129755 00002000:00010000:3.0:1746129755.511603:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:3.0:1746129755.511629:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3297:x1830949053343360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 185us (688us total) trans 17179873204 rc 0/0 00000100:00100000:3.0:1746129755.511634:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11181 00000100:00100000:3.0:1746129755.511648:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11182 00000100:00100000:3.0:1746129755.511653:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3297:x1830949053344000:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129755.511730:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129755.511732:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746129755.511733:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746129755.511735:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746129755.511736:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746129755.511754:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3297:x1830949053344000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 101us (783us total) trans 21474840350 rc 0/0 00000100:00100000:3.0:1746129755.511759:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11182 00000100:00100000:3.0:1746129755.511768:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11183 00000100:00100000:3.0:1746129755.511772:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3297:x1830949053344512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129755.511833:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129755.511835:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129755 -> 1746129755 00002000:00010000:3.0:1746129755.511837:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746129755 -> 1746129755 00002000:00010000:3.0:1746129755.511839:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129755 -> 1746129755 00002000:00010000:3.0:1746129755.511841:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746129755.511873:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3297:x1830949053344512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (880us total) trans 17179873205 rc 0/0 00000100:00100000:3.0:1746129755.511878:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11183 00000100:00100000:3.0:1746129755.511887:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11184 00000100:00100000:3.0:1746129755.511892:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3297:x1830949053345024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129755.511959:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3297:x1830949053345024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (945us total) trans 17179873206 rc 0/0 00000100:00100000:3.0:1746129755.511963:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11184 00000100:00100000:3.0:1746129755.511973:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11185 00000100:00100000:3.0:1746129755.511977:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3297:x1830949053343232:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129755.512040:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129755.512042:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129755 -> 1746129755 00002000:00010000:3.0:1746129755.512044:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129755 -> 1746129755 00002000:00010000:3.0:1746129755.512046:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129755 -> 1746129755 00002000:00010000:3.0:1746129755.512047:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746129755.512064:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3297:x1830949053343232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (1019us total) trans 21474840351 rc 0/0 00000100:00100000:3.0:1746129755.512069:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11185 00000100:00100000:3.0:1746129755.512079:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11186 00000100:00100000:3.0:1746129755.512083:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3297:x1830949053343872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129755.512150:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3297:x1830949053343872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (1083us total) trans 21474840352 rc 0/0 00000100:00100000:3.0:1746129755.512155:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11186 00000100:00100000:3.0:1746129755.512244:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11187 00000100:00100000:3.0:1746129755.512249:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3297:x1830949053344384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129755.512316:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3297:x1830949053344384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (1229us total) trans 21474840353 rc 0/0 00000100:00100000:3.0:1746129755.512321:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11187 00000100:00100000:3.0:1746129755.512347:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11188 00000100:00100000:3.0:1746129755.512352:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3297:x1830949053344896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129755.512420:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3297:x1830949053344896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (1314us total) trans 17179873207 rc 0/0 00000100:00100000:3.0:1746129755.512425:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11188 00000100:00100000:3.0:1746129755.512436:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11189 00000100:00100000:3.0:1746129755.512440:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3298:x1830949053343616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129755.512502:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129755.512505:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129755 -> 1746129755 00002000:00010000:3.0:1746129755.512507:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129755 -> 1746129755 00002000:00010000:3.0:1746129755.512508:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129755 -> 1746129755 00002000:00010000:3.0:1746129755.512510:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746129755.512532:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3298:x1830949053343616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (1400us total) trans 21474840354 rc 0/0 00000100:00100000:3.0:1746129755.512536:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11189 00000100:00100000:3.0:1746129755.512548:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11190 00000100:00100000:3.0:1746129755.512552:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3298:x1830949053344128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129755.512622:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3298:x1830949053344128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (1467us total) trans 21474840355 rc 0/0 00000100:00100000:3.0:1746129755.512626:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11190 00000100:00100000:3.0:1746129755.512636:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11191 00000100:00100000:3.0:1746129755.512640:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3298:x1830949053344640:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129755.512702:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:3.0:1746129755.512704:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129755 -> 1746129755 00002000:00010000:3.0:1746129755.512706:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129755 -> 1746129755 00002000:00010000:3.0:1746129755.512707:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129755 -> 1746129755 00002000:00010000:3.0:1746129755.512709:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5673 -> 5673 00000100:00100000:3.0:1746129755.512726:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3298:x1830949053344640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (1551us total) trans 17179873208 rc 0/0 00000100:00100000:3.0:1746129755.512731:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11191 00000100:00100000:3.0:1746129755.512742:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11192 00000100:00100000:3.0:1746129755.512746:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3298:x1830949053345152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129755.512813:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3298:x1830949053345152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (1618us total) trans 17179873209 rc 0/0 00000100:00100000:3.0:1746129755.512819:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11192 00000100:00100000:3.0:1746129755.512827:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11193 00000100:00100000:3.0:1746129755.512831:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3298:x1830949053343744:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129755.512911:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746129755.512914:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129755 -> 1746129755 00002000:00010000:3.0:1746129755.512915:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129755 -> 1746129755 00002000:00010000:3.0:1746129755.512917:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129755 -> 1746129755 00002000:00010000:3.0:1746129755.512918:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746129755.512937:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3298:x1830949053343744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (1716us total) trans 21474840356 rc 0/0 00000100:00100000:3.0:1746129755.512941:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11193 00000100:00100000:3.0:1746129755.512951:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11194 00000100:00100000:3.0:1746129755.512955:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3298:x1830949053344256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129755.513022:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3298:x1830949053344256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (1782us total) trans 21474840357 rc 0/0 00000100:00100000:3.0:1746129755.513026:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11194 00000100:00100000:3.0:1746129755.513035:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11195 00000100:00100000:3.0:1746129755.513040:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3298:x1830949053344768:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129755.513097:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129755.513099:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746129755.513100:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746129755.513102:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746129755.513103:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746129755.513120:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3298:x1830949053344768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (1864us total) trans 17179873210 rc 0/0 00000100:00100000:3.0:1746129755.513125:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11195 00000100:00100000:3.0:1746129755.513134:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11196 00000100:00100000:3.0:1746129755.513138:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3298:x1830949053345280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129755.513204:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3298:x1830949053345280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (1932us total) trans 17179873211 rc 0/0 00000100:00100000:3.0:1746129755.513208:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11196 00000004:00080000:3.0:1746129755.513245:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d634e00/2, rc 0, transno 21474840356 00000100:00100000:3.0:1746129755.513249:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053343744:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129755.513256:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009423c380/2, rc 0, transno 21474840357 00000100:00100000:3.0:1746129755.513259:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053344256:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129755.513265:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131460000/2, rc 0, transno 17179873210 00000100:00100000:3.0:1746129755.513271:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053344768:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129755.513278:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131461180/2, rc 0, transno 17179873211 00000100:00100000:3.0:1746129755.513280:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053345280:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129755.513286:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d635c00/2, rc 0, transno 21474840354 00000100:00100000:3.0:1746129755.513288:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053343616:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129755.513293:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009423d500/2, rc 0, transno 21474840355 00000100:00100000:3.0:1746129755.513295:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053344128:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129755.513299:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131463480/2, rc 0, transno 17179873208 00000100:00100000:3.0:1746129755.513301:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053344640:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129755.513306:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131461f80/2, rc 0, transno 17179873209 00000100:00100000:3.0:1746129755.513308:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053345152:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129755.513321:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d636680/2, rc 0, transno 21474840351 00000100:00100000:3.0:1746129755.513323:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053343232:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129755.513344:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d636300/2, rc 0, transno 21474840352 00000100:00100000:3.0:1746129755.513346:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053343872:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129755.513352:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009423d180/2, rc 0, transno 21474840353 00000100:00100000:3.0:1746129755.513354:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053344384:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129755.513359:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131461c00/2, rc 0, transno 17179873207 00000100:00100000:3.0:1746129755.513361:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053344896:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129755.513367:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131463800/2, rc 0, transno 17179873204 00000100:00100000:3.0:1746129755.513370:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053343360:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129755.513376:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009423d880/2, rc 0, transno 21474840350 00000100:00100000:3.0:1746129755.513378:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053344000:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129755.513383:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131462d80/2, rc 0, transno 17179873205 00000100:00100000:3.0:1746129755.513385:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053344512:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129755.513390:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131461500/2, rc 0, transno 17179873206 00000100:00100000:3.0:1746129755.513393:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053345024:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129755.513438:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746129755.513444:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053345408:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129755.513463:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129755.513482:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053345408 00000100:00100000:3.0:1746129755.513486:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053345408 00000100:00100000:3.0:1746129755.513501:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11197 00000100:00100000:3.0:1746129755.513505:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3297:x1830949053345408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129755.513579:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3297:x1830949053345408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (114us total) trans 17179873212 rc 0/0 00000100:00100000:3.0:1746129755.513584:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11197 00000004:00080000:3.0:1746129755.513603:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130505180/2, rc 0, transno 17179873212 00000100:00100000:3.0:1746129755.513606:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053345408:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129755.514985:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053343488:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129755.515012:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f9e00/0x48868a4e43949ff4 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc0f expref: 285 pid: 1851 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746129755.515028:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949ffb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc0f expref: 284 pid: 1851 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746129755.515035:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949ffb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc0f expref: 284 pid: 1851 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746129755.515055:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129c30800, rc 0) 00000100:00100000:2.0:1746129755.515083:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28711:x1830949052292096:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 48078us (48360us total) trans 8589943726 rc 0/0 00000100:00100000:2.0:1746129755.515088:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9933 00000100:00100000:0.0:1746129755.518010:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.518032:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052292992 00000100:00100000:0.0:1746129755.518038:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052292992 00010000:00010000:0.0:1746129755.518062:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949ffb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc0f expref: 284 pid: 1851 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746129755.518082:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5395 00000100:00100000:0.0:1746129755.518088:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:1962:x1830949052292992:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129755.518097:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129755.518101:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949ffb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc0f expref: 284 pid: 1851 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746129755.518114:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949ffb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc0f expref: 284 pid: 1851 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746129755.518130:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c30800/0x48868a4e43949ffb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc0f expref: 284 pid: 1851 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746129755.518138:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129755.518142:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e200/0x48868a4e4394a017 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129755.518149:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e200/0x48868a4e4394a017 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129755.518154:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e200/0x48868a4e4394a017 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129755.518160:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e4394a01e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc1d expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129755.518173:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129755.518199:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:1962:x1830949052292992:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 111us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129755.518204:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5395 00010000:00010000:0.0:1746129755.518220:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e200/0x48868a4e4394a017 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129755.518225:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e200/0x48868a4e4394a017 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00000040:00080000:0.0:1746129755.518739:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2869, 88 off239328 00000004:00080000:0.0:1746129755.518745:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701576896571ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129755.518795:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2798, 88 off233160 00000004:00080000:0.0:1746129755.518799:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701576950958ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129755.518809:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2799, 88 off233248 00000004:00080000:0.0:1746129755.518812:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701576964175ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129755.518819:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2870, 88 off239416 00000004:00080000:0.0:1746129755.518822:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701576974228ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129755.518828:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2871, 88 off239504 00000004:00080000:0.0:1746129755.518830:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701576982308ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129755.518836:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2800, 88 off233336 00000004:00080000:0.0:1746129755.518838:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701576990138ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129755.518844:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2801, 88 off233424 00000004:00080000:0.0:1746129755.518865:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701577017046ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129755.518875:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2802, 88 off233512 00000004:00080000:0.0:1746129755.518877:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701577029420ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129755.518884:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2872, 88 off239592 00000004:00080000:0.0:1746129755.518886:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701577038185ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129755.518892:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2803, 88 off233600 00000004:00080000:0.0:1746129755.518894:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701577046485ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129755.518901:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2873, 88 off239680 00000004:00080000:0.0:1746129755.518903:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701577054995ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129755.518909:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2804, 88 off233688 00000004:00080000:0.0:1746129755.518912:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701577063875ns, next at 641623252291ns, rc = 0 00000040:00080000:0.0:1746129755.518918:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2874, 88 off239768 00000004:00080000:0.0:1746129755.518920:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701577072075ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129755.518926:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2875, 88 off239856 00000004:00080000:0.0:1746129755.518928:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701577080531ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129755.518935:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2876, 88 off239944 00000004:00080000:0.0:1746129755.518937:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701577089628ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129755.518943:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2877, 88 off240032 00000004:00080000:0.0:1746129755.518946:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701577097673ns, next at 641639930618ns, rc = 0 00000040:00080000:0.0:1746129755.518953:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2805, 88 off233776 00000004:00080000:0.0:1746129755.518955:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701577107140ns, next at 641623252291ns, rc = 0 00010000:00010000:1.0:1746129755.545770:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e200/0x48868a4e4394a017 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc16 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.545783:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129755.545786:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746129755.545789:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e4394a01e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc1d expref: 11 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.545798:0:14315:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e4394a01e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc1d expref: 11 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.545808:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e4394a01e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc1d expref: 11 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.545815:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4bc00/0x48868a4e4394a025 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc2b expref: 282 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.545821:0:14315:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4bc00/0x48868a4e4394a025 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc2b expref: 282 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.545826:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4bc00/0x48868a4e4394a025 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc2b expref: 282 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.545871:0:14315:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4bc00/0x48868a4e4394a025 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc2b expref: 282 pid: 16808 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129755.545882:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053345536:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129755.545958:0:14315:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e4394a01e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc1d expref: 11 pid: 15044 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129755.545965:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936de300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053345664:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129755.545983:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d917600 going to sleep for 11 seconds 00000001:00080000:0.0:1746129755.546067:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943727 is committed 00000004:00080000:0.0:1746129755.546073:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1990 committed 00000004:00080000:0.0:1746129755.546080:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2058 committed 00000004:00080000:0.0:1746129755.546092:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2057 committed 00000004:00080000:0.0:1746129755.546093:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2056 committed 00000004:00080000:0.0:1746129755.546096:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2055 committed 00000004:00080000:0.0:1746129755.546097:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1989 committed 00000004:00080000:0.0:1746129755.546099:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2054 committed 00000004:00080000:0.0:1746129755.546100:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1988 committed 00000004:00080000:0.0:1746129755.546101:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2053 committed 00000004:00080000:0.0:1746129755.546102:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1987 committed 00000004:00080000:0.0:1746129755.546104:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1986 committed 00000004:00080000:0.0:1746129755.546108:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1985 committed 00000004:00080000:0.0:1746129755.546110:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2052 committed 00000004:00080000:0.0:1746129755.546111:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2051 committed 00000004:00080000:0.0:1746129755.546112:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1984 committed 00000004:00080000:0.0:1746129755.546113:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1983 committed 00000004:00080000:0.0:1746129755.546115:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2050 committed 00000100:00100000:2.0:1746129755.546314:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053345792:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129755.546357:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129755.546372:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053346304:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129755.546387:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129755.546401:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746129755.546405:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053346176:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129755.546417:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129755.546426:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053346688:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129755.546438:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129755.546456:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053345920:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129755.546470:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129755.546479:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053346432:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129755.546491:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129755.546501:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746129755.546505:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053346048:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129755.546518:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129755.546528:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053346560:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129755.546539:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129755.546559:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053345792 00000100:00100000:2.0:1746129755.546565:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053345792 00000100:00100000:2.0:1746129755.546591:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053346304 00000100:00100000:2.0:1746129755.546593:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053346304 00000100:00100000:2.0:1746129755.546603:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053346176 00000100:00100000:2.0:1746129755.546605:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053346176 00000100:00100000:2.0:1746129755.546613:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053346688 00000100:00100000:2.0:1746129755.546614:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053346688 00000100:00100000:2.0:1746129755.546621:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053345920 00000100:00100000:2.0:1746129755.546623:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053345920 00000100:00100000:2.0:1746129755.546629:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053346432 00000100:00100000:2.0:1746129755.546630:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053346432 00000100:00100000:2.0:1746129755.546636:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053346048 00000100:00100000:2.0:1746129755.546638:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053346048 00000100:00100000:2.0:1746129755.546644:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053346560 00000100:00100000:2.0:1746129755.546645:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053346560 00000100:00100000:2.0:1746129755.546654:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11198 00000100:00100000:2.0:1746129755.546660:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3297:x1830949053345792:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129755.546809:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746129755.546812:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129755 -> 1746129755 00002000:00010000:2.0:1746129755.546815:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129755 -> 1746129755 00002000:00010000:2.0:1746129755.546816:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129755 -> 1746129755 00002000:00010000:2.0:1746129755.546818:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:2.0:1746129755.546843:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3297:x1830949053345792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 183us (486us total) trans 17179873213 rc 0/0 00000100:00100000:2.0:1746129755.546871:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11198 00000100:00100000:2.0:1746129755.546885:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11199 00000100:00100000:2.0:1746129755.546889:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3297:x1830949053346304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129755.547645:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053347072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129755.547670:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129755.547681:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053347584:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129755.547692:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129755.547701:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746129755.547705:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053346944:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129755.547716:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129755.547723:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053347456:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129755.547733:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129755.547744:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053347200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129755.547756:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129755.547763:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053347712:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129755.547773:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129755.547779:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746129755.547782:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053346816:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129755.547793:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129755.547799:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053347328:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129755.547810:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129755.547866:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053347072 00000100:00100000:0.0:1746129755.547870:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053347072 00000100:00100000:0.0:1746129755.547885:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053347584 00000100:00100000:0.0:1746129755.547887:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053347584 00000100:00100000:0.0:1746129755.547892:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053346944 00000100:00100000:0.0:1746129755.547893:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053346944 00000100:00100000:0.0:1746129755.547899:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053347456 00000100:00100000:0.0:1746129755.547900:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053347456 00000100:00100000:0.0:1746129755.547905:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053347200 00000100:00100000:0.0:1746129755.547906:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053347200 00000100:00100000:0.0:1746129755.547911:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053347712 00000100:00100000:0.0:1746129755.547913:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053347712 00000100:00100000:0.0:1746129755.547918:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053346816 00000100:00100000:0.0:1746129755.547920:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053346816 00000100:00100000:0.0:1746129755.547924:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053347328 00000100:00100000:0.0:1746129755.547926:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053347328 00000100:00100000:0.0:1746129755.547933:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11200 00000100:00100000:0.0:1746129755.547938:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3297:x1830949053346176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129755.547951:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11201 00000100:00100000:0.0:1746129755.547955:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3297:x1830949053346688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129755.547964:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11202 00000100:00100000:0.0:1746129755.547967:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3298:x1830949053345920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129755.547976:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11203 00000100:00100000:0.0:1746129755.547979:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3298:x1830949053346432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129755.548956:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3297:x1830949053346304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2065us (2565us total) trans 17179873214 rc 0/0 00000100:00100000:2.0:1746129755.548963:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11199 00000100:00100000:2.0:1746129755.548978:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11204 00000100:00100000:2.0:1746129755.548983:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3298:x1830949053346048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129755.549089:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:2.0:1746129755.549093:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129755 -> 1746129755 00002000:00010000:2.0:1746129755.549095:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129755 -> 1746129755 00002000:00010000:2.0:1746129755.549096:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129755 -> 1746129755 00002000:00010000:2.0:1746129755.549098:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5673 -> 5673 00002000:00010000:0.0:1746129755.549238:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129755.549240:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129755.549242:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129755.549243:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129755.549244:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129755.549268:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3297:x1830949053346176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1330us (2850us total) trans 17179873216 rc 0/0 00000100:00100000:0.0:1746129755.549275:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11200 00000100:00100000:0.0:1746129755.549285:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11205 00000100:00100000:0.0:1746129755.549289:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3298:x1830949053346560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129755.549394:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3298:x1830949053346048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 411us (2874us total) trans 17179873215 rc 0/0 00000100:00100000:2.0:1746129755.549400:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11204 00000100:00100000:2.0:1746129755.549409:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11206 00000100:00100000:2.0:1746129755.549413:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3299:x1830949053347072:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129755.549494:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746129755.549497:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129755 -> 1746129755 00002000:00010000:2.0:1746129755.549498:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129755 -> 1746129755 00002000:00010000:2.0:1746129755.549500:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129755 -> 1746129755 00002000:00010000:2.0:1746129755.549501:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746129755.549826:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3299:x1830949053347072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 411us (2154us total) trans 21474840358 rc 0/0 00000100:00100000:2.0:1746129755.549831:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11206 00000100:00100000:2.0:1746129755.549841:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11207 00000100:00100000:2.0:1746129755.549863:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3299:x1830949053347584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129755.549877:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11208 00000100:00100000:2.0:1746129755.549881:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3299:x1830949053346944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129755.550232:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3298:x1830949053346560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 941us (3690us total) trans 17179873217 rc 0/0 00000100:00100000:0.0:1746129755.550238:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11205 00000100:00100000:0.0:1746129755.550249:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11209 00000100:00100000:0.0:1746129755.550254:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3299:x1830949053347456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129755.550348:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3299:x1830949053347456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (2613us total) trans 21474840360 rc 0/0 00000100:00100000:0.0:1746129755.550353:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11209 00000100:00100000:0.0:1746129755.550362:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11210 00000100:00100000:0.0:1746129755.550366:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3296:x1830949053347200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129755.550441:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3296:x1830949053347200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (2682us total) trans 21474840361 rc 0/0 00000100:00100000:0.0:1746129755.550445:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11210 00000100:00100000:0.0:1746129755.550455:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11211 00000100:00100000:0.0:1746129755.550460:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3296:x1830949053347712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129755.550535:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3296:x1830949053347712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (2761us total) trans 21474840362 rc 0/0 00000100:00100000:0.0:1746129755.550539:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11211 00000100:00100000:0.0:1746129755.550549:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11212 00000100:00100000:0.0:1746129755.550553:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3296:x1830949053346816:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129755.550615:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129755.550618:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129755 -> 1746129755 00002000:00010000:0.0:1746129755.550620:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129755 -> 1746129755 00002000:00010000:0.0:1746129755.550621:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129755 -> 1746129755 00002000:00010000:0.0:1746129755.550624:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746129755.550642:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3296:x1830949053346816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (2848us total) trans 21474840363 rc 0/0 00000100:00100000:0.0:1746129755.550647:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11212 00000100:00100000:0.0:1746129755.550656:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11213 00000100:00100000:0.0:1746129755.550660:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3296:x1830949053347328:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129755.550718:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129755.550720:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129755.550722:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129755.550723:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129755.550725:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129755.550743:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3296:x1830949053347328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (2932us total) trans 21474840364 rc 0/0 00000100:00100000:0.0:1746129755.550747:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11213 00000100:00100000:0.0:1746129755.550834:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3297:x1830949053346688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2878us (4394us total) trans 17179873218 rc 0/0 00000100:00100000:0.0:1746129755.550839:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11201 00002000:00010000:0.0:1746129755.550928:0:20441:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129755.550931:0:20441:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129755 -> 1746129755 00002000:00010000:0.0:1746129755.550932:0:20441:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746129755 -> 1746129755 00002000:00010000:0.0:1746129755.550934:0:20441:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129755 -> 1746129755 00002000:00010000:0.0:1746129755.550936:0:20441:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129755.550955:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3298:x1830949053345920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2987us (4485us total) trans 17179873219 rc 0/0 00000100:00100000:0.0:1746129755.550960:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11202 00002000:00010000:2.0:1746129755.551217:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129755.551219:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129755 -> 1746129755 00002000:00010000:2.0:1746129755.551221:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129755 -> 1746129755 00002000:00010000:2.0:1746129755.551222:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129755 -> 1746129755 00002000:00010000:2.0:1746129755.551224:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746129755.551244:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3299:x1830949053346944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1363us (3526us total) trans 21474840359 rc 0/0 00000100:00100000:2.0:1746129755.551249:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11208 00000004:00080000:2.0:1746129755.551303:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02fc000/2, rc 0, transno 17179873216 00000100:00100000:2.0:1746129755.551312:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053346176:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129755.551319:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135d8df80/2, rc 0, transno 17179873218 00000100:00100000:2.0:1746129755.551322:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053346688:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129755.551340:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02fd500/2, rc 0, transno 17179873213 00000100:00100000:2.0:1746129755.551343:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053345792:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129755.551349:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135d8ed80/2, rc 0, transno 17179873214 00000100:00100000:2.0:1746129755.551351:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053346304:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129755.551394:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053347840:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129755.551423:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129755.551446:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053347840 00000100:00100000:2.0:1746129755.551451:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053347840 00000100:00100000:2.0:1746129755.551469:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11214 00000100:00100000:2.0:1746129755.551474:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3297:x1830949053347840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129755.551555:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+42:3297:x1830949053347840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (130us total) trans 17179873220 rc 0/0 00000100:00100000:2.0:1746129755.551560:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11214 00000004:00080000:2.0:1746129755.551578:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd44380/2, rc 0, transno 17179873220 00000100:00100000:2.0:1746129755.551582:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053347840:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129755.551661:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3299:x1830949053347584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1815us (3967us total) trans 21474840365 rc 0/0 00000100:00100000:2.0:1746129755.551666:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11207 00000004:00080000:1.0:1746129755.551741:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02ffb80/2, rc 0, transno 17179873215 00000100:00100000:1.0:1746129755.551745:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053346048:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129755.551755:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135d8f480/2, rc 0, transno 17179873217 00000100:00100000:1.0:1746129755.551757:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053346560:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129755.551763:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02fd180/2, rc 0, transno 17179873219 00000100:00100000:1.0:1746129755.551765:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053345920:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129755.551783:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936ddf80/2, rc 0, transno 21474840363 00000100:00100000:1.0:1746129755.551786:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053346816:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129755.551792:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f4de300/2, rc 0, transno 21474840364 00000100:00100000:1.0:1746129755.551794:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053347328:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129755.551801:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f4de680/2, rc 0, transno 21474840361 00000100:00100000:1.0:1746129755.551803:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053347200:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129755.551809:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f4df800/2, rc 0, transno 21474840362 00000100:00100000:1.0:1746129755.551811:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053347712:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129755.551825:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936dd180/2, rc 0, transno 21474840359 00000100:00100000:1.0:1746129755.551828:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053346944:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129755.551834:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f4df480/2, rc 0, transno 21474840360 00000100:00100000:1.0:1746129755.551836:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053347456:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129755.551842:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d7800/2, rc 0, transno 21474840358 00000100:00100000:1.0:1746129755.551845:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053347072:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129755.551870:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f4df100/2, rc 0, transno 21474840365 00000100:00100000:1.0:1746129755.551873:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053347584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129755.553421:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3298:x1830949053346432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 5437us (6925us total) trans 17179873221 rc 0/0 00000100:00100000:0.0:1746129755.553430:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11203 00000004:00080000:1.0:1746129755.553506:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135d8ca80/2, rc 0, transno 17179873221 00000100:00100000:1.0:1746129755.553511:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053346432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129755.557399:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936de300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053345664:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129755.557438:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.557537:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052293120 00000100:00100000:3.0:1746129755.557542:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052293120 00000100:00100000:3.0:1746129755.557691:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3913 00000100:00100000:3.0:1746129755.557697:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28714:x1830949052293120:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:3.0:1746129755.557929:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28714:x1830949052293120:12345-192.168.204.31@tcp:49:cat.0 Request processed in 231us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129755.557935:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3913 00000100:00100000:1.0:1746129755.562496:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053345536:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129755.562536:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6f400/0x48868a4e4394a010 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc16 expref: 10 pid: 14315 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746129755.562552:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e200/0x48868a4e4394a017 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc16 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.562579:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6e200, rc 0) 00000100:00100000:1.0:1746129755.562616:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28710:x1830949052292352:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 81596us (87876us total) trans 8589943727 rc 0/0 00000100:00100000:1.0:1746129755.562623:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9934 00000100:00100000:0.0:1746129755.563359:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.563395:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.563514:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052293248 00000100:00100000:3.0:1746129755.563521:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052293248 00000100:00100000:3.0:1746129755.563599:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3914 00000100:00100000:3.0:1746129755.563605:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28715:x1830949052293248:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:3.0:1746129755.564610:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28715:x1830949052293248:12345-192.168.204.31@tcp:49:cat.0 Request processed in 1004us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129755.564616:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3914 00000100:00100000:1.0:1746129755.565113:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052293376 00000100:00100000:1.0:1746129755.565119:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052293376 00000100:00100000:1.0:1746129755.565145:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9937 00000100:00100000:1.0:1746129755.565149:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28711:x1830949052293376:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129755.565159:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129755.565172:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e800/0x48868a4e4394a02c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fc32 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.565208:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e800/0x48868a4e4394a02c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc32 expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.565218:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e800/0x48868a4e4394a02c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc32 expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.565230:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129755.565232:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129755.565234:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6e800, rc 0) 00000100:00100000:1.0:1746129755.565257:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28711:x1830949052293376:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 107us (1861us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129755.565262:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9937 00000100:00100000:2.0:1746129755.580047:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.580129:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.580187:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052293632 00000100:00100000:0.0:1746129755.580195:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052293632 00002000:00100000:0.0:1746129755.580232:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009fd44700 x1830949052293632/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129755.580240:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd44700 with x1830949052293632 ext(1048576->2097151) 00002000:00010000:0.0:1746129755.580245:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd44700 00000100:00100000:0.0:1746129755.580262:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4187 00000100:00100000:0.0:1746129755.580269:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052293632:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129755.580424:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052293760 00000100:00100000:1.0:1746129755.580428:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052293760 00000100:00100000:1.0:1746129755.580451:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11215 00000100:00100000:1.0:1746129755.580455:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28710:x1830949052293760:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129755.580466:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129755.580480:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ee00/0x48868a4e4394a033 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fc39 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.580498:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801305e2a00/0x48868a4e43949f1b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbb4 expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129755.580504:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129755.580506:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129755.580509:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ee00/0x48868a4e4394a033 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2482176->3145727] (req 2482176->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc39 expref: 13 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.580530:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801305e2a00/0x48868a4e43949f1b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbb4 expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129755.580538:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801305e2a00/0x48868a4e43949f1b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbb4 expref: 11 pid: 10930 timeout: 801 lvb_type: 1 00000100:00100000:1.0:1746129755.580547:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053347968:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129755.580608:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d917600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129755.582843:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.583707:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052293888 00000100:00100000:0.0:1746129755.583714:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052293888 00000100:00100000:0.0:1746129755.583752:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 575 00000100:00100000:0.0:1746129755.583758:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:1961:x1830949052293888:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129755.583768:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129755.583787:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e800/0x48868a4e4394a02c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc32 expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129755.583801:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129755.583804:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129755.583843:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:1961:x1830949052293888:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 84us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129755.583873:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 575 00000100:00100000:3.0:1746129755.587690:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129755.588587:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053347968:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129755.588609:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ee00/0x48868a4e4394a033 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2482176->3145727] (req 2482176->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc39 expref: 13 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.588623:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6ee00, rc 0) 00000100:00100000:1.0:1746129755.588661:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28710:x1830949052293760:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 8204us (8531us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129755.588670:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11215 00000100:00100000:2.0:1746129755.588764:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052294016 00000100:00100000:2.0:1746129755.588770:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052294016 00010000:00010000:2.0:1746129755.588793:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801305e2a00/0x48868a4e43949f1b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbb4 expref: 12 pid: 10930 timeout: 801 lvb_type: 1 00000100:00100000:2.0:1746129755.588812:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5396 00000100:00100000:2.0:1746129755.588818:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949052294016:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129755.588829:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129755.588864:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801305e2a00/0x48868a4e43949f1b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbb4 expref: 12 pid: 10930 timeout: 801 lvb_type: 1 00010000:00010000:2.0:1746129755.588873:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801305e2a00/0x48868a4e43949f1b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbb4 expref: 12 pid: 10930 timeout: 801 lvb_type: 1 00010000:00010000:2.0:1746129755.588893:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801305e2a00/0x48868a4e43949f1b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbb4 expref: 12 pid: 10930 timeout: 801 lvb_type: 1 00010000:00010000:2.0:1746129755.588906:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129755.588907:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129755.588913:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ee00/0x48868a4e4394a033 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc39 expref: 12 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.588919:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ee00/0x48868a4e4394a033 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc39 expref: 12 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.588944:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ee00/0x48868a4e4394a033 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc39 expref: 12 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129755.588955:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053348096:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129755.589037:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129755.595218:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052293632:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14942us (15171us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129755.595229:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4187 00002000:00100000:0.0:1746129755.595239:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009fd44700 x1830949052293632/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/440 e 0 to 0 dl 1746129766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129755.595247:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd44700 with x1830949052293632 ext(1048576->2097151) 00002000:00010000:0.0:1746129755.595251:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd44700 00000100:00100000:0.0:1746129755.595300:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.595402:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129755.599971:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052294400 00000100:00100000:1.0:1746129755.599980:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052294400 00000100:00100000:3.0:1746129755.600014:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053348096:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129755.600015:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11216 00000100:00100000:1.0:1746129755.600021:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:28711:x1830949052294400:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129755.600036:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129755.600036:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129755.600049:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f87da00/0x48868a4e4394a03a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fc40 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.600072:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e43949eff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbad expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129755.600075:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052294016:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 11257us (12391us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129755.600079:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129755.600080:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129755.600083:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87da00/0x48868a4e4394a03a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1773568->2097151] (req 1773568->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc40 expref: 27 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129755.600087:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5396 00010000:00010000:1.0:1746129755.600105:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e43949eff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbad expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129755.600115:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e43949eff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbad expref: 10 pid: 3624 timeout: 801 lvb_type: 1 00000100:00100000:1.0:1746129755.600124:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053348224:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129755.600171:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d917600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129755.600384:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.600410:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.600426:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052294272 00000100:00100000:0.0:1746129755.600429:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052294272 00002000:00100000:0.0:1746129755.600453:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009423ed80 x1830949052294272/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129755.600462:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423ed80 with x1830949052294272 ext(1048576->2097151) 00002000:00010000:0.0:1746129755.600466:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009423ed80 00000100:00100000:0.0:1746129755.600477:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052294656 00000100:00100000:0.0:1746129755.600479:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052294656 00002000:00100000:0.0:1746129755.600489:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (2482176->2486271) req@ffff88009423c700 x1830949052294656/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129755.600495:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423c700 with x1830949052294656 ext(2482176->2486271) 00002000:00010000:0.0:1746129755.600498:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009423c700 00000100:00100000:0.0:1746129755.600514:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4188 00000100:00100000:0.0:1746129755.600519:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1962:x1830949052294272:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129755.600526:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4189 00000100:00100000:3.0:1746129755.600537:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949052294656:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129755.600640:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949052294656:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 109us (257us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129755.600645:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4189 00002000:00100000:3.0:1746129755.600655:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (2482176->2486271) req@ffff88009423c700 x1830949052294656/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/4536 e 0 to 0 dl 1746129766 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129755.600661:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423c700 with x1830949052294656 ext(2482176->2486271) 00002000:00010000:3.0:1746129755.600663:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009423c700 00000100:00100000:1.0:1746129755.600833:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052294784 00000100:00100000:1.0:1746129755.600837:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052294784 00000100:00100000:1.0:1746129755.600874:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11217 00000100:00100000:1.0:1746129755.600879:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28714:x1830949052294784:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129755.600885:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129755.600892:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ea00/0x48868a4e4394a041 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fc47 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.600903:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129755.600906:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f87da00/0x48868a4e4394a03a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1773568->2097151] (req 1773568->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc40 expref: 27 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.600911:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129755.600914:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ea00/0x48868a4e4394a041 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc47 expref: 14 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.600930:0:20441:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f87da00/0x48868a4e4394a03a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1773568->2097151] (req 1773568->2097151) gid 0 flags: 0x60000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc40 expref: 27 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.600938:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ea00/0x48868a4e4394a041 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc47 expref: 14 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.600945:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6ea00, rc 0) 00000100:00100000:1.0:1746129755.600964:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28714:x1830949052294784:12345-192.168.204.31@tcp:101:cat.0 Request processed in 85us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129755.600968:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11217 00000100:00100000:1.0:1746129755.609343:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053348224:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129755.609370:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f87da00/0x48868a4e4394a03a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1773568->2097151] (req 1773568->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc40 expref: 27 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.609386:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f87da00, rc 0) 00000100:00100000:1.0:1746129755.609451:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:28711:x1830949052294400:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 9428us (14046us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129755.609458:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11216 00000100:00100000:0.0:1746129755.610783:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.612909:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052294912 00000100:00100000:3.0:1746129755.612920:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052294912 00010000:00010000:3.0:1746129755.612957:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e43949eff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbad expref: 11 pid: 3624 timeout: 801 lvb_type: 1 00000100:00100000:3.0:1746129755.612990:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5397 00000100:00100000:3.0:1746129755.612997:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052294912:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129755.613008:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129755.613027:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e43949eff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbad expref: 11 pid: 3624 timeout: 801 lvb_type: 1 00010000:00010000:3.0:1746129755.613037:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e43949eff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbad expref: 11 pid: 3624 timeout: 801 lvb_type: 1 00010000:00010000:3.0:1746129755.613055:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6f600/0x48868a4e43949eff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbad expref: 11 pid: 3624 timeout: 801 lvb_type: 1 00010000:00010000:3.0:1746129755.613459:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129755.613461:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129755.613468:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f87da00/0x48868a4e4394a03a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc40 expref: 26 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.613475:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87da00/0x48868a4e4394a03a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc40 expref: 26 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.613505:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f87da00/0x48868a4e4394a03a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc40 expref: 26 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.613515:0:10979:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f87da00/0x48868a4e4394a03a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc40 expref: 26 pid: 10930 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746129755.613529:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130506300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053348480:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129755.613616:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a260c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129755.614533:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.616310:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130506300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053348480:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129755.616340:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129755.616379:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052294912:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3382us (5598us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129755.616389:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5397 00000100:00100000:0.0:1746129755.616736:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.619005:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052295296 00000100:00100000:3.0:1746129755.619016:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052295296 00002000:00100000:3.0:1746129755.619054:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1773568->1777663) req@ffff88009423e300 x1830949052295296/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129755.619063:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423e300 with x1830949052295296 ext(1773568->1777663) 00010000:00010000:3.0:1746129755.619071:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f87da00/0x48868a4e4394a03a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc40 expref: 27 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746129755.619084:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f87da00/0x48868a4e4394a03a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc40 expref: 27 pid: 10930 timeout: 801 lvb_type: 0 00002000:00010000:3.0:1746129755.619091:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009423e300 00000100:00100000:3.0:1746129755.619115:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 620 00000100:00100000:3.0:1746129755.619122:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949052295296:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129755.619365:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052295040 00000100:00100000:1.0:1746129755.619369:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052295040 00000100:00100000:1.0:1746129755.619391:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11218 00000100:00100000:1.0:1746129755.619396:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28710:x1830949052295040:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129755.619405:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129755.619418:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f400/0x48868a4e4394a048 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fc4e expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.619437:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4a00/0x48868a4e43949f14 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbbb expref: 11 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129755.619443:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129755.619444:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129755.619447:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f400/0x48868a4e4394a048 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->2138111] (req 2097152->2138111) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc4e expref: 10 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.619470:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4a00/0x48868a4e43949f14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbbb expref: 11 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129755.619479:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4a00/0x48868a4e43949f14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbbb expref: 11 pid: 7976 timeout: 801 lvb_type: 1 00000100:00100000:1.0:1746129755.619494:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053348608:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129755.619872:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949052295296:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 750us (3136us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129755.619919:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d917600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129755.619920:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 620 00002000:00100000:3.0:1746129755.619926:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1773568->1777663) req@ffff88009423e300 x1830949052295296/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:496/0 lens 488/4536 e 0 to 0 dl 1746129766 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129755.619932:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423e300 with x1830949052295296 ext(1773568->1777663) 00010000:00010000:3.0:1746129755.619937:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f87da00/0x48868a4e4394a03a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc40 expref: 27 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746129755.619945:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f87da00/0x48868a4e4394a03a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc40 expref: 27 pid: 10930 timeout: 801 lvb_type: 0 00002000:00010000:3.0:1746129755.619950:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009423e300 00000100:00100000:3.0:1746129755.621564:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1962:x1830949052294272:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 21040us (26260us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129755.621572:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4188 00002000:00100000:3.0:1746129755.621578:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009423ed80 x1830949052294272/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:496/0 lens 488/440 e 0 to 0 dl 1746129766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129755.621586:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423ed80 with x1830949052294272 ext(1048576->2097151) 00002000:00010000:3.0:1746129755.621589:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009423ed80 00000100:00100000:1.0:1746129755.622716:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053348608:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129755.622739:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f400/0x48868a4e4394a048 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->2138111] (req 2097152->2138111) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc4e expref: 10 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.622753:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6f400, rc 0) 00000100:00100000:1.0:1746129755.622786:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28710:x1830949052295040:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3389us (8255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129755.622793:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11218 00000100:00100000:0.0:1746129755.627316:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.630644:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052295424 00000100:00100000:3.0:1746129755.630655:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052295424 00010000:00010000:3.0:1746129755.630694:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4a00/0x48868a4e43949f14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbbb expref: 12 pid: 7976 timeout: 801 lvb_type: 1 00000100:00100000:3.0:1746129755.630727:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5398 00000100:00100000:3.0:1746129755.630735:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+12:1964:x1830949052295424:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129755.630747:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129755.630765:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4a00/0x48868a4e43949f14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbbb expref: 12 pid: 7976 timeout: 801 lvb_type: 1 00010000:00010000:3.0:1746129755.630775:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4a00/0x48868a4e43949f14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbbb expref: 12 pid: 7976 timeout: 801 lvb_type: 1 00010000:00010000:3.0:1746129755.630795:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b22c4a00/0x48868a4e43949f14 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbbb expref: 12 pid: 7976 timeout: 801 lvb_type: 1 00010000:00010000:3.0:1746129755.630813:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129755.630815:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129755.630821:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f400/0x48868a4e4394a048 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc4e expref: 9 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.630829:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f400/0x48868a4e4394a048 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc4e expref: 9 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.630889:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f400/0x48868a4e4394a048 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc4e expref: 9 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129755.630901:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130506300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053348736:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129755.630989:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a260c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129755.631645:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.631688:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129755.631754:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052295680 00000100:00100000:1.0:1746129755.631758:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052295680 00000100:00100000:1.0:1746129755.631791:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052295808 00000100:00100000:1.0:1746129755.631793:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052295808 00000100:00100000:1.0:1746129755.631817:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11219 00000100:00100000:1.0:1746129755.631823:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:28711:x1830949052295680:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129755.631838:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129755.631843:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11220 00010000:00010000:1.0:1746129755.631865:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e4394a04f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fc55 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129755.631865:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:28715:x1830949052295808:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129755.631871:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129755.631877:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5245200/0x48868a4e4394a056 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fc5c expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.631881:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ee00/0x48868a4e4394a033 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc39 expref: 13 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.631887:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129755.631887:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129755.631888:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129755.631890:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5245200/0x48868a4e4394a056 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc5c expref: 30 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.631891:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e4394a04f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->2334719] (req 2097152->2334719) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc55 expref: 30 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129755.631899:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5245200/0x48868a4e4394a056 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc5c expref: 30 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129755.631905:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5245200, rc 0) 00010000:00010000:1.0:1746129755.631907:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ee00/0x48868a4e4394a033 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc39 expref: 13 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.631914:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ee00/0x48868a4e4394a033 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc39 expref: 13 pid: 10930 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746129755.631922:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053348864:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129755.631928:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:28715:x1830949052295808:12345-192.168.204.31@tcp:101:cat.0 Request processed in 65us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129755.631933:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11220 00000100:00100000:1.0:1746129755.631949:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d917600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129755.633539:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.633608:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052295936 00000100:00100000:3.0:1746129755.633613:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052295936 00002000:00100000:3.0:1746129755.633641:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3ea:0x0] (1773568->2097151) req@ffff88009f6a7b80 x1830949052295936/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129755.633655:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a7b80 with x1830949052295936 ext(1773568->2097151) 00010000:00010000:3.0:1746129755.633661:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f87da00/0x48868a4e4394a03a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc40 expref: 30 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746129755.633670:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f87da00/0x48868a4e4394a03a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc40 expref: 30 pid: 10930 timeout: 801 lvb_type: 0 00002000:00010000:3.0:1746129755.633676:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f6a7b80 00000100:00100000:3.0:1746129755.633691:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 621 00000100:00100000:3.0:1746129755.633696:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1963:x1830949052295936:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:1.0:1746129755.636014:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.636092:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052296064 00000100:00100000:0.0:1746129755.636096:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052296064 00002000:00100000:0.0:1746129755.636122:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2482176->3145727) req@ffff8800a5490a80 x1830949052296064/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129755.636130:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5490a80 with x1830949052296064 ext(2482176->3145727) 00010000:00010000:0.0:1746129755.636137:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ee00/0x48868a4e4394a033 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc39 expref: 14 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746129755.636146:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ee00/0x48868a4e4394a033 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc39 expref: 14 pid: 10930 timeout: 801 lvb_type: 0 00002000:00010000:0.0:1746129755.636152:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5490a80 00000100:00100000:0.0:1746129755.636167:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 622 00000100:00100000:3.0:1746129755.636171:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130506300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053348736:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129755.636172:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052296064:12345-192.168.204.31@tcp:4:multiop.0 00010000:00010000:3.0:1746129755.636185:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129755.636212:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052295424:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5478us (12809us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129755.636219:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5398 00000100:00100000:2.0:1746129755.637663:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053348864:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129755.637683:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e4394a04f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->2334719] (req 2097152->2334719) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc55 expref: 31 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.637697:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6fe00, rc 0) 00000100:00100000:2.0:1746129755.637739:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:28711:x1830949052295680:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5916us (6095us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129755.637746:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11219 00000100:00100000:1.0:1746129755.640098:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.640204:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052296320 00000100:00100000:3.0:1746129755.640211:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052296320 00002000:00100000:3.0:1746129755.640246:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2134016->2138111) req@ffff8800a5493b80 x1830949052296320/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129755.640255:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5493b80 with x1830949052296320 ext(2134016->2138111) 00002000:00010000:3.0:1746129755.640260:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5493b80 00000100:00100000:3.0:1746129755.640278:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4190 00000100:00100000:3.0:1746129755.640284:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949052296320:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129755.640430:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949052296320:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 145us (337us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129755.640435:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4190 00002000:00100000:3.0:1746129755.640440:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2134016->2138111) req@ffff8800a5493b80 x1830949052296320/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/4536 e 0 to 0 dl 1746129766 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129755.640447:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5493b80 with x1830949052296320 ext(2134016->2138111) 00002000:00010000:3.0:1746129755.640449:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5493b80 00000100:00100000:3.0:1746129755.644293:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949052295936:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 10588us (10749us total) trans 17179873222 rc 0/0 00000100:00100000:3.0:1746129755.644304:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 621 00002000:00100000:3.0:1746129755.644313:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3ea:0x0] (1773568->2097151) req@ffff88009f6a7b80 x1830949052295936/t17179873222(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:496/0 lens 488/448 e 0 to 0 dl 1746129766 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129755.644322:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a7b80 with x1830949052295936 ext(1773568->2097151) 00010000:00010000:3.0:1746129755.644341:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f87da00/0x48868a4e4394a03a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc40 expref: 31 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746129755.644353:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f87da00/0x48868a4e4394a03a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc40 expref: 31 pid: 10930 timeout: 801 lvb_type: 0 00002000:00010000:3.0:1746129755.644359:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f6a7b80 00000100:00100000:3.0:1746129755.645058:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.645081:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052296576 00000100:00100000:3.0:1746129755.645087:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052296576 00000100:00100000:3.0:1746129755.645111:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3915 00000100:00100000:3.0:1746129755.645117:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28710:x1830949052296576:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129755.645314:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28710:x1830949052296576:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 196us (257us total) trans 8589943728 rc 0/0 00000100:00100000:3.0:1746129755.645320:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3915 00000100:00100000:2.0:1746129755.653400:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.653781:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052296704 00000100:00100000:0.0:1746129755.653789:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052296704 00010000:00010000:0.0:1746129755.653821:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87da00/0x48868a4e4394a03a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc40 expref: 31 pid: 10930 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746129755.654650:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5399 00000100:00100000:1.0:1746129755.654659:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130566c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949052296704:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129755.654670:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746129755.654684:0:10980:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129755 -> 1746129756 00002000:00010000:1.0:1746129755.654687:0:10980:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129755 -> 1746129756 00010000:00010000:1.0:1746129755.654692:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f87da00/0x48868a4e4394a03a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc40 expref: 31 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.654702:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f87da00/0x48868a4e4394a03a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc40 expref: 31 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.654719:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f87da00/0x48868a4e4394a03a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc40 expref: 31 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.654740:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129755.654742:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129755.654747:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ea00/0x48868a4e4394a041 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc47 expref: 15 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.654754:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ea00/0x48868a4e4394a041 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc47 expref: 15 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.654760:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129755.654760:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129755.654763:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5245200/0x48868a4e4394a056 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc5c expref: 30 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.654768:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5245200/0x48868a4e4394a056 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc5c expref: 30 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.654791:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5245200/0x48868a4e4394a056 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc5c expref: 30 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129755.654800:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5492d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053348992:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129755.654881:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ea00/0x48868a4e4394a041 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc47 expref: 15 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129755.654887:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5492680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053349120:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129755.654903:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d917480 going to sleep for 11 seconds 00000100:00100000:3.0:1746129755.662245:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.662541:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5492d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053348992:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129755.662551:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5492680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053349120:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129755.662566:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129755.662601:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130566c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949052296704:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7943us (9207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129755.662611:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5399 00000100:00100000:3.0:1746129755.663665:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.663682:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052296960 00000100:00100000:3.0:1746129755.663687:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052296960 00002000:00100000:3.0:1746129755.663716:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880130504380 x1830949052296960/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129755.663724:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130504380 with x1830949052296960 ext(1048576->2097151) 00002000:00010000:3.0:1746129755.663728:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130504380 00000100:00100000:3.0:1746129755.663740:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052297216 00000100:00100000:3.0:1746129755.663742:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052297216 00002000:00100000:3.0:1746129755.663751:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880130504000 x1830949052297216/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129755.663757:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130504000 with x1830949052297216 ext(1048576->2097151) 00002000:00010000:3.0:1746129755.663759:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130504000 00000100:00100000:3.0:1746129755.664027:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4191 00000100:00100000:2.0:1746129755.664033:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4192 00000100:00100000:3.0:1746129755.664034:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949052296960:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129755.664038:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949052297216:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129755.671280:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052296064:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 35096us (35261us total) trans 17179873223 rc 0/0 00000100:00100000:1.0:1746129755.671292:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 622 00002000:00100000:1.0:1746129755.671303:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2482176->3145727) req@ffff8800a5490a80 x1830949052296064/t17179873223(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/448 e 0 to 0 dl 1746129766 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129755.671313:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5490a80 with x1830949052296064 ext(2482176->3145727) 00010000:00010000:1.0:1746129755.671322:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ee00/0x48868a4e4394a033 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc39 expref: 18 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746129755.671348:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ee00/0x48868a4e4394a033 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc39 expref: 18 pid: 10930 timeout: 801 lvb_type: 0 00002000:00010000:1.0:1746129755.671354:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5490a80 00000100:00100000:2.0:1746129755.680080:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949052297216:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 16034us (16410us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129755.680091:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4192 00002000:00100000:2.0:1746129755.680517:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880130504000 x1830949052297216/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/440 e 0 to 0 dl 1746129766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129755.680529:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130504000 with x1830949052297216 ext(1048576->2097151) 00002000:00010000:2.0:1746129755.680534:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130504000 00000100:00100000:0.0:1746129755.680820:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.681145:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052297344 00000100:00100000:2.0:1746129755.681151:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052297344 00010000:00010000:2.0:1746129755.681174:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ee00/0x48868a4e4394a033 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc39 expref: 16 pid: 10930 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746129755.681636:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5400 00000100:00100000:2.0:1746129755.681644:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1961:x1830949052297344:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129755.681656:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129755.681672:0:10980:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129755 -> 1746129756 00002000:00010000:2.0:1746129755.681674:0:10980:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129755 -> 1746129756 00010000:00010000:2.0:1746129755.681679:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ee00/0x48868a4e4394a033 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc39 expref: 16 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746129755.681691:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ee00/0x48868a4e4394a033 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc39 expref: 16 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746129755.681710:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ee00/0x48868a4e4394a033 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc39 expref: 16 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746129755.681726:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129755.681727:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129755.681733:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e4394a04f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc55 expref: 31 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.681740:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e4394a04f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc55 expref: 31 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.681766:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e4394a04f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc55 expref: 31 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129755.681775:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053349248:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129755.681830:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129755.683175:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949052296960:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 19136us (20933us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129755.683183:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4191 00002000:00100000:3.0:1746129755.683190:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880130504380 x1830949052296960/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:496/0 lens 488/440 e 0 to 0 dl 1746129766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129755.683203:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130504380 with x1830949052296960 ext(1048576->2097151) 00002000:00010000:3.0:1746129755.683207:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130504380 00000100:00100000:0.0:1746129755.686010:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.686171:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052297600 00000100:00100000:3.0:1746129755.686179:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052297600 00002000:00100000:3.0:1746129755.686218:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (2330624->2334719) req@ffff88009f6a6680 x1830949052297600/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129755.686227:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a6680 with x1830949052297600 ext(2330624->2334719) 00002000:00010000:3.0:1746129755.686231:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a6680 00000100:00100000:3.0:1746129755.686258:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4193 00000100:00100000:3.0:1746129755.686265:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949052297600:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129755.687021:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053349248:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129755.687022:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949052297600:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 756us (1018us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129755.687028:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4193 00002000:00100000:3.0:1746129755.687034:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (2330624->2334719) req@ffff88009f6a6680 x1830949052297600/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:496/0 lens 488/4536 e 0 to 0 dl 1746129766 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129755.687041:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a6680 with x1830949052297600 ext(2330624->2334719) 00002000:00010000:3.0:1746129755.687044:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a6680 00010000:00010000:2.0:1746129755.687761:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129755.687799:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1961:x1830949052297344:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6154us (6977us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129755.687806:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5400 00000100:00100000:0.0:1746129755.693477:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.693956:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052297728 00000100:00100000:2.0:1746129755.693965:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052297728 00000100:00100000:2.0:1746129755.694016:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11221 00000100:00100000:2.0:1746129755.694023:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28714:x1830949052297728:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129755.694039:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129755.694053:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbb7600/0x48868a4e4394a05d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fc63 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.694077:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e4394a04f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc55 expref: 29 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.694083:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129755.694085:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129755.694088:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb7600/0x48868a4e4394a05d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc63 expref: 16 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.694111:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e4394a04f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc55 expref: 29 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.694123:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e4394a04f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc55 expref: 29 pid: 10930 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746129755.694132:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053349376:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129755.694210:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129755.694755:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.695346:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052297984 00000100:00100000:3.0:1746129755.695351:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052297984 00002000:00100000:3.0:1746129755.695380:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (2334720->3145727) req@ffff88009f6a4a80 x1830949052297984/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129755.695388:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a4a80 with x1830949052297984 ext(2334720->3145727) 00010000:00010000:3.0:1746129755.695395:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e4394a04f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc55 expref: 30 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746129755.695406:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e4394a04f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc55 expref: 30 pid: 10930 timeout: 801 lvb_type: 0 00002000:00010000:3.0:1746129755.695413:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f6a4a80 00000100:00100000:3.0:1746129755.695436:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 623 00000100:00100000:3.0:1746129755.695442:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949052297984:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129755.696601:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053349376:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129755.696620:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb7600/0x48868a4e4394a05d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc63 expref: 16 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.696632:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb7600, rc 0) 00000100:00100000:3.0:1746129755.696667:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28714:x1830949052297728:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2644us (3197us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129755.696673:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11221 00000100:00100000:0.0:1746129755.698136:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.698183:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052298112 00000100:00100000:2.0:1746129755.698189:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052298112 00002000:00100000:2.0:1746129755.698214:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->2334719) req@ffff88009f6a7800 x1830949052298112/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129755.698220:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a7800 with x1830949052298112 ext(2097152->2334719) 00010000:00010000:2.0:1746129755.698225:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e4394a04f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc55 expref: 32 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746129755.698233:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e4394a04f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc55 expref: 32 pid: 10930 timeout: 801 lvb_type: 0 00002000:00010000:2.0:1746129755.698238:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f6a7800 00000100:00100000:2.0:1746129755.698259:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 624 00000100:00100000:2.0:1746129755.698265:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949052298112:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129755.703423:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949052297984:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7972us (8660us total) trans 0 rc 811008/811008 00000100:00100000:3.0:1746129755.703433:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 623 00002000:00100000:3.0:1746129755.703443:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (2334720->3145727) req@ffff88009f6a4a80 x1830949052297984/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:496/0 lens 488/440 e 0 to 0 dl 1746129766 ref 1 fl Complete:H/200/0 rc 811008/811008 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129755.703451:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a4a80 with x1830949052297984 ext(2334720->3145727) 00010000:00010000:3.0:1746129755.703460:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e4394a04f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc55 expref: 32 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746129755.703476:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e4394a04f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc55 expref: 32 pid: 10930 timeout: 801 lvb_type: 0 00002000:00010000:3.0:1746129755.703483:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f6a4a80 00000100:00100000:2.0:1746129755.705392:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949052298112:12345-192.168.204.31@tcp:4:cat.0 Request processed in 7119us (7253us total) trans 17179873224 rc 0/0 00000100:00100000:2.0:1746129755.705401:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 624 00002000:00100000:2.0:1746129755.705409:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->2334719) req@ffff88009f6a7800 x1830949052298112/t17179873224(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:496/0 lens 488/448 e 0 to 0 dl 1746129766 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129755.705416:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a7800 with x1830949052298112 ext(2097152->2334719) 00010000:00010000:2.0:1746129755.705424:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e4394a04f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc55 expref: 32 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746129755.705436:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e4394a04f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc55 expref: 32 pid: 10930 timeout: 801 lvb_type: 0 00002000:00010000:2.0:1746129755.705442:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f6a7800 00000100:00100000:0.0:1746129755.707660:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.707875:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052298240 00000100:00100000:3.0:1746129755.707883:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052298240 00000100:00100000:3.0:1746129755.707916:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11222 00000100:00100000:3.0:1746129755.707923:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:28715:x1830949052298240:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129755.707937:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129755.707952:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef3a00/0x48868a4e4394a064 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fc6a expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.707976:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f400/0x48868a4e4394a048 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc4e expref: 9 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.707982:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129755.707984:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129755.707987:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef3a00/0x48868a4e4394a064 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc6a expref: 17 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.708015:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f400/0x48868a4e4394a048 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc4e expref: 9 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.708025:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f400/0x48868a4e4394a048 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc4e expref: 9 pid: 10930 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746129755.708040:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053349504:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129755.708122:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129755.708656:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.708694:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052298368 00000100:00100000:3.0:1746129755.708701:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052298368 00010000:00010000:3.0:1746129755.708717:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e4394a04f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc55 expref: 32 pid: 10930 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746129755.709657:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5401 00000100:00100000:3.0:1746129755.709664:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949052298368:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129755.709674:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129755.709693:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e4394a04f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc55 expref: 32 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746129755.709703:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e4394a04f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc55 expref: 32 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746129755.709720:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fe00/0x48868a4e4394a04f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc55 expref: 32 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746129755.709737:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129755.709738:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129755.709743:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb7600/0x48868a4e4394a05d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc63 expref: 15 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.709750:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb7600/0x48868a4e4394a05d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc63 expref: 15 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.709771:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbb7600/0x48868a4e4394a05d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc63 expref: 15 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129755.709780:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130504e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053349632:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129755.710199:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129755.714221:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.714292:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052298496 00000100:00100000:2.0:1746129755.714299:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052298496 00000100:00100000:3.0:1746129755.714376:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130504e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053349632:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129755.714391:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129755.714436:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1964:x1830949052298368:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4772us (5780us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129755.714445:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5401 00000100:00100000:3.0:1746129755.714478:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053349504:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129755.714494:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef3a00/0x48868a4e4394a064 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc6a expref: 17 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.714508:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ef3a00, rc 0) 00000100:00100000:3.0:1746129755.714525:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:28715:x1830949052298240:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6603us (6872us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129755.714531:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11222 00002000:00100000:2.0:1746129755.714550:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->2138111) req@ffff8800a5490000 x1830949052298496/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129755.714559:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5490000 with x1830949052298496 ext(2097152->2138111) 00010000:00010000:2.0:1746129755.714566:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f400/0x48868a4e4394a048 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc4e expref: 10 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746129755.714576:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f400/0x48868a4e4394a048 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc4e expref: 10 pid: 10930 timeout: 801 lvb_type: 0 00002000:00010000:2.0:1746129755.714582:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5490000 00000100:00100000:2.0:1746129755.714595:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 625 00000100:00100000:2.0:1746129755.714601:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949052298496:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129755.717345:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052298496:12345-192.168.204.31@tcp:4:cat.0 Request processed in 2737us (3124us total) trans 21474840366 rc 0/0 00000100:00100000:2.0:1746129755.717354:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 625 00002000:00100000:2.0:1746129755.717362:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->2138111) req@ffff8800a5490000 x1830949052298496/t21474840366(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/448 e 0 to 0 dl 1746129766 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129755.717370:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5490000 with x1830949052298496 ext(2097152->2138111) 00010000:00010000:2.0:1746129755.717377:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f400/0x48868a4e4394a048 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc4e expref: 12 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746129755.717394:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f400/0x48868a4e4394a048 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc4e expref: 12 pid: 10930 timeout: 801 lvb_type: 0 00002000:00010000:2.0:1746129755.717400:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5490000 00000100:00100000:0.0:1746129755.719033:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.719050:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.719078:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.719442:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.719566:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052299008 00000100:00100000:2.0:1746129755.719573:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052299008 00002000:00100000:2.0:1746129755.719608:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3186688->4194303) req@ffff88009f6a5180 x1830949052299008/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129755.719617:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a5180 with x1830949052299008 ext(3186688->4194303) 00010000:00010000:2.0:1746129755.719624:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f400/0x48868a4e4394a048 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc4e expref: 12 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746129755.719635:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f400/0x48868a4e4394a048 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc4e expref: 12 pid: 10930 timeout: 801 lvb_type: 0 00002000:00010000:2.0:1746129755.719642:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f6a5180 00000100:00100000:2.0:1746129755.719654:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052298880 00000100:00100000:2.0:1746129755.719656:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052298880 00002000:00100000:2.0:1746129755.719665:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2138112->3186687) req@ffff88009f6a4e00 x1830949052298880/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129755.719671:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a4e00 with x1830949052298880 ext(2138112->3186687) 00010000:00010000:2.0:1746129755.719675:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f400/0x48868a4e4394a048 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc4e expref: 13 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746129755.719682:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f400/0x48868a4e4394a048 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc4e expref: 13 pid: 10930 timeout: 801 lvb_type: 0 00002000:00010000:2.0:1746129755.719688:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f6a4e00 00000100:00100000:2.0:1746129755.719695:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052299136 00000100:00100000:2.0:1746129755.719697:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052299136 00002000:00100000:2.0:1746129755.719707:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009f6a4700 x1830949052299136/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129755.719713:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a4700 with x1830949052299136 ext(2097152->3145727) 00002000:00010000:2.0:1746129755.719716:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a4700 00000100:00100000:2.0:1746129755.719722:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052299264 00000100:00100000:2.0:1746129755.719724:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052299264 00002000:00100000:2.0:1746129755.719732:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009f6a4380 x1830949052299264/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129755.719738:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a4380 with x1830949052299264 ext(3145728->4194303) 00002000:00010000:2.0:1746129755.719740:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a4380 00000100:00100000:2.0:1746129755.719754:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 626 00000100:00100000:2.0:1746129755.719759:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949052299008:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129755.720877:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 627 00000100:00100000:2.0:1746129755.720884:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949052298880:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129755.721439:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4194 00000100:00100000:1.0:1746129755.721448:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949052299136:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129755.723667:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4195 00000100:00100000:1.0:1746129755.723679:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949052299264:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129755.735576:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949052299008:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15807us (16538us total) trans 0 rc 1007616/1007616 00000100:00100000:2.0:1746129755.735588:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 626 00002000:00100000:2.0:1746129755.735600:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3186688->4194303) req@ffff88009f6a5180 x1830949052299008/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/440 e 0 to 0 dl 1746129766 ref 1 fl Complete:H/200/0 rc 1007616/1007616 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129755.735614:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a5180 with x1830949052299008 ext(3186688->4194303) 00010000:00010000:2.0:1746129755.735623:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f400/0x48868a4e4394a048 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc4e expref: 14 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746129755.735638:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f400/0x48868a4e4394a048 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc4e expref: 14 pid: 10930 timeout: 801 lvb_type: 0 00002000:00010000:2.0:1746129755.735645:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f6a5180 00000100:00100000:1.0:1746129755.739977:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949052299136:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18523us (20890us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129755.739987:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4194 00002000:00100000:1.0:1746129755.739997:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009f6a4700 x1830949052299136/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/440 e 0 to 0 dl 1746129766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129755.740011:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a4700 with x1830949052299136 ext(2097152->3145727) 00002000:00010000:1.0:1746129755.740016:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a4700 00000100:00100000:0.0:1746129755.744771:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949052298880:12345-192.168.204.31@tcp:3:cat.0 Request processed in 23878us (25710us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129755.744783:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 627 00002000:00100000:0.0:1746129755.744793:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (2138112->3186687) req@ffff88009f6a4e00 x1830949052298880/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/440 e 0 to 0 dl 1746129766 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129755.744803:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a4e00 with x1830949052298880 ext(2138112->3186687) 00010000:00010000:0.0:1746129755.744815:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f400/0x48868a4e4394a048 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc4e expref: 12 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746129755.744828:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f400/0x48868a4e4394a048 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc4e expref: 12 pid: 10930 timeout: 801 lvb_type: 0 00002000:00010000:0.0:1746129755.746079:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f6a4e00 00000100:00100000:1.0:1746129755.747556:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949052299264:12345-192.168.204.31@tcp:3:cat.0 Request processed in 23874us (28109us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129755.747565:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4195 00002000:00100000:1.0:1746129755.747573:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009f6a4380 x1830949052299264/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/440 e 0 to 0 dl 1746129766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129755.747581:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a4380 with x1830949052299264 ext(3145728->4194303) 00002000:00010000:1.0:1746129755.747585:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a4380 00000100:00100000:0.0:1746129755.751350:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.751471:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052299776 00000100:00100000:3.0:1746129755.751479:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052299776 00000100:00100000:3.0:1746129755.751520:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11223 00000100:00100000:3.0:1746129755.751528:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28714:x1830949052299776:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129755.751542:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129755.751556:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7400/0x48868a4e4394a06b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fc71 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.751578:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129755.751582:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7400/0x48868a4e4394a06b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc71 expref: 13 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.751591:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7400/0x48868a4e4394a06b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc71 expref: 13 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.751600:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb7400, rc 0) 00000100:00100000:3.0:1746129755.751638:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28714:x1830949052299776:12345-192.168.204.31@tcp:101:cat.0 Request processed in 111us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129755.751643:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11223 00000100:00100000:2.0:1746129755.752036:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.752711:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052299648 00000100:00100000:3.0:1746129755.752716:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052299648 00010000:00010000:3.0:1746129755.752732:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f400/0x48868a4e4394a048 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc4e expref: 13 pid: 10930 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746129755.752763:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5402 00000100:00100000:3.0:1746129755.752769:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949052299648:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129755.752777:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746129755.752790:0:10980:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129755 -> 1746129756 00002000:00010000:3.0:1746129755.752793:0:10980:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129755 -> 1746129756 00010000:00010000:3.0:1746129755.752798:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f400/0x48868a4e4394a048 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc4e expref: 13 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746129755.752812:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f400/0x48868a4e4394a048 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc4e expref: 13 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746129755.752827:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f400/0x48868a4e4394a048 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc4e expref: 13 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746129755.752867:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129755.752868:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129755.752874:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef3a00/0x48868a4e4394a064 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc6a expref: 16 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.752880:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef3a00/0x48868a4e4394a064 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc6a expref: 16 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.752887:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129755.752888:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129755.752890:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7400/0x48868a4e4394a06b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc71 expref: 12 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.752896:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7400/0x48868a4e4394a06b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc71 expref: 12 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.752918:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7400/0x48868a4e4394a06b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc71 expref: 12 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129755.752928:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053349760:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129755.754083:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef3a00/0x48868a4e4394a064 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc6a expref: 16 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129755.754096:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130504e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053349888:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129755.754316:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129755.759206:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053349760:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129755.759217:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130504e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053349888:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129755.759234:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129755.759269:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052299648:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6499us (7233us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129755.759278:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5402 00000100:00100000:0.0:1746129755.768425:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.768462:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.769080:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.769111:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052300032 00000100:00100000:0.0:1746129755.769118:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052300032 00002000:00100000:0.0:1746129755.769156:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f6a6300 x1830949052300032/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129755.769166:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a6300 with x1830949052300032 ext(2097152->3145727) 00002000:00010000:0.0:1746129755.769171:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6a6300 00000100:00100000:0.0:1746129755.769197:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052300160 00000100:00100000:0.0:1746129755.769200:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052300160 00002000:00100000:0.0:1746129755.769212:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009f6a6a00 x1830949052300160/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129755.769218:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a6a00 with x1830949052300160 ext(3145728->4194303) 00002000:00010000:0.0:1746129755.769220:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6a6a00 00000100:00100000:0.0:1746129755.769228:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052300544 00000100:00100000:0.0:1746129755.769229:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052300544 00002000:00100000:0.0:1746129755.769239:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f6a7100 x1830949052300544/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129755.769244:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a7100 with x1830949052300544 ext(2097152->3145727) 00002000:00010000:0.0:1746129755.769246:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6a7100 00000100:00100000:0.0:1746129755.769815:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4196 00000100:00100000:0.0:1746129755.769824:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949052300032:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129755.770823:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4197 00000100:00100000:1.0:1746129755.770832:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052300160:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129755.771796:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4198 00000100:00100000:2.0:1746129755.771806:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949052300544:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129755.795602:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052300032:12345-192.168.204.31@tcp:3:cat.0 Request processed in 25769us (27175us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129755.795614:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4196 00002000:00100000:3.0:1746129755.795624:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f6a6300 x1830949052300032/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/440 e 0 to 0 dl 1746129766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129755.796452:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a6300 with x1830949052300032 ext(2097152->3145727) 00002000:00010000:3.0:1746129755.796457:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6a6300 00000100:00100000:2.0:1746129755.803311:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949052300544:12345-192.168.204.31@tcp:3:cat.0 Request processed in 31500us (34224us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129755.803330:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4198 00002000:00100000:2.0:1746129755.803339:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f6a7100 x1830949052300544/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:496/0 lens 488/440 e 0 to 0 dl 1746129766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129755.803348:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a7100 with x1830949052300544 ext(2097152->3145727) 00002000:00010000:2.0:1746129755.803353:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6a7100 00000100:00100000:1.0:1746129755.803902:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052300160:12345-192.168.204.31@tcp:3:cat.0 Request processed in 33069us (35437us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129755.803910:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4197 00002000:00100000:1.0:1746129755.803924:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009f6a6a00 x1830949052300160/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/440 e 0 to 0 dl 1746129766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129755.803930:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a6a00 with x1830949052300160 ext(3145728->4194303) 00002000:00010000:1.0:1746129755.803934:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6a6a00 00000100:00100000:0.0:1746129755.810208:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.810428:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.810500:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052300672 00000100:00100000:2.0:1746129755.810508:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052300672 00000100:00100000:2.0:1746129755.810557:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11224 00000100:00100000:2.0:1746129755.810565:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:28715:x1830949052300672:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129755.810584:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129755.810598:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f87ae00/0x48868a4e4394a072 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fc78 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.810617:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129755.810619:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129755.810626:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87ae00/0x48868a4e4394a072 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc78 expref: 32 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.810637:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f87ae00/0x48868a4e4394a072 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc78 expref: 32 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.810646:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f87ae00, rc 0) 00000100:00100000:2.0:1746129755.810679:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:28715:x1830949052300672:12345-192.168.204.31@tcp:101:cat.0 Request processed in 115us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129755.810684:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11224 00000100:00100000:1.0:1746129755.811246:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052300928 00000100:00100000:1.0:1746129755.811250:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052300928 00002000:00100000:1.0:1746129755.811274:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009423f100 x1830949052300928/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129755.811282:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423f100 with x1830949052300928 ext(4194304->4964351) 00002000:00010000:1.0:1746129755.811286:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009423f100 00000100:00100000:1.0:1746129755.811311:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4199 00000100:00100000:1.0:1746129755.811317:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1961:x1830949052300928:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129755.817518:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129755.818260:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.818283:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052301312 00000100:00100000:2.0:1746129755.818291:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052301312 00002000:00100000:2.0:1746129755.818338:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009423dc00 x1830949052301312/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129755.818347:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423dc00 with x1830949052301312 ext(3145728->4194303) 00002000:00010000:2.0:1746129755.818351:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009423dc00 00000100:00100000:2.0:1746129755.819086:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052301440 00000100:00100000:2.0:1746129755.819090:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052301440 00002000:00100000:2.0:1746129755.819106:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800a5493100 x1830949052301440/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129755.819112:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5493100 with x1830949052301440 ext(3145728->4194303) 00002000:00010000:2.0:1746129755.819115:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5493100 00000100:00100000:2.0:1746129755.819128:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4200 00000100:00100000:2.0:1746129755.819135:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1963:x1830949052301312:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129755.820150:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4201 00000100:00100000:3.0:1746129755.820161:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1963:x1830949052301440:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129755.824572:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1961:x1830949052300928:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13248us (14137us total) trans 0 rc 770048/770048 00000100:00100000:0.0:1746129755.824583:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4199 00002000:00100000:0.0:1746129755.824593:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009423f100 x1830949052300928/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/440 e 0 to 0 dl 1746129766 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129755.824608:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423f100 with x1830949052300928 ext(4194304->4964351) 00002000:00010000:0.0:1746129755.824613:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009423f100 00000100:00100000:2.0:1746129755.835311:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1963:x1830949052301312:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16168us (17793us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129755.835330:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4200 00002000:00100000:2.0:1746129755.835341:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009423dc00 x1830949052301312/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:496/0 lens 488/440 e 0 to 0 dl 1746129766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129755.835349:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423dc00 with x1830949052301312 ext(3145728->4194303) 00002000:00010000:2.0:1746129755.835354:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009423dc00 00000100:00100000:3.0:1746129755.843383:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1963:x1830949052301440:12345-192.168.204.31@tcp:3:cat.0 Request processed in 23217us (25113us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129755.843394:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4201 00002000:00100000:3.0:1746129755.843404:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800a5493100 x1830949052301440/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:496/0 lens 488/440 e 0 to 0 dl 1746129766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129755.843412:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5493100 with x1830949052301440 ext(3145728->4194303) 00002000:00010000:3.0:1746129755.843418:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5493100 00000100:00100000:0.0:1746129755.857219:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.857352:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052301696 00000100:00100000:3.0:1746129755.857360:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052301696 00002000:00100000:3.0:1746129755.857397:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009423e680 x1830949052301696/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129755.857406:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423e680 with x1830949052301696 ext(4194304->4964351) 00002000:00010000:3.0:1746129755.857411:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009423e680 00000100:00100000:2.0:1746129755.858886:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4202 00000100:00100000:2.0:1746129755.858898:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949052301696:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129755.868358:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949052301696:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9454us (11137us total) trans 0 rc 770048/770048 00000100:00100000:2.0:1746129755.868368:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4202 00002000:00100000:2.0:1746129755.868378:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009423e680 x1830949052301696/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:496/0 lens 488/440 e 0 to 0 dl 1746129766 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129755.868386:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423e680 with x1830949052301696 ext(4194304->4964351) 00002000:00010000:2.0:1746129755.868391:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009423e680 00000100:00100000:0.0:1746129755.876210:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.877019:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052301952 00000100:00100000:2.0:1746129755.877028:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052301952 00000100:00100000:2.0:1746129755.877612:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3916 00000100:00100000:2.0:1746129755.877620:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d63c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28715:x1830949052301952:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129755.878288:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d63c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28715:x1830949052301952:12345-192.168.204.31@tcp:35:cat.0 Request processed in 668us (2085us total) trans 8589943729 rc 0/0 00000100:00100000:2.0:1746129755.878296:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3916 00000100:00100000:0.0:1746129755.911212:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.912593:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052302208 00000100:00100000:3.0:1746129755.912603:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052302208 00000100:00100000:3.0:1746129755.912660:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9938 00000100:00100000:3.0:1746129755.912668:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28722:x1830949052302208:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129755.912689:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129755.912704:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef2a00/0x48868a4e4394a079 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fc7f expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.912791:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244200/0x48868a4e4394a080 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.912802:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244200/0x48868a4e4394a080 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.912810:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244200/0x48868a4e4394a080 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.912822:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244000/0x48868a4e4394a087 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.912831:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244000/0x48868a4e4394a087 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.912836:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244000/0x48868a4e4394a087 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.912950:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e4394a08e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.912971:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e4394a08e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.912977:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e4394a08e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129755.912984:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129755.913045:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244200/0x48868a4e4394a080 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.913061:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244200/0x48868a4e4394a080 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.913066:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244200/0x48868a4e4394a080 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.913071:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b5244200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129755.913074:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244200/0x48868a4e4394a080 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.913079:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244200/0x48868a4e4394a080 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.913087:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129755.913090:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129755.913094:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244200/0x48868a4e4394a080 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.913098:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244200/0x48868a4e4394a080 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.913120:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244000/0x48868a4e4394a087 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.913125:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244000/0x48868a4e4394a087 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.913129:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244000/0x48868a4e4394a087 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.913133:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b5244000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129755.913135:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244000/0x48868a4e4394a087 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.913139:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244000/0x48868a4e4394a087 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.913145:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094266800) 00010000:00010000:3.0:1746129755.913146:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129755.913148:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244000/0x48868a4e4394a087 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.913151:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244000/0x48868a4e4394a087 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129755.913183:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef2a00/0x48868a4e4394a079 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc7f expref: 13 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.913198:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e4394a08e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc7f expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.913204:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129755.913206:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129755.913208:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5244600, rc 0) 00000100:00100000:3.0:1746129755.913253:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28722:x1830949052302208:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 585us (2048us total) trans 8589943730 rc 0/0 00000100:00100000:3.0:1746129755.913258:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9938 00000100:00100000:0.0:1746129755.915447:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129755.916212:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052302464 00000100:00100000:1.0:1746129755.916219:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052302464 00000100:00100000:1.0:1746129755.916258:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9939 00000100:00100000:1.0:1746129755.916264:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28725:x1830949052302464:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129755.916280:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129755.916292:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4ee00/0x48868a4e4394a09c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fc86 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.916374:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4e400/0x48868a4e4394a0a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129755.916384:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4e400/0x48868a4e4394a0a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129755.916390:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4e400/0x48868a4e4394a0a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129755.916399:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4f000/0x48868a4e4394a0aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129755.916404:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4f000/0x48868a4e4394a0aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129755.916408:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4f000/0x48868a4e4394a0aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129755.916488:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4f400/0x48868a4e4394a0b1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129755.916495:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4f400/0x48868a4e4394a0b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129755.916500:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4f400/0x48868a4e4394a0b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:1.0:1746129755.916507:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129755.916566:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4e400/0x48868a4e4394a0a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129755.916572:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4e400/0x48868a4e4394a0a3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129755.916577:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4e400/0x48868a4e4394a0a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129755.916582:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800acd4e400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129755.916585:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4e400/0x48868a4e4394a0a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129755.916590:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4e400/0x48868a4e4394a0a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129755.916599:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129755.916601:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129755.916604:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4e400/0x48868a4e4394a0a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129755.916609:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4e400/0x48868a4e4394a0a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129755.917591:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4f000/0x48868a4e4394a0aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129755.917605:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4f000/0x48868a4e4394a0aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129755.917610:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4f000/0x48868a4e4394a0aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129755.917615:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800acd4f000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129755.917618:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4f000/0x48868a4e4394a0aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129755.917623:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4f000/0x48868a4e4394a0aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129755.917631:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e8c7f00) 00010000:00010000:1.0:1746129755.917633:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129755.917636:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4f000/0x48868a4e4394a0aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129755.917640:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4f000/0x48868a4e4394a0aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129755.917683:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4ee00/0x48868a4e4394a09c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc86 expref: 287 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.917695:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4f400/0x48868a4e4394a0b1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc86 expref: 286 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129755.917701:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129755.917703:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129755.917705:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd4f400, rc 0) 00000100:00100000:1.0:1746129755.919239:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:28725:x1830949052302464:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2968us (3791us total) trans 8589943731 rc 0/0 00000100:00100000:1.0:1746129755.919249:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9939 00000100:00100000:0.0:1746129755.931588:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129755.931629:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.931702:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052302720 00000100:00100000:2.0:1746129755.931710:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052302720 00000100:00100000:2.0:1746129755.931744:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3917 00000100:00100000:2.0:1746129755.931750:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:28725:x1830949052302720:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129755.931895:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052302848 00000100:00100000:3.0:1746129755.931898:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052302848 00000100:00100000:3.0:1746129755.931922:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11225 00000100:00100000:3.0:1746129755.931927:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28722:x1830949052302848:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129755.931935:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129755.931949:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e4394a0bf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fc8d expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.931968:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb7600/0x48868a4e4394a05d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc63 expref: 17 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.931976:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f87ae00/0x48868a4e4394a072 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc78 expref: 31 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.931981:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129755.931983:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129755.931985:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e4394a0bf lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3723264->4095999] (req 3723264->4095999) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc8d expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.932010:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f87ae00/0x48868a4e4394a072 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc78 expref: 31 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.932020:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f87ae00/0x48868a4e4394a072 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc78 expref: 31 pid: 4589 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746129755.932029:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130504e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053350016:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129755.933215:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:28725:x1830949052302720:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 1462us (1631us total) trans 8589943732 rc 0/0 00000100:00100000:2.0:1746129755.933224:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3917 00010000:00010000:3.0:1746129755.933373:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbb7600/0x48868a4e4394a05d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc63 expref: 17 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.933383:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb7600/0x48868a4e4394a05d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc63 expref: 17 pid: 10930 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746129755.933391:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053350144:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129755.933422:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129755.954534:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130504e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053350016:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129755.957991:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053350144:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129755.958024:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e4394a0bf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3723264->4095999] (req 3723264->4095999) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc8d expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.958039:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5244200, rc 0) 00000100:00100000:3.0:1746129755.958104:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28722:x1830949052302848:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 26175us (26472us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129755.958115:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11225 00000100:00100000:0.0:1746129755.959073:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.959380:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052302976 00000100:00100000:3.0:1746129755.959386:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052302976 00010000:00010000:3.0:1746129755.959412:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87ae00/0x48868a4e4394a072 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc78 expref: 32 pid: 4589 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746129755.959441:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5403 00000100:00100000:3.0:1746129755.959447:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949052302976:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129755.959458:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129755.959475:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009f87ae00/0x48868a4e4394a072 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc78 expref: 32 pid: 4589 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746129755.959484:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f87ae00/0x48868a4e4394a072 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc78 expref: 32 pid: 4589 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746129755.959503:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f87ae00/0x48868a4e4394a072 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc78 expref: 32 pid: 4589 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746129755.959530:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129755.959564:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1964:x1830949052302976:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 117us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129755.959570:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5403 00000100:00100000:0.0:1746129755.969765:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.970904:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052303104 00000100:00100000:2.0:1746129755.970913:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052303104 00010000:00010000:2.0:1746129755.970940:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb7600/0x48868a4e4394a05d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc63 expref: 17 pid: 10930 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746129755.970977:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5404 00000100:00100000:2.0:1746129755.970984:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949052303104:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129755.970996:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129755.971016:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88012dbb7600/0x48868a4e4394a05d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc63 expref: 17 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746129755.971027:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbb7600/0x48868a4e4394a05d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc63 expref: 17 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746129755.971045:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb7600/0x48868a4e4394a05d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc63 expref: 17 pid: 10930 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746129755.971074:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129755.971076:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129755.971082:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e4394a0bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4095999) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc8d expref: 16 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.971089:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e4394a0bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4095999) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc8d expref: 16 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129755.971117:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e4394a0bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4095999) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc8d expref: 16 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129755.971127:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053350272:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129755.971204:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1300 going to sleep for 11 seconds 00000100:00100000:2.0:1746129755.979081:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053350272:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129755.979099:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129755.979148:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949052303104:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8163us (9389us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129755.979157:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5404 00000100:00100000:0.0:1746129755.980681:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129755.980751:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052303360 00000100:00100000:2.0:1746129755.980757:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052303360 00002000:00100000:2.0:1746129755.980792:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3723264->3727359) req@ffff88009207c700 x1830949052303360/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/0 e 0 to 0 dl 1746129766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129755.980801:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207c700 with x1830949052303360 ext(3723264->3727359) 00002000:00010000:2.0:1746129755.980805:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207c700 00000100:00100000:2.0:1746129755.982538:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4203 00000100:00100000:2.0:1746129755.982549:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052303360:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129755.982705:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052303360:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 158us (2027us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129755.982711:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4203 00002000:00100000:2.0:1746129755.982717:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3723264->3727359) req@ffff88009207c700 x1830949052303360/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:496/0 lens 488/4536 e 0 to 0 dl 1746129766 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129755.982725:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207c700 with x1830949052303360 ext(3723264->3727359) 00002000:00010000:2.0:1746129755.982729:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207c700 00000100:00100000:0.0:1746129755.989692:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129755.998116:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052303488 00000100:00100000:3.0:1746129755.998127:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052303488 00000100:00100000:3.0:1746129755.998174:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11226 00000100:00100000:3.0:1746129755.998181:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:28725:x1830949052303488:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129755.998196:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129755.998209:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e4394a0c6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fc94 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.998233:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e4394a0bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4095999) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc8d expref: 15 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.998240:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129755.998241:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129755.998244:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e4394a0c6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3321856->3670015] (req 3321856->3670015) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc94 expref: 32 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.998266:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e4394a0bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4095999) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc8d expref: 15 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129755.998275:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e4394a0bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4095999) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc8d expref: 15 pid: 4589 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746129755.998284:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053350400:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129755.998373:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129756.010945:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.011067:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052303744 00000100:00100000:2.0:1746129756.011075:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052303744 00002000:00100000:2.0:1746129756.011109:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (4091904->4095999) req@ffff88009207df80 x1830949052303744/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.011119:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207df80 with x1830949052303744 ext(4091904->4095999) 00010000:00010000:2.0:1746129756.011127:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e4394a0bf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4095999) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc8d expref: 16 pid: 4589 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.011139:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e4394a0bf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4095999) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc8d expref: 16 pid: 4589 timeout: 802 lvb_type: 0 00002000:00010000:2.0:1746129756.011145:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009207df80 00000100:00100000:3.0:1746129756.011385:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053350400:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129756.011406:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e4394a0c6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3321856->3670015] (req 3321856->3670015) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc94 expref: 32 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.011418:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb6e00, rc 0) 00000100:00100000:3.0:1746129756.011464:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:28725:x1830949052303488:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 13282us (21778us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.011471:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11226 00000100:00100000:2.0:1746129756.011521:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 628 00000100:00100000:2.0:1746129756.011528:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052303744:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129756.012268:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052303744:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 738us (1328us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129756.013874:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 628 00002000:00100000:2.0:1746129756.013884:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (4091904->4095999) req@ffff88009207df80 x1830949052303744/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/4536 e 0 to 0 dl 1746129767 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.013893:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207df80 with x1830949052303744 ext(4091904->4095999) 00010000:00010000:2.0:1746129756.013901:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e4394a0bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4095999) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc8d expref: 16 pid: 4589 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.013912:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e4394a0bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4095999) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc8d expref: 16 pid: 4589 timeout: 802 lvb_type: 0 00002000:00010000:2.0:1746129756.013919:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009207df80 00000100:00100000:0.0:1746129756.019151:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.019640:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.021090:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052304256 00000100:00100000:2.0:1746129756.021100:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052304256 00000100:00100000:2.0:1746129756.021149:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3918 00000100:00100000:2.0:1746129756.021157:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28722:x1830949052304256:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129756.021334:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28722:x1830949052304256:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 177us (2189us total) trans 8589943733 rc 0/0 00000100:00100000:2.0:1746129756.021340:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3918 00000100:00100000:3.0:1746129756.022237:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052304000 00000100:00100000:3.0:1746129756.022241:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052304000 00002000:00100000:3.0:1746129756.022266:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3723264->4095999) req@ffff88009207f800 x1830949052304000/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.022284:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207f800 with x1830949052304000 ext(3723264->4095999) 00010000:00010000:3.0:1746129756.022290:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e4394a0bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4095999) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc8d expref: 16 pid: 4589 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.022302:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e4394a0bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4095999) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc8d expref: 16 pid: 4589 timeout: 802 lvb_type: 0 00002000:00010000:3.0:1746129756.022308:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009207f800 00000100:00100000:3.0:1746129756.022333:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 629 00000100:00100000:3.0:1746129756.022338:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052304000:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:0.0:1746129756.034690:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129756.035220:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052304512 00000100:00100000:1.0:1746129756.035228:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052304512 00000100:00100000:1.0:1746129756.035881:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9940 00000100:00100000:1.0:1746129756.035890:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:28728:x1830949052304512:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129756.035908:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129756.035924:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4f000/0x48868a4e4394a0cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fc9b expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.036012:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4e400/0x48868a4e4394a0d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.036024:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4e400/0x48868a4e4394a0d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.036033:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4e400/0x48868a4e4394a0d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.036044:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4fe00/0x48868a4e4394a0db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.036049:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4fe00/0x48868a4e4394a0db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.036053:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4fe00/0x48868a4e4394a0db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.036136:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4fc00/0x48868a4e4394a0e2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.036144:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4fc00/0x48868a4e4394a0e2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.036150:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4fc00/0x48868a4e4394a0e2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:1.0:1746129756.036157:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129756.036216:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4e400/0x48868a4e4394a0d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.036221:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4e400/0x48868a4e4394a0d4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.036226:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4e400/0x48868a4e4394a0d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.036231:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800acd4e400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129756.036234:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4e400/0x48868a4e4394a0d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.036239:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4e400/0x48868a4e4394a0d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.036247:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129756.036250:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129756.036253:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4e400/0x48868a4e4394a0d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.036257:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4e400/0x48868a4e4394a0d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.036282:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4fe00/0x48868a4e4394a0db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.036286:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4fe00/0x48868a4e4394a0db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.036294:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4fe00/0x48868a4e4394a0db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.036297:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800acd4fe00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129756.036299:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4fe00/0x48868a4e4394a0db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.036303:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4fe00/0x48868a4e4394a0db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.036308:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e8c7b00) 00010000:00010000:1.0:1746129756.036309:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129756.036311:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4fe00/0x48868a4e4394a0db lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.036315:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4fe00/0x48868a4e4394a0db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.036352:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4f000/0x48868a4e4394a0cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc9b expref: 290 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.036360:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4fc00/0x48868a4e4394a0e2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc9b expref: 289 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.036366:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129756.036367:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129756.036369:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd4fc00, rc 0) 00000100:00100000:1.0:1746129756.036408:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:28728:x1830949052304512:12345-192.168.204.31@tcp:101:cat.0 Request processed in 520us (1724us total) trans 8589943734 rc 0/0 00000100:00100000:1.0:1746129756.036414:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9940 00000100:00100000:2.0:1746129756.043865:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052304000:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 21497us (24196us total) trans 17179873225 rc 0/0 00000100:00100000:2.0:1746129756.043876:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 629 00002000:00100000:2.0:1746129756.043886:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3723264->4095999) req@ffff88009207f800 x1830949052304000/t17179873225(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/448 e 0 to 0 dl 1746129767 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.043894:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207f800 with x1830949052304000 ext(3723264->4095999) 00010000:00010000:2.0:1746129756.043904:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e4394a0bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4095999) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc8d expref: 18 pid: 4589 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.043918:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e4394a0bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4095999) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc8d expref: 18 pid: 4589 timeout: 802 lvb_type: 0 00002000:00010000:2.0:1746129756.043924:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009207f800 00010000:00010000:3.0:1746129756.044617:0:12137:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746129756.044710:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129756.045057:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129756.045081:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052304768 00000100:00100000:1.0:1746129756.045087:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052304768 00000100:00100000:1.0:1746129756.045114:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11227 00000100:00100000:1.0:1746129756.045119:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949052304768:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129756.045131:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129756.045141:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acd4fe00/0x48868a4e4394a0f0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fca2 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129756.045179:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053350528:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129756.045234:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d917480 going to sleep for 11 seconds 00000100:00100000:3.0:1746129756.045381:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052304640 00000100:00100000:3.0:1746129756.045384:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052304640 00000100:00100000:3.0:1746129756.045410:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 576 00000100:00100000:3.0:1746129756.045415:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:1963:x1830949052304640:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129756.045423:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129756.045438:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4fc00/0x48868a4e4394a0e2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc9b expref: 289 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.045453:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129756.045456:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129756.045473:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:1963:x1830949052304640:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 58us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.045478:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 576 00010000:00010000:1.0:1746129756.049173:0:4589:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.31@tcp) returned -22 from glimpse AST (req@ffff8800a5491880 x1830949053350528) - normal race ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e4394a0bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3723264->4095999) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc8d expref: 17 pid: 4589 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.049205:0:4589:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e4394a0bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3723264->4095999) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc8d expref: 17 pid: 4589 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.049226:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e4394a0bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3723264->4095999) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc8d expref: 17 pid: 4589 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746129756.049558:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053350528:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129756.049577:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129756.049578:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129756.049584:0:4589:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e4394a0c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3670015) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc94 expref: 33 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.049595:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e4394a0c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3670015) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc94 expref: 33 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.049629:0:4589:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e4394a0c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3670015) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc94 expref: 33 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129756.049645:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053350656:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129756.051569:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d917480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129756.051864:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.051947:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.051980:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053350656:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129756.052002:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acd4fe00/0x48868a4e4394a0f0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fca2 expref: 33 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129756.052014:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acd4fe00/0x48868a4e4394a0f0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fca2 expref: 33 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129756.052029:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd4fe00, rc 0) 00000100:00100000:0.0:1746129756.052057:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949052304768:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6938us (7000us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129756.052065:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11227 00000100:00100000:3.0:1746129756.052157:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052304896 00000100:00100000:3.0:1746129756.052163:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052304896 00000100:00100000:3.0:1746129756.052191:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 577 00000100:00100000:3.0:1746129756.052195:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130566850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052304896:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129756.052204:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129756.052206:0:10980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 48868a4e4394a0bf) 00010000:00010000:3.0:1746129756.052208:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129756.052222:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130566850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052304896:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 26us (361us total) trans 0 rc 116/116 00000100:00100000:3.0:1746129756.052226:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 577 00000100:00100000:2.0:1746129756.053527:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052305152 00000100:00100000:2.0:1746129756.053534:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052305152 00002000:00100000:2.0:1746129756.053561:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3321856->3325951) req@ffff88009207d180 x1830949052305152/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.053569:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207d180 with x1830949052305152 ext(3321856->3325951) 00002000:00010000:2.0:1746129756.053573:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207d180 00000100:00100000:2.0:1746129756.053711:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4204 00000100:00100000:2.0:1746129756.053717:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949052305152:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129756.053828:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949052305152:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 111us (1881us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129756.053833:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4204 00002000:00100000:2.0:1746129756.053837:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3321856->3325951) req@ffff88009207d180 x1830949052305152/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/4536 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.053843:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207d180 with x1830949052305152 ext(3321856->3325951) 00002000:00010000:2.0:1746129756.053868:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207d180 00000100:00100000:0.0:1746129756.063217:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.063296:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052305408 00000100:00100000:3.0:1746129756.063303:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052305408 00000100:00100000:3.0:1746129756.063357:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9941 00000100:00100000:3.0:1746129756.063363:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28732:x1830949052305408:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129756.063381:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129756.063395:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7600/0x48868a4e4394a0f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fca9 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.063477:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6200/0x48868a4e4394a0fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.063487:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6200/0x48868a4e4394a0fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.063496:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6200/0x48868a4e4394a0fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.063506:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244200/0x48868a4e4394a105 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.063511:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244200/0x48868a4e4394a105 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.063516:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244200/0x48868a4e4394a105 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.063590:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244000/0x48868a4e4394a10c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.063596:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244000/0x48868a4e4394a10c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.063601:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244000/0x48868a4e4394a10c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129756.063607:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129756.063665:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6200/0x48868a4e4394a0fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.063670:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6200/0x48868a4e4394a0fe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.063675:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6200/0x48868a4e4394a0fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.063679:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbb6200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129756.063681:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6200/0x48868a4e4394a0fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.063686:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6200/0x48868a4e4394a0fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.063694:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129756.063697:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129756.063699:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6200/0x48868a4e4394a0fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.063703:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6200/0x48868a4e4394a0fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.063716:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244200/0x48868a4e4394a105 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.063720:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244200/0x48868a4e4394a105 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.063724:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244200/0x48868a4e4394a105 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.063727:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b5244200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129756.063728:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244200/0x48868a4e4394a105 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.063732:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244200/0x48868a4e4394a105 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.063736:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094266900) 00010000:00010000:3.0:1746129756.063737:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129756.063739:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244200/0x48868a4e4394a105 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.063742:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244200/0x48868a4e4394a105 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.063769:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7600/0x48868a4e4394a0f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fca9 expref: 16 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.063778:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244000/0x48868a4e4394a10c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fca9 expref: 15 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.063783:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129756.063785:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129756.063786:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5244000, rc 0) 00000100:00100000:3.0:1746129756.063818:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28732:x1830949052305408:12345-192.168.204.31@tcp:101:cat.0 Request processed in 456us (610us total) trans 8589943735 rc 0/0 00000100:00100000:3.0:1746129756.063823:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9941 00000100:00100000:0.0:1746129756.067921:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.067962:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.067999:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052305792 00000100:00100000:3.0:1746129756.068008:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052305792 00000100:00100000:2.0:1746129756.068018:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052305920 00000100:00100000:2.0:1746129756.068021:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052305920 00002000:00100000:3.0:1746129756.068044:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009207dc00 x1830949052305792/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.068044:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009207e300 x1830949052305920/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.068053:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207dc00 with x1830949052305792 ext(1048576->2097151) 00002000:00010000:3.0:1746129756.068057:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207dc00 00002000:00100000:2.0:1746129756.068057:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207e300 with x1830949052305920 ext(0->1048575) 00002000:00010000:2.0:1746129756.068060:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207e300 00000100:00100000:3.0:1746129756.068071:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4205 00000100:00100000:2.0:1746129756.068076:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4206 00000100:00100000:3.0:1746129756.068077:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1964:x1830949052305792:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129756.068080:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949052305920:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129756.075994:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.076076:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.076148:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052306176 00000100:00100000:2.0:1746129756.076156:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052306176 00002000:00100000:2.0:1746129756.076188:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3665920->3670015) req@ffff88009207fb80 x1830949052306176/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.076197:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207fb80 with x1830949052306176 ext(3665920->3670015) 00002000:00010000:2.0:1746129756.076202:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207fb80 00000100:00100000:2.0:1746129756.076231:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4207 00000100:00100000:2.0:1746129756.076238:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949052306176:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129756.076379:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949052306176:12345-192.168.204.31@tcp:3:cat.0 Request processed in 141us (393us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129756.076384:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4207 00002000:00100000:2.0:1746129756.076389:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3665920->3670015) req@ffff88009207fb80 x1830949052306176/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/4536 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.076394:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207fb80 with x1830949052306176 ext(3665920->3670015) 00002000:00010000:2.0:1746129756.076397:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207fb80 00000100:00100000:3.0:1746129756.079717:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052306304 00000100:00100000:3.0:1746129756.079728:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052306304 00000100:00100000:3.0:1746129756.079796:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 578 00000100:00100000:3.0:1746129756.079803:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1964:x1830949052306304:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129756.079816:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129756.079838:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244000/0x48868a4e4394a10c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fca9 expref: 15 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.079906:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129756.079910:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129756.079953:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1964:x1830949052306304:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 150us (3875us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.079959:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 578 00000100:00100000:0.0:1746129756.091012:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129756.091104:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052306560 00000100:00100000:1.0:1746129756.091112:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052306560 00000100:00100000:1.0:1746129756.091154:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3919 00000100:00100000:1.0:1746129756.091161:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28732:x1830949052306560:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129756.091326:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28732:x1830949052306560:12345-192.168.204.31@tcp:35:cat.0 Request processed in 157us (314us total) trans 8589943736 rc 0/0 00000100:00100000:1.0:1746129756.091333:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3919 00000100:00100000:3.0:1746129756.091862:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1964:x1830949052305792:12345-192.168.204.31@tcp:3:cat.0 Request processed in 23768us (23933us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129756.091870:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4205 00002000:00100000:3.0:1746129756.091877:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009207dc00 x1830949052305792/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.091886:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207dc00 with x1830949052305792 ext(1048576->2097151) 00002000:00010000:3.0:1746129756.091891:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207dc00 00000100:00100000:2.0:1746129756.094803:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949052305920:12345-192.168.204.31@tcp:3:cat.0 Request processed in 26715us (26833us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129756.094813:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4206 00002000:00100000:2.0:1746129756.094822:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009207e300 x1830949052305920/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.094831:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207e300 with x1830949052305920 ext(0->1048575) 00002000:00010000:2.0:1746129756.094835:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207e300 00000100:00100000:0.0:1746129756.100768:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.102353:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052306688 00000100:00100000:2.0:1746129756.102363:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052306688 00000100:00100000:2.0:1746129756.102414:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11228 00000100:00100000:2.0:1746129756.102422:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052306688:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129756.102438:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129756.102452:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x48868a4e4394a11a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fcb0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129756.102495:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053350784:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129756.112620:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.112655:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.112685:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052306944 00000100:00100000:0.0:1746129756.112691:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052306944 00002000:00100000:0.0:1746129756.112724:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009a04d500 x1830949052306944/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129756.112732:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04d500 with x1830949052306944 ext(2097152->3145727) 00002000:00010000:0.0:1746129756.112737:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04d500 00000100:00100000:2.0:1746129756.112868:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129756.112966:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052307200 00000100:00100000:0.0:1746129756.112969:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052307200 00002000:00100000:0.0:1746129756.112982:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009a04c000 x1830949052307200/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 504/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129756.112988:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04c000 with x1830949052307200 ext(3145728->4194303) 00002000:00010000:0.0:1746129756.112991:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04c000 00000100:00100000:3.0:1746129756.113121:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4208 00000100:00100000:3.0:1746129756.113131:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949052306944:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129756.114260:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4209 00000100:00100000:0.0:1746129756.114267:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949052307200:12345-192.168.204.31@tcp:3:cat.0 00002000:00010000:2.0:1746129756.126686:0:4589:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime: 1746129755 -> 1746129756 00000100:00100000:2.0:1746129756.126709:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053350784:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129756.126738:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x48868a4e4394a11a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcb0 expref: 18 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129756.126750:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x48868a4e4394a11a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcb0 expref: 18 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129756.126777:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11800, rc 0) 00000100:00100000:2.0:1746129756.126822:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052306688:12345-192.168.204.31@tcp:101:cat.0 Request processed in 24401us (26061us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129756.126830:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11228 00000100:00100000:3.0:1746129756.147446:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949052306944:12345-192.168.204.31@tcp:3:cat.0 Request processed in 34308us (34825us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129756.147459:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4208 00002000:00100000:3.0:1746129756.147469:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009a04d500 x1830949052306944/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.147479:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04d500 with x1830949052306944 ext(2097152->3145727) 00002000:00010000:3.0:1746129756.147484:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04d500 00000100:00100000:1.0:1746129756.148686:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949052307200:12345-192.168.204.31@tcp:3:cat.0 Request processed in 34416us (36026us total) trans 0 rc 700416/700416 00000100:00100000:1.0:1746129756.148695:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4209 00002000:00100000:1.0:1746129756.148702:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009a04c000 x1830949052307200/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 504/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 700416/700416 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.148709:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04c000 with x1830949052307200 ext(3145728->4194303) 00002000:00010000:1.0:1746129756.148714:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04c000 00000100:00100000:0.0:1746129756.156632:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.158878:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.158966:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052307456 00000100:00100000:3.0:1746129756.158974:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052307456 00002000:00100000:3.0:1746129756.159009:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009a04ce00 x1830949052307456/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.159019:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04ce00 with x1830949052307456 ext(0->1048575) 00002000:00010000:3.0:1746129756.159023:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04ce00 00000100:00100000:3.0:1746129756.159581:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052307712 00000100:00100000:3.0:1746129756.159585:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052307712 00002000:00100000:3.0:1746129756.159600:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009a04f100 x1830949052307712/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.159607:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04f100 with x1830949052307712 ext(1048576->2097151) 00002000:00010000:3.0:1746129756.159611:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a04f100 00000100:00100000:1.0:1746129756.159637:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4210 00000100:00100000:1.0:1746129756.159646:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052307456:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129756.160128:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4211 00000100:00100000:3.0:1746129756.160136:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052307712:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129756.168362:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129756.169788:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052307840 00000100:00100000:1.0:1746129756.169799:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052307840 00000100:00100000:1.0:1746129756.169878:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9942 00000100:00100000:1.0:1746129756.169886:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+6:28734:x1830949052307840:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129756.169905:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129756.169920:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5600/0x48868a4e4394a121 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fcb7 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.169968:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c4400/0x48868a4e4394a128 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.169979:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c4400/0x48868a4e4394a128 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.169987:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c4400/0x48868a4e4394a128 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.169998:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c4e00/0x48868a4e4394a12f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.170002:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c4e00/0x48868a4e4394a12f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.170007:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c4e00/0x48868a4e4394a12f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.170094:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5200/0x48868a4e4394a136 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.170103:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e43949fca lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbe5 expref: 287 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.170113:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5200/0x48868a4e4394a136 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.170136:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e43949fca lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbe5 expref: 287 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.170147:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e43949fca lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbe5 expref: 287 pid: 15044 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746129756.170158:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053350912:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129756.170228:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d917600 going to sleep for 11 seconds 00000100:00080000:3.0:1746129756.171695:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746129756.190570:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.190637:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.190655:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052308352 00000100:00100000:2.0:1746129756.190661:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052308352 00000100:00100000:2.0:1746129756.190692:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3920 00000100:00100000:2.0:1746129756.190698:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:27195:x1830949052308352:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746129756.190872:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:27195:x1830949052308352:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 173us (233us total) trans 8589943737 rc 0/0 00000100:00100000:2.0:1746129756.190878:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3920 00000100:00100000:2.0:1746129756.190962:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.191027:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052308608 00000100:00100000:2.0:1746129756.191030:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052308608 00002000:00100000:2.0:1746129756.191049:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff8800a00c5500 x1830949052308608/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.191058:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c5500 with x1830949052308608 ext(4194304->4964351) 00002000:00010000:2.0:1746129756.191063:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a00c5500 00000100:00100000:2.0:1746129756.191083:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4212 00000100:00100000:2.0:1746129756.191088:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949052308608:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129756.191524:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053350912:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129756.191541:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5200/0x48868a4e4394a136 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:1.0:1746129756.191609:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052308096 00000100:00100000:1.0:1746129756.191613:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052308096 00000100:00100000:1.0:1746129756.191634:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9943 00000100:00100000:1.0:1746129756.191639:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28736:x1830949052308096:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129756.191649:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129756.191661:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c4000/0x48868a4e4394a13d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fcbe expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.191722:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5800/0x48868a4e4394a144 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129756.191733:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5800/0x48868a4e4394a144 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129756.191742:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5800/0x48868a4e4394a144 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129756.191752:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093612200/0x48868a4e4394a14b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129756.191759:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093612200/0x48868a4e4394a14b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129756.191764:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093612200/0x48868a4e4394a14b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129756.191867:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f7600/0x48868a4e4394a152 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129756.191875:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f7600/0x48868a4e4394a152 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129756.191881:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f7600/0x48868a4e4394a152 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:1.0:1746129756.191888:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129756.191932:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5800/0x48868a4e4394a144 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129756.191938:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5800/0x48868a4e4394a144 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129756.191942:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5800/0x48868a4e4394a144 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129756.191946:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a51c5800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129756.191949:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5800/0x48868a4e4394a144 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129756.191954:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5800/0x48868a4e4394a144 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129756.191963:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129756.191966:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129756.191969:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5800/0x48868a4e4394a144 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129756.191974:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5800/0x48868a4e4394a144 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129756.191987:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093612200/0x48868a4e4394a14b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129756.191991:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093612200/0x48868a4e4394a14b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129756.191994:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093612200/0x48868a4e4394a14b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129756.191998:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093612200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129756.192000:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093612200/0x48868a4e4394a14b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129756.192004:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093612200/0x48868a4e4394a14b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129756.192009:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e8c7500) 00010000:00010000:1.0:1746129756.192011:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129756.192013:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093612200/0x48868a4e4394a14b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129756.192016:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093612200/0x48868a4e4394a14b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129756.192038:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c4000/0x48868a4e4394a13d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcbe expref: 18 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.192052:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f7600/0x48868a4e4394a152 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcbe expref: 17 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.192056:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129756.192058:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129756.192061:0:1851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5200/0x48868a4e4394a136 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.192065:0:1851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5200/0x48868a4e4394a136 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.192070:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b7f7600, rc 0) 00000100:00100000:1.0:1746129756.192093:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28736:x1830949052308096:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 454us (1530us total) trans 8589943738 rc 0/0 00000100:00100000:1.0:1746129756.192097:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9943 00000100:00100000:3.0:1746129756.192567:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052307712:12345-192.168.204.31@tcp:3:cat.0 Request processed in 32430us (33694us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129756.192573:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4211 00002000:00100000:3.0:1746129756.192579:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009a04f100 x1830949052307712/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.192585:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04f100 with x1830949052307712 ext(1048576->2097151) 00002000:00010000:3.0:1746129756.192589:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a04f100 00000100:00100000:1.0:1746129756.203637:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052307456:12345-192.168.204.31@tcp:3:cat.0 Request processed in 43984us (47009us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129756.203649:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4210 00002000:00100000:1.0:1746129756.203659:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009a04ce00 x1830949052307456/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.203667:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04ce00 with x1830949052307456 ext(0->1048575) 00002000:00010000:1.0:1746129756.203673:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04ce00 00000100:00100000:2.0:1746129756.205552:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.205590:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129756.205729:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052308736 00000100:00100000:1.0:1746129756.205736:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052308736 00000100:00100000:3.0:1746129756.205738:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052308864 00000100:00100000:3.0:1746129756.205742:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052308864 00010000:00010000:3.0:1746129756.205762:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e43949fca lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbe5 expref: 289 pid: 15044 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746129756.205780:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5405 00000100:00100000:3.0:1746129756.205785:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 579 00000100:00100000:1.0:1746129756.205787:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:1961:x1830949052308864:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129756.205790:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052308736:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129756.205797:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129756.205798:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129756.205803:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e43949fca lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbe5 expref: 289 pid: 15044 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.205813:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f7600/0x48868a4e4394a152 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcbe expref: 17 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.205815:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e43949fca lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbe5 expref: 289 pid: 15044 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.205826:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9bc800/0x48868a4e43949fca lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbe5 expref: 289 pid: 15044 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.205831:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129756.205835:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5200/0x48868a4e4394a136 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129756.205841:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5200/0x48868a4e4394a136 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129756.206311:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5200/0x48868a4e4394a136 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.206372:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129756.206377:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129756.206736:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:1961:x1830949052308864:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 948us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129756.206742:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5405 00010000:00010000:3.0:1746129756.207292:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129756.207324:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052308736:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1532us (1776us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.207331:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 579 00010000:00010000:0.0:1746129756.207884:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5200/0x48868a4e4394a136 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129756.207892:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5200/0x48868a4e4394a136 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:0.0:1746129756.207928:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:0.0:1746129756.207931:0:14315:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129756.207943:0:14315:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5200/0x48868a4e4394a136 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129756.207952:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5200/0x48868a4e4394a136 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129756.207959:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c4400/0x48868a4e4394a128 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129756.207964:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c4400/0x48868a4e4394a128 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129756.207969:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c4400/0x48868a4e4394a128 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129756.207977:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a51c4400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129756.207980:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c4400/0x48868a4e4394a128 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129756.207985:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c4400/0x48868a4e4394a128 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129756.207993:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:0.0:1746129756.207995:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129756.207998:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c4400/0x48868a4e4394a128 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129756.208001:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c4400/0x48868a4e4394a128 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129756.208532:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c4e00/0x48868a4e4394a12f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129756.208539:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c4e00/0x48868a4e4394a12f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129756.208544:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c4e00/0x48868a4e4394a12f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129756.208547:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a51c4e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129756.208549:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c4e00/0x48868a4e4394a12f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129756.208554:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c4e00/0x48868a4e4394a12f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129756.208561:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e8c7500) 00010000:00010000:0.0:1746129756.208563:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129756.208565:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c4e00/0x48868a4e4394a12f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129756.208569:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c4e00/0x48868a4e4394a12f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129756.208601:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5600/0x48868a4e4394a121 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcb7 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.208613:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5200/0x48868a4e4394a136 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcb7 expref: 7 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.208618:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129756.208619:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129756.208621:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a51c5200, rc 0) 00000100:00100000:0.0:1746129756.208667:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+7:28734:x1830949052307840:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 38782us (40312us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129756.208673:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9942 00000100:00100000:2.0:1746129756.212455:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.212474:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052308992 00000100:00100000:2.0:1746129756.212482:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052308992 00000100:00100000:2.0:1746129756.212514:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11229 00000100:00100000:2.0:1746129756.212520:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28736:x1830949052308992:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129756.212534:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129756.212549:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a160 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fcc5 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.212573:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ea00/0x48868a4e4394a041 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc47 expref: 18 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.212580:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5245200/0x48868a4e4394a056 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc5c expref: 33 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.212585:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.212587:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.212590:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a160 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1388544->1454079] (req 1388544->1454079) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcc5 expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.212613:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5245200/0x48868a4e4394a056 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc5c expref: 33 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.212623:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b5245200/0x48868a4e4394a056 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc5c expref: 33 pid: 20441 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746129756.212634:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053351040:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129756.212761:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949052308608:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21669us (21796us total) trans 0 rc 770048/770048 00000100:00100000:3.0:1746129756.212770:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4212 00002000:00100000:3.0:1746129756.212778:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff8800a00c5500 x1830949052308608/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.212786:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c5500 with x1830949052308608 ext(4194304->4964351) 00002000:00010000:3.0:1746129756.212790:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a00c5500 00010000:00010000:2.0:1746129756.214178:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ea00/0x48868a4e4394a041 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc47 expref: 18 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.214189:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ea00/0x48868a4e4394a041 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc47 expref: 18 pid: 20441 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746129756.214199:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053351168:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129756.214352:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129756.216262:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.216284:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.216348:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.216367:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052309120 00000100:00100000:3.0:1746129756.216374:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052309120 00000100:00100000:1.0:1746129756.216396:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052309248 00000100:00100000:1.0:1746129756.216400:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052309248 00000100:00100000:3.0:1746129756.216401:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052309376 00000100:00100000:3.0:1746129756.216402:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052309376 00000100:00100000:2.0:1746129756.216415:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11230 00000100:00100000:3.0:1746129756.216424:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11231 00000100:00100000:2.0:1746129756.216428:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052309120:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:3.0:1746129756.216430:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052309376:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129756.216442:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129756.216442:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129756.216454:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a16e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fcda expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.216454:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009330fe00/0x48868a4e4394a167 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fccc expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129756.216468:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11232 00010000:00010000:3.0:1746129756.216471:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.216472:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129756.216474:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746129756.216475:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+12:1963:x1830949052309248:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129756.216480:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a16e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcda expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129756.216480:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009330fe00/0x48868a4e4394a167 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fccc expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129756.216482:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129756.216489:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009330fe00/0x48868a4e4394a167 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fccc expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129756.216490:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b7f6200/0x48868a4e4394a175 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fcd3 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.216493:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a16e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcda expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129756.216501:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb6600, rc 0) 00010000:00010000:2.0:1746129756.216501:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009330fe00, rc 0) 00000100:00100000:1.0:1746129756.216521:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5492300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053351296:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129756.216529:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+12:1964:x1830949052309376:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 100us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129756.216531:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+12:1964:x1830949052309120:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 108us (274us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129756.216535:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11231 00000100:00100000:2.0:1746129756.216538:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11230 00000100:00100000:1.0:1746129756.216555:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d917600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129756.221250:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.221692:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052309504 00000100:00100000:3.0:1746129756.221700:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052309504 00010000:00010000:3.0:1746129756.221727:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5245200/0x48868a4e4394a056 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc5c expref: 32 pid: 20441 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746129756.221841:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053351040:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129756.221873:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053351168:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129756.221893:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a160 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1388544->1454079] (req 1388544->1454079) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcc5 expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.221905:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130677c00, rc 0) 00000100:00100000:2.0:1746129756.221940:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28736:x1830949052308992:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 9420us (9492us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129756.221946:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11229 00000100:00100000:3.0:1746129756.222194:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5406 00000100:00100000:3.0:1746129756.222201:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1963:x1830949052309504:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129756.222211:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129756.222228:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b5245200/0x48868a4e4394a056 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc5c expref: 32 pid: 20441 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.222238:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b5245200/0x48868a4e4394a056 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc5c expref: 32 pid: 20441 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.222255:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5245200/0x48868a4e4394a056 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc5c expref: 32 pid: 20441 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.222441:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129756.222465:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949052309504:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 264us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.222470:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5406 00000100:00100000:0.0:1746129756.224083:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.224106:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.224120:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052309760 00000100:00100000:0.0:1746129756.224125:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052309760 00010000:00010000:0.0:1746129756.224144:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ea00/0x48868a4e4394a041 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc47 expref: 18 pid: 20441 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746129756.224161:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5407 00000100:00100000:0.0:1746129756.224166:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949052309760:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129756.224174:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129756.224188:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ea00/0x48868a4e4394a041 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc47 expref: 18 pid: 20441 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.224196:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ea00/0x48868a4e4394a041 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc47 expref: 18 pid: 20441 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.224211:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6ea00/0x48868a4e4394a041 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc47 expref: 18 pid: 20441 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.224222:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129756.224224:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129756.224229:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a160 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1454079) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcc5 expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.224236:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a160 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1454079) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcc5 expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.224256:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a160 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1454079) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcc5 expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129756.224264:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053351424:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129756.224309:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129756.224558:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5492300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053351296:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129756.224578:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b7f6200/0x48868a4e4394a175 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcd3 expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129756.224587:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b7f6200/0x48868a4e4394a175 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcd3 expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129756.224594:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b7f6200, rc 0) 00000100:00100000:3.0:1746129756.225453:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+10:1963:x1830949052309248:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 8976us (9165us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129756.225459:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11232 00000100:00100000:3.0:1746129756.225475:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052309632 00000100:00100000:3.0:1746129756.225478:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052309632 00000100:00100000:3.0:1746129756.225493:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11233 00000100:00100000:3.0:1746129756.225497:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28732:x1830949052309632:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129756.225506:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129756.225515:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6200/0x48868a4e4394a17c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fce1 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.225529:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e4394a0c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3670015) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc94 expref: 30 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.225535:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129756.225536:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129756.225539:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6200/0x48868a4e4394a17c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fce1 expref: 19 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.225555:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e4394a0c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3670015) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc94 expref: 30 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.225564:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e4394a0c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3670015) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc94 expref: 30 pid: 4589 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746129756.225572:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053351552:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129756.225593:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a260c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129756.229107:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.230163:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052309888 00000100:00100000:2.0:1746129756.230171:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052309888 00000100:00100000:1.0:1746129756.230335:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.230404:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052310144 00000100:00100000:0.0:1746129756.230407:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052310144 00000100:00100000:2.0:1746129756.230421:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11234 00000100:00100000:2.0:1746129756.230429:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949052309888:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129756.230444:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129756.230457:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009330ec00/0x48868a4e4394a183 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fce8 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129756.230499:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053351680:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129756.230549:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129756.230623:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053351424:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129756.230640:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129756.230659:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1961:x1830949052309760:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6492us (6551us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129756.230666:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5407 00000100:00100000:1.0:1746129756.230734:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.230768:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9944 00000100:00100000:0.0:1746129756.230774:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+7:28734:x1830949052310144:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129756.230782:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129756.230792:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4c5600/0x48868a4e4394a18a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fcef expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.230877:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4c4c00/0x48868a4e4394a191 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129756.230889:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5200/0x48868a4e4394a136 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcb7 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.230894:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4c4c00/0x48868a4e4394a191 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129756.230911:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5200/0x48868a4e4394a136 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcb7 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.230919:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5200/0x48868a4e4394a136 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcb7 expref: 8 pid: 14315 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746129756.230927:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053351808:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129756.230949:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129756.231237:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052310400 00000100:00100000:3.0:1746129756.231241:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052310400 00000100:00100000:1.0:1746129756.231244:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:3.0:1746129756.231265:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3ea:0x0] (1388544->1392639) req@ffff8800a5491180 x1830949052310400/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.231282:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5491180 with x1830949052310400 ext(1388544->1392639) 00002000:00010000:3.0:1746129756.231286:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5491180 00000100:00100000:3.0:1746129756.231295:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052310528 00000100:00100000:3.0:1746129756.231297:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052310528 00002000:00100000:3.0:1746129756.231304:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3321856->3670015) req@ffff8800a5491f80 x1830949052310528/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.231310:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5491f80 with x1830949052310528 ext(3321856->3670015) 00010000:00010000:3.0:1746129756.231323:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e4394a0c6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc94 expref: 33 pid: 4589 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.231332:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e4394a0c6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc94 expref: 33 pid: 4589 timeout: 802 lvb_type: 0 00002000:00010000:3.0:1746129756.231338:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5491f80 00000100:00100000:3.0:1746129756.231360:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 630 00000100:00100000:0.0:1746129756.231364:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4213 00000100:00100000:3.0:1746129756.231365:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949052310528:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129756.231369:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949052310400:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129756.231461:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949052310400:12345-192.168.204.31@tcp:3:cat.0 Request processed in 91us (725us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129756.231466:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4213 00002000:00100000:0.0:1746129756.231470:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1388544->1392639) req@ffff8800a5491180 x1830949052310400/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/4536 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129756.231477:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5491180 with x1830949052310400 ext(1388544->1392639) 00002000:00010000:0.0:1746129756.231479:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5491180 00000100:00100000:2.0:1746129756.231592:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053351552:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129756.231606:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6200/0x48868a4e4394a17c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fce1 expref: 18 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.231615:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb6200, rc 0) 00000100:00100000:2.0:1746129756.231631:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28732:x1830949052309632:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6133us (7552us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129756.231636:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11233 00000100:00100000:0.0:1746129756.236455:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.236475:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129756.236769:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053351808:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129756.236791:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4c4c00/0x48868a4e4394a191 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:1.0:1746129756.236814:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052310912 00000100:00100000:1.0:1746129756.236818:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052310912 00002000:00100000:1.0:1746129756.236868:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (1449984->1454079) req@ffff88009a04ca80 x1830949052310912/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.236877:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04ca80 with x1830949052310912 ext(1449984->1454079) 00002000:00010000:1.0:1746129756.236882:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04ca80 00000100:00100000:1.0:1746129756.236908:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4214 00000100:00100000:1.0:1746129756.236915:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949052310912:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129756.237485:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949052310912:12345-192.168.204.31@tcp:3:cat.0 Request processed in 568us (1007us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129756.237491:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4214 00002000:00100000:1.0:1746129756.237496:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (1449984->1454079) req@ffff88009a04ca80 x1830949052310912/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/4536 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.237503:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04ca80 with x1830949052310912 ext(1449984->1454079) 00002000:00010000:1.0:1746129756.237506:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04ca80 00000100:00100000:1.0:1746129756.237524:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052310656 00000100:00100000:1.0:1746129756.237692:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052310656 00010000:00010000:1.0:1746129756.237706:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5200/0x48868a4e4394a136 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcb7 expref: 9 pid: 14315 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746129756.238145:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5408 00000100:00100000:1.0:1746129756.238151:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+9:1964:x1830949052310656:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129756.238160:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129756.238165:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5200/0x48868a4e4394a136 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcb7 expref: 9 pid: 14315 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.238174:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5200/0x48868a4e4394a136 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcb7 expref: 9 pid: 14315 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.238191:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a51c5200/0x48868a4e4394a136 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcb7 expref: 9 pid: 14315 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.238205:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129756.238209:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4c4c00/0x48868a4e4394a191 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.238216:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4c4c00/0x48868a4e4394a191 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.238222:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4c4c00/0x48868a4e4394a191 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.238235:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129756.239116:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4c4c00/0x48868a4e4394a191 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129756.239124:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4c4c00/0x48868a4e4394a191 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:0.0:1746129756.239140:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129756.239244:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4c5600/0x48868a4e4394a18a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcef expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.239261:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4c4c00/0x48868a4e4394a191 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcef expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.239267:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129756.239269:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129756.239272:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4c4c00, rc 0) 00000100:00100000:0.0:1746129756.239292:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:28734:x1830949052310144:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 8519us (8958us total) trans 8589943739 rc 0/0 00000100:00100000:0.0:1746129756.239299:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9944 00000100:00100000:1.0:1746129756.241033:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:1964:x1830949052310656:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 736us (2440us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129756.241051:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5408 00002000:00010000:3.0:1746129756.241455:0:3623:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime: 1746129755 -> 1746129756 00000100:00100000:3.0:1746129756.241471:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053351680:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129756.241493:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009330ec00/0x48868a4e4394a183 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fce8 expref: 34 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129756.241504:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009330ec00/0x48868a4e4394a183 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fce8 expref: 34 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129756.241532:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009330ec00, rc 0) 00000100:00100000:3.0:1746129756.241567:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949052309888:12345-192.168.204.31@tcp:101:cat.0 Request processed in 11139us (12467us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129756.241573:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11234 00000100:00100000:0.0:1746129756.244448:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949052310528:12345-192.168.204.31@tcp:4:cat.0 Request processed in 13075us (13196us total) trans 17179873226 rc 0/0 00000100:00100000:0.0:1746129756.244459:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 630 00002000:00100000:0.0:1746129756.244468:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3321856->3670015) req@ffff8800a5491f80 x1830949052310528/t17179873226(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/448 e 0 to 0 dl 1746129767 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129756.244476:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5491f80 with x1830949052310528 ext(3321856->3670015) 00010000:00010000:0.0:1746129756.244484:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e4394a0c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc94 expref: 33 pid: 4589 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746129756.244494:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129756.244496:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e4394a0c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc94 expref: 33 pid: 4589 timeout: 802 lvb_type: 0 00002000:00010000:0.0:1746129756.244501:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5491f80 00000100:00100000:3.0:1746129756.244579:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.244623:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.244652:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052311168 00000100:00100000:3.0:1746129756.244658:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052311168 00000100:00100000:3.0:1746129756.244692:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11235 00000100:00100000:3.0:1746129756.244698:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:28728:x1830949052311168:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129756.244710:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129756.244722:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bc62400/0x48868a4e4394a19f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fcf6 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.244739:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129756.244741:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129756.244745:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc62400/0x48868a4e4394a19f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4960256->5242879] (req 4960256->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcf6 expref: 34 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.244753:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bc62400/0x48868a4e4394a19f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4960256->5242879] (req 4960256->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcf6 expref: 34 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.244762:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bc62400, rc 0) 00000100:00100000:3.0:1746129756.244780:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:28728:x1830949052311168:12345-192.168.204.31@tcp:101:cat.0 Request processed in 82us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.244787:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11235 00000100:00100000:1.0:1746129756.244872:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052311424 00000100:00100000:1.0:1746129756.244876:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052311424 00000100:00100000:1.0:1746129756.244898:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9945 00000100:00100000:1.0:1746129756.244903:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28734:x1830949052311424:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129756.244914:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129756.244930:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f7600/0x48868a4e4394a1a6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fcfd expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.244986:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f6200/0x48868a4e4394a1ad lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.244997:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4c4c00/0x48868a4e4394a191 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcef expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.245003:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f6200/0x48868a4e4394a1ad lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.245024:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4c4c00/0x48868a4e4394a191 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcef expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.245032:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4c4c00/0x48868a4e4394a191 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcef expref: 9 pid: 14315 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746129756.245042:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5490380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053351936:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129756.245093:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129dbf000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129756.245142:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052311296 00000100:00100000:0.0:1746129756.245145:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052311296 00000100:00100000:0.0:1746129756.245167:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3921 00000100:00100000:0.0:1746129756.245171:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28736:x1830949052311296:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:0.0:1746129756.245884:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28736:x1830949052311296:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 710us (1302us total) trans 8589943740 rc 0/0 00000100:00100000:0.0:1746129756.245891:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3921 00000100:00100000:1.0:1746129756.247515:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5490380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053351936:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129756.247539:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f6200/0x48868a4e4394a1ad lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129756.250162:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.250243:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129756.250645:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052311680 00000100:00100000:1.0:1746129756.250654:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052311680 00010000:00010000:1.0:1746129756.250681:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e4394a0c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3321856->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc94 expref: 34 pid: 4589 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746129756.250905:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052311552 00000100:00100000:1.0:1746129756.250908:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052311552 00010000:00010000:1.0:1746129756.250921:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4c4c00/0x48868a4e4394a191 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcef expref: 10 pid: 14315 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746129756.251025:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5409 00000100:00100000:2.0:1746129756.251033:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130566450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949052311680:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129756.251044:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129756.251064:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e4394a0c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3321856->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc94 expref: 34 pid: 4589 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.251079:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e4394a0c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3321856->3670015) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc94 expref: 34 pid: 4589 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.251097:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e4394a0c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3321856->3670015) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc94 expref: 34 pid: 4589 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.251113:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.251114:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.251120:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6200/0x48868a4e4394a17c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fce1 expref: 17 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.251128:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6200/0x48868a4e4394a17c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fce1 expref: 17 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.251134:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.251135:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.251138:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bc62400/0x48868a4e4394a19f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcf6 expref: 33 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.251144:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc62400/0x48868a4e4394a19f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcf6 expref: 33 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.251171:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bc62400/0x48868a4e4394a19f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcf6 expref: 33 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129756.251182:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053352064:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129756.251251:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6200/0x48868a4e4394a17c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fce1 expref: 17 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129756.251260:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053352192:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129756.251276:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1240 going to sleep for 11 seconds 00000100:00100000:1.0:1746129756.251441:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5410 00000100:00100000:1.0:1746129756.251447:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052311552:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129756.251455:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129756.251460:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4c4c00/0x48868a4e4394a191 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcef expref: 10 pid: 14315 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.251467:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4c4c00/0x48868a4e4394a191 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcef expref: 10 pid: 14315 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.251477:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4c4c00/0x48868a4e4394a191 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcef expref: 10 pid: 14315 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.251490:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129756.251494:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f6200/0x48868a4e4394a1ad lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.251500:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f6200/0x48868a4e4394a1ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.251509:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f6200/0x48868a4e4394a1ad lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.251523:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129756.251535:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f6200/0x48868a4e4394a1ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.251540:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f6200/0x48868a4e4394a1ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:1.0:1746129756.251569:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:1.0:1746129756.251573:0:14315:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746129756.251584:0:14315:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f6200/0x48868a4e4394a1ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.251608:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f7600/0x48868a4e4394a1a6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcfd expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.251620:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f6200/0x48868a4e4394a1ad lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcfd expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.251626:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129756.251628:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129756.251630:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b7f6200, rc 0) 00000100:00100000:1.0:1746129756.251652:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:28734:x1830949052311424:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 6748us (7028us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129756.251658:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9945 00000100:00100000:1.0:1746129756.251687:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052311552:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 240us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129756.251692:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5410 00000100:00100000:0.0:1746129756.253497:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.253753:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.253890:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053352192:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129756.253937:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052311808 00000100:00100000:3.0:1746129756.253941:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052311808 00000100:00100000:3.0:1746129756.253964:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052311936 00000100:00100000:3.0:1746129756.253966:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052311936 00000100:00100000:3.0:1746129756.253976:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11236 00000100:00100000:3.0:1746129756.253981:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949052311808:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129756.253993:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129756.254005:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b539b600/0x48868a4e4394a1b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fd04 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129756.254038:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130507480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053352320:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129756.254160:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11237 00000100:00100000:2.0:1746129756.254165:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+12:1963:x1830949052311936:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129756.254171:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129756.254176:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009330e400/0x48868a4e4394a1bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fd0b expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.254186:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.254187:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.254193:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009330e400/0x48868a4e4394a1bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd0b expref: 13 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129756.254203:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009330e400/0x48868a4e4394a1bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd0b expref: 13 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129756.254210:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009330e400, rc 0) 00000100:00100000:3.0:1746129756.254470:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26780 going to sleep for 11 seconds 00000100:00100000:3.0:1746129756.254778:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053352064:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129756.254792:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129756.254813:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130566450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949052311680:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3781us (4657us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.254821:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5409 00000100:00100000:2.0:1746129756.254927:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+13:1963:x1830949052311936:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 761us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129756.254932:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11237 00000100:00100000:3.0:1746129756.256384:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130507480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053352320:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129756.256403:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b539b600/0x48868a4e4394a1b4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd04 expref: 12 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129756.256414:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b539b600/0x48868a4e4394a1b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd04 expref: 12 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129756.256495:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b539b600, rc 0) 00000100:00100000:3.0:1746129756.256904:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949052311808:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 2921us (3410us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129756.256910:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11236 00000100:00100000:0.0:1746129756.257628:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.257717:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052312064 00000100:00100000:3.0:1746129756.257721:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052312064 00000100:00100000:3.0:1746129756.257789:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11238 00000100:00100000:3.0:1746129756.257796:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1964:x1830949052312064:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129756.257808:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129756.257818:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094da2a00/0x48868a4e4394a1c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fd12 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129756.258506:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130507480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053352448:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129756.258576:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129756.260545:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.260597:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052312320 00000100:00100000:2.0:1746129756.260603:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052312320 00000100:00100000:2.0:1746129756.260650:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9946 00000100:00100000:2.0:1746129756.260656:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28734:x1830949052312320:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129756.260672:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129756.260689:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009330f600/0x48868a4e4394a1c9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fd19 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.260761:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009330fe00/0x48868a4e4394a1d0 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129756.260814:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009330fe00/0x48868a4e4394a1d0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129756.260822:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009330fe00/0x48868a4e4394a1d0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129756.260832:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000100:00100000:1.0:1746129756.261062:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.261115:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052312576 00000100:00100000:0.0:1746129756.261118:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052312576 00002000:00100000:0.0:1746129756.261139:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a5490380 x1830949052312576/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129756.261151:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5490380 with x1830949052312576 ext(2097152->3145727) 00002000:00010000:0.0:1746129756.261155:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5490380 00000100:00100000:0.0:1746129756.261171:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4215 00010000:00010000:2.0:1746129756.261268:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009330f600/0x48868a4e4394a1c9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd19 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.261287:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009330fe00/0x48868a4e4394a1d0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd19 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.261294:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129756.261297:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129756.261299:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009330fe00, rc 0) 00000100:00100000:2.0:1746129756.261345:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+10:28734:x1830949052312320:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 688us (1080us total) trans 8589943741 rc 0/0 00000100:00100000:2.0:1746129756.261350:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9946 00000100:00100000:0.0:1746129756.261390:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052312576:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129756.261434:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130507480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053352448:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129756.261452:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094da2a00/0x48868a4e4394a1c2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd12 expref: 34 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129756.261461:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094da2a00/0x48868a4e4394a1c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd12 expref: 34 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129756.261467:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094da2a00, rc 0) 00000100:00100000:3.0:1746129756.261488:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1964:x1830949052312064:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3693us (3861us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129756.261495:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11238 00000100:00100000:1.0:1746129756.261540:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129756.261552:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052312832 00000100:00100000:1.0:1746129756.261555:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052312832 00002000:00100000:1.0:1746129756.261568:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800a5491880 x1830949052312832/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.261574:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5491880 with x1830949052312832 ext(3145728->4194303) 00002000:00010000:1.0:1746129756.261576:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5491880 00000100:00100000:1.0:1746129756.261585:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4216 00000100:00100000:1.0:1746129756.261589:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949052312832:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129756.267907:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.267943:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.267980:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.268043:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052313088 00000100:00100000:3.0:1746129756.268052:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052313088 00002000:00100000:3.0:1746129756.268088:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (4960256->4964351) req@ffff88009adafb80 x1830949052313088/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.268097:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adafb80 with x1830949052313088 ext(4960256->4964351) 00002000:00010000:3.0:1746129756.268102:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adafb80 00000100:00100000:3.0:1746129756.268119:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4217 00000100:00100000:3.0:1746129756.268126:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949052313088:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129756.268258:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949052313088:12345-192.168.204.31@tcp:3:cat.0 Request processed in 132us (357us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129756.268263:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4217 00002000:00100000:3.0:1746129756.268267:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (4960256->4964351) req@ffff88009adafb80 x1830949052313088/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/4536 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.268273:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adafb80 with x1830949052313088 ext(4960256->4964351) 00002000:00010000:3.0:1746129756.268276:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adafb80 00000100:00100000:2.0:1746129756.268490:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052313216 00000100:00100000:2.0:1746129756.268494:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052313216 00000100:00100000:2.0:1746129756.268519:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052313344 00000100:00100000:2.0:1746129756.268521:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052313344 00000100:00100000:2.0:1746129756.268534:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11239 00000100:00100000:2.0:1746129756.268539:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949052313216:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:2.0:1746129756.268561:0:1140:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009330ea00/0x48868a4e4394a1de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.268577:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fc00/0x48868a4e43949ef8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb98 expref: 11 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129756.268584:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x48868a4e43949fbc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbde expref: 32 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.268591:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc8e600/0x48868a4e43949fb5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbd7 expref: 21 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.268597:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.268599:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.268601:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009330ea00/0x48868a4e4394a1de lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.268626:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc8e600/0x48868a4e43949fb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbd7 expref: 21 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.268636:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc8e600/0x48868a4e43949fb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbd7 expref: 21 pid: 8437 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746129756.268645:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053352576:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129756.268703:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x48868a4e43949fbc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbde expref: 32 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.268709:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x48868a4e43949fbc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbde expref: 32 pid: 4589 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746129756.268716:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053352704:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129756.268737:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fc00/0x48868a4e43949ef8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb98 expref: 11 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129756.268743:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fc00/0x48868a4e43949ef8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb98 expref: 11 pid: 7975 timeout: 802 lvb_type: 1 00000100:00100000:2.0:1746129756.268750:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053352832:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129756.268764:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129756.268780:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11240 00000100:00100000:2.0:1746129756.268785:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+12:1964:x1830949052313344:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:2.0:1746129756.268800:0:20441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef3800/0x48868a4e4394a1e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.268809:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9e00/0x48868a4e43949f06 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb9f expref: 12 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129756.268814:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e1ab400/0x48868a4e43949fed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc01 expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.268825:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3200/0x48868a4e43949fdf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbf3 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.268829:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.268831:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.268833:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef3800/0x48868a4e4394a1e5 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.268866:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3200/0x48868a4e43949fdf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbf3 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.268873:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3200/0x48868a4e43949fdf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbf3 expref: 11 pid: 8437 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746129756.268882:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053352960:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129756.268915:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e1ab400/0x48868a4e43949fed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc01 expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.268921:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e1ab400/0x48868a4e43949fed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc01 expref: 16 pid: 1140 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746129756.268928:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053353088:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129756.268946:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9e00/0x48868a4e43949f06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb9f expref: 12 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129756.268955:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9e00/0x48868a4e43949f06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb9f expref: 12 pid: 8435 timeout: 802 lvb_type: 1 00000100:00100000:2.0:1746129756.268962:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053353216:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129756.268975:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129756.269987:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.270019:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.270041:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.270069:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.270385:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052313472 00000100:00100000:3.0:1746129756.270390:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052313472 00000100:00100000:3.0:1746129756.270412:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052313728 00000100:00100000:3.0:1746129756.270413:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052313728 00000100:00100000:3.0:1746129756.270422:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052313600 00000100:00100000:3.0:1746129756.270423:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052313600 00000100:00100000:3.0:1746129756.270431:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052313856 00000100:00100000:3.0:1746129756.270432:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052313856 00000100:00100000:3.0:1746129756.270444:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11241 00000100:00100000:3.0:1746129756.270449:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+14:1964:x1830949052313472:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:3.0:1746129756.270472:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394a1ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.270483:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f800/0x48868a4e43949f0d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fba6 expref: 14 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129756.270489:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1e000/0x48868a4e4394a009 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc24 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.270496:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7600/0x48868a4e4394a002 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc08 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.270501:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129756.270502:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129756.270504:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394a1ec lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.270523:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7600/0x48868a4e4394a002 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc08 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.270531:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7600/0x48868a4e4394a002 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc08 expref: 11 pid: 8437 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746129756.270539:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130507480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053353344:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129756.270595:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acc1e000/0x48868a4e4394a009 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc24 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.270607:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1e000/0x48868a4e4394a009 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc24 expref: 16 pid: 8437 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746129756.270615:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053353472:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129756.270639:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f800/0x48868a4e43949f0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fba6 expref: 14 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129756.270646:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f800/0x48868a4e43949f0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fba6 expref: 14 pid: 3624 timeout: 802 lvb_type: 1 00000100:00100000:3.0:1746129756.270654:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130506d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053353600:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129756.270671:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26780 going to sleep for 11 seconds 00000100:00100000:3.0:1746129756.270688:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11242 00000100:00100000:3.0:1746129756.270694:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+13:1964:x1830949052313728:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:3.0:1746129756.270711:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095106600/0x48868a4e4394a1f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.270720:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6200/0x48868a4e4394a17c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fce1 expref: 21 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.270726:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009330e400/0x48868a4e4394a1bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd0b expref: 13 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129756.270733:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bc62400/0x48868a4e4394a19f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcf6 expref: 32 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.270739:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129756.270741:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129756.270743:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095106600/0x48868a4e4394a1f3 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.270756:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bc62400/0x48868a4e4394a19f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcf6 expref: 32 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.270763:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bc62400/0x48868a4e4394a19f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcf6 expref: 32 pid: 3623 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746129756.270770:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130507800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053353728:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129756.270794:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009330e400/0x48868a4e4394a1bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd0b expref: 13 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129756.270800:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009330e400/0x48868a4e4394a1bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd0b expref: 13 pid: 1140 timeout: 802 lvb_type: 1 00000100:00100000:3.0:1746129756.270807:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130507b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053353856:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129756.270829:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6200/0x48868a4e4394a17c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fce1 expref: 21 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.270836:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6200/0x48868a4e4394a17c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fce1 expref: 21 pid: 20441 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746129756.270869:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130506680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053353984:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129756.270896:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129756.270910:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11243 00000100:00100000:3.0:1746129756.270915:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+13:1964:x1830949052313600:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:3.0:1746129756.270927:0:3623:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e800/0x48868a4e4394a1fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.270937:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a160 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1454079) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcc5 expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.270942:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129756.270943:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129756.270945:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e800/0x48868a4e4394a1fa lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.270957:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a160 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1454079) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcc5 expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.270963:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a160 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1454079) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcc5 expref: 21 pid: 4589 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746129756.270969:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053354112:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129756.270983:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129756.271123:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11244 00000100:00100000:1.0:1746129756.271130:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+14:1964:x1830949052313856:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:1.0:1746129756.271145:0:4589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135cab400/0x48868a4e4394a201 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.271155:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef3a00/0x48868a4e4394a064 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc6a expref: 16 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.271161:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a16e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcda expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129756.271167:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7400/0x48868a4e4394a06b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc71 expref: 11 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.271172:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129756.271173:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129756.271175:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135cab400/0x48868a4e4394a201 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.271191:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7400/0x48868a4e4394a06b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc71 expref: 11 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.271198:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7400/0x48868a4e4394a06b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc71 expref: 11 pid: 10930 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746129756.271205:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5493800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053354240:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129756.271234:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a16e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcda expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129756.271241:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a16e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcda expref: 14 pid: 8437 timeout: 802 lvb_type: 1 00000100:00100000:1.0:1746129756.271248:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5492a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053354368:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129756.271266:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef3a00/0x48868a4e4394a064 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc6a expref: 16 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.271273:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef3a00/0x48868a4e4394a064 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc6a expref: 16 pid: 10930 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746129756.271279:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5490e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053354496:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129756.271289:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129dbf000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129756.273577:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949052312576:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12392us (13008us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129756.273588:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4215 00002000:00100000:0.0:1746129756.273597:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a5490380 x1830949052312576/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129756.273605:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5490380 with x1830949052312576 ext(2097152->3145727) 00010000:00010000:0.0:1746129756.273613:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6200/0x48868a4e4394a17c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fce1 expref: 20 pid: 20441 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.273623:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6200/0x48868a4e4394a17c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fce1 expref: 20 pid: 20441 timeout: 802 lvb_type: 0 00002000:00010000:0.0:1746129756.273629:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5490380 00000100:00100000:2.0:1746129756.277622:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053352576:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129756.277926:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052312832:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16334us (16383us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129756.277934:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4216 00002000:00100000:1.0:1746129756.277943:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800a5491880 x1830949052312832/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.277950:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5491880 with x1830949052312832 ext(3145728->4194303) 00010000:00010000:1.0:1746129756.277958:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6200/0x48868a4e4394a17c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fce1 expref: 18 pid: 20441 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.277968:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6200/0x48868a4e4394a17c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fce1 expref: 18 pid: 20441 timeout: 802 lvb_type: 0 00002000:00010000:1.0:1746129756.277973:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5491880 00000100:00100000:2.0:1746129756.278870:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053352704:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129756.278879:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053352832:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129756.278906:0:1140:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009330ea00/0x48868a4e4394a1de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129756.280411:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.280442:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.280468:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.280482:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.280500:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052313984 00000100:00100000:0.0:1746129756.280505:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052313984 00010000:00010000:0.0:1746129756.280531:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc8e600/0x48868a4e43949fb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbd7 expref: 18 pid: 8437 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746129756.280548:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052314240 00000100:00100000:0.0:1746129756.280550:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052314240 00010000:00010000:0.0:1746129756.280558:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fc00/0x48868a4e43949ef8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb98 expref: 14 pid: 7975 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746129756.280568:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052314112 00000100:00100000:0.0:1746129756.280569:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052314112 00010000:00010000:0.0:1746129756.280576:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x48868a4e43949fbc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbde expref: 33 pid: 4589 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746129756.280587:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5411 00000100:00100000:0.0:1746129756.280593:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949052313984:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129756.280603:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129756.280618:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc8e600/0x48868a4e43949fb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbd7 expref: 18 pid: 8437 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.280628:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc8e600/0x48868a4e43949fb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbd7 expref: 18 pid: 8437 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.280645:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc8e600/0x48868a4e43949fb5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbd7 expref: 18 pid: 8437 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.280661:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129756.280688:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949052313984:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 96us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129756.280694:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5411 00000100:00100000:0.0:1746129756.280705:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5412 00000100:00100000:0.0:1746129756.280709:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+14:1964:x1830949052314240:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129756.280715:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129756.280720:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fc00/0x48868a4e43949ef8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb98 expref: 14 pid: 7975 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746129756.280728:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fc00/0x48868a4e43949ef8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb98 expref: 14 pid: 7975 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746129756.280739:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6fc00/0x48868a4e43949ef8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb98 expref: 14 pid: 7975 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746129756.280746:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129756.280756:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+13:1964:x1830949052314240:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 47us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129756.280761:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5412 00000100:00100000:0.0:1746129756.280767:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5413 00000100:00100000:0.0:1746129756.280772:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1964:x1830949052314112:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129756.280777:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129756.280782:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x48868a4e43949fbc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbde expref: 33 pid: 4589 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.280789:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x48868a4e43949fbc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbde expref: 33 pid: 4589 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.280799:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x48868a4e43949fbc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbde expref: 33 pid: 4589 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.280806:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129756.280808:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129756.280811:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009330ea00/0x48868a4e4394a1de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.280818:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009330ea00/0x48868a4e4394a1de lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.280832:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129756.280842:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949052314112:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 70us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129756.280865:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5413 00000100:00100000:0.0:1746129756.280896:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.280905:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052314624 00000100:00100000:0.0:1746129756.280907:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052314624 00010000:00010000:0.0:1746129756.280916:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3200/0x48868a4e43949fdf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbf3 expref: 12 pid: 8437 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746129756.280925:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5414 00000100:00100000:0.0:1746129756.280928:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1964:x1830949052314624:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129756.280936:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129756.280945:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3200/0x48868a4e43949fdf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbf3 expref: 12 pid: 8437 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.280952:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3200/0x48868a4e43949fdf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbf3 expref: 12 pid: 8437 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.280961:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129756.280971:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1964:x1830949052314624:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 43us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129756.280976:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5414 00000100:00100000:0.0:1746129756.281016:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.281023:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052314880 00000100:00100000:0.0:1746129756.281025:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052314880 00010000:00010000:0.0:1746129756.281032:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9e00/0x48868a4e43949f06 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb9f expref: 15 pid: 8435 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746129756.281041:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5415 00000100:00100000:0.0:1746129756.281044:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052314880:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129756.281049:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129756.281054:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9e00/0x48868a4e43949f06 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb9f expref: 15 pid: 8435 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746129756.281060:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9e00/0x48868a4e43949f06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb9f expref: 15 pid: 8435 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746129756.281067:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129756.281077:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052314880:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 33us (61us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129756.281081:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5415 00000100:00100000:0.0:1746129756.281107:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.281113:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052314752 00000100:00100000:0.0:1746129756.281115:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052314752 00010000:00010000:0.0:1746129756.281122:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e1ab400/0x48868a4e43949fed lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc01 expref: 17 pid: 1140 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746129756.281130:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5416 00000100:00100000:0.0:1746129756.281133:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130566050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949052314752:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129756.281138:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129756.281142:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e1ab400/0x48868a4e43949fed lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc01 expref: 17 pid: 1140 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.281148:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e1ab400/0x48868a4e43949fed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc01 expref: 17 pid: 1140 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.281157:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129756.281158:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129756.281160:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef3800/0x48868a4e4394a1e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.281165:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef3800/0x48868a4e4394a1e5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.281172:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129756.281182:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130566050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949052314752:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 48us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129756.281186:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5416 00000100:00100000:0.0:1746129756.281268:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.281275:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052315136 00000100:00100000:0.0:1746129756.281277:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052315136 00010000:00010000:0.0:1746129756.281285:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1e000/0x48868a4e4394a009 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc24 expref: 17 pid: 8437 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746129756.281293:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5417 00000100:00100000:0.0:1746129756.281297:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1963:x1830949052315136:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129756.281301:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129756.281307:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acc1e000/0x48868a4e4394a009 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc24 expref: 17 pid: 8437 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.281328:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acc1e000/0x48868a4e4394a009 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc24 expref: 17 pid: 8437 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.281337:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129756.281350:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1963:x1830949052315136:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 53us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129756.281354:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5417 00000100:00100000:0.0:1746129756.281372:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.281378:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052315008 00000100:00100000:0.0:1746129756.281380:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052315008 00010000:00010000:0.0:1746129756.281386:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7600/0x48868a4e4394a002 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc08 expref: 12 pid: 8437 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746129756.281395:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5418 00000100:00100000:0.0:1746129756.281399:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1963:x1830949052315008:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129756.281403:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129756.281409:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7600/0x48868a4e4394a002 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc08 expref: 12 pid: 8437 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.281415:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7600/0x48868a4e4394a002 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc08 expref: 12 pid: 8437 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.281431:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129756.281442:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1963:x1830949052315008:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 43us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129756.281447:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5418 00000100:00100000:0.0:1746129756.281473:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.281482:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052315264 00000100:00100000:0.0:1746129756.281484:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052315264 00010000:00010000:0.0:1746129756.281491:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f800/0x48868a4e43949f0d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fba6 expref: 15 pid: 3624 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746129756.281500:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5419 00000100:00100000:0.0:1746129756.281504:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052315264:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129756.281509:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129756.281515:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f800/0x48868a4e43949f0d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fba6 expref: 15 pid: 3624 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746129756.281522:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f800/0x48868a4e43949f0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fba6 expref: 15 pid: 3624 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746129756.281536:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129756.281537:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129756.281540:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394a1ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.281546:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394a1ec lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.281554:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129756.281565:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6141239f-0c60-480d-830c-e22ba61457b0+15:1962:x1830949052315264:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 60us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129756.281570:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5419 00010000:00010000:2.0:1746129756.281715:0:1140:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009330ea00/0x48868a4e4394a1de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.281722:0:1140:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009330ea00/0x48868a4e4394a1de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.281738:0:1140:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009330ea00/0x48868a4e4394a1de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.281744:0:1140:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009330ea00/0x48868a4e4394a1de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.281750:0:1140:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009330ea00/0x48868a4e4394a1de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.281756:0:1140:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009330ea00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129756.281759:0:1140:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009330ea00/0x48868a4e4394a1de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.281764:0:1140:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009330ea00/0x48868a4e4394a1de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.281773:0:1140:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009330ea00/0x48868a4e4394a1de lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.281778:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009330ea00/0x48868a4e4394a1de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129756.281813:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+12:1963:x1830949052313216:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 13274us (13869us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129756.281819:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11239 00010000:00010000:2.0:1746129756.281875:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3200/0x48868a4e43949fdf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fbf3 expref: 11 pid: 8437 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746129756.281884:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053352960:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129756.281892:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e1ab400/0x48868a4e43949fed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc01 expref: 16 pid: 1140 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746129756.281897:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053353088:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129756.281905:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9e00/0x48868a4e43949f06 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fb9f expref: 14 pid: 8435 timeout: 802 lvb_type: 1 00000100:00100000:2.0:1746129756.281911:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053353216:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129756.281929:0:20441:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef3800/0x48868a4e4394a1e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.281935:0:20441:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef3800/0x48868a4e4394a1e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.281939:0:20441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef3800/0x48868a4e4394a1e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.281950:0:20441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef3800/0x48868a4e4394a1e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.281956:0:20441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef3800/0x48868a4e4394a1e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.281960:0:20441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef3800/0x48868a4e4394a1e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.281964:0:20441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ef3800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129756.281966:0:20441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef3800/0x48868a4e4394a1e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.281970:0:20441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef3800/0x48868a4e4394a1e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.281982:0:20441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef3800/0x48868a4e4394a1e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.281987:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef3800/0x48868a4e4394a1e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129756.282013:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+13:1964:x1830949052313344:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 13229us (14033us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129756.282017:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11240 00000100:00100000:1.0:1746129756.282072:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052314496 00000100:00100000:1.0:1746129756.282076:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052314496 00000100:00100000:1.0:1746129756.282095:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3922 00000100:00100000:1.0:1746129756.282099:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012babf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:28728:x1830949052314496:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129756.282220:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012babf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:28728:x1830949052314496:12345-192.168.204.31@tcp:35:cat.0 Request processed in 120us (1814us total) trans 8589943742 rc 0/0 00000100:00100000:1.0:1746129756.282226:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3922 00000100:00100000:1.0:1746129756.282268:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5493800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053354240:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129756.282347:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130507800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053353728:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129756.282358:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130507b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053353856:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129756.282365:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130506680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053353984:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129756.282382:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095106600/0x48868a4e4394a1f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.282400:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7600/0x48868a4e4394a002 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc08 expref: 10 pid: 8437 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746129756.282411:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130507480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053353344:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129756.282419:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1e000/0x48868a4e4394a009 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc24 expref: 15 pid: 8437 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746129756.282426:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053353472:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129756.282433:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6f800/0x48868a4e43949f0d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fba6 expref: 12 pid: 3624 timeout: 802 lvb_type: 1 00000100:00100000:3.0:1746129756.282439:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130506d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053353600:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129756.282451:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394a1ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.282457:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394a1ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.282461:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394a1ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.282473:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394a1ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.282478:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394a1ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.282482:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394a1ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.282486:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d7f9a00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129756.282488:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394a1ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.282493:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394a1ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.282500:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394a1ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.282504:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9a00/0x48868a4e4394a1ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129756.282530:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052313472:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 12081us (12547us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.282535:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11241 00000100:00100000:3.0:1746129756.282560:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053354112:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129756.282568:0:3623:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e800/0x48868a4e4394a1fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129756.285107:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.285717:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052315520 00000100:00100000:3.0:1746129756.285724:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052315520 00010000:00010000:3.0:1746129756.285753:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009330e400/0x48868a4e4394a1bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd0b expref: 12 pid: 1140 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746129756.286030:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.286606:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.286624:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052315392 00000100:00100000:3.0:1746129756.286627:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052315392 00010000:00010000:3.0:1746129756.286643:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc62400/0x48868a4e4394a19f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcf6 expref: 32 pid: 3623 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746129756.286980:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.287499:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052315776 00000100:00100000:3.0:1746129756.287503:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052315776 00010000:00010000:3.0:1746129756.287519:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a16e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcda expref: 11 pid: 8437 timeout: 802 lvb_type: 1 00000100:00100000:3.0:1746129756.287539:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5420 00000100:00100000:3.0:1746129756.287546:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949052315520:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129756.287558:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129756.287578:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009330e400/0x48868a4e4394a1bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd0b expref: 12 pid: 1140 timeout: 802 lvb_type: 1 00010000:00010000:3.0:1746129756.287587:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009330e400/0x48868a4e4394a1bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd0b expref: 12 pid: 1140 timeout: 802 lvb_type: 1 00010000:00010000:3.0:1746129756.287605:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009330e400/0x48868a4e4394a1bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd0b expref: 12 pid: 1140 timeout: 802 lvb_type: 1 00010000:00010000:3.0:1746129756.287620:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129756.287651:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052315520:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 107us (2552us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.287656:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5420 00000100:00100000:3.0:1746129756.287672:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5421 00000100:00100000:3.0:1746129756.287676:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949052315392:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129756.287680:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129756.287685:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bc62400/0x48868a4e4394a19f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcf6 expref: 32 pid: 3623 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.287691:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bc62400/0x48868a4e4394a19f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcf6 expref: 32 pid: 3623 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.287700:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bc62400/0x48868a4e4394a19f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcf6 expref: 32 pid: 3623 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.287706:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129756.287717:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949052315392:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 41us (1688us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.287721:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5421 00000100:00100000:3.0:1746129756.287728:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5422 00000100:00100000:3.0:1746129756.287731:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052315776:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129756.287737:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129756.287748:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a16e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcda expref: 11 pid: 8437 timeout: 802 lvb_type: 1 00010000:00010000:3.0:1746129756.287754:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a16e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcda expref: 11 pid: 8437 timeout: 802 lvb_type: 1 00010000:00010000:3.0:1746129756.287762:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129756.287771:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052315776:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 40us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.287775:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5422 00000100:00100000:3.0:1746129756.287823:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.287833:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052315904 00000100:00100000:3.0:1746129756.287835:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052315904 00010000:00010000:3.0:1746129756.287844:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef3a00/0x48868a4e4394a064 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc6a expref: 15 pid: 10930 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746129756.287872:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5423 00000100:00100000:3.0:1746129756.287876:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949052315904:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129756.287882:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129756.287888:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef3a00/0x48868a4e4394a064 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc6a expref: 15 pid: 10930 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.287895:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef3a00/0x48868a4e4394a064 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc6a expref: 15 pid: 10930 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.287904:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129756.287915:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949052315904:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 39us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.287923:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5423 00000100:00100000:3.0:1746129756.287993:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.288005:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052316032 00000100:00100000:3.0:1746129756.288007:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052316032 00010000:00010000:3.0:1746129756.288017:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7400/0x48868a4e4394a06b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc71 expref: 10 pid: 10930 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746129756.288026:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5424 00000100:00100000:3.0:1746129756.288030:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052316032:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129756.288035:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129756.288042:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7400/0x48868a4e4394a06b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc71 expref: 10 pid: 10930 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.288048:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7400/0x48868a4e4394a06b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc71 expref: 10 pid: 10930 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.288058:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7400/0x48868a4e4394a06b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc71 expref: 10 pid: 10930 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.288065:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129756.288067:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129756.288071:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135cab400/0x48868a4e4394a201 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.288078:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135cab400/0x48868a4e4394a201 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.288095:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129756.288108:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1961:x1830949052316032:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 77us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.288112:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5424 00000100:00100000:1.0:1746129756.289031:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052315648 00000100:00100000:1.0:1746129756.289036:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052315648 00002000:00100000:1.0:1746129756.289065:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (1388544->1454079) req@ffff88012ba19880 x1830949052315648/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.289074:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba19880 with x1830949052315648 ext(1388544->1454079) 00010000:00010000:1.0:1746129756.289081:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a160 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcc5 expref: 17 pid: 4589 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.289089:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a160 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcc5 expref: 17 pid: 4589 timeout: 802 lvb_type: 0 00002000:00010000:1.0:1746129756.289095:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ba19880 00000100:00100000:1.0:1746129756.289108:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 631 00000100:00100000:1.0:1746129756.289114:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052315648:12345-192.168.204.31@tcp:4:cat.0 00010000:00010000:1.0:1746129756.289256:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a16e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcda expref: 10 pid: 8437 timeout: 802 lvb_type: 1 00000100:00100000:1.0:1746129756.289266:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5492a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053354368:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129756.289277:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef3a00/0x48868a4e4394a064 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc6a expref: 14 pid: 10930 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746129756.289286:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5490e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053354496:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129756.289309:0:4589:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880135cab400/0x48868a4e4394a201 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.289328:0:4589:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880135cab400/0x48868a4e4394a201 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.289334:0:4589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135cab400/0x48868a4e4394a201 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.289355:0:4589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135cab400/0x48868a4e4394a201 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.289361:0:4589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135cab400/0x48868a4e4394a201 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.289368:0:4589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135cab400/0x48868a4e4394a201 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.289374:0:4589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135cab400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129756.289377:0:4589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135cab400/0x48868a4e4394a201 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.289384:0:4589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135cab400/0x48868a4e4394a201 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.289396:0:4589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135cab400/0x48868a4e4394a201 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.289401:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135cab400/0x48868a4e4394a201 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129756.289434:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+9:1964:x1830949052313856:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 18305us (19365us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129756.289441:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11244 00000100:00100000:0.0:1746129756.292775:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129756.293708:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052316160 00000100:00100000:1.0:1746129756.293718:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052316160 00000100:00100000:1.0:1746129756.293768:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11245 00000100:00100000:1.0:1746129756.293882:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28732:x1830949052316160:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129756.293896:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129756.293912:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a87c3a00/0x48868a4e4394a208 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fd20 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129756.293932:0:4589:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e8:0x0] initial LVB size: 4194304, mtime: 0x6813d35c, atime: 0x6813d35b, ctime: 0x6813d35c, blocks: 0x1029 00010000:00010000:1.0:1746129756.293949:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129756.293951:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746129756.294214:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.294228:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052316288 00000100:00100000:0.0:1746129756.294230:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052316288 00010000:00010000:0.0:1746129756.294245:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6200/0x48868a4e4394a17c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fce1 expref: 19 pid: 20441 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746129756.294260:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5425 00000100:00100000:0.0:1746129756.294264:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1961:x1830949052316288:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129756.294272:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129756.294284:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6200/0x48868a4e4394a17c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fce1 expref: 19 pid: 20441 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.294293:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6200/0x48868a4e4394a17c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fce1 expref: 19 pid: 20441 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.294308:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6200/0x48868a4e4394a17c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fce1 expref: 19 pid: 20441 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.294337:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129756.294339:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129756.294342:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095106600/0x48868a4e4394a1f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.294347:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095106600/0x48868a4e4394a1f3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.294363:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129756.294391:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949052316288:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 126us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129756.294396:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5425 00010000:00010000:3.0:1746129756.294480:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095106600/0x48868a4e4394a1f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.294488:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095106600/0x48868a4e4394a1f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.294503:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095106600/0x48868a4e4394a1f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.294508:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095106600/0x48868a4e4394a1f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.294514:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095106600/0x48868a4e4394a1f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.294519:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095106600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129756.294522:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095106600/0x48868a4e4394a1f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.294528:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095106600/0x48868a4e4394a1f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.294541:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095106600/0x48868a4e4394a1f3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.294546:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095106600/0x48868a4e4394a1f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129756.294585:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+10:1964:x1830949052313728:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 23891us (24564us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.294590:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11242 00010000:00010000:1.0:1746129756.295031:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a87c3a00/0x48868a4e4394a208 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd20 expref: 10 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.295047:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a87c3a00/0x48868a4e4394a208 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd20 expref: 10 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.295054:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a87c3a00, rc 0) 00000100:00100000:1.0:1746129756.295084:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28732:x1830949052316160:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1206us (2315us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129756.295089:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11245 00000100:00100000:1.0:1746129756.297197:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949052315648:12345-192.168.204.31@tcp:4:cat.0 Request processed in 8076us (10584us total) trans 17179873227 rc 0/0 00000100:00100000:1.0:1746129756.297206:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 631 00002000:00100000:1.0:1746129756.297215:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (1388544->1454079) req@ffff88012ba19880 x1830949052315648/t17179873227(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/448 e 0 to 0 dl 1746129767 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.297223:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba19880 with x1830949052315648 ext(1388544->1454079) 00010000:00010000:1.0:1746129756.297232:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a160 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcc5 expref: 18 pid: 4589 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.297243:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a160 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcc5 expref: 18 pid: 4589 timeout: 802 lvb_type: 0 00002000:00010000:1.0:1746129756.297249:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ba19880 00000100:00100000:3.0:1746129756.299166:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129756.299210:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052316544 00000100:00100000:1.0:1746129756.299217:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052316544 00002000:00100000:1.0:1746129756.299248:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880130506d80 x1830949052316544/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.299256:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130506d80 with x1830949052316544 ext(2097152->3145727) 00002000:00010000:1.0:1746129756.299260:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130506d80 00000100:00100000:1.0:1746129756.299409:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4218 00000100:00100000:1.0:1746129756.299415:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949052316544:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129756.301082:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129756.302026:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052316672 00000100:00100000:1.0:1746129756.302034:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052316672 00010000:00010000:1.0:1746129756.302061:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a160 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcc5 expref: 18 pid: 4589 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746129756.302090:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5426 00000100:00100000:1.0:1746129756.302096:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052316672:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129756.302107:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129756.302125:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a160 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1388544->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcc5 expref: 18 pid: 4589 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.302139:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a160 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1388544->1454079) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcc5 expref: 18 pid: 4589 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.302157:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a160 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1388544->1454079) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcc5 expref: 18 pid: 4589 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.302172:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129756.302173:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129756.302177:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e800/0x48868a4e4394a1fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.302185:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e800/0x48868a4e4394a1fa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.302218:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129756.302243:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052316672:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 147us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129756.302248:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5426 00010000:00010000:3.0:1746129756.302299:0:3623:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e800/0x48868a4e4394a1fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.302309:0:3623:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e800/0x48868a4e4394a1fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.302338:0:3623:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e800/0x48868a4e4394a1fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.302344:0:3623:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e800/0x48868a4e4394a1fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.302350:0:3623:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e800/0x48868a4e4394a1fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.302355:0:3623:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb6e800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129756.302358:0:3623:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e800/0x48868a4e4394a1fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.302364:0:3623:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e800/0x48868a4e4394a1fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.302372:0:3623:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e800/0x48868a4e4394a1fa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.302377:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e800/0x48868a4e4394a1fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129756.302410:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+9:1964:x1830949052313600:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 31495us (32368us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.302417:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11243 00000100:00100000:1.0:1746129756.308554:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949052316544:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9130us (9384us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129756.308565:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4218 00002000:00100000:1.0:1746129756.308575:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880130506d80 x1830949052316544/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.308584:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130506d80 with x1830949052316544 ext(2097152->3145727) 00002000:00010000:1.0:1746129756.308595:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130506d80 00000100:00100000:2.0:1746129756.308722:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.308804:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052316928 00000100:00100000:0.0:1746129756.308817:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052316928 00000100:00100000:0.0:1746129756.308872:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9947 00000100:00100000:0.0:1746129756.308880:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+10:28734:x1830949052316928:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:0.0:1746129756.308921:0:14315:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129756.308941:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f6200/0x48868a4e4394a1ad lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fcfd expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.308964:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129756.308968:0:14315:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129756.308994:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0c00/0x48868a4e4394a20f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129756.309006:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e200/0x48868a4e4394a017 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc16 expref: 16 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.309012:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e4394a01e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc1d expref: 16 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.309018:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4bc00/0x48868a4e4394a025 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc2b expref: 288 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.309070:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e4394a08e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc7f expref: 16 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.309075:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4f400/0x48868a4e4394a0b1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc86 expref: 288 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.309080:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0c00/0x48868a4e4394a20f lrc: 8/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129756.309101:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4f400/0x48868a4e4394a0b1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc86 expref: 288 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.309111:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4f400/0x48868a4e4394a0b1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc86 expref: 288 pid: 14315 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746129756.309131:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053354624:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129756.310352:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e4394a08e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc7f expref: 16 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.310365:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e4394a08e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc7f expref: 16 pid: 1851 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746129756.310373:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053354752:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129756.310431:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4bc00/0x48868a4e4394a025 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc2b expref: 288 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.310438:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4bc00/0x48868a4e4394a025 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc2b expref: 288 pid: 16808 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746129756.310446:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053354880:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129756.310471:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e4394a01e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc1d expref: 16 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.310476:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e4394a01e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc1d expref: 16 pid: 15044 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746129756.310482:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053355008:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129756.310495:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e200/0x48868a4e4394a017 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc16 expref: 16 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.310505:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e200/0x48868a4e4394a017 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc16 expref: 16 pid: 14315 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746129756.311754:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053355136:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129756.311796:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129756.311943:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129756.312299:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052317056 00000100:00100000:1.0:1746129756.312306:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052317056 00010000:00010000:1.0:1746129756.312340:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4f400/0x48868a4e4394a0b1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc86 expref: 289 pid: 14315 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746129756.312372:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5427 00000100:00100000:1.0:1746129756.312379:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:1963:x1830949052317056:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129756.312390:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129756.312394:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4f400/0x48868a4e4394a0b1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc86 expref: 289 pid: 14315 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.312404:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4f400/0x48868a4e4394a0b1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc86 expref: 289 pid: 14315 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.312423:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129756.312427:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0c00/0x48868a4e4394a20f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129756.312435:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129756.312467:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:1963:x1830949052317056:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 88us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129756.312473:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5427 00010000:00010000:0.0:1746129756.312739:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd4f400/0x48868a4e4394a0b1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc86 expref: 288 pid: 14315 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746129756.312752:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053354624:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129756.314349:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.314629:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053354752:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129756.314795:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052317312 00000100:00100000:3.0:1746129756.314802:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052317312 00000100:00100000:3.0:1746129756.315233:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11246 00000100:00100000:3.0:1746129756.315242:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28732:x1830949052317312:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129756.315256:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129756.315288:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.315427:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053354880:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129756.315471:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129756.315665:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb4be00/0x48868a4e4394a216 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fd27 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129756.315685:0:3623:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3eb:0x0] initial LVB size: 4960928, mtime: 0x6813d35c, atime: 0x6813d35c, ctime: 0x6813d35c, blocks: 0x1629 00010000:00010000:3.0:1746129756.315702:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129756.315704:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129756.315712:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb4be00/0x48868a4e4394a216 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd27 expref: 18 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.315724:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb4be00/0x48868a4e4394a216 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd27 expref: 18 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.315732:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb4be00, rc 0) 00000100:00100000:3.0:1746129756.315767:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28732:x1830949052317312:12345-192.168.204.31@tcp:101:cat.0 Request processed in 526us (1424us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.315772:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11246 00000100:00100000:2.0:1746129756.316275:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052317184 00000100:00100000:2.0:1746129756.316280:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052317184 00010000:00010000:2.0:1746129756.316298:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e4394a08e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc7f expref: 17 pid: 1851 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746129756.316325:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052317440 00000100:00100000:2.0:1746129756.316327:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052317440 00010000:00010000:2.0:1746129756.316336:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4bc00/0x48868a4e4394a025 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc2b expref: 288 pid: 16808 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746129756.316358:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5428 00000100:00100000:2.0:1746129756.316363:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1963:x1830949052317184:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129756.316371:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129756.316376:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e4394a08e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc7f expref: 17 pid: 1851 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.316383:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e4394a08e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc7f expref: 17 pid: 1851 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.316398:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244600/0x48868a4e4394a08e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc7f expref: 17 pid: 1851 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.316411:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129756.316416:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0c00/0x48868a4e4394a20f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129756.316422:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129756.316438:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1963:x1830949052317184:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 75us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129756.316442:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5428 00000100:00100000:2.0:1746129756.316454:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5429 00000100:00100000:2.0:1746129756.316458:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:1964:x1830949052317440:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129756.316463:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129756.316466:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4bc00/0x48868a4e4394a025 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc2b expref: 288 pid: 16808 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.316473:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4bc00/0x48868a4e4394a025 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc2b expref: 288 pid: 16808 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.316482:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4bc00/0x48868a4e4394a025 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc2b expref: 288 pid: 16808 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.316493:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129756.316496:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0c00/0x48868a4e4394a20f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129756.316500:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129756.316512:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:1964:x1830949052317440:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 54us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129756.316516:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5429 00000100:00100000:0.0:1746129756.317637:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.317836:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.317865:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052317568 00000100:00100000:0.0:1746129756.317868:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052317568 00010000:00010000:0.0:1746129756.317883:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e4394a01e lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc1d expref: 16 pid: 15044 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746129756.317891:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053355008:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129756.317896:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052317696 00000100:00100000:2.0:1746129756.317898:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053355136:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129756.317898:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052317696 00010000:00010000:0.0:1746129756.317905:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e200/0x48868a4e4394a017 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc16 expref: 17 pid: 14315 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746129756.317915:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5430 00000100:00100000:0.0:1746129756.317919:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052317568:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129756.317926:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0c00/0x48868a4e4394a20f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129756.317928:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129756.317932:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e4394a01e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc1d expref: 17 pid: 15044 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746129756.317939:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5431 00010000:00010000:0.0:1746129756.317939:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e4394a01e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc1d expref: 17 pid: 15044 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746129756.317944:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052317696:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129756.317949:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129756.317950:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6fa00/0x48868a4e4394a01e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc1d expref: 17 pid: 15044 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.317952:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e200/0x48868a4e4394a017 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc16 expref: 17 pid: 14315 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.317958:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e200/0x48868a4e4394a017 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc16 expref: 16 pid: 14315 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.318144:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129756.318148:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0c00/0x48868a4e4394a20f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129756.318154:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129756.318161:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb6e200/0x48868a4e4394a017 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fc16 expref: 16 pid: 14315 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.318169:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129756.318172:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0c00/0x48868a4e4394a20f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129756.318178:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0c00/0x48868a4e4394a20f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129756.318188:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0c00/0x48868a4e4394a20f lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129756.318202:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129756.318246:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1961:x1830949052317696:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 301us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129756.318246:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1961:x1830949052317568:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 326us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129756.318251:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5430 00000100:00100000:2.0:1746129756.318253:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5431 00010000:00010000:2.0:1746129756.318268:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0c00/0x48868a4e4394a20f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129756.318272:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0c00/0x48868a4e4394a20f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129756.318307:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.318334:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052317824 00000100:00100000:2.0:1746129756.318337:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052317824 00000100:00100000:2.0:1746129756.318367:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9948 00000100:00100000:2.0:1746129756.318372:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28732:x1830949052317824:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129756.318387:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129756.318395:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394a21d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fd2e expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.318424:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0c00/0x48868a4e4394a20f lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129756.318431:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394a21d lrc: 4/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd2e expref: 15 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.318446:0:1851:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0c00/0x48868a4e4394a20f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129756.318454:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394a21d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd2e expref: 15 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.318462:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129756.318464:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129756.318467:0:1851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394a21d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd2e expref: 15 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.318472:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10000, rc 0) 00000100:00100000:2.0:1746129756.318487:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28732:x1830949052317824:12345-192.168.204.31@tcp:101:cat.0 Request processed in 116us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129756.318492:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9948 00000040:00080000:2.0:1746129756.319005:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2878, 88 off240120 00000004:00080000:2.0:1746129756.319010:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702377162278ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129756.319103:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2806, 88 off233864 00000004:00080000:2.0:1746129756.319110:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702377262065ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129756.319130:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2807, 88 off233952 00000004:00080000:2.0:1746129756.319132:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702377284543ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129756.319140:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2879, 88 off240208 00000004:00080000:2.0:1746129756.319142:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702377294096ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129756.319149:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2880, 88 off240296 00000004:00080000:2.0:1746129756.319152:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702377303755ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129756.319175:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2808, 88 off234040 00000004:00080000:2.0:1746129756.319179:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702377330991ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129756.319196:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2809, 88 off234128 00000004:00080000:2.0:1746129756.319198:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702377350568ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129756.319205:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2810, 88 off234216 00000004:00080000:2.0:1746129756.319208:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702377359668ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129756.319216:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2881, 88 off240384 00000004:00080000:2.0:1746129756.319218:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702377370216ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129756.319225:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2811, 88 off234304 00000004:00080000:2.0:1746129756.319227:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702377379428ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129756.319234:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2882, 88 off240472 00000004:00080000:2.0:1746129756.319236:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702377388288ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129756.319242:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2812, 88 off234392 00000004:00080000:2.0:1746129756.319245:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702377397296ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129756.319252:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2883, 88 off240560 00000004:00080000:2.0:1746129756.319254:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702377406283ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129756.319260:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2884, 88 off240648 00000004:00080000:2.0:1746129756.319262:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702377414350ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129756.319267:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2885, 88 off240736 00000004:00080000:2.0:1746129756.319269:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702377421408ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129756.319274:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2886, 88 off240824 00000004:00080000:2.0:1746129756.319276:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702377428301ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129756.319281:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2813, 88 off234480 00000004:00080000:2.0:1746129756.319283:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702377434820ns, next at 641623252291ns, rc = 0 00000100:00100000:2.0:1746129756.337367:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.337390:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052318080 00000100:00100000:2.0:1746129756.337397:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052318080 00000100:00100000:2.0:1746129756.337425:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9949 00000100:00100000:2.0:1746129756.337431:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:28740:x1830949052318080:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129756.337448:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129756.337462:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0a00/0x48868a4e4394a224 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fd35 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.337539:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0200/0x48868a4e4394a22b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.337548:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0200/0x48868a4e4394a22b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.337556:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0200/0x48868a4e4394a22b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.337565:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1600/0x48868a4e4394a232 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.337570:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1600/0x48868a4e4394a232 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.337574:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1600/0x48868a4e4394a232 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000001:00080000:1.0:1746129756.347948:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943740 is committed 00000001:00080000:1.0:1746129756.347961:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943739 is committed 00000001:00080000:1.0:1746129756.347966:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943742 is committed 00000001:00080000:1.0:1746129756.347975:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943743 is committed 00000004:00080000:1.0:1746129756.347979:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1998 committed 00000004:00080000:1.0:1746129756.347985:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2067 committed 00000004:00010000:3.0:1746129756.347988:0:14315:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a00c5f80 reply state ffff8800924d7400 transno 8589943743 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0c00/0x48868a4e4394a20f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00000004:00080000:1.0:1746129756.347989:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2066 committed 00000004:00080000:1.0:1746129756.347992:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2065 committed 00000004:00080000:1.0:1746129756.347993:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2064 committed 00000004:00080000:1.0:1746129756.347995:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1997 committed 00000004:00080000:1.0:1746129756.347996:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2063 committed 00000100:00100000:3.0:1746129756.347997:0:14315:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000004:00080000:1.0:1746129756.347998:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1996 committed 00000004:00080000:1.0:1746129756.347999:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2062 committed 00000004:00080000:1.0:1746129756.348000:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1995 committed 00000004:00080000:1.0:1746129756.348001:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1994 committed 00000004:00080000:1.0:1746129756.348002:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1993 committed 00000004:00080000:1.0:1746129756.348004:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2061 committed 00000004:00080000:1.0:1746129756.348005:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2060 committed 00000004:00080000:1.0:1746129756.348006:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1992 committed 00000004:00080000:1.0:1746129756.348007:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1991 committed 00000004:00080000:1.0:1746129756.348008:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2059 committed 00010000:00080000:3.0:1746129756.348074:0:14315:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746129756.348087:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28734:x1830949052316928:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 39204us (39361us total) trans 8589943743 rc 0/0 00000100:00100000:3.0:1746129756.348094:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9947 00000100:00100000:1.0:1746129756.348184:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053355264:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129756.348221:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746129756.348307:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a239 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.348328:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009330fe00/0x48868a4e4394a1d0 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd19 expref: 7 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.348335:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a239 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.348356:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009330fe00/0x48868a4e4394a1d0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd19 expref: 7 pid: 14315 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129756.348986:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053355264 00000100:00100000:3.0:1746129756.348992:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053355264 00000100:00100000:3.0:1746129756.349024:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11247 00000100:00100000:3.0:1746129756.349032:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c089180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3298:x1830949053355264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129756.349176:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c089180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3298:x1830949053355264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 145us (954us total) trans 21474840367 rc 0/0 00000100:00100000:3.0:1746129756.349182:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11247 00000100:00080000:3.0:1746129756.349198:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1746129756.349417:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5490e00/2, rc 0, transno 21474840367 00000100:00100000:1.0:1746129756.349422:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053355264:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129756.349427:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053355776:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129756.349444:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746129756.349483:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009330fe00/0x48868a4e4394a1d0 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd19 expref: 7 pid: 14315 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746129756.349494:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053357312:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129756.349531:0:3283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0c00/0x48868a4e4394a20f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129756.349538:0:3283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0c00/0x48868a4e4394a20f lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129756.349543:0:3283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0c00/0x48868a4e4394a20f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129756.349548:0:3283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b7f0c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129756.349551:0:3283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0c00/0x48868a4e4394a20f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129756.349557:0:3283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0c00/0x48868a4e4394a20f lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129756.349568:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129756.349570:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129756.349574:0:3283:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394a21d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd2e expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.349581:0:3283:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394a21d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd2e expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.349587:0:3283:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394a21d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd2e expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.349605:0:3283:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394a21d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd2e expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129756.349612:0:3283:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3283:1830949053357440:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129756.349635:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053355648:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129756.349652:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129756.349810:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053355776 00000100:00100000:3.0:1746129756.349814:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053355776 00000100:00100000:3.0:1746129756.350443:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053355648 00000100:00100000:3.0:1746129756.350448:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053355648 00000100:00100000:3.0:1746129756.351206:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11248 00000100:00100000:3.0:1746129756.351215:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c089f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:3298:x1830949053355776:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129756.351344:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129756.351347:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746129756.351349:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746129756.351350:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746129756.351352:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746129756.351382:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c089f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+40:3298:x1830949053355776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 169us (1937us total) trans 21474840368 rc 0/0 00000100:00100000:3.0:1746129756.351387:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11248 00000100:00100000:3.0:1746129756.351401:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11249 00000100:00100000:3.0:1746129756.351405:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:3297:x1830949053355648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129756.353034:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5492a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053355392:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129756.353075:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129756.353164:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053355904:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129756.353177:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129756.353189:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053356416:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129756.353201:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129756.353210:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c08b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053356928:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129756.353223:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129756.353244:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053355520:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129756.353257:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129756.353268:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053356032:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129756.353279:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129756.353288:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053356544:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129756.353299:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129756.353309:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c08b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053357056:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129756.353330:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129756.353336:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129756.353359:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053355392 00000100:00100000:1.0:1746129756.353364:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053355392 00000100:00100000:1.0:1746129756.353384:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053355904 00000100:00100000:1.0:1746129756.353385:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053355904 00000100:00100000:0.0:1746129756.353391:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053356416 00000100:00100000:1.0:1746129756.353392:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053356928 00000100:00100000:1.0:1746129756.353393:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053356928 00000100:00100000:0.0:1746129756.353393:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053356416 00000100:00100000:2.0:1746129756.353424:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053355520 00000100:00100000:2.0:1746129756.353427:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053355520 00000100:00100000:2.0:1746129756.353439:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053356032 00000100:00100000:2.0:1746129756.353440:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053356032 00000100:00100000:2.0:1746129756.353444:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053356544 00000100:00100000:2.0:1746129756.353446:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053356544 00000100:00100000:2.0:1746129756.353600:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053357056 00000100:00100000:2.0:1746129756.353602:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053357056 00000100:00100000:0.0:1746129756.353603:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11250 00000100:00100000:2.0:1746129756.353608:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11251 00000100:00100000:0.0:1746129756.353608:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3299:x1830949053355392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129756.353612:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3299:x1830949053355904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129756.353654:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129756.353667:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11252 00000100:00100000:2.0:1746129756.353671:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+44:3296:x1830949053355520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129756.353731:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11253 00000100:00100000:2.0:1746129756.353735:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3296:x1830949053356032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129756.353755:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3299:x1830949053355392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 146us (680us total) trans 21474840370 rc 0/0 00000100:00100000:0.0:1746129756.353761:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11250 00000100:00100000:0.0:1746129756.353773:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11254 00000100:00100000:0.0:1746129756.353777:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c089500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3296:x1830949053356544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129756.353810:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3296:x1830949053356032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (529us total) trans 21474840372 rc 0/0 00000100:00100000:2.0:1746129756.353815:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11253 00000100:00100000:2.0:1746129756.353825:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11255 00000100:00100000:2.0:1746129756.353829:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3299:x1830949053356416:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129756.353877:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:0.0:1746129756.353880:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129756 -> 1746129756 00002000:00010000:0.0:1746129756.353882:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129756 -> 1746129756 00002000:00010000:0.0:1746129756.353884:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129756 -> 1746129756 00002000:00010000:0.0:1746129756.353886:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5673 -> 5673 00000100:00100000:0.0:1746129756.353904:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c089500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3296:x1830949053356544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 126us (603us total) trans 17179873228 rc 0/0 00000100:00100000:2.0:1746129756.353907:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3299:x1830949053356416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (705us total) trans 17179873229 rc 0/0 00000100:00100000:0.0:1746129756.353909:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11254 00000100:00100000:2.0:1746129756.353911:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11255 00000100:00100000:0.0:1746129756.353917:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11256 00000100:00100000:0.0:1746129756.353921:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3296:x1830949053357056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129756.353980:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3296:x1830949053357056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (643us total) trans 17179873230 rc 0/0 00000100:00100000:0.0:1746129756.353984:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11256 00002000:00010000:0.0:1746129756.354006:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746129756.354008:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129756 -> 1746129756 00002000:00010000:0.0:1746129756.354009:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129755 -> 1746129755 00002000:00010000:0.0:1746129756.354011:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129756 -> 1746129756 00002000:00010000:0.0:1746129756.354012:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746129756.354023:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:3296:x1830949053355520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 352us (765us total) trans 21474840371 rc 0/0 00000100:00100000:0.0:1746129756.354027:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11252 00000004:00080000:0.0:1746129756.354046:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5492a00/2, rc 0, transno 21474840370 00000100:00100000:0.0:1746129756.354050:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5492a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053355392:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129756.354056:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936de300/2, rc 0, transno 17179873229 00000100:00100000:0.0:1746129756.354062:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053356416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129756.354140:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3299:x1830949053355904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 527us (961us total) trans 21474840373 rc 0/0 00000100:00100000:0.0:1746129756.354144:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11251 00000004:00080000:0.0:1746129756.354158:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5492d80/2, rc 0, transno 21474840373 00000100:00100000:0.0:1746129756.354161:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053355904:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129756.354164:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746129756.354168:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053357568:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129756.354181:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129756.354192:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053357568 00000100:00100000:0.0:1746129756.354194:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053357568 00000100:00100000:0.0:1746129756.354204:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11257 00000100:00100000:0.0:1746129756.354207:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3299:x1830949053357568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129756.354267:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:3299:x1830949053357568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (84us total) trans 17179873231 rc 0/0 00000100:00100000:0.0:1746129756.354271:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11257 00000004:00080000:0.0:1746129756.354285:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba1b480/2, rc 0, transno 17179873231 00000100:00100000:0.0:1746129756.354287:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053357568:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129756.354447:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11258 00000100:00100000:1.0:1746129756.354451:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3299:x1830949053356928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129756.354452:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3297:x1830949053355648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3045us (4798us total) trans 21474840369 rc 0/0 00000100:00100000:3.0:1746129756.354457:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11249 00000100:00080000:3.0:1746129756.354474:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746129756.354482:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052318208 00000100:00100000:3.0:1746129756.354485:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052318208 00000100:00100000:3.0:1746129756.354503:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9950 00000100:00100000:3.0:1746129756.354508:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28734:x1830949052318208:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129756.354518:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129756.354529:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:3299:x1830949053356928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (1304us total) trans 17179873232 rc 0/0 00010000:00010000:3.0:1746129756.354531:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x48868a4e4394a240 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fd3c expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129756.354533:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11258 00000004:00080000:1.0:1746129756.354560:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5493800/2, rc 0, transno 21474840371 00000100:00100000:1.0:1746129756.354563:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053355520:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129756.354568:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5491c00/2, rc 0, transno 21474840372 00010000:00010000:3.0:1746129756.354569:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x48868a4e4394a240 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd3c expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129756.354571:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053356032:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129756.354576:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c089c00/2, rc 0, transno 17179873228 00000100:00100000:1.0:1746129756.354578:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053356544:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746129756.354581:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x48868a4e4394a240 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd3c expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746129756.354583:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c08b800/2, rc 0, transno 17179873230 00000100:00100000:1.0:1746129756.354586:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c08b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053357056:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746129756.354595:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129756.354598:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129756.354600:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11800, rc 0) 00000100:00100000:3.0:1746129756.354625:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:28734:x1830949052318208:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 117us (1296us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.354630:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9950 00000004:00080000:2.0:1746129756.355730:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5493480/2, rc 0, transno 21474840369 00000100:00100000:2.0:1746129756.355736:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053355648:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129756.356090:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c08b100/2, rc 0, transno 17179873232 00000100:00100000:0.0:1746129756.356094:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c08b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053356928:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129756.356231:0:3283:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129756.356243:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053356160:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129756.356257:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5492680/2, rc 0, transno 21474840368 00000100:00100000:3.0:1746129756.356260:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053355776:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129756.356265:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053356288:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129756.356270:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129756.356280:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129756.356284:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c08ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053356672:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129756.356291:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c088700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053356800:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129756.356294:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129756.356303:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129756.356303:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c08b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053357184:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129756.356326:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129756.356332:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053356160 00000100:00100000:3.0:1746129756.356335:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053356160 00000100:00100000:3.0:1746129756.356490:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053356288 00000100:00100000:3.0:1746129756.356493:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053356288 00000100:00100000:0.0:1746129756.356527:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053356672 00000100:00100000:0.0:1746129756.356530:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053356672 00000100:00100000:0.0:1746129756.356544:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053356800 00000100:00100000:0.0:1746129756.356546:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053356800 00000100:00100000:0.0:1746129756.356554:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053357184 00000100:00100000:0.0:1746129756.356555:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053357184 00000100:00100000:0.0:1746129756.356566:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11259 00000100:00100000:1.0:1746129756.356570:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11260 00000100:00100000:0.0:1746129756.356571:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3297:x1830949053356160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129756.356575:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+49:3298:x1830949053356288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129756.356694:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+50:3298:x1830949053356288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 119us (413us total) trans 17179873233 rc 0/0 00000100:00100000:0.0:1746129756.356694:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3297:x1830949053356160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 123us (423us total) trans 21474840374 rc 0/0 00000100:00100000:1.0:1746129756.356700:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11260 00000004:00080000:2.0:1746129756.357620:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009423c000/2, rc 0, transno 21474840374 00000100:00100000:2.0:1746129756.357625:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053356160:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129756.357796:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11259 00000100:00100000:0.0:1746129756.357811:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11261 00000100:00100000:0.0:1746129756.357818:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3297:x1830949053356672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129756.357920:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11262 00000100:00100000:1.0:1746129756.357926:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+50:3298:x1830949053356800:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129756.357933:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129756.357936:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129756.357937:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129756.357939:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129756.357941:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129756.357981:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3297:x1830949053356672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 164us (1684us total) trans 17179873234 rc 0/0 00000100:00100000:0.0:1746129756.357986:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11261 00000100:00100000:0.0:1746129756.357994:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11263 00000100:00100000:0.0:1746129756.357998:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3297:x1830949053357184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129756.358014:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+50:3298:x1830949053356800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (1709us total) trans 17179873235 rc 0/0 00000100:00100000:1.0:1746129756.358018:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11262 00000004:00080000:1.0:1746129756.358051:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c1c5c00/2, rc 0, transno 17179873233 00000100:00100000:1.0:1746129756.358055:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053356288:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129756.358062:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c088700/2, rc 0, transno 17179873235 00000100:00100000:1.0:1746129756.358064:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c088700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053356800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129756.358068:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3297:x1830949053357184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (1741us total) trans 17179873236 rc 0/0 00000100:00100000:0.0:1746129756.358072:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11263 00000100:00100000:0.0:1746129756.358222:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.358240:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053357312:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129756.358257:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a239 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:2.0:1746129756.358274:0:3283:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3283:1830949053357440:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129756.358283:0:3283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0c00/0x48868a4e4394a20f lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129756.358289:0:3283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0c00/0x48868a4e4394a20f lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 14315 initiator: MDT0 00000004:00080000:2.0:1746129756.358332:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c08ad80/2, rc 0, transno 17179873234 00000100:00100000:2.0:1746129756.358335:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c08ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053356672:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129756.358341:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c08b480/2, rc 0, transno 17179873236 00000100:00100000:2.0:1746129756.358344:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c08b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053357184:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129756.358452:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052318336 00000100:00100000:1.0:1746129756.358457:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052318336 00010000:00010000:1.0:1746129756.358474:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009330fe00/0x48868a4e4394a1d0 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd19 expref: 8 pid: 14315 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746129756.358501:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5432 00000100:00100000:1.0:1746129756.358506:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052318336:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129756.358514:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129756.358519:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009330fe00/0x48868a4e4394a1d0 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd19 expref: 8 pid: 14315 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.358528:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009330fe00/0x48868a4e4394a1d0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd19 expref: 8 pid: 14315 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.358542:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009330fe00/0x48868a4e4394a1d0 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd19 expref: 8 pid: 14315 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.358551:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129756.358556:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a239 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129756.358562:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a239 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129756.358567:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a239 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129756.358580:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129756.358606:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+7:1962:x1830949052318336:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 100us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129756.358611:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5432 00010000:00010000:2.0:1746129756.358722:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a239 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.358728:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a239 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129756.358738:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129756.358838:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a239 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.358845:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a239 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.358866:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a239 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.358871:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b7f0600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129756.358873:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a239 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.358878:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a239 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.358886:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129756.358888:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129756.358890:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a239 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.358895:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a239 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.358906:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0200/0x48868a4e4394a22b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.358911:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0200/0x48868a4e4394a22b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.358915:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0200/0x48868a4e4394a22b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.358919:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b7f0200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129756.358921:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0200/0x48868a4e4394a22b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.358924:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0200/0x48868a4e4394a22b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.358929:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129756.358930:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129756.358932:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0200/0x48868a4e4394a22b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.358936:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0200/0x48868a4e4394a22b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.358942:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1600/0x48868a4e4394a232 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.358947:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1600/0x48868a4e4394a232 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.358951:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1600/0x48868a4e4394a232 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.358955:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b7f1600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129756.358957:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1600/0x48868a4e4394a232 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.358961:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1600/0x48868a4e4394a232 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.358965:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e2d8300) 00010000:00010000:2.0:1746129756.358967:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129756.358969:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1600/0x48868a4e4394a232 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.358973:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1600/0x48868a4e4394a232 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129756.359010:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0a00/0x48868a4e4394a224 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd35 expref: 283 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.359016:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0a00/0x48868a4e4394a224 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd35 expref: 283 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.359022:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b7f0a00, rc 0) 00000100:00100000:2.0:1746129756.359043:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:28740:x1830949052318080:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 21612us (21681us total) trans 8589943744 rc 301/301 00000100:00100000:0.0:1746129756.359464:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.360056:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9949 00000100:00100000:3.0:1746129756.360973:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052318592 00000100:00100000:3.0:1746129756.360979:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052318592 00000100:00100000:3.0:1746129756.361017:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3923 00000100:00100000:3.0:1746129756.361024:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6141239f-0c60-480d-830c-e22ba61457b0+7:28734:x1830949052318592:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1746129756.361167:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28734:x1830949052318592:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 144us (1703us total) trans 8589943745 rc 0/0 00000100:00100000:3.0:1746129756.361175:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3923 00000100:00100000:0.0:1746129756.361512:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.363222:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052318720 00000100:00100000:3.0:1746129756.363229:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052318720 00000100:00100000:3.0:1746129756.363268:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3924 00000100:00100000:3.0:1746129756.363275:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28732:x1830949052318720:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:3.0:1746129756.363390:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28732:x1830949052318720:12345-192.168.204.31@tcp:49:cat.0 Request processed in 114us (1877us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.363397:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3924 00000100:00100000:0.0:1746129756.364700:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.365498:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052318976 00000100:00100000:3.0:1746129756.365505:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052318976 00000100:00100000:3.0:1746129756.365534:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3925 00000100:00100000:3.0:1746129756.365539:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28734:x1830949052318976:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1746129756.365686:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:28734:x1830949052318976:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 145us (991us total) trans 8589943746 rc 0/0 00000100:00100000:3.0:1746129756.365691:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3925 00000100:00100000:2.0:1746129756.374434:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129756.374504:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052319232 00000100:00100000:1.0:1746129756.374511:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052319232 00002000:00100000:1.0:1746129756.374545:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800a00c4000 x1830949052319232/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.374555:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c4000 with x1830949052319232 ext(3145728->4194303) 00002000:00010000:1.0:1746129756.374560:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a00c4000 00000100:00100000:1.0:1746129756.375244:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4219 00000100:00100000:1.0:1746129756.375252:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949052319232:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129756.384988:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.385057:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.385476:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052319360 00000100:00100000:2.0:1746129756.385484:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052319360 00000100:00100000:2.0:1746129756.385522:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9951 00000100:00100000:2.0:1746129756.385530:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:28740:x1830949052319360:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129756.385553:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129756.385569:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1600/0x48868a4e4394a24e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fd43 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.385620:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1600/0x48868a4e4394a24e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd43 expref: 283 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.385631:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1600/0x48868a4e4394a24e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd43 expref: 283 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.385646:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129756.385649:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129756.385652:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b7f1600, rc 0) 00000100:00100000:2.0:1746129756.385688:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28740:x1830949052319360:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 159us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129756.385694:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9951 00000100:00100000:3.0:1746129756.385815:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052319616 00000100:00100000:3.0:1746129756.385818:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052319616 00002000:00100000:3.0:1746129756.385841:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012ba18a80 x1830949052319616/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.385873:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba18a80 with x1830949052319616 ext(3145728->4194303) 00002000:00010000:3.0:1746129756.385878:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba18a80 00000100:00100000:3.0:1746129756.385902:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4220 00000100:00100000:3.0:1746129756.385908:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1963:x1830949052319616:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129756.389182:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949052319232:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13921us (14747us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129756.389192:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4219 00002000:00100000:1.0:1746129756.389200:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800a00c4000 x1830949052319232/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.389208:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c4000 with x1830949052319232 ext(3145728->4194303) 00002000:00010000:1.0:1746129756.389213:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a00c4000 00000100:00100000:0.0:1746129756.392203:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129756.392264:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052319872 00000100:00100000:1.0:1746129756.392273:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052319872 00000100:00100000:1.0:1746129756.392320:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9952 00000100:00100000:1.0:1746129756.392329:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28740:x1830949052319872:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129756.392347:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129756.392350:0:16808:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746129756.392372:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1600/0x48868a4e4394a24e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd43 expref: 283 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.392409:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129756.392413:0:16808:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129756.392432:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3fa00/0x48868a4e4394a255 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fd4a expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.392470:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f800/0x48868a4e4394a25c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.392479:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394a21d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd2e expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.392490:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x48868a4e4394a240 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd3c expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.392496:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f800/0x48868a4e4394a25c lrc: 5/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.392521:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x48868a4e4394a240 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd3c expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.392531:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x48868a4e4394a240 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd3c expref: 8 pid: 14315 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746129756.392541:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c089180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053357696:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129756.392619:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394a21d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd2e expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.392625:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394a21d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd2e expref: 7 pid: 1851 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746129756.392632:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c089f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053357824:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129756.392649:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d5106c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129756.402520:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c089180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053357696:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129756.402531:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c089f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053357824:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129756.402549:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f800/0x48868a4e4394a25c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:3.0:1746129756.411922:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1963:x1830949052319616:12345-192.168.204.31@tcp:3:cat.0 Request processed in 26006us (26857us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129756.411934:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4220 00002000:00100000:3.0:1746129756.411943:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012ba18a80 x1830949052319616/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.411952:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba18a80 with x1830949052319616 ext(3145728->4194303) 00002000:00010000:3.0:1746129756.411957:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba18a80 00000100:00100000:0.0:1746129756.413754:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.413796:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129756.414925:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052320000 00000100:00100000:1.0:1746129756.414934:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052320000 00010000:00010000:1.0:1746129756.414964:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x48868a4e4394a240 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd3c expref: 9 pid: 14315 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746129756.414995:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052320128 00000100:00100000:1.0:1746129756.414996:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052320128 00010000:00010000:1.0:1746129756.415004:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394a21d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd2e expref: 8 pid: 1851 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746129756.415023:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5433 00000100:00100000:1.0:1746129756.415028:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949052320000:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129756.415039:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129756.415043:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x48868a4e4394a240 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd3c expref: 9 pid: 14315 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746129756.415050:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5434 00010000:00010000:1.0:1746129756.415052:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x48868a4e4394a240 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd3c expref: 9 pid: 14315 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746129756.415058:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1963:x1830949052320128:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129756.415065:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129756.415068:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11800/0x48868a4e4394a240 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd3c expref: 9 pid: 14315 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.415070:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394a21d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd2e expref: 8 pid: 1851 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.415078:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394a21d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd2e expref: 8 pid: 1851 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.415083:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129756.415087:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f800/0x48868a4e4394a25c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.415130:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f800/0x48868a4e4394a25c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.415139:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129756.415169:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+8:1961:x1830949052320000:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 141us (1421us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129756.415170:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394a21d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd2e expref: 8 pid: 1851 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746129756.415174:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5433 00010000:00010000:0.0:1746129756.415183:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129756.415186:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f800/0x48868a4e4394a25c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129756.415193:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f800/0x48868a4e4394a25c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129756.415198:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f800/0x48868a4e4394a25c lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129756.415215:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129756.415232:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1963:x1830949052320128:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 177us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129756.415238:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5434 00010000:00010000:0.0:1746129756.415263:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f800/0x48868a4e4394a25c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129756.415271:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f800/0x48868a4e4394a25c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000040:00080000:1.0:1746129756.415769:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2887, 88 off240912 00000004:00080000:1.0:1746129756.415774:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702473925682ns, next at 641639930618ns, rc = 0 00000040:00080000:1.0:1746129756.415805:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2814, 88 off234568 00000004:00080000:1.0:1746129756.415807:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702473959430ns, next at 641623252291ns, rc = 0 00000040:00080000:1.0:1746129756.415815:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2815, 88 off234656 00000004:00080000:1.0:1746129756.415817:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702473969516ns, next at 641623252291ns, rc = 0 00000040:00080000:1.0:1746129756.415823:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2888, 88 off241000 00000004:00080000:1.0:1746129756.415824:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702473976666ns, next at 641639930618ns, rc = 0 00000040:00080000:1.0:1746129756.415829:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2889, 88 off241088 00000004:00080000:1.0:1746129756.415831:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702473983390ns, next at 641639930618ns, rc = 0 00000040:00080000:1.0:1746129756.415836:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2816, 88 off234744 00000004:00080000:1.0:1746129756.415838:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702473990371ns, next at 641623252291ns, rc = 0 00000040:00080000:1.0:1746129756.415843:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2817, 88 off234832 00000004:00080000:1.0:1746129756.415845:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702473997145ns, next at 641623252291ns, rc = 0 00000040:00080000:1.0:1746129756.415870:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2818, 88 off234920 00000004:00080000:1.0:1746129756.415872:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702474024295ns, next at 641623252291ns, rc = 0 00000040:00080000:1.0:1746129756.415877:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2890, 88 off241176 00000004:00080000:1.0:1746129756.415879:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702474031441ns, next at 641639930618ns, rc = 0 00000040:00080000:1.0:1746129756.415885:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2819, 88 off235008 00000004:00080000:1.0:1746129756.415887:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702474039027ns, next at 641623252291ns, rc = 0 00000040:00080000:1.0:1746129756.415924:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2891, 88 off241264 00000004:00080000:1.0:1746129756.415928:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702474079725ns, next at 641639930618ns, rc = 0 00000040:00080000:1.0:1746129756.419124:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2820, 88 off235096 00000004:00080000:1.0:1746129756.419134:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702477285740ns, next at 641623252291ns, rc = 0 00000040:00080000:1.0:1746129756.419151:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2892, 88 off241352 00000004:00080000:1.0:1746129756.419153:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702477305518ns, next at 641639930618ns, rc = 0 00000040:00080000:1.0:1746129756.419163:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2893, 88 off241440 00000004:00080000:1.0:1746129756.419165:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702477317426ns, next at 641639930618ns, rc = 0 00000040:00080000:1.0:1746129756.419174:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2894, 88 off241528 00000004:00080000:1.0:1746129756.419176:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702477328438ns, next at 641639930618ns, rc = 0 00000040:00080000:1.0:1746129756.419182:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2895, 88 off241616 00000004:00080000:1.0:1746129756.419184:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702477336375ns, next at 641639930618ns, rc = 0 00000040:00080000:1.0:1746129756.419191:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2821, 88 off235184 00000004:00080000:1.0:1746129756.419193:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702477345236ns, next at 641623252291ns, rc = 0 00000100:00100000:0.0:1746129756.430435:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.430605:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052320256 00000100:00100000:2.0:1746129756.430611:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052320256 00000100:00100000:2.0:1746129756.430645:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9953 00000100:00100000:2.0:1746129756.430652:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:28732:x1830949052320256:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129756.430667:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129756.430680:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7600/0x48868a4e4394a263 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fd51 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.430888:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f800/0x48868a4e4394a25c lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129756.430900:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7600/0x48868a4e4394a263 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd51 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.430913:0:1851:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f800/0x48868a4e4394a25c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129756.430924:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7600/0x48868a4e4394a263 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd51 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.430933:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129756.430936:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129756.430939:0:1851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7600/0x48868a4e4394a263 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd51 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.430944:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb7600, rc 0) 00000100:00100000:2.0:1746129756.431171:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28732:x1830949052320256:12345-192.168.204.31@tcp:101:cat.0 Request processed in 518us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129756.431176:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9953 00000001:00080000:1.0:1746129756.440911:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943747 is committed 00000004:00080000:1.0:1746129756.440920:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2006 committed 00000004:00080000:1.0:1746129756.440927:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2076 committed 00000004:00080000:1.0:1746129756.440932:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2075 committed 00000004:00080000:1.0:1746129756.440934:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2074 committed 00000004:00080000:1.0:1746129756.440935:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2073 committed 00000004:00080000:1.0:1746129756.440937:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2005 committed 00000004:00080000:1.0:1746129756.440938:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2072 committed 00000004:00080000:1.0:1746129756.440939:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2004 committed 00000004:00080000:1.0:1746129756.440940:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2071 committed 00000004:00080000:1.0:1746129756.440942:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2003 committed 00000004:00080000:1.0:1746129756.440943:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2002 committed 00000004:00080000:1.0:1746129756.440944:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2001 committed 00000004:00080000:1.0:1746129756.440945:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2070 committed 00000004:00080000:1.0:1746129756.440947:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2069 committed 00000004:00080000:1.0:1746129756.440948:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2000 committed 00000004:00080000:1.0:1746129756.440950:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1999 committed 00000004:00080000:1.0:1746129756.440952:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2068 committed 00010000:00010000:2.0:1746129756.440953:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f800/0x48868a4e4394a25c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd4a expref: 284 pid: 16808 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1746129756.440961:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943746 is committed 00010000:00010000:2.0:1746129756.440967:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129756.440969:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746129756.440973:0:16808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7600/0x48868a4e4394a263 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd51 expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.440982:0:16808:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7600/0x48868a4e4394a263 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd51 expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.440992:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7600/0x48868a4e4394a263 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd51 expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.441014:0:16808:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7600/0x48868a4e4394a263 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd51 expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129756.441024:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053358208:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129756.441063:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c08bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053358336:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129756.441109:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129756.441149:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053358848:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129756.441154:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053357952:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129756.441164:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129756.441175:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053359360:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129756.441177:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129756.441188:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129756.441195:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053358592:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129756.441199:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053359872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129756.441209:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129756.441221:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053358336 00000100:00100000:1.0:1746129756.441224:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c08a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053359104:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129756.441226:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053358336 00000100:00100000:1.0:1746129756.441237:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129756.441248:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053359616:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129756.441250:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053358848 00000100:00100000:3.0:1746129756.441252:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053358848 00000100:00100000:3.0:1746129756.441260:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053357952 00000100:00100000:3.0:1746129756.441261:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053357952 00000100:00100000:1.0:1746129756.441261:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129756.441270:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053359360 00000100:00100000:3.0:1746129756.441272:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053359360 00000100:00100000:1.0:1746129756.441273:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1746129756.441277:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053358464:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129756.441281:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053358592 00000100:00100000:3.0:1746129756.441282:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053358592 00000100:00100000:1.0:1746129756.441289:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129756.441291:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053359104 00000100:00100000:3.0:1746129756.441292:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053359104 00000100:00100000:1.0:1746129756.441295:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c08a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053358976:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129756.441298:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053359616 00000100:00100000:3.0:1746129756.441299:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053359616 00000100:00100000:3.0:1746129756.441304:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053358464 00000100:00100000:3.0:1746129756.441306:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053358464 00000100:00100000:1.0:1746129756.441306:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129756.441327:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053359488:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129756.441328:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053358976 00000100:00100000:3.0:1746129756.441330:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053358976 00000100:00100000:3.0:1746129756.441340:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11264 00000100:00100000:1.0:1746129756.441342:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129756.441346:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3297:x1830949053358336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129756.441348:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053360000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129756.441359:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129756.441374:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c089180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053358080:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129756.441387:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129756.441393:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c089880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053358720:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129756.441404:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129756.441409:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053359232:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129756.441437:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129756.441444:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053359744:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129756.441455:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129756.441471:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053359488 00000100:00100000:1.0:1746129756.441474:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053359488 00000100:00100000:1.0:1746129756.441486:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053360000 00000100:00100000:1.0:1746129756.441487:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053360000 00002000:00010000:3.0:1746129756.441489:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746129756.441492:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129756 -> 1746129756 00000100:00100000:1.0:1746129756.441493:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053358080 00002000:00010000:3.0:1746129756.441494:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129755 -> 1746129755 00000100:00100000:1.0:1746129756.441495:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053358080 00002000:00010000:3.0:1746129756.441496:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129756 -> 1746129756 00002000:00010000:3.0:1746129756.441497:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746129756.441500:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053358720 00000100:00100000:1.0:1746129756.441501:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053358720 00000100:00100000:1.0:1746129756.441506:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053359232 00000100:00100000:1.0:1746129756.441508:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053359232 00000100:00100000:1.0:1746129756.441513:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053359744 00000100:00100000:1.0:1746129756.441514:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053359744 00000100:00100000:3.0:1746129756.441519:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3297:x1830949053358336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 173us (410us total) trans 21474840375 rc 0/0 00000100:00100000:1.0:1746129756.441523:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11265 00000100:00100000:3.0:1746129756.441526:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11264 00000100:00100000:1.0:1746129756.441527:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3297:x1830949053358848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129756.441543:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11266 00000100:00100000:3.0:1746129756.441547:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3299:x1830949053357952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129756.441621:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:3299:x1830949053357952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (443us total) trans 21474840376 rc 0/0 00000100:00100000:3.0:1746129756.441626:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11266 00000100:00100000:3.0:1746129756.441635:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11267 00000100:00100000:1.0:1746129756.441643:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3297:x1830949053358848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 115us (478us total) trans 21474840377 rc 0/0 00000100:00100000:3.0:1746129756.441645:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+56:3297:x1830949053359360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129756.441649:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11265 00000100:00100000:1.0:1746129756.441660:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11268 00000100:00100000:1.0:1746129756.441664:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+52:3299:x1830949053358592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129756.441694:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129756.441709:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11269 00000100:00100000:2.0:1746129756.441715:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3299:x1830949053359104:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129756.441724:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:1.0:1746129756.441725:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129756.441726:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129756 -> 1746129756 00002000:00010000:3.0:1746129756.441728:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129756 -> 1746129756 00002000:00010000:1.0:1746129756.441728:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746129756.441730:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129756 -> 1746129756 00002000:00010000:1.0:1746129756.441730:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746129756.441732:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5673 -> 5673 00002000:00010000:1.0:1746129756.441732:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746129756.441733:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746129756.441748:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:3297:x1830949053359360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (559us total) trans 17179873237 rc 0/0 00000100:00100000:1.0:1746129756.441752:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3299:x1830949053358592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (542us total) trans 21474840378 rc 0/0 00000100:00100000:3.0:1746129756.441753:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11267 00000100:00100000:1.0:1746129756.441758:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11268 00000100:00100000:3.0:1746129756.441763:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11270 00000100:00100000:3.0:1746129756.441768:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+56:3299:x1830949053359616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129756.441769:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11271 00000100:00100000:1.0:1746129756.441773:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+52:3299:x1830949053358464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129756.441808:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3299:x1830949053359104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (568us total) trans 17179873238 rc 0/0 00000100:00100000:2.0:1746129756.441813:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11269 00000100:00100000:2.0:1746129756.441825:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11272 00000100:00100000:2.0:1746129756.441829:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3299:x1830949053358976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129756.441831:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:3299:x1830949053359616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (569us total) trans 17179873239 rc 0/0 00000100:00100000:3.0:1746129756.441836:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11270 00000100:00100000:1.0:1746129756.441843:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3299:x1830949053358464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (552us total) trans 21474840379 rc 0/0 00000100:00100000:3.0:1746129756.441868:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11273 00000100:00100000:3.0:1746129756.441873:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+56:3299:x1830949053359488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129756.441874:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11271 00000100:00100000:1.0:1746129756.441885:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11274 00000100:00100000:1.0:1746129756.441889:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+56:3299:x1830949053360000:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129756.441927:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129756.441929:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746129756.441931:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746129756.441932:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746129756.441934:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746129756.441940:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3299:x1830949053358976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (631us total) trans 21474840380 rc 0/0 00000100:00100000:2.0:1746129756.441945:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11272 00000100:00100000:3.0:1746129756.441950:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3299:x1830949053359488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (607us total) trans 17179873240 rc 0/0 00000100:00100000:3.0:1746129756.441954:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11273 00000100:00100000:2.0:1746129756.441960:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11275 00000100:00100000:1.0:1746129756.441960:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3299:x1830949053360000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (600us total) trans 17179873241 rc 0/0 00000100:00100000:3.0:1746129756.441965:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11276 00000100:00100000:2.0:1746129756.441965:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:3296:x1830949053358080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129756.441968:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11274 00000100:00100000:3.0:1746129756.441969:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3296:x1830949053358720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129756.441977:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11277 00000100:00100000:1.0:1746129756.441981:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+56:3296:x1830949053359232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129756.441990:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11278 00000100:00100000:3.0:1746129756.441994:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:3296:x1830949053359744:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129756.443291:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c088e00/2, rc 0, transno 21474840379 00000100:00100000:0.0:1746129756.443298:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053358464:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129756.443305:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c08a300/2, rc 0, transno 21474840380 00000100:00100000:0.0:1746129756.443308:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c08a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053358976:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129756.443327:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009be64700/2, rc 0, transno 17179873240 00000100:00100000:0.0:1746129756.443333:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053359488:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129756.443340:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009be64e00/2, rc 0, transno 17179873241 00000100:00100000:0.0:1746129756.443342:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053360000:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129756.443349:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c089f80/2, rc 0, transno 21474840376 00000100:00100000:0.0:1746129756.443351:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053357952:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129756.443357:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c089500/2, rc 0, transno 21474840378 00000100:00100000:0.0:1746129756.443359:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053358592:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129756.443364:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c08a680/2, rc 0, transno 17179873238 00000100:00100000:0.0:1746129756.443366:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c08a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053359104:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129756.443371:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009be64380/2, rc 0, transno 17179873239 00000100:00100000:0.0:1746129756.443374:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053359616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129756.446366:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053360128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129756.446412:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129756.446454:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053360128 00000100:00100000:0.0:1746129756.446460:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053360128 00000100:00100000:0.0:1746129756.446487:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11279 00000100:00100000:0.0:1746129756.446493:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3299:x1830949053360128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129756.446666:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+60:3299:x1830949053360128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 173us (253us total) trans 17179873244 rc 0/0 00000100:00100000:0.0:1746129756.446672:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11279 00000004:00080000:0.0:1746129756.446701:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba19c00/2, rc 0, transno 17179873244 00000100:00100000:0.0:1746129756.446706:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053360128:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129756.446768:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+59:3296:x1830949053359744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4773us (5310us total) trans 17179873243 rc 0/0 00000100:00100000:3.0:1746129756.446774:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11278 00000100:00100000:3.0:1746129756.446814:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746129756.446835:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c08bb80/2, rc 0, transno 21474840375 00000100:00100000:3.0:1746129756.446838:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c08bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053358336:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129756.446865:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c088380/2, rc 0, transno 21474840377 00000100:00100000:3.0:1746129756.446867:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053358848:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129756.446874:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009be65c00/2, rc 0, transno 17179873237 00000100:00100000:3.0:1746129756.446876:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053359360:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129756.446885:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053359872 00000100:00100000:3.0:1746129756.446887:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053359872 00000100:00100000:3.0:1746129756.446900:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11280 00000100:00100000:3.0:1746129756.446903:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+59:3297:x1830949053359872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129756.446980:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3297:x1830949053359872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (165us total) trans 17179873245 rc 0/0 00000100:00100000:3.0:1746129756.446985:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11280 00000004:00080000:3.0:1746129756.447002:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009be66a00/2, rc 0, transno 17179873245 00000100:00100000:3.0:1746129756.447004:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053359872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129756.447443:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+59:3296:x1830949053359232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 5459us (6004us total) trans 17179873242 rc 0/0 00000100:00100000:1.0:1746129756.447449:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11277 00000100:00100000:2.0:1746129756.448012:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3296:x1830949053358080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 6045us (6622us total) trans 21474840381 rc 0/0 00000100:00100000:2.0:1746129756.448019:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11275 00000100:00100000:2.0:1746129756.448137:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3296:x1830949053358720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 6167us (6731us total) trans 21474840382 rc 0/0 00000100:00100000:2.0:1746129756.448143:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11276 00000004:00080000:2.0:1746129756.448540:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c089180/2, rc 0, transno 21474840381 00000100:00100000:2.0:1746129756.448546:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c089180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053358080:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129756.448552:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c089880/2, rc 0, transno 21474840382 00000100:00100000:2.0:1746129756.448554:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c089880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053358720:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129756.448562:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c088a80/2, rc 0, transno 17179873242 00000100:00100000:2.0:1746129756.448565:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053359232:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129756.448571:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009be65180/2, rc 0, transno 17179873243 00000100:00100000:2.0:1746129756.448573:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053359744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129756.451668:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.451742:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053358208:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129756.451773:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3fa00/0x48868a4e4394a255 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd4a expref: 283 pid: 16808 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746129756.451791:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f800/0x48868a4e4394a25c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd4a expref: 282 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.451817:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3f800, rc 0) 00000100:00100000:2.0:1746129756.451870:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:28740:x1830949052319872:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 59543us (59672us total) trans 8589943747 rc 0/0 00000100:00100000:2.0:1746129756.451878:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9952 00000100:00100000:1.0:1746129756.452276:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052320384 00000100:00100000:1.0:1746129756.452282:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052320384 00000100:00100000:1.0:1746129756.452328:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3926 00000100:00100000:1.0:1746129756.452335:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28732:x1830949052320384:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:1.0:1746129756.453506:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28732:x1830949052320384:12345-192.168.204.31@tcp:49:cat.0 Request processed in 1168us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129756.453512:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3926 00000100:00100000:0.0:1746129756.458108:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.458174:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052320512 00000100:00100000:2.0:1746129756.458182:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052320512 00000100:00100000:2.0:1746129756.458219:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11281 00000100:00100000:2.0:1746129756.458226:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:28740:x1830949052320512:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129756.458243:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129756.458260:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6200/0x48868a4e4394a26a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fd58 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129756.458279:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e6:0x0] initial LVB size: 2097152, mtime: 0x6813d35b, atime: 0x6813d35b, ctime: 0x6813d35b, blocks: 0x81f 00010000:00010000:2.0:1746129756.458294:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.458296:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.458303:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6200/0x48868a4e4394a26a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1150976->1474559) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd58 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.458328:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6200/0x48868a4e4394a26a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1150976->1474559) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd58 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.458337:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb6200, rc 0) 00000100:00100000:2.0:1746129756.458388:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:28740:x1830949052320512:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 162us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129756.458394:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11281 00000100:00100000:0.0:1746129756.466761:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.466807:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.466906:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.467027:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052321152 00000100:00100000:3.0:1746129756.467035:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052321152 00002000:00100000:3.0:1746129756.467072:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e6:0x0] (1150976->1155071) req@ffff88009adaf480 x1830949052321152/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.467080:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adaf480 with x1830949052321152 ext(1150976->1155071) 00002000:00010000:3.0:1746129756.467085:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adaf480 00000100:00100000:1.0:1746129756.467085:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052320768 00000100:00100000:1.0:1746129756.467090:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052320768 00000100:00100000:3.0:1746129756.467103:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4221 00000100:00100000:3.0:1746129756.467110:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949052321152:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129756.467245:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949052321152:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 134us (436us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129756.467252:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4221 00002000:00100000:3.0:1746129756.467257:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e6:0x0] (1150976->1155071) req@ffff88009adaf480 x1830949052321152/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/4536 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.467264:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adaf480 with x1830949052321152 ext(1150976->1155071) 00002000:00010000:3.0:1746129756.467266:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adaf480 00000100:00100000:1.0:1746129756.468333:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9954 00000100:00100000:1.0:1746129756.468341:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28743:x1830949052320768:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129756.468351:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129756.468365:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14d600/0x48868a4e4394a271 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fd5f expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.468440:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14dc00/0x48868a4e4394a278 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.468451:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14dc00/0x48868a4e4394a278 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.468460:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14dc00/0x48868a4e4394a278 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.468470:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14d800/0x48868a4e4394a27f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.468475:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14d800/0x48868a4e4394a27f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.468479:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14d800/0x48868a4e4394a27f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.468564:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14de00/0x48868a4e4394a286 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.468570:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14de00/0x48868a4e4394a286 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.468576:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14de00/0x48868a4e4394a286 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:1.0:1746129756.468586:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129756.468694:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14dc00/0x48868a4e4394a278 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.468700:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14dc00/0x48868a4e4394a278 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.468704:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14dc00/0x48868a4e4394a278 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.468709:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a14dc00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129756.468712:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14dc00/0x48868a4e4394a278 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.468716:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14dc00/0x48868a4e4394a278 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.468724:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129756.468726:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129756.468729:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14dc00/0x48868a4e4394a278 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.468734:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14dc00/0x48868a4e4394a278 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.468742:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14d800/0x48868a4e4394a27f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.468746:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14d800/0x48868a4e4394a27f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.468750:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14d800/0x48868a4e4394a27f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.468756:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a14d800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129756.468758:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14d800/0x48868a4e4394a27f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.468762:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14d800/0x48868a4e4394a27f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.468766:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e8c7500) 00010000:00010000:1.0:1746129756.468767:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129756.468769:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14d800/0x48868a4e4394a27f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.468773:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14d800/0x48868a4e4394a27f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.468801:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14d600/0x48868a4e4394a271 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd5f expref: 11 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.468811:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14de00/0x48868a4e4394a286 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd5f expref: 10 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.468816:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129756.468818:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129756.468819:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a14de00, rc 0) 00000100:00100000:1.0:1746129756.468866:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28743:x1830949052320768:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 525us (2110us total) trans 8589943748 rc 0/0 00000100:00100000:1.0:1746129756.468871:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9954 00000100:00100000:0.0:1746129756.469019:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.469118:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052320896 00000100:00100000:0.0:1746129756.469122:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052320896 00000100:00100000:0.0:1746129756.469141:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052321280 00000100:00100000:0.0:1746129756.469143:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052321280 00000100:00100000:0.0:1746129756.469155:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11282 00000100:00100000:0.0:1746129756.469160:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052320896:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129756.469167:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129756.469178:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135cab400/0x48868a4e4394a294 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fd66 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129756.469193:0:10930:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e8:0x0] initial LVB size: 1048576, mtime: 0x6813d35b, atime: 0x6813d35b, ctime: 0x6813d35b, blocks: 0x809 00010000:00010000:0.0:1746129756.469204:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129756.469206:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129756.469212:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135cab400/0x48868a4e4394a294 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd66 expref: 19 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129756.469222:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135cab400/0x48868a4e4394a294 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd66 expref: 19 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129756.469229:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135cab400, rc 0) 00000100:00100000:0.0:1746129756.469248:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949052320896:12345-192.168.204.31@tcp:101:cat.0 Request processed in 88us (2343us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129756.469253:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11282 00000100:00100000:0.0:1746129756.469264:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11283 00000100:00100000:0.0:1746129756.469268:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052321280:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129756.469273:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129756.469281:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135caa000/0x48868a4e4394a29b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fd6d expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129756.469320:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053360256:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129756.469372:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5188c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129756.471341:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.471575:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052321536 00000100:00100000:0.0:1746129756.471617:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052321536 00002000:00100000:0.0:1746129756.471648:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1470464->1474559) req@ffff88012ba3b800 x1830949052321536/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129756.471656:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3b800 with x1830949052321536 ext(1470464->1474559) 00002000:00010000:0.0:1746129756.471661:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba3b800 00000100:00100000:0.0:1746129756.471688:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4222 00000100:00100000:0.0:1746129756.471694:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1963:x1830949052321536:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129756.471838:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1963:x1830949052321536:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 143us (501us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129756.471844:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4222 00002000:00100000:0.0:1746129756.471869:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1470464->1474559) req@ffff88012ba3b800 x1830949052321536/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/4536 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129756.471875:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3b800 with x1830949052321536 ext(1470464->1474559) 00002000:00010000:0.0:1746129756.471877:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba3b800 00000100:00100000:0.0:1746129756.473006:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.473057:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052321664 00000100:00100000:2.0:1746129756.473062:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052321664 00000100:00100000:2.0:1746129756.473088:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11284 00002000:00010000:1.0:1746129756.473567:0:10930:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime: 1746129755 -> 1746129757 00002000:00010000:1.0:1746129756.473570:0:10930:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime: 1746129755 -> 1746129756 00002000:00010000:1.0:1746129756.473572:0:10930:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime: 1746129755 -> 1746129757 00000100:00100000:1.0:1746129756.473585:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053360256:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129756.473609:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135caa000/0x48868a4e4394a29b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd6d expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129756.473621:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135caa000/0x48868a4e4394a29b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd6d expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129756.473630:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135caa000, rc 0) 00000100:00100000:2.0:1746129756.473657:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949052321664:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129756.473670:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129756.473673:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052321280:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4403us (4653us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129756.473679:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11283 00010000:00010000:2.0:1746129756.473683:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x48868a4e4394a2a2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fd74 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129756.473696:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e7:0x0] initial LVB size: 2097152, mtime: 0x6813d35b, atime: 0x6813d35b, ctime: 0x6813d35b, blocks: 0x81f 00010000:00010000:2.0:1746129756.473708:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.473710:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.473718:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x48868a4e4394a2a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd74 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129756.473730:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x48868a4e4394a2a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd74 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129756.473737:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:2.0:1746129756.473754:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052321664:12345-192.168.204.31@tcp:101:cat.0 Request processed in 660us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129756.473759:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11284 00000100:00100000:0.0:1746129756.476943:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.477277:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052321792 00000100:00100000:2.0:1746129756.477284:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052321792 00000100:00100000:2.0:1746129756.477327:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11285 00000100:00100000:2.0:1746129756.477334:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949052321792:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129756.477348:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129756.477361:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x48868a4e4394a2a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fd7b expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129756.477381:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3ea:0x0] initial LVB size: 2097152, mtime: 0x6813d35c, atime: 0x6813d35b, ctime: 0x6813d35c, blocks: 0x821 00010000:00010000:2.0:1746129756.477395:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.477397:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.477404:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x48868a4e4394a2a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd7b expref: 20 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129756.477417:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x48868a4e4394a2a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd7b expref: 20 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129756.477430:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11200, rc 0) 00000100:00100000:2.0:1746129756.477464:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949052321792:12345-192.168.204.31@tcp:101:cat.0 Request processed in 130us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129756.477469:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11285 00000100:00100000:0.0:1746129756.482418:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129756.482469:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052322048 00000100:00100000:1.0:1746129756.482476:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052322048 00000100:00100000:1.0:1746129756.482523:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3927 00000100:00100000:1.0:1746129756.482530:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012babd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:28740:x1830949052322048:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129756.482770:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012babd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28740:x1830949052322048:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 239us (357us total) trans 8589943749 rc 0/0 00000100:00100000:1.0:1746129756.482775:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3927 00000100:00100000:0.0:1746129756.484410:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.484524:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052322304 00000100:00100000:2.0:1746129756.484529:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052322304 00002000:00100000:2.0:1746129756.484557:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009adaf800 x1830949052322304/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.484565:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adaf800 with x1830949052322304 ext(4194304->4964351) 00002000:00010000:2.0:1746129756.484569:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adaf800 00000100:00100000:2.0:1746129756.484585:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4223 00000100:00100000:2.0:1746129756.484590:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949052322304:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129756.493382:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949052322304:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8780us (8964us total) trans 0 rc 770048/770048 00000100:00100000:2.0:1746129756.493394:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4223 00002000:00100000:2.0:1746129756.493404:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009adaf800 x1830949052322304/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.493413:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adaf800 with x1830949052322304 ext(4194304->4964351) 00002000:00010000:2.0:1746129756.493418:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adaf800 00000100:00100000:0.0:1746129756.501016:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.501106:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052322432 00000100:00100000:2.0:1746129756.501114:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052322432 00000100:00100000:2.0:1746129756.501158:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11286 00000100:00100000:2.0:1746129756.501165:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052322432:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129756.501182:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129756.501197:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394a2b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fd82 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129756.501238:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053360384:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129756.501319:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129756.510803:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.510889:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052322688 00000100:00100000:3.0:1746129756.510896:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052322688 00000100:00100000:3.0:1746129756.510949:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9955 00000100:00100000:3.0:1746129756.510956:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28747:x1830949052322688:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129756.510975:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129756.510989:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ea00/0x48868a4e4394a2b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fd89 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.511076:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ee00/0x48868a4e4394a2be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.511086:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ee00/0x48868a4e4394a2be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.511095:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ee00/0x48868a4e4394a2be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.511104:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f000/0x48868a4e4394a2c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.511109:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f000/0x48868a4e4394a2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.511114:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f000/0x48868a4e4394a2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.511199:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ec00/0x48868a4e4394a2cc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.511207:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ec00/0x48868a4e4394a2cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.511212:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ec00/0x48868a4e4394a2cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129756.511219:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129756.511282:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ee00/0x48868a4e4394a2be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.511288:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ee00/0x48868a4e4394a2be lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.511293:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ee00/0x48868a4e4394a2be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.511298:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd3ee00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129756.511301:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ee00/0x48868a4e4394a2be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.511306:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ee00/0x48868a4e4394a2be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.511326:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129756.511329:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129756.511331:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ee00/0x48868a4e4394a2be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.511335:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ee00/0x48868a4e4394a2be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.511350:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f000/0x48868a4e4394a2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.511355:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f000/0x48868a4e4394a2c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.511359:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f000/0x48868a4e4394a2c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.511362:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd3f000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129756.511364:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f000/0x48868a4e4394a2c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.511368:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f000/0x48868a4e4394a2c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.511372:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f99bf00) 00010000:00010000:3.0:1746129756.511373:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129756.511375:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f000/0x48868a4e4394a2c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.511380:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f000/0x48868a4e4394a2c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129756.511407:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ea00/0x48868a4e4394a2b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd89 expref: 286 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.511417:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ec00/0x48868a4e4394a2cc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd89 expref: 285 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.511423:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129756.511425:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129756.511427:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3ec00, rc 0) 00000100:00100000:3.0:1746129756.512118:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28747:x1830949052322688:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1160us (1321us total) trans 8589943750 rc 0/0 00000100:00100000:3.0:1746129756.512125:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9955 00000100:00100000:2.0:1746129756.512843:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053360384:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129756.512883:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394a2b0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd82 expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129756.512893:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394a2b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd82 expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129756.512903:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:2.0:1746129756.512934:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052322432:12345-192.168.204.31@tcp:101:cat.0 Request processed in 11768us (11924us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129756.512939:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11286 00000100:00100000:0.0:1746129756.516750:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.516797:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052322816 00000100:00100000:2.0:1746129756.516804:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052322816 00000100:00100000:2.0:1746129756.516841:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11287 00000100:00100000:2.0:1746129756.516860:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052322816:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129756.516873:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129756.516886:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x48868a4e4394a2da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fd90 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129756.516925:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053360512:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129756.517563:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129756.524256:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.524293:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.524328:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.524347:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052322944 00000100:00100000:0.0:1746129756.524355:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052322944 00000100:00100000:0.0:1746129756.524383:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052323072 00000100:00100000:0.0:1746129756.524385:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052323072 00000100:00100000:0.0:1746129756.524407:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052323328 00000100:00100000:0.0:1746129756.524409:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052323328 00000100:00100000:0.0:1746129756.524423:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11288 00000100:00100000:0.0:1746129756.524429:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949052322944:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129756.524445:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129756.524459:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800945ce400/0x48868a4e4394a2e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fd97 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.524479:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129756.524481:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129756.524489:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800945ce400/0x48868a4e4394a2e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd97 expref: 33 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129756.524503:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800945ce400/0x48868a4e4394a2e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd97 expref: 33 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129756.524513:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800945ce400, rc 0) 00000100:00100000:0.0:1746129756.524546:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949052322944:12345-192.168.204.31@tcp:101:cat.0 Request processed in 117us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129756.524551:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11288 00000100:00100000:0.0:1746129756.524565:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11289 00000100:00100000:0.0:1746129756.524569:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949052323072:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129756.524575:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129756.524583:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800924f9e00/0x48868a4e4394a2e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fd9e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.524592:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129756.524593:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129756.524597:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800924f9e00/0x48868a4e4394a2e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd9e expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129756.524606:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800924f9e00/0x48868a4e4394a2e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd9e expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129756.524616:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924f9e00, rc 0) 00000100:00100000:0.0:1746129756.524628:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1961:x1830949052323072:12345-192.168.204.31@tcp:101:cat.0 Request processed in 59us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129756.524633:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11289 00000100:00100000:0.0:1746129756.524641:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11290 00000100:00100000:0.0:1746129756.524645:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949052323328:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129756.524650:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129756.524655:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800924f8400/0x48868a4e4394a2ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fdac expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.524662:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129756.524664:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129756.524667:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800924f8400/0x48868a4e4394a2ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdac expref: 33 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129756.524675:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800924f8400/0x48868a4e4394a2ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdac expref: 33 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129756.524681:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924f8400, rc 0) 00000100:00100000:0.0:1746129756.524694:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949052323328:12345-192.168.204.31@tcp:101:cat.0 Request processed in 49us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129756.524698:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11290 00000100:00100000:0.0:1746129756.524722:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.524734:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052323200 00000100:00100000:0.0:1746129756.524737:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052323200 00000100:00100000:0.0:1746129756.524749:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11291 00000100:00100000:0.0:1746129756.524753:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949052323200:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129756.524758:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129756.524764:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a2f6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fda5 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.524772:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129756.524774:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129756.524777:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a2f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fda5 expref: 34 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129756.524785:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a2f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fda5 expref: 34 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129756.524790:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb6600, rc 0) 00000100:00100000:0.0:1746129756.524803:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949052323200:12345-192.168.204.31@tcp:101:cat.0 Request processed in 50us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129756.524807:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11291 00000100:00100000:0.0:1746129756.524871:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.524882:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052323456 00000100:00100000:0.0:1746129756.524884:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052323456 00000100:00100000:0.0:1746129756.524897:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11292 00000100:00100000:0.0:1746129756.524901:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1961:x1830949052323456:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129756.524906:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129756.524913:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e4394a2fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fdb3 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.524920:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129756.524922:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129756.524926:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e4394a2fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdb3 expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129756.524932:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e4394a2fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdb3 expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129756.524938:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c840c00, rc 0) 00000100:00100000:0.0:1746129756.524951:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949052323456:12345-192.168.204.31@tcp:101:cat.0 Request processed in 50us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129756.524954:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11292 00000100:00100000:1.0:1746129756.525220:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053360512:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129756.525242:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x48868a4e4394a2da lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd90 expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129756.525249:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11000/0x48868a4e4394a2da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd90 expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129756.525260:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11000, rc 0) 00000100:00100000:1.0:1746129756.525280:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052322816:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8433us (8537us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129756.525285:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11287 00000100:00100000:0.0:1746129756.541291:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.541835:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.542709:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.542809:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052323840 00000100:00100000:2.0:1746129756.542816:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052323840 00002000:00100000:2.0:1746129756.542866:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009ba85880 x1830949052323840/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.542874:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85880 with x1830949052323840 ext(0->1048575) 00002000:00010000:2.0:1746129756.542879:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba85880 00000100:00100000:0.0:1746129756.543598:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052324096 00000100:00100000:0.0:1746129756.543602:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052324096 00002000:00100000:0.0:1746129756.543618:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ba86a00 x1830949052324096/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 504/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129756.543624:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba86a00 with x1830949052324096 ext(1048576->2097151) 00002000:00010000:0.0:1746129756.543627:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba86a00 00000100:00100000:2.0:1746129756.543926:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052324224 00000100:00100000:2.0:1746129756.543929:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052324224 00002000:00100000:2.0:1746129756.543939:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009ba85f80 x1830949052324224/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.543944:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85f80 with x1830949052324224 ext(1048576->2097151) 00002000:00010000:2.0:1746129756.543947:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba85f80 00000100:00100000:0.0:1746129756.544066:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4224 00000100:00100000:0.0:1746129756.544073:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949052323840:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129756.545186:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.545203:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052324480 00000100:00100000:0.0:1746129756.545206:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052324480 00002000:00100000:0.0:1746129756.545219:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009ba84000 x1830949052324480/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129756.545232:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba84000 with x1830949052324480 ext(1048576->2097151) 00002000:00010000:0.0:1746129756.545236:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba84000 00000100:00100000:0.0:1746129756.545246:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4225 00000100:00100000:0.0:1746129756.545251:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949052324096:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129756.546016:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4226 00000100:00100000:0.0:1746129756.546023:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949052324224:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129756.549123:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4227 00000100:00100000:0.0:1746129756.549139:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949052324480:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129756.569898:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949052324096:12345-192.168.204.31@tcp:3:cat.0 Request processed in 24640us (28059us total) trans 0 rc 724992/724992 00000100:00100000:1.0:1746129756.569909:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4225 00002000:00100000:1.0:1746129756.569919:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ba86a00 x1830949052324096/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 504/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.569929:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba86a00 with x1830949052324096 ext(1048576->2097151) 00002000:00010000:1.0:1746129756.569934:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba86a00 00000100:00100000:2.0:1746129756.569995:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949052323840:12345-192.168.204.31@tcp:3:cat.0 Request processed in 25290us (28113us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129756.570001:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4224 00002000:00100000:2.0:1746129756.570007:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009ba85880 x1830949052323840/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.570013:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85880 with x1830949052323840 ext(0->1048575) 00002000:00010000:2.0:1746129756.570016:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba85880 00000100:00100000:1.0:1746129756.573288:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949052324224:12345-192.168.204.31@tcp:3:cat.0 Request processed in 27256us (30571us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129756.573299:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4226 00002000:00100000:1.0:1746129756.573319:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009ba85f80 x1830949052324224/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.573327:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85f80 with x1830949052324224 ext(1048576->2097151) 00002000:00010000:1.0:1746129756.573332:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba85f80 00000100:00100000:1.0:1746129756.574259:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949052324480:12345-192.168.204.31@tcp:3:cat.0 Request processed in 25123us (29071us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129756.574267:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4227 00002000:00100000:1.0:1746129756.574272:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009ba84000 x1830949052324480/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.574285:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba84000 with x1830949052324480 ext(1048576->2097151) 00002000:00010000:1.0:1746129756.574289:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba84000 00000100:00100000:0.0:1746129756.594483:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.594518:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.595175:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.595908:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.595962:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052324864 00000100:00100000:2.0:1746129756.595971:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052324864 00002000:00100000:2.0:1746129756.596008:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009ba85c00 x1830949052324864/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.596016:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85c00 with x1830949052324864 ext(3145728->4194303) 00002000:00010000:2.0:1746129756.596021:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba85c00 00000100:00100000:2.0:1746129756.596035:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052325376 00000100:00100000:2.0:1746129756.596037:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052325376 00002000:00100000:2.0:1746129756.596047:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009ba84700 x1830949052325376/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.596052:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba84700 with x1830949052325376 ext(3145728->4194303) 00002000:00010000:2.0:1746129756.596055:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba84700 00000100:00100000:2.0:1746129756.596063:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052324736 00000100:00100000:2.0:1746129756.596064:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052324736 00002000:00100000:2.0:1746129756.596073:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009ba85180 x1830949052324736/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.596079:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85180 with x1830949052324736 ext(2097152->3145727) 00002000:00010000:2.0:1746129756.596081:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba85180 00000100:00100000:2.0:1746129756.596092:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4228 00000100:00100000:2.0:1746129756.596097:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949052324864:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129756.597098:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4229 00000100:00100000:2.0:1746129756.597105:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949052325376:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129756.598426:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4230 00000100:00100000:3.0:1746129756.598436:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949052324736:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129756.598581:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052325248 00000100:00100000:3.0:1746129756.598585:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052325248 00002000:00100000:3.0:1746129756.598608:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009ba85500 x1830949052325248/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.598616:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85500 with x1830949052325248 ext(2097152->3145727) 00002000:00010000:3.0:1746129756.598621:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba85500 00000100:00100000:3.0:1746129756.598640:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4231 00000100:00100000:3.0:1746129756.598645:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949052325248:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129756.606967:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949052324864:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10860us (12482us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129756.606978:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4228 00002000:00100000:2.0:1746129756.606988:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009ba85c00 x1830949052324864/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.606998:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85c00 with x1830949052324864 ext(3145728->4194303) 00002000:00010000:2.0:1746129756.607003:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba85c00 00000100:00100000:3.0:1746129756.613367:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949052325248:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14711us (17449us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129756.613377:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4231 00002000:00100000:3.0:1746129756.613387:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009ba85500 x1830949052325248/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.613396:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85500 with x1830949052325248 ext(2097152->3145727) 00002000:00010000:3.0:1746129756.613401:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba85500 00000100:00100000:3.0:1746129756.619759:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949052324736:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21317us (24576us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129756.619773:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4230 00002000:00100000:3.0:1746129756.619782:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009ba85180 x1830949052324736/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.619791:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85180 with x1830949052324736 ext(2097152->3145727) 00002000:00010000:3.0:1746129756.619796:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba85180 00000100:00100000:2.0:1746129756.620077:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949052325376:12345-192.168.204.31@tcp:3:cat.0 Request processed in 22972us (25558us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129756.620083:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4229 00002000:00100000:2.0:1746129756.620088:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009ba84700 x1830949052325376/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.620094:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba84700 with x1830949052325376 ext(3145728->4194303) 00002000:00010000:2.0:1746129756.620097:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba84700 00000100:00100000:0.0:1746129756.635755:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.635929:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052325760 00000100:00100000:2.0:1746129756.635936:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052325760 00002000:00100000:2.0:1746129756.635971:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff8800a645e300 x1830949052325760/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.635979:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645e300 with x1830949052325760 ext(4194304->4964351) 00002000:00010000:2.0:1746129756.635983:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a645e300 00000100:00100000:2.0:1746129756.636016:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4232 00000100:00100000:2.0:1746129756.636023:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949052325760:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129756.646109:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949052325760:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10077us (10351us total) trans 0 rc 770048/770048 00000100:00100000:2.0:1746129756.646121:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4232 00002000:00100000:2.0:1746129756.646131:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff8800a645e300 x1830949052325760/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.646140:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645e300 with x1830949052325760 ext(4194304->4964351) 00002000:00010000:2.0:1746129756.646145:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a645e300 00000100:00100000:0.0:1746129756.657886:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.658038:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052326016 00000100:00100000:3.0:1746129756.658046:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052326016 00000100:00100000:3.0:1746129756.658085:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3928 00000100:00100000:3.0:1746129756.658092:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28747:x1830949052326016:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:3.0:1746129756.658266:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:28747:x1830949052326016:12345-192.168.204.31@tcp:35:cat.0 Request processed in 173us (419us total) trans 8589943751 rc 0/0 00000100:00100000:3.0:1746129756.658271:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3928 00000100:00100000:0.0:1746129756.661630:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.661708:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052326144 00000100:00100000:2.0:1746129756.661714:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052326144 00000100:00100000:2.0:1746129756.661757:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11293 00000100:00100000:2.0:1746129756.661764:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052326144:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129756.661777:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129756.661791:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb4bc00/0x48868a4e4394a304 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fdba expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129756.661829:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053360640:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129756.661919:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1240 going to sleep for 11 seconds 00002000:00010000:3.0:1746129756.663740:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime: 1746129756 -> 1746129757 00000100:00100000:3.0:1746129756.663759:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053360640:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129756.663779:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb4bc00/0x48868a4e4394a304 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdba expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129756.663790:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb4bc00/0x48868a4e4394a304 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdba expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129756.663798:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb4bc00, rc 0) 00000100:00100000:3.0:1746129756.663824:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052326144:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2061us (2200us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129756.663830:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11293 00000100:00100000:0.0:1746129756.666710:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.667108:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052326400 00000100:00100000:2.0:1746129756.667116:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052326400 00002000:00100000:2.0:1746129756.667152:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800a645ea00 x1830949052326400/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.667160:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645ea00 with x1830949052326400 ext(0->1048575) 00002000:00010000:2.0:1746129756.667165:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a645ea00 00000100:00100000:2.0:1746129756.667182:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4233 00000100:00100000:2.0:1746129756.667188:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949052326400:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129756.671086:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.671146:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052326528 00000100:00100000:3.0:1746129756.671155:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052326528 00000100:00100000:3.0:1746129756.671202:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11294 00000100:00100000:3.0:1746129756.671210:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28743:x1830949052326528:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129756.671224:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129756.671239:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e600/0x48868a4e4394a30b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fdc1 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.671269:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x48868a4e4394a2a2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd74 expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129756.671280:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800924f9e00/0x48868a4e4394a2e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd9e expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129756.671287:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129756.671288:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129756.671291:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e600/0x48868a4e4394a30b lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1748992->2097151] (req 1748992->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc1 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.671330:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800924f9e00/0x48868a4e4394a2e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd9e expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129756.671340:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800924f9e00/0x48868a4e4394a2e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd9e expref: 16 pid: 8437 timeout: 802 lvb_type: 1 00000100:00100000:3.0:1746129756.671350:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130507480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053360768:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129756.671436:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x48868a4e4394a2a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd74 expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129756.671445:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x48868a4e4394a2a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd74 expref: 12 pid: 8436 timeout: 802 lvb_type: 1 00000100:00100000:3.0:1746129756.671452:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130506680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053360896:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129756.671470:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129756.672552:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130507480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053360768:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129756.672561:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130506680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053360896:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129756.672577:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e600/0x48868a4e4394a30b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1748992->2097151] (req 1748992->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc1 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.672586:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6e600, rc 0) 00000100:00100000:3.0:1746129756.672609:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28743:x1830949052326528:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1401us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.672616:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11294 00000100:00100000:0.0:1746129756.673303:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.673418:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052326656 00000100:00100000:3.0:1746129756.673423:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052326656 00010000:00010000:3.0:1746129756.673441:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x48868a4e4394a2a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd74 expref: 12 pid: 8436 timeout: 802 lvb_type: 1 00000100:00100000:3.0:1746129756.673457:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5435 00000100:00100000:3.0:1746129756.673462:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949052326656:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129756.673470:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129756.673486:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x48868a4e4394a2a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd74 expref: 12 pid: 8436 timeout: 802 lvb_type: 1 00010000:00010000:3.0:1746129756.673494:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x48868a4e4394a2a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd74 expref: 12 pid: 8436 timeout: 802 lvb_type: 1 00010000:00010000:3.0:1746129756.673510:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10c00/0x48868a4e4394a2a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd74 expref: 12 pid: 8436 timeout: 802 lvb_type: 1 00010000:00010000:3.0:1746129756.673521:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129756.673540:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052326656:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 77us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.673544:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5435 00000100:00100000:2.0:1746129756.673656:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949052326400:12345-192.168.204.31@tcp:3:cat.0 Request processed in 6467us (6951us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129756.673664:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4233 00002000:00100000:2.0:1746129756.673672:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800a645ea00 x1830949052326400/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.673680:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645ea00 with x1830949052326400 ext(0->1048575) 00002000:00010000:2.0:1746129756.673684:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a645ea00 00000100:00100000:0.0:1746129756.674269:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.674968:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052326784 00000100:00100000:2.0:1746129756.674973:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052326784 00010000:00010000:2.0:1746129756.674989:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800924f9e00/0x48868a4e4394a2e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd9e expref: 17 pid: 8437 timeout: 802 lvb_type: 1 00000100:00100000:2.0:1746129756.675019:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5436 00000100:00100000:2.0:1746129756.675025:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1963:x1830949052326784:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129756.675031:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129756.675043:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800924f9e00/0x48868a4e4394a2e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd9e expref: 17 pid: 8437 timeout: 802 lvb_type: 1 00010000:00010000:2.0:1746129756.675053:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800924f9e00/0x48868a4e4394a2e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd9e expref: 17 pid: 8437 timeout: 802 lvb_type: 1 00010000:00010000:2.0:1746129756.675066:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800924f9e00/0x48868a4e4394a2e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd9e expref: 17 pid: 8437 timeout: 802 lvb_type: 1 00010000:00010000:2.0:1746129756.675119:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.675122:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.675127:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e600/0x48868a4e4394a30b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc1 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.675133:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e600/0x48868a4e4394a30b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc1 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.675157:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e600/0x48868a4e4394a30b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc1 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129756.675168:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053361024:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129756.675226:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129756.676986:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.677091:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053361024:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129756.677105:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129756.677134:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1963:x1830949052326784:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2108us (2865us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129756.677142:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5436 00000100:00100000:3.0:1746129756.677216:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052327040 00000100:00100000:3.0:1746129756.677221:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052327040 00002000:00100000:3.0:1746129756.677251:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e7:0x0] (1748992->1753087) req@ffff8800a645c380 x1830949052327040/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.677259:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645c380 with x1830949052327040 ext(1748992->1753087) 00002000:00010000:3.0:1746129756.677262:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645c380 00000100:00100000:3.0:1746129756.677287:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4234 00000100:00100000:3.0:1746129756.677294:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1963:x1830949052327040:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129756.677834:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1963:x1830949052327040:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 539us (851us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129756.677840:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4234 00002000:00100000:3.0:1746129756.677845:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e7:0x0] (1748992->1753087) req@ffff8800a645c380 x1830949052327040/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/4536 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.677881:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645c380 with x1830949052327040 ext(1748992->1753087) 00002000:00010000:3.0:1746129756.677883:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645c380 00000100:00100000:0.0:1746129756.683530:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.683601:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052327168 00000100:00100000:3.0:1746129756.683608:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052327168 00000100:00100000:0.0:1746129756.683711:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129756.683764:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052327296 00000100:00100000:1.0:1746129756.683768:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052327296 00000100:00100000:3.0:1746129756.684044:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11295 00000100:00100000:3.0:1746129756.684052:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28752:x1830949052327168:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129756.684069:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129756.684085:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e4394a312 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fdc8 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.684110:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6200/0x48868a4e4394a26a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1474559) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd58 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.684116:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129756.684117:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129756.684120:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e4394a312 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc8 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.684145:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6200/0x48868a4e4394a26a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1474559) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd58 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.684154:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6200/0x48868a4e4394a26a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1474559) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd58 expref: 15 pid: 8436 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746129756.684163:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130506680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053361152:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129756.684231:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28300 going to sleep for 11 seconds 00000100:00100000:1.0:1746129756.684240:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11296 00000100:00100000:1.0:1746129756.684246:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:28743:x1830949052327296:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129756.684253:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129756.684262:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e4394a319 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fdcf expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.684275:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x48868a4e4394a2a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd7b expref: 21 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129756.684282:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a2f6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fda5 expref: 33 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129756.684287:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129756.684288:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129756.684291:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e4394a319 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->1740799] (req 1048576->1740799) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdcf expref: 21 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.684317:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a2f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fda5 expref: 33 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129756.684325:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a2f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fda5 expref: 33 pid: 8437 timeout: 802 lvb_type: 1 00000100:00100000:1.0:1746129756.684337:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053361280:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129756.684365:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x48868a4e4394a2a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd7b expref: 21 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129756.684372:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x48868a4e4394a2a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd7b expref: 21 pid: 8436 timeout: 802 lvb_type: 1 00000100:00100000:1.0:1746129756.684378:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053361408:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129756.684392:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129756.687750:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.687777:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130506680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053361152:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129756.687802:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e4394a312 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc8 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.687817:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6e800, rc 0) 00000100:00100000:1.0:1746129756.687841:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053361280:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129756.687880:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28752:x1830949052327168:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3827us (4356us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.687888:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11295 00000100:00100000:2.0:1746129756.688033:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052327424 00000100:00100000:2.0:1746129756.688078:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052327424 00002000:00100000:2.0:1746129756.688116:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e6:0x0] (1150976->1474559) req@ffff8800a645d180 x1830949052327424/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.688124:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645d180 with x1830949052327424 ext(1150976->1474559) 00010000:00010000:2.0:1746129756.688131:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6200/0x48868a4e4394a26a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1474559) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd58 expref: 16 pid: 8436 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.688141:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6200/0x48868a4e4394a26a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1474559) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd58 expref: 16 pid: 8436 timeout: 802 lvb_type: 0 00002000:00010000:2.0:1746129756.688146:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a645d180 00000100:00100000:2.0:1746129756.688170:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 632 00000100:00100000:2.0:1746129756.688177:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1961:x1830949052327424:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129756.688640:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.688688:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052327552 00000100:00100000:3.0:1746129756.688691:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052327552 00010000:00010000:3.0:1746129756.688708:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x48868a4e4394a2a9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd7b expref: 22 pid: 8436 timeout: 802 lvb_type: 1 00000100:00100000:2.0:1746129756.688715:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053361408:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129756.688726:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5437 00010000:00010000:2.0:1746129756.688730:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e4394a319 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->1740799] (req 1048576->1740799) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdcf expref: 22 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129756.688731:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949052327552:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129756.688740:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129756.688740:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009536f200, rc 0) 00010000:00010000:3.0:1746129756.688755:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x48868a4e4394a2a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd7b expref: 22 pid: 8436 timeout: 802 lvb_type: 1 00000100:00100000:2.0:1746129756.688760:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:28743:x1830949052327296:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4514us (5049us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129756.688763:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x48868a4e4394a2a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd7b expref: 22 pid: 8436 timeout: 802 lvb_type: 1 00000100:00100000:2.0:1746129756.688766:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11296 00010000:00010000:3.0:1746129756.688781:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x48868a4e4394a2a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd7b expref: 21 pid: 8436 timeout: 802 lvb_type: 1 00010000:00010000:3.0:1746129756.688793:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129756.688809:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949052327552:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 78us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.688814:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5437 00000100:00100000:1.0:1746129756.688843:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.689003:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052327680 00000100:00100000:0.0:1746129756.689007:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052327680 00010000:00010000:0.0:1746129756.689020:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a2f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fda5 expref: 34 pid: 8437 timeout: 802 lvb_type: 1 00000100:00100000:1.0:1746129756.689046:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5438 00000100:00100000:1.0:1746129756.689052:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949052327680:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129756.689059:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129756.689068:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a2f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fda5 expref: 34 pid: 8437 timeout: 802 lvb_type: 1 00010000:00010000:1.0:1746129756.689076:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a2f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fda5 expref: 34 pid: 8437 timeout: 802 lvb_type: 1 00010000:00010000:1.0:1746129756.689088:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a2f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fda5 expref: 34 pid: 8437 timeout: 802 lvb_type: 1 00010000:00010000:1.0:1746129756.689105:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129756.689106:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129756.689112:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e4394a319 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdcf expref: 19 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.689119:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e4394a319 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdcf expref: 19 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.689141:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e4394a319 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdcf expref: 19 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129756.689150:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053361536:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129756.689200:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129756.693105:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053361536:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129756.693176:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129756.693214:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949052327680:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4161us (4369us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129756.693222:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5438 00000100:00100000:0.0:1746129756.697702:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.697722:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949052327424:12345-192.168.204.31@tcp:4:cat.0 Request processed in 9545us (9978us total) trans 21474840383 rc 0/0 00000100:00100000:3.0:1746129756.697732:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 632 00002000:00100000:3.0:1746129756.697741:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e6:0x0] (1150976->1474559) req@ffff8800a645d180 x1830949052327424/t21474840383(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/448 e 0 to 0 dl 1746129767 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.697749:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645d180 with x1830949052327424 ext(1150976->1474559) 00010000:00010000:3.0:1746129756.697758:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6200/0x48868a4e4394a26a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1474559) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd58 expref: 18 pid: 8436 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.697770:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6200/0x48868a4e4394a26a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1474559) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd58 expref: 18 pid: 8436 timeout: 802 lvb_type: 0 00002000:00010000:3.0:1746129756.697776:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a645d180 00000100:00100000:3.0:1746129756.697793:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052327936 00000100:00100000:3.0:1746129756.697799:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052327936 00002000:00100000:3.0:1746129756.697821:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3ea:0x0] (1736704->1740799) req@ffff8800a645dc00 x1830949052327936/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.697827:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645dc00 with x1830949052327936 ext(1736704->1740799) 00002000:00010000:3.0:1746129756.697829:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a645dc00 00000100:00100000:1.0:1746129756.697863:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4235 00000100:00100000:1.0:1746129756.697872:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949052327936:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129756.697979:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949052327936:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 108us (283us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129756.697985:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4235 00002000:00100000:1.0:1746129756.697990:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3ea:0x0] (1736704->1740799) req@ffff8800a645dc00 x1830949052327936/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/4536 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.697997:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645dc00 with x1830949052327936 ext(1736704->1740799) 00002000:00010000:1.0:1746129756.698000:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a645dc00 00000100:00100000:0.0:1746129756.702944:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.702987:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.703055:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052328320 00000100:00100000:2.0:1746129756.703064:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052328320 00000100:00100000:2.0:1746129756.703111:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3929 00000100:00100000:2.0:1746129756.703118:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28743:x1830949052328320:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129756.703294:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28743:x1830949052328320:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 175us (306us total) trans 8589943752 rc 0/0 00000100:00100000:2.0:1746129756.703300:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3929 00000100:00100000:1.0:1746129756.704979:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052328064 00000100:00100000:1.0:1746129756.704987:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052328064 00010000:00010000:1.0:1746129756.705014:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6200/0x48868a4e4394a26a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1474559) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd58 expref: 18 pid: 8436 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746129756.705049:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5439 00000100:00100000:1.0:1746129756.705056:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949052328064:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129756.705068:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129756.705084:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6200/0x48868a4e4394a26a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1150976->1474559) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd58 expref: 18 pid: 8436 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.705094:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6200/0x48868a4e4394a26a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1150976->1474559) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd58 expref: 18 pid: 8436 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.705113:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6200/0x48868a4e4394a26a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1150976->1474559) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd58 expref: 18 pid: 8436 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.705136:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129756.705138:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129756.705146:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e4394a312 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc8 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.705152:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e4394a312 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc8 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.705184:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e4394a312 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc8 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129756.705195:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053361664:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129756.705264:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129756.708279:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053361664:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129756.708295:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129756.708353:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949052328064:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3296us (5417us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129756.708362:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5439 00000100:00100000:0.0:1746129756.710523:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.711143:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.711343:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129756.712147:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052328832 00000100:00100000:1.0:1746129756.712155:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052328832 00002000:00100000:1.0:1746129756.712193:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3ea:0x0] (1740800->2097151) req@ffff8800a645ce00 x1830949052328832/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.712202:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645ce00 with x1830949052328832 ext(1740800->2097151) 00002000:00010000:1.0:1746129756.712207:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a645ce00 00000100:00100000:1.0:1746129756.712223:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052328704 00000100:00100000:1.0:1746129756.712226:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052328704 00002000:00100000:1.0:1746129756.712236:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800a645d880 x1830949052328704/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.712242:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645d880 with x1830949052328704 ext(1048576->2097151) 00002000:00010000:1.0:1746129756.712244:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645d880 00000100:00100000:1.0:1746129756.712253:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052328960 00000100:00100000:1.0:1746129756.712255:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052328960 00002000:00100000:1.0:1746129756.712264:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->1748991) req@ffff8800a645ed80 x1830949052328960/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.712270:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645ed80 with x1830949052328960 ext(1048576->1748991) 00002000:00010000:1.0:1746129756.712272:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645ed80 00000100:00100000:1.0:1746129756.712282:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4236 00000100:00100000:1.0:1746129756.712288:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949052328832:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129756.712745:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4237 00000100:00100000:1.0:1746129756.712750:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949052328704:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129756.713208:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4238 00000100:00100000:0.0:1746129756.713216:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949052328960:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129756.717418:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129756.718253:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052329344 00000100:00100000:1.0:1746129756.718262:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052329344 00000100:00100000:1.0:1746129756.718319:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9956 00000100:00100000:1.0:1746129756.718326:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:28755:x1830949052329344:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129756.718345:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129756.718362:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840800/0x48868a4e4394a320 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fdd6 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.718444:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841e00/0x48868a4e4394a327 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.718457:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14de00/0x48868a4e4394a286 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd5f expref: 10 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.718464:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ec00/0x48868a4e4394a2cc lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd89 expref: 287 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.718470:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841e00/0x48868a4e4394a327 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.718494:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ec00/0x48868a4e4394a2cc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd89 expref: 287 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.718504:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ec00/0x48868a4e4394a2cc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd89 expref: 287 pid: 1851 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746129756.718515:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053361792:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129756.718580:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14de00/0x48868a4e4394a286 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd5f expref: 10 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.718588:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14de00/0x48868a4e4394a286 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd5f expref: 10 pid: 16808 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746129756.718595:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053361920:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129756.718609:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129756.722958:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949052328832:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 10660us (12430us total) trans 0 rc 356352/356352 00000100:00100000:1.0:1746129756.722969:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4236 00002000:00100000:1.0:1746129756.722978:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3ea:0x0] (1740800->2097151) req@ffff8800a645ce00 x1830949052328832/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 356352/356352 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.722987:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645ce00 with x1830949052328832 ext(1740800->2097151) 00002000:00010000:1.0:1746129756.722992:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a645ce00 00000100:00100000:3.0:1746129756.724397:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129756.724404:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053361792:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129756.724420:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052329600 00000100:00100000:1.0:1746129756.724426:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052329600 00000100:00100000:3.0:1746129756.724432:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129756.724451:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14de00/0x48868a4e4394a286 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd5f expref: 11 pid: 16808 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746129756.724476:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052329472 00000100:00100000:1.0:1746129756.724478:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052329472 00010000:00010000:1.0:1746129756.724488:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ec00/0x48868a4e4394a2cc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd89 expref: 288 pid: 1851 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746129756.724490:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5440 00000100:00100000:2.0:1746129756.724498:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949052329600:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129756.724502:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5441 00000100:00100000:1.0:1746129756.724507:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:1964:x1830949052329472:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129756.724509:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129756.724514:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129756.724517:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14de00/0x48868a4e4394a286 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd5f expref: 11 pid: 16808 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.724518:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ec00/0x48868a4e4394a2cc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd89 expref: 288 pid: 1851 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.724526:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14de00/0x48868a4e4394a286 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd5f expref: 11 pid: 16808 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.724538:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ec00/0x48868a4e4394a2cc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd89 expref: 288 pid: 1851 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.724554:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ec00/0x48868a4e4394a2cc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd89 expref: 288 pid: 1851 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.724571:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129756.724575:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841e00/0x48868a4e4394a327 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.724581:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841e00/0x48868a4e4394a327 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.724586:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129756.724656:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:1964:x1830949052329472:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 148us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129756.724663:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5441 00000100:00100000:1.0:1746129756.724687:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba38380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053361920:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129756.724743:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949052328704:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 11992us (13599us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129756.724751:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4237 00002000:00100000:0.0:1746129756.724757:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800a645d880 x1830949052328704/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129756.724765:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645d880 with x1830949052328704 ext(1048576->2097151) 00002000:00010000:0.0:1746129756.724769:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645d880 00010000:00010000:2.0:1746129756.726077:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14de00/0x48868a4e4394a286 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd5f expref: 11 pid: 16808 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.726104:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129756.726108:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841e00/0x48868a4e4394a327 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129756.726116:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841e00/0x48868a4e4394a327 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129756.726122:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841e00/0x48868a4e4394a327 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129756.726137:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129756.726179:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949052329600:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1681us (1785us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129756.726185:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5440 00010000:00010000:1.0:1746129756.726235:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841e00/0x48868a4e4394a327 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.726248:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841e00/0x48868a4e4394a327 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.726253:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841e00/0x48868a4e4394a327 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:1.0:1746129756.726271:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129756.726388:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840800/0x48868a4e4394a320 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdd6 expref: 288 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.726401:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841e00/0x48868a4e4394a327 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdd6 expref: 287 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.726407:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129756.726410:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129756.726412:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c841e00, rc 0) 00000100:00100000:1.0:1746129756.726448:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:28755:x1830949052329344:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 8123us (9039us total) trans 8589943753 rc 0/0 00000100:00100000:1.0:1746129756.726454:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9956 00000100:00100000:0.0:1746129756.726489:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949052328960:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 13273us (15146us total) trans 0 rc 700416/700416 00000100:00100000:0.0:1746129756.726496:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4238 00002000:00100000:0.0:1746129756.726503:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->1748991) req@ffff8800a645ed80 x1830949052328960/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 700416/700416 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129756.726510:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645ed80 with x1830949052328960 ext(1048576->1748991) 00002000:00010000:0.0:1746129756.726514:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645ed80 00000100:00100000:0.0:1746129756.742277:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.742351:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052329728 00000100:00100000:2.0:1746129756.742360:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052329728 00000100:00100000:2.0:1746129756.742403:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11297 00000100:00100000:2.0:1746129756.742411:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:28755:x1830949052329728:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129756.742425:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129756.742440:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bc62600/0x48868a4e4394a335 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fddd expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.742463:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb4be00/0x48868a4e4394a216 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd27 expref: 19 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.742469:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800924f8400/0x48868a4e4394a2ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdac expref: 34 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129756.742475:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.742476:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.742479:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc62600/0x48868a4e4394a335 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3444736->3723263] (req 3444736->3723263) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fddd expref: 34 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.742503:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800924f8400/0x48868a4e4394a2ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdac expref: 34 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129756.742513:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800924f8400/0x48868a4e4394a2ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdac expref: 34 pid: 8437 timeout: 802 lvb_type: 1 00000100:00100000:2.0:1746129756.742522:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053362048:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129756.742596:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb4be00/0x48868a4e4394a216 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd27 expref: 19 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.742604:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb4be00/0x48868a4e4394a216 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd27 expref: 19 pid: 3623 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746129756.742611:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053362176:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129756.742628:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129756.752949:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.753059:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053362048:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129756.753070:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053362176:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129756.753093:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bc62600/0x48868a4e4394a335 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3444736->3723263] (req 3444736->3723263) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fddd expref: 34 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.753108:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bc62600, rc 0) 00000100:00100000:2.0:1746129756.753152:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:28755:x1830949052329728:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 10741us (10881us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129756.753160:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11297 00000100:00100000:0.0:1746129756.753713:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.753730:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.753742:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.753762:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.754087:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052329856 00000100:00100000:3.0:1746129756.754094:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052329856 00010000:00010000:3.0:1746129756.754118:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800924f8400/0x48868a4e4394a2ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdac expref: 34 pid: 8437 timeout: 802 lvb_type: 1 00000100:00100000:3.0:1746129756.754136:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5442 00000100:00100000:3.0:1746129756.754142:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135400700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949052329856:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129756.754152:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129756.754169:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800924f8400/0x48868a4e4394a2ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdac expref: 34 pid: 8437 timeout: 802 lvb_type: 1 00010000:00010000:3.0:1746129756.754178:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800924f8400/0x48868a4e4394a2ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdac expref: 34 pid: 8437 timeout: 802 lvb_type: 1 00010000:00010000:3.0:1746129756.754196:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800924f8400/0x48868a4e4394a2ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdac expref: 34 pid: 8437 timeout: 802 lvb_type: 1 00010000:00010000:3.0:1746129756.754216:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129756.754236:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135400700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949052329856:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 94us (1296us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.754242:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5442 00000100:00100000:1.0:1746129756.754447:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052330112 00000100:00100000:1.0:1746129756.754451:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052330112 00002000:00100000:1.0:1746129756.754475:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880135400a80 x1830949052330112/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.754489:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135400a80 with x1830949052330112 ext(2097152->3145727) 00010000:00010000:1.0:1746129756.754495:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb4be00/0x48868a4e4394a216 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd27 expref: 20 pid: 3623 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.754504:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb4be00/0x48868a4e4394a216 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd27 expref: 20 pid: 3623 timeout: 802 lvb_type: 0 00002000:00010000:1.0:1746129756.754510:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135400a80 00000100:00100000:1.0:1746129756.755065:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052330368 00000100:00100000:1.0:1746129756.755069:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052330368 00002000:00100000:1.0:1746129756.755082:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880135400e00 x1830949052330368/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.755088:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135400e00 with x1830949052330368 ext(3145728->4194303) 00010000:00010000:1.0:1746129756.755092:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb4be00/0x48868a4e4394a216 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd27 expref: 21 pid: 3623 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.755099:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb4be00/0x48868a4e4394a216 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd27 expref: 21 pid: 3623 timeout: 802 lvb_type: 0 00002000:00010000:1.0:1746129756.755104:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135400e00 00000100:00100000:0.0:1746129756.756288:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052330624 00000100:00100000:0.0:1746129756.756294:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052330624 00002000:00100000:0.0:1746129756.756325:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880135401500 x1830949052330624/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129756.756332:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135401500 with x1830949052330624 ext(2097152->3145727) 00002000:00010000:0.0:1746129756.756335:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135401500 00000100:00100000:0.0:1746129756.756350:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052330880 00000100:00100000:0.0:1746129756.756352:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052330880 00002000:00100000:0.0:1746129756.756361:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880135401180 x1830949052330880/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129756.756366:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135401180 with x1830949052330880 ext(3145728->4194303) 00002000:00010000:0.0:1746129756.756368:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135401180 00000100:00100000:0.0:1746129756.756386:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 633 00000100:00100000:0.0:1746129756.756392:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1963:x1830949052330112:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129756.757410:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 634 00000100:00100000:0.0:1746129756.757417:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135400e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1963:x1830949052330368:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129756.758360:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4239 00000100:00100000:0.0:1746129756.758367:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1963:x1830949052330624:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129756.765426:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4240 00000100:00100000:2.0:1746129756.765444:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1963:x1830949052330880:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129756.783752:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1963:x1830949052330112:12345-192.168.204.31@tcp:3:cat.0 Request processed in 27351us (30030us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129756.783762:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 633 00002000:00100000:1.0:1746129756.783772:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880135400a80 x1830949052330112/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.783787:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135400a80 with x1830949052330112 ext(2097152->3145727) 00010000:00010000:1.0:1746129756.783796:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb4be00/0x48868a4e4394a216 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd27 expref: 22 pid: 3623 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746129756.783809:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb4be00/0x48868a4e4394a216 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd27 expref: 22 pid: 3623 timeout: 802 lvb_type: 0 00002000:00010000:1.0:1746129756.783816:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135400a80 00000100:00100000:2.0:1746129756.786040:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135400e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1963:x1830949052330368:12345-192.168.204.31@tcp:3:cat.0 Request processed in 28616us (32300us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129756.786049:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 634 00002000:00100000:2.0:1746129756.786057:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880135400e00 x1830949052330368/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.786066:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135400e00 with x1830949052330368 ext(3145728->4194303) 00010000:00010000:2.0:1746129756.786074:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb4be00/0x48868a4e4394a216 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd27 expref: 20 pid: 3623 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.786087:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb4be00/0x48868a4e4394a216 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd27 expref: 20 pid: 3623 timeout: 802 lvb_type: 0 00002000:00010000:2.0:1746129756.786093:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135400e00 00000100:00100000:1.0:1746129756.792146:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1963:x1830949052330624:12345-192.168.204.31@tcp:3:cat.0 Request processed in 33770us (38393us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129756.792157:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4239 00002000:00100000:1.0:1746129756.792166:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880135401500 x1830949052330624/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.792176:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135401500 with x1830949052330624 ext(2097152->3145727) 00002000:00010000:1.0:1746129756.792181:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135401500 00000100:00100000:2.0:1746129756.793275:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1963:x1830949052330880:12345-192.168.204.31@tcp:3:cat.0 Request processed in 27832us (39504us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129756.793284:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4240 00002000:00100000:2.0:1746129756.793290:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880135401180 x1830949052330880/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.793298:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135401180 with x1830949052330880 ext(3145728->4194303) 00002000:00010000:2.0:1746129756.793301:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135401180 00000100:00100000:0.0:1746129756.795965:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129756.796028:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052331136 00000100:00100000:1.0:1746129756.796036:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052331136 00000100:00100000:1.0:1746129756.796082:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9957 00000100:00100000:1.0:1746129756.796090:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:28759:x1830949052331136:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129756.796110:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129756.796125:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x48868a4e4394a33c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fde4 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.796208:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394a343 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.796222:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394a343 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.796231:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394a343 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.796240:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e4394a34a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.796245:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e4394a34a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.796249:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e4394a34a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:0.0:1746129756.796313:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129756.796341:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x48868a4e4394a351 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.796348:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x48868a4e4394a351 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.796353:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x48868a4e4394a351 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:1.0:1746129756.796361:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129756.796424:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394a343 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.796430:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394a343 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.796435:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394a343 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.796443:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb10000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129756.796446:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394a343 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.796451:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394a343 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.796460:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129756.796462:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129756.796465:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394a343 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.796470:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10000/0x48868a4e4394a343 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.796484:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e4394a34a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.796488:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e4394a34a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.796493:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e4394a34a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.796496:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb11e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129756.796499:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e4394a34a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.796503:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e4394a34a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.796507:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e8c7500) 00010000:00010000:1.0:1746129756.796509:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129756.796512:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e4394a34a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.796516:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e4394a34a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129756.796572:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x48868a4e4394a33c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fde4 expref: 290 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.796583:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x48868a4e4394a351 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fde4 expref: 289 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129756.796589:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129756.796591:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129756.796593:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:2.0:1746129756.796622:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052331264 00000100:00100000:2.0:1746129756.796627:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052331264 00000100:00100000:1.0:1746129756.796639:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:28759:x1830949052331136:12345-192.168.204.31@tcp:101:cat.0 Request processed in 550us (680us total) trans 8589943754 rc 0/0 00000100:00100000:1.0:1746129756.796645:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9957 00000100:00100000:2.0:1746129756.796650:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11298 00000100:00100000:2.0:1746129756.796655:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:28752:x1830949052331264:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129756.796665:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129756.796673:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ee00/0x48868a4e4394a35f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fdeb expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.796687:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.796691:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bc62600/0x48868a4e4394a335 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3444736->3723263] (req 3444736->3723263) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fddd expref: 32 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.796701:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129756.796705:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ee00/0x48868a4e4394a35f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdeb expref: 21 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129756.796715:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129756.796731:0:10930:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bc62600/0x48868a4e4394a335 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3444736->3723263] (req 3444736->3723263) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fddd expref: 32 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.796741:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ee00/0x48868a4e4394a35f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdeb expref: 21 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129756.796744:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052331392 00000100:00100000:0.0:1746129756.796746:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052331392 00010000:00010000:2.0:1746129756.796749:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3ee00, rc 0) 00010000:00010000:0.0:1746129756.796761:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb4be00/0x48868a4e4394a216 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd27 expref: 22 pid: 3623 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746129756.796767:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:28752:x1830949052331264:12345-192.168.204.31@tcp:101:cat.0 Request processed in 113us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129756.796772:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11298 00000100:00100000:0.0:1746129756.796775:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5443 00000100:00100000:0.0:1746129756.796779:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135401c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1964:x1830949052331392:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129756.796786:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129756.796801:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb4be00/0x48868a4e4394a216 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd27 expref: 21 pid: 3623 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.796810:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb4be00/0x48868a4e4394a216 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd27 expref: 21 pid: 3623 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.796821:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb4be00/0x48868a4e4394a216 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd27 expref: 21 pid: 3623 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.796831:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129756.796833:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129756.796838:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bc62600/0x48868a4e4394a335 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3444736->3723263) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fddd expref: 32 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.796844:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc62600/0x48868a4e4394a335 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3444736->3723263) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fddd expref: 32 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.796886:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bc62600/0x48868a4e4394a335 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3444736->3723263) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fddd expref: 32 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.796895:0:7109:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bc62600/0x48868a4e4394a335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3444736->3723263) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fddd expref: 32 pid: 10930 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746129756.796906:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135403480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053362432:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129756.796967:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5188300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129756.798411:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.798979:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052331520 00000100:00100000:3.0:1746129756.798985:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052331520 00000100:00100000:3.0:1746129756.799011:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11299 00000100:00100000:0.0:1746129756.799012:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.799017:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949052331520:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:0.0:1746129756.799024:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052331648 00000100:00100000:0.0:1746129756.799027:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052331648 00010000:00010000:3.0:1746129756.799028:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129756.799039:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b530ae00/0x48868a4e4394a366 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fdf2 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129756.799048:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11300 00000100:00100000:0.0:1746129756.799052:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949052331648:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129756.799057:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129756.799063:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129756.799063:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009faea000/0x48868a4e4394a36d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fdf9 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.799064:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129756.799069:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b530ae00/0x48868a4e4394a366 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdf2 expref: 20 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129756.799080:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b530ae00/0x48868a4e4394a366 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdf2 expref: 20 pid: 10930 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129756.799086:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135403800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053362560:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129756.799088:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b530ae00, rc 0) 00000100:00100000:3.0:1746129756.799113:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949052331520:12345-192.168.204.31@tcp:101:cat.0 Request processed in 96us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.799118:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11299 00000100:00100000:0.0:1746129756.799296:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5188c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129756.799390:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135403480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053362432:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129756.799402:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129756.799431:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135401c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949052331392:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2651us (2716us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129756.799437:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5443 00000100:00100000:0.0:1746129756.800175:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.800213:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.800218:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052331776 00000100:00100000:2.0:1746129756.800220:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052331776 00000100:00100000:2.0:1746129756.800238:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11301 00000100:00100000:2.0:1746129756.800243:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949052331776:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129756.800251:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129756.800264:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd3f000/0x48868a4e4394a374 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fe00 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129756.800290:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053362688:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129756.800386:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1240 going to sleep for 11 seconds 00000100:00100000:3.0:1746129756.800456:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052332032 00000100:00100000:3.0:1746129756.800459:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052332032 00002000:00100000:3.0:1746129756.800483:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3444736->3448831) req@ffff880135402680 x1830949052332032/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.800491:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135402680 with x1830949052332032 ext(3444736->3448831) 00010000:00010000:3.0:1746129756.800497:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bc62600/0x48868a4e4394a335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3723263) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fddd expref: 35 pid: 10930 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.800507:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bc62600/0x48868a4e4394a335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3723263) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fddd expref: 35 pid: 10930 timeout: 802 lvb_type: 0 00002000:00010000:3.0:1746129756.800513:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135402680 00002000:00010000:0.0:1746129756.800694:0:8435:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime: 1746129755 -> 1746129757 00002000:00010000:0.0:1746129756.800697:0:8435:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime: 1746129755 -> 1746129757 00002000:00010000:0.0:1746129756.800699:0:8435:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime: 1746129755 -> 1746129757 00000100:00100000:0.0:1746129756.800714:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135403800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053362560:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129756.800727:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009faea000/0x48868a4e4394a36d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdf9 expref: 19 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129756.800736:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009faea000/0x48868a4e4394a36d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdf9 expref: 19 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129756.800744:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faea000, rc 0) 00000100:00100000:0.0:1746129756.800759:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949052331648:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1707us (1748us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129756.800763:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11300 00000100:00100000:3.0:1746129756.801054:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 635 00000100:00100000:3.0:1746129756.801061:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949052332032:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129756.801175:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949052332032:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 114us (960us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129756.801180:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 635 00002000:00100000:3.0:1746129756.801186:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3444736->3448831) req@ffff880135402680 x1830949052332032/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/4536 e 0 to 0 dl 1746129767 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.801192:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135402680 with x1830949052332032 ext(3444736->3448831) 00010000:00010000:3.0:1746129756.801197:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bc62600/0x48868a4e4394a335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3723263) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fddd expref: 35 pid: 10930 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.801206:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bc62600/0x48868a4e4394a335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3723263) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fddd expref: 35 pid: 10930 timeout: 802 lvb_type: 0 00002000:00010000:3.0:1746129756.801211:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135402680 00002000:00010000:2.0:1746129756.802560:0:8436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime: 1746129756 -> 1746129757 00002000:00010000:2.0:1746129756.802565:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime: 1746129755 -> 1746129757 00002000:00010000:2.0:1746129756.802567:0:8436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime: 1746129756 -> 1746129757 00000100:00100000:2.0:1746129756.802582:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053362688:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129756.802601:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3f000/0x48868a4e4394a374 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe00 expref: 34 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129756.802611:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3f000/0x48868a4e4394a374 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe00 expref: 34 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129756.802622:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3f000, rc 0) 00000100:00100000:2.0:1746129756.802798:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949052331776:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2553us (2623us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129756.802804:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11301 00000100:00100000:0.0:1746129756.804817:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.804942:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052332288 00000100:00100000:3.0:1746129756.804949:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052332288 00002000:00100000:3.0:1746129756.804986:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3719168->3723263) req@ffff880135403800 x1830949052332288/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.804994:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135403800 with x1830949052332288 ext(3719168->3723263) 00010000:00010000:3.0:1746129756.805002:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bc62600/0x48868a4e4394a335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3723263) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fddd expref: 33 pid: 10930 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.805012:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bc62600/0x48868a4e4394a335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3723263) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fddd expref: 33 pid: 10930 timeout: 802 lvb_type: 0 00002000:00010000:3.0:1746129756.805019:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135403800 00000100:00100000:3.0:1746129756.805188:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 636 00000100:00100000:3.0:1746129756.805195:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1964:x1830949052332288:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129756.805871:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1964:x1830949052332288:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 675us (1058us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129756.805878:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 636 00002000:00100000:3.0:1746129756.805885:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3719168->3723263) req@ffff880135403800 x1830949052332288/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/4536 e 0 to 0 dl 1746129767 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.805893:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135403800 with x1830949052332288 ext(3719168->3723263) 00010000:00010000:3.0:1746129756.805898:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bc62600/0x48868a4e4394a335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3723263) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fddd expref: 33 pid: 10930 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.805909:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bc62600/0x48868a4e4394a335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3723263) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fddd expref: 33 pid: 10930 timeout: 802 lvb_type: 0 00002000:00010000:3.0:1746129756.805914:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135403800 00000100:00100000:0.0:1746129756.809613:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129756.810266:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.810314:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052332544 00000100:00100000:0.0:1746129756.810322:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052332544 00002000:00100000:0.0:1746129756.810355:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3444736->3723263) req@ffff880135400000 x1830949052332544/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129756.810364:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135400000 with x1830949052332544 ext(3444736->3723263) 00010000:00010000:0.0:1746129756.810371:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bc62600/0x48868a4e4394a335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3723263) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fddd expref: 33 pid: 10930 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.810383:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bc62600/0x48868a4e4394a335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3723263) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fddd expref: 33 pid: 10930 timeout: 802 lvb_type: 0 00002000:00010000:0.0:1746129756.810390:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135400000 00000100:00100000:0.0:1746129756.810413:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052332800 00000100:00100000:0.0:1746129756.810417:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052332800 00002000:00100000:0.0:1746129756.810428:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012ba38380 x1830949052332800/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129756.810435:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba38380 with x1830949052332800 ext(1048576->2097151) 00002000:00010000:0.0:1746129756.810437:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba38380 00000100:00100000:0.0:1746129756.810448:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 637 00000100:00100000:0.0:1746129756.810455:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1964:x1830949052332544:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129756.810529:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4241 00000100:00100000:2.0:1746129756.810536:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949052332800:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129756.822257:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949052332800:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11715us (11985us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129756.822267:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4241 00000100:00100000:0.0:1746129756.822272:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1964:x1830949052332544:12345-192.168.204.31@tcp:4:cat.0 Request processed in 11817us (12666us total) trans 17179873246 rc 0/0 00002000:00100000:2.0:1746129756.822276:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012ba38380 x1830949052332800/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746129756.822278:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 637 00002000:00100000:0.0:1746129756.822282:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3444736->3723263) req@ffff880135400000 x1830949052332544/t17179873246(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/448 e 0 to 0 dl 1746129767 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.822285:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba38380 with x1830949052332800 ext(1048576->2097151) 00002000:00100000:0.0:1746129756.822288:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135400000 with x1830949052332544 ext(3444736->3723263) 00002000:00010000:2.0:1746129756.822289:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba38380 00010000:00010000:0.0:1746129756.822294:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bc62600/0x48868a4e4394a335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3723263) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fddd expref: 35 pid: 10930 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746129756.822318:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bc62600/0x48868a4e4394a335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3723263) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fddd expref: 35 pid: 10930 timeout: 802 lvb_type: 0 00002000:00010000:0.0:1746129756.822324:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135400000 00000100:00100000:0.0:1746129756.828195:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.829048:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.829172:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052333056 00000100:00100000:3.0:1746129756.829180:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052333056 00010000:00010000:3.0:1746129756.829209:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc62600/0x48868a4e4394a335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->3723263) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fddd expref: 35 pid: 10930 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746129756.829234:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5444 00000100:00100000:3.0:1746129756.829241:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949052333056:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129756.829253:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746129756.829269:0:7109:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129756 -> 1746129757 00002000:00010000:3.0:1746129756.829271:0:7109:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129756 -> 1746129757 00010000:00010000:3.0:1746129756.829277:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bc62600/0x48868a4e4394a335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3444736->3723263) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fddd expref: 35 pid: 10930 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.829287:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bc62600/0x48868a4e4394a335 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3444736->3723263) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fddd expref: 35 pid: 10930 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.829316:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bc62600/0x48868a4e4394a335 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3444736->3723263) gid 0 flags: 0x44801000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fddd expref: 35 pid: 10930 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.829331:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129756.829332:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129756.829339:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ee00/0x48868a4e4394a35f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdeb expref: 19 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.829346:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ee00/0x48868a4e4394a35f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdeb expref: 19 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.829370:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ee00/0x48868a4e4394a35f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdeb expref: 19 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129756.829380:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053362816:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129756.829433:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129756.830076:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052332928 00000100:00100000:2.0:1746129756.830082:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052332928 00000100:00100000:2.0:1746129756.830111:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11302 00000100:00100000:2.0:1746129756.830123:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:28759:x1830949052332928:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129756.830136:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129756.830153:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a37b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fe07 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.830169:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e600/0x48868a4e4394a30b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc1 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.830175:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129756.830176:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129756.830179:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a37b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe07 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.830217:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e600/0x48868a4e4394a30b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc1 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.830230:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e600/0x48868a4e4394a30b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc1 expref: 11 pid: 8436 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746129756.830237:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053362944:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129756.830984:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1240 going to sleep for 11 seconds 00000100:00100000:3.0:1746129756.832170:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053362816:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129756.832184:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129756.832283:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053362944:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129756.832298:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a37b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe07 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.832319:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3f200, rc 0) 00000100:00100000:3.0:1746129756.832660:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949052333056:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3417us (3611us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.832670:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5444 00000100:00100000:2.0:1746129756.832728:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:28759:x1830949052332928:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2605us (4540us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129756.832734:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11302 00000100:00100000:0.0:1746129756.834051:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.834148:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052333184 00000100:00100000:2.0:1746129756.834154:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052333184 00002000:00100000:2.0:1746129756.834181:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1748992->2097151) req@ffff880135400700 x1830949052333184/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.834190:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135400700 with x1830949052333184 ext(1748992->2097151) 00010000:00010000:2.0:1746129756.834196:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e600/0x48868a4e4394a30b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc1 expref: 12 pid: 8436 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.834206:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e600/0x48868a4e4394a30b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc1 expref: 12 pid: 8436 timeout: 802 lvb_type: 0 00002000:00010000:2.0:1746129756.834216:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135400700 00000100:00100000:2.0:1746129756.834237:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 638 00000100:00100000:2.0:1746129756.834242:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052333184:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129756.836973:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.836998:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052333440 00000100:00100000:0.0:1746129756.837004:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052333440 00002000:00100000:0.0:1746129756.837034:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880135401c00 x1830949052333440/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129756.837043:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135401c00 with x1830949052333440 ext(3145728->4194303) 00002000:00010000:0.0:1746129756.837047:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135401c00 00000100:00100000:0.0:1746129756.837607:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4242 00000100:00100000:0.0:1746129756.837614:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135401c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949052333440:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129756.839499:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129756.840134:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052333696 00000100:00100000:0.0:1746129756.840140:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052333696 00000100:00100000:0.0:1746129756.840175:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9958 00000100:00100000:0.0:1746129756.840192:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28762:x1830949052333696:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129756.840209:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129756.840225:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217e00/0x48868a4e4394a382 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fe0e expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.840313:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217600/0x48868a4e4394a389 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129756.840324:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217600/0x48868a4e4394a389 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129756.840333:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217600/0x48868a4e4394a389 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129756.840343:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a390 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129756.840349:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a390 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129756.840357:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a390 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129756.840442:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217400/0x48868a4e4394a397 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129756.840450:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217400/0x48868a4e4394a397 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129756.840456:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217400/0x48868a4e4394a397 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:0.0:1746129756.840465:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129756.840530:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217600/0x48868a4e4394a389 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129756.840536:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217600/0x48868a4e4394a389 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129756.840541:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217600/0x48868a4e4394a389 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129756.840545:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b5217600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129756.840548:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217600/0x48868a4e4394a389 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129756.840554:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217600/0x48868a4e4394a389 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129756.840563:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:0.0:1746129756.840566:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129756.840569:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217600/0x48868a4e4394a389 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129756.840577:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217600/0x48868a4e4394a389 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129756.840604:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a390 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129756.840609:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a390 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129756.840613:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a390 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129756.840617:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b5216e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129756.840619:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a390 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129756.840623:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a390 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129756.840630:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012bfcac00) 00010000:00010000:0.0:1746129756.840632:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129756.840634:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a390 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129756.840639:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a390 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129756.840669:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217e00/0x48868a4e4394a382 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe0e expref: 13 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.840679:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217400/0x48868a4e4394a397 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe0e expref: 12 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129756.840690:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129756.840692:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746129756.840694:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5217400, rc 0) 00000100:00100000:0.0:1746129756.840725:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28762:x1830949052333696:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 544us (1231us total) trans 8589943755 rc 0/0 00000100:00100000:0.0:1746129756.840731:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9958 00000100:00100000:3.0:1746129756.842642:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052333184:12345-192.168.204.31@tcp:4:cat.0 Request processed in 8393us (8587us total) trans 21474840384 rc 0/0 00000100:00100000:3.0:1746129756.842651:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 638 00002000:00100000:3.0:1746129756.842660:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1748992->2097151) req@ffff880135400700 x1830949052333184/t21474840384(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/448 e 0 to 0 dl 1746129767 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.842669:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135400700 with x1830949052333184 ext(1748992->2097151) 00010000:00010000:3.0:1746129756.842677:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e600/0x48868a4e4394a30b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc1 expref: 14 pid: 8436 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.842689:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e600/0x48868a4e4394a30b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc1 expref: 14 pid: 8436 timeout: 802 lvb_type: 0 00002000:00010000:3.0:1746129756.842695:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135400700 00000100:00100000:2.0:1746129756.847131:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135401c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949052333440:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9505us (10152us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129756.847143:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4242 00002000:00100000:2.0:1746129756.847155:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880135401c00 x1830949052333440/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.847164:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135401c00 with x1830949052333440 ext(3145728->4194303) 00002000:00010000:2.0:1746129756.847169:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135401c00 00000100:00100000:1.0:1746129756.847818:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.847983:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052333824 00000100:00100000:3.0:1746129756.847990:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052333824 00010000:00010000:3.0:1746129756.848422:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e600/0x48868a4e4394a30b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc1 expref: 14 pid: 8436 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746129756.848471:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5445 00000100:00100000:3.0:1746129756.848478:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1964:x1830949052333824:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129756.848490:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129756.848506:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e600/0x48868a4e4394a30b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc1 expref: 14 pid: 8436 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.848515:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e600/0x48868a4e4394a30b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc1 expref: 14 pid: 8436 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.848537:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e600/0x48868a4e4394a30b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc1 expref: 14 pid: 8436 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.848643:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129756.848645:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129756.848651:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a37b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe07 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.848658:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a37b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe07 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.848684:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a37b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe07 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129756.848693:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053363072:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129756.849605:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28780 going to sleep for 11 seconds 00000100:00100000:3.0:1746129756.853844:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053363072:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129756.853889:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129756.853925:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1964:x1830949052333824:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5446us (6107us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.853935:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5445 00000100:00100000:0.0:1746129756.854534:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.855209:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052333952 00000100:00100000:2.0:1746129756.855215:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052333952 00000100:00100000:2.0:1746129756.855299:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11303 00000100:00100000:2.0:1746129756.855331:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1963:x1830949052333952:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129756.855346:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129756.855359:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d79a00/0x48868a4e4394a3a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fe15 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.855377:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.855378:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.855385:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d79a00/0x48868a4e4394a3a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe15 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129756.855398:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d79a00/0x48868a4e4394a3a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe15 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129756.855407:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d79a00, rc 0) 00000100:00100000:2.0:1746129756.856267:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1963:x1830949052333952:12345-192.168.204.31@tcp:101:cat.0 Request processed in 935us (1731us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129756.856273:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11303 00000100:00100000:0.0:1746129756.857592:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.857765:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052334208 00000100:00100000:2.0:1746129756.857770:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052334208 00002000:00100000:2.0:1746129756.857799:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009a56d180 x1830949052334208/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.857808:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56d180 with x1830949052334208 ext(1048576->2097151) 00002000:00010000:2.0:1746129756.857812:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a56d180 00000100:00100000:2.0:1746129756.857841:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4243 00000100:00100000:2.0:1746129756.857869:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949052334208:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129756.859890:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.860048:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052334464 00000100:00100000:3.0:1746129756.860062:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052334464 00002000:00100000:3.0:1746129756.860089:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009a56dc00 x1830949052334464/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.860102:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56dc00 with x1830949052334464 ext(4194304->4964351) 00002000:00010000:3.0:1746129756.860107:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a56dc00 00000100:00100000:3.0:1746129756.860130:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4244 00000100:00100000:3.0:1746129756.860135:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949052334464:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129756.876719:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949052334208:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18864us (19123us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129756.876728:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4243 00002000:00100000:2.0:1746129756.876738:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009a56d180 x1830949052334208/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.876746:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56d180 with x1830949052334208 ext(1048576->2097151) 00002000:00010000:2.0:1746129756.876751:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a56d180 00000100:00100000:3.0:1746129756.876844:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949052334464:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16706us (16957us total) trans 0 rc 770048/770048 00000100:00100000:3.0:1746129756.876893:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4244 00002000:00100000:3.0:1746129756.876899:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009a56dc00 x1830949052334464/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.876906:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56dc00 with x1830949052334464 ext(4194304->4964351) 00002000:00010000:3.0:1746129756.876909:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a56dc00 00000100:00100000:0.0:1746129756.885015:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.885117:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052334592 00000100:00100000:2.0:1746129756.885125:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052334592 00000100:00100000:2.0:1746129756.885158:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11304 00000100:00100000:2.0:1746129756.885165:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:28759:x1830949052334592:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129756.885180:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129756.885196:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a3ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fe1c expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.885220:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e4394a319 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdcf expref: 19 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.885226:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129756.885228:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129756.885230:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a3ac lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe1c expref: 35 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.885255:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e4394a319 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdcf expref: 19 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.885265:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e4394a319 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdcf expref: 19 pid: 10930 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746129756.885275:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053363200:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129756.885580:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1240 going to sleep for 11 seconds 00000100:00100000:2.0:1746129756.890620:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053363200:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129756.890651:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a3ac lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe1c expref: 35 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.890666:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130677c00, rc 0) 00000100:00100000:2.0:1746129756.890712:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:28759:x1830949052334592:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5545us (5702us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129756.890720:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11304 00000100:00100000:0.0:1746129756.891821:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.892243:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052334720 00000100:00100000:3.0:1746129756.892249:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052334720 00002000:00100000:3.0:1746129756.892283:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1740799) req@ffff88009a56d880 x1830949052334720/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129756.892292:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56d880 with x1830949052334720 ext(1048576->1740799) 00010000:00010000:3.0:1746129756.892298:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e4394a319 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdcf expref: 20 pid: 10930 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746129756.892320:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e4394a319 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdcf expref: 20 pid: 10930 timeout: 802 lvb_type: 0 00002000:00010000:3.0:1746129756.892325:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a56d880 00000100:00100000:3.0:1746129756.892350:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 639 00000100:00100000:3.0:1746129756.892356:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949052334720:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129756.905790:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.906823:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052334720:12345-192.168.204.31@tcp:4:cat.0 Request processed in 14464us (15003us total) trans 17179873247 rc 0/0 00000100:00100000:2.0:1746129756.906832:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 639 00002000:00100000:2.0:1746129756.906840:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1740799) req@ffff88009a56d880 x1830949052334720/t17179873247(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/448 e 0 to 0 dl 1746129767 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.906864:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56d880 with x1830949052334720 ext(1048576->1740799) 00010000:00010000:2.0:1746129756.906871:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e4394a319 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdcf expref: 22 pid: 10930 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.906883:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e4394a319 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdcf expref: 22 pid: 10930 timeout: 802 lvb_type: 0 00002000:00010000:2.0:1746129756.906889:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a56d880 00000100:00100000:3.0:1746129756.906970:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052334848 00000100:00100000:3.0:1746129756.906977:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052334848 00000100:00100000:3.0:1746129756.907013:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11305 00000100:00100000:3.0:1746129756.907022:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28762:x1830949052334848:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129756.907034:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129756.907046:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f000/0x48868a4e4394a3b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fe23 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.907066:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a37b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe07 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.907073:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d79a00/0x48868a4e4394a3a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe15 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129756.907078:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129756.907079:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129756.907082:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f000/0x48868a4e4394a3b3 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [2064384->2097151] (req 2064384->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe23 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.907104:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d79a00/0x48868a4e4394a3a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe15 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129756.907113:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d79a00/0x48868a4e4394a3a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe15 expref: 15 pid: 8436 timeout: 802 lvb_type: 1 00000100:00100000:3.0:1746129756.907122:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053363328:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129756.907182:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a37b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe07 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.907189:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a37b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe07 expref: 18 pid: 8436 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746129756.907196:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130507480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053363456:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129756.907213:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28780 going to sleep for 11 seconds 00000100:00100000:1.0:1746129756.912576:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.912658:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052334976 00000100:00100000:2.0:1746129756.912666:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052334976 00010000:00010000:2.0:1746129756.912694:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a37b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe07 expref: 19 pid: 8436 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746129756.912728:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5446 00000100:00100000:2.0:1746129756.912736:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949052334976:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129756.912747:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129756.913008:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129756.913155:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a37b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe07 expref: 19 pid: 8436 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.913171:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a37b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe07 expref: 19 pid: 8436 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.913192:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129756.913271:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052335104 00000100:00100000:0.0:1746129756.913276:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052335104 00010000:00010000:0.0:1746129756.913289:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d79a00/0x48868a4e4394a3a5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe15 expref: 16 pid: 8436 timeout: 802 lvb_type: 1 00000100:00100000:3.0:1746129756.913444:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053363328:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129756.913453:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a37b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe07 expref: 19 pid: 8436 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746129756.913665:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949052334976:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 929us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129756.913671:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5446 00000100:00100000:2.0:1746129756.913688:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5447 00000100:00100000:2.0:1746129756.913692:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1963:x1830949052335104:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129756.913699:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129756.913707:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d79a00/0x48868a4e4394a3a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe15 expref: 16 pid: 8436 timeout: 802 lvb_type: 1 00010000:00010000:2.0:1746129756.913715:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d79a00/0x48868a4e4394a3a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe15 expref: 16 pid: 8436 timeout: 802 lvb_type: 1 00010000:00010000:2.0:1746129756.913725:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d79a00/0x48868a4e4394a3a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe15 expref: 16 pid: 8436 timeout: 802 lvb_type: 1 00010000:00010000:2.0:1746129756.913738:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.913740:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.913745:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f000/0x48868a4e4394a3b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe23 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.913752:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f000/0x48868a4e4394a3b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe23 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.913776:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f000/0x48868a4e4394a3b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe23 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129756.913786:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053363584:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129756.913830:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1240 going to sleep for 11 seconds 00000100:00100000:3.0:1746129756.916810:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130507480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053363456:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129756.916845:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f000/0x48868a4e4394a3b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe23 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.916872:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3f000, rc 0) 00000100:00100000:3.0:1746129756.916927:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28762:x1830949052334848:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 9907us (11143us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.916935:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11305 00000100:00100000:0.0:1746129756.919167:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.919481:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053363584:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129756.919495:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129756.919526:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1963:x1830949052335104:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5832us (6517us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129756.919535:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5447 00000100:00100000:2.0:1746129756.919559:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052335232 00000100:00100000:2.0:1746129756.919563:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052335232 00010000:00010000:2.0:1746129756.919583:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e4394a319 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdcf expref: 22 pid: 10930 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746129756.919599:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5448 00000100:00100000:2.0:1746129756.919605:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949052335232:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129756.919614:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129756.919633:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e4394a319 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdcf expref: 22 pid: 10930 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.920157:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e4394a319 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdcf expref: 22 pid: 10930 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.920182:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009536f200/0x48868a4e4394a319 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1740799) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdcf expref: 22 pid: 10930 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.920192:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.920194:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.920199:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a3ac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe1c expref: 34 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.920205:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a3ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe1c expref: 34 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.920228:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a3ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe1c expref: 34 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129756.920237:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053363712:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129756.920669:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129756.923109:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.923229:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052335488 00000100:00100000:2.0:1746129756.923237:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052335488 00002000:00100000:2.0:1746129756.923273:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (2064384->2068479) req@ffff88009a56f100 x1830949052335488/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.923282:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56f100 with x1830949052335488 ext(2064384->2068479) 00002000:00010000:2.0:1746129756.923286:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a56f100 00000100:00100000:2.0:1746129756.923309:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4245 00000100:00100000:2.0:1746129756.923316:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949052335488:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129756.923471:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949052335488:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 155us (366us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129756.923477:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4245 00002000:00100000:2.0:1746129756.923483:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (2064384->2068479) req@ffff88009a56f100 x1830949052335488/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/4536 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.924720:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56f100 with x1830949052335488 ext(2064384->2068479) 00002000:00010000:2.0:1746129756.924729:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a56f100 00000100:00100000:0.0:1746129756.927925:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.928063:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053363712:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129756.928081:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129756.928113:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1961:x1830949052335232:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8508us (8951us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129756.928121:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5448 00000100:00100000:3.0:1746129756.928214:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052335616 00000100:00100000:3.0:1746129756.928220:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052335616 00000100:00100000:3.0:1746129756.928243:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11306 00000100:00100000:3.0:1746129756.928249:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:28762:x1830949052335616:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129756.928263:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129756.928276:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a0e800/0x48868a4e4394a3ba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fe2a expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.928298:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a3ac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe1c expref: 34 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.928321:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129756.928323:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129756.928327:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a0e800/0x48868a4e4394a3ba lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->1535999] (req 1048576->1535999) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe2a expref: 22 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.928350:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a3ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe1c expref: 34 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.928361:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a3ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe1c expref: 34 pid: 8436 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746129756.928371:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130507b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053363840:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129756.928406:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129756.934218:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.935137:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130507b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053363840:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129756.935163:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a0e800/0x48868a4e4394a3ba lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->1535999] (req 1048576->1535999) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe2a expref: 22 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.935179:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a0e800, rc 0) 00000100:00100000:3.0:1746129756.935215:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:28762:x1830949052335616:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6965us (7298us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.935223:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11306 00000100:00100000:2.0:1746129756.935569:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052335872 00000100:00100000:2.0:1746129756.935576:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052335872 00002000:00100000:2.0:1746129756.935607:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009a56c700 x1830949052335872/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.935615:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56c700 with x1830949052335872 ext(1048576->2097151) 00010000:00010000:2.0:1746129756.935621:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a3ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe1c expref: 35 pid: 8436 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.935631:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a3ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe1c expref: 35 pid: 8436 timeout: 802 lvb_type: 0 00002000:00010000:2.0:1746129756.935637:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a56c700 00000100:00100000:2.0:1746129756.935649:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 640 00000100:00100000:2.0:1746129756.935655:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949052335872:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129756.949087:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949052335872:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13423us (14868us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129756.949098:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 640 00002000:00100000:2.0:1746129756.949108:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009a56c700 x1830949052335872/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129756.949116:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56c700 with x1830949052335872 ext(1048576->2097151) 00010000:00010000:2.0:1746129756.949124:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a3ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe1c expref: 35 pid: 8436 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746129756.949136:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a3ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe1c expref: 35 pid: 8436 timeout: 803 lvb_type: 0 00002000:00010000:2.0:1746129756.949141:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a56c700 00000100:00100000:0.0:1746129756.960574:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.960674:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052336000 00000100:00100000:3.0:1746129756.960682:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052336000 00000100:00100000:3.0:1746129756.961114:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11307 00000100:00100000:3.0:1746129756.961123:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:28759:x1830949052336000:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129756.961141:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129756.961155:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd3f400/0x48868a4e4394a3c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fe31 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.961177:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129756.961180:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129756.961186:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3f400/0x48868a4e4394a3c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe31 expref: 36 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.961199:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3f400/0x48868a4e4394a3c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe31 expref: 36 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129756.961208:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3f400, rc 0) 00000100:00100000:3.0:1746129756.961244:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:28759:x1830949052336000:12345-192.168.204.31@tcp:101:cat.0 Request processed in 123us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129756.961249:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11307 00000100:00100000:2.0:1746129756.970612:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.970637:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052336128 00000100:00100000:2.0:1746129756.970643:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052336128 00010000:00010000:2.0:1746129756.970667:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a3ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe1c expref: 36 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746129756.970841:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.970875:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129756.971061:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5449 00000100:00100000:2.0:1746129756.971071:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1962:x1830949052336128:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129756.971091:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129756.971153:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a3ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe1c expref: 36 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746129756.971208:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052336384 00000100:00100000:0.0:1746129756.971208:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052336512 00000100:00100000:1.0:1746129756.971212:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052336384 00000100:00100000:0.0:1746129756.971212:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052336512 00002000:00100000:1.0:1746129756.971234:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880130507b80 x1830949052336384/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129756.971234:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880130507800 x1830949052336512/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.971243:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130507b80 with x1830949052336384 ext(2097152->3145727) 00002000:00010000:1.0:1746129756.971247:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130507b80 00002000:00100000:0.0:1746129756.971247:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130507800 with x1830949052336512 ext(3145728->4194303) 00002000:00010000:0.0:1746129756.971250:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130507800 00010000:00010000:2.0:1746129756.971266:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a3ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe1c expref: 36 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129756.971290:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130677c00/0x48868a4e4394a3ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe1c expref: 38 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129756.971326:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.971328:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129756.971335:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a0e800/0x48868a4e4394a3ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe2a expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.971402:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a0e800/0x48868a4e4394a3ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe2a expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129756.971433:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130a0e800/0x48868a4e4394a3ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe2a expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129756.971444:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053363968:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129756.971500:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1240 going to sleep for 11 seconds 00000100:00100000:1.0:1746129756.971565:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4246 00000100:00100000:1.0:1746129756.971572:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1962:x1830949052336384:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129756.971573:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4247 00000100:00100000:0.0:1746129756.971580:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1962:x1830949052336512:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129756.982112:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053363968:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129756.982129:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129756.982171:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1962:x1830949052336128:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 11099us (11565us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129756.982179:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5449 00000100:00100000:0.0:1746129756.986141:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129756.986374:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1962:x1830949052336384:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14799us (15530us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129756.986384:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4246 00002000:00100000:1.0:1746129756.986394:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880130507b80 x1830949052336384/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.986401:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130507b80 with x1830949052336384 ext(2097152->3145727) 00002000:00010000:1.0:1746129756.986406:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130507b80 00000100:00100000:1.0:1746129756.990820:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052336896 00000100:00100000:1.0:1746129756.990832:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052336896 00002000:00100000:1.0:1746129756.990886:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (1531904->1535999) req@ffff88009a56f480 x1830949052336896/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/0 e 0 to 0 dl 1746129767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.990895:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56f480 with x1830949052336896 ext(1531904->1535999) 00002000:00010000:1.0:1746129756.990900:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a56f480 00000100:00100000:1.0:1746129756.990917:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4248 00000100:00100000:1.0:1746129756.990925:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052336896:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129756.991053:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052336896:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 129us (4919us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129756.991058:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4248 00002000:00100000:1.0:1746129756.991063:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (1531904->1535999) req@ffff88009a56f480 x1830949052336896/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:497/0 lens 488/4536 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129756.991070:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56f480 with x1830949052336896 ext(1531904->1535999) 00002000:00010000:1.0:1746129756.991073:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a56f480 00000100:00100000:0.0:1746129756.991099:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949052336512:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19518us (20221us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129756.991106:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4247 00002000:00100000:0.0:1746129756.991112:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880130507800 x1830949052336512/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:497/0 lens 488/440 e 0 to 0 dl 1746129767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129756.991119:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130507800 with x1830949052336512 ext(3145728->4194303) 00002000:00010000:0.0:1746129756.991123:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130507800 00000100:00100000:0.0:1746129756.996625:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129756.996695:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052337152 00000100:00100000:3.0:1746129756.996704:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052337152 00000100:00100000:3.0:1746129756.996945:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3930 00000100:00100000:3.0:1746129756.996954:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28762:x1830949052337152:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129756.997148:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28762:x1830949052337152:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 195us (528us total) trans 8589943756 rc 0/0 00000100:00100000:3.0:1746129756.997155:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3930 00000100:00100000:0.0:1746129757.009121:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.009168:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.009198:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052337280 00000100:00100000:1.0:1746129757.009206:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052337280 00000100:00100000:1.0:1746129757.009319:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052337408 00000100:00100000:1.0:1746129757.009322:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052337408 00000100:00100000:1.0:1746129757.009340:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11308 00000100:00100000:1.0:1746129757.009347:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1964:x1830949052337280:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129757.009362:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129757.009375:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a93b600/0x48868a4e4394a3c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fe38 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129757.009419:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053364096:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129757.009467:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11309 00000100:00100000:3.0:1746129757.009475:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1964:x1830949052337408:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:1.0:1746129757.009477:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510240 going to sleep for 11 seconds 00010000:00010000:3.0:1746129757.009483:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129757.009491:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd3f200/0x48868a4e4394a3cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fe3f expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129757.009513:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130504a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053364224:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129757.009533:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28780 going to sleep for 11 seconds 00000100:00080000:2.0:1746129757.009708:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746129757.009712:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746129757.016052:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba38700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053364096:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129757.016080:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a93b600/0x48868a4e4394a3c8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe38 expref: 19 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129757.016094:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a93b600/0x48868a4e4394a3c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe38 expref: 19 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129757.016111:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a93b600, rc 0) 00000100:00100000:2.0:1746129757.016147:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1964:x1830949052337280:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6800us (7033us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129757.016154:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11308 00000100:00100000:3.0:1746129757.016994:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130504a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053364224:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129757.017014:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3f200/0x48868a4e4394a3cf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe3f expref: 36 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129757.017025:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3f200/0x48868a4e4394a3cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe3f expref: 36 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129757.017037:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3f200, rc 0) 00000100:00100000:3.0:1746129757.017073:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1964:x1830949052337408:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7599us (7904us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129757.017079:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11309 00000100:00100000:0.0:1746129757.032650:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.032743:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052337664 00000100:00100000:3.0:1746129757.032751:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052337664 00002000:00100000:3.0:1746129757.032791:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009a56ed80 x1830949052337664/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.032806:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56ed80 with x1830949052337664 ext(4194304->4964351) 00002000:00010000:3.0:1746129757.032811:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a56ed80 00000100:00100000:3.0:1746129757.032827:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4249 00000100:00100000:3.0:1746129757.032833:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949052337664:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129757.034504:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.034760:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052337920 00000100:00100000:2.0:1746129757.034766:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052337920 00000100:00100000:2.0:1746129757.034824:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9959 00000100:00100000:2.0:1746129757.034831:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28768:x1830949052337920:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129757.034867:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129757.034883:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4d800/0x48868a4e4394a3d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fe46 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.034975:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c800/0x48868a4e4394a3dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129757.034986:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c800/0x48868a4e4394a3dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129757.034996:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c800/0x48868a4e4394a3dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129757.035008:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c400/0x48868a4e4394a3e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129757.035013:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c400/0x48868a4e4394a3e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129757.035018:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c400/0x48868a4e4394a3e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129757.035099:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b539b600/0x48868a4e4394a3eb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129757.035106:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b539b600/0x48868a4e4394a3eb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129757.035111:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b539b600/0x48868a4e4394a3eb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129757.035118:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129757.035176:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c800/0x48868a4e4394a3dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129757.035182:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c800/0x48868a4e4394a3dd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129757.035187:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c800/0x48868a4e4394a3dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129757.035191:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4e4c800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129757.035194:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c800/0x48868a4e4394a3dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129757.035199:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c800/0x48868a4e4394a3dd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129757.035208:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129757.035211:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129757.035213:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c800/0x48868a4e4394a3dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129757.035217:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c800/0x48868a4e4394a3dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129757.035228:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c400/0x48868a4e4394a3e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129757.035232:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c400/0x48868a4e4394a3e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129757.035236:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c400/0x48868a4e4394a3e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129757.035239:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4e4c400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129757.035241:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c400/0x48868a4e4394a3e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129757.035245:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c400/0x48868a4e4394a3e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129757.035250:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e2d8300) 00010000:00010000:2.0:1746129757.035252:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129757.035254:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c400/0x48868a4e4394a3e4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129757.035257:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4c400/0x48868a4e4394a3e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129757.035284:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e4d800/0x48868a4e4394a3d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe46 expref: 16 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.035296:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b539b600/0x48868a4e4394a3eb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe46 expref: 15 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.035313:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129757.035315:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129757.035317:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b539b600, rc 0) 00000100:00100000:2.0:1746129757.035357:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28768:x1830949052337920:12345-192.168.204.31@tcp:101:cat.0 Request processed in 527us (859us total) trans 8589943757 rc 0/0 00000100:00100000:2.0:1746129757.035363:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9959 00000100:00080000:0.0:1746129757.035668:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746129757.041153:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.041186:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.041243:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052338304 00000100:00100000:0.0:1746129757.041243:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052338176 00000100:00100000:3.0:1746129757.041251:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052338304 00000100:00100000:0.0:1746129757.041251:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052338176 00000100:00100000:0.0:1746129757.041287:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3931 00000100:00100000:0.0:1746129757.041294:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28768:x1830949052338176:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:3.0:1746129757.041488:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 580 00000100:00100000:3.0:1746129757.041494:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052338304:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129757.041504:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129757.041525:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b539b600/0x48868a4e4394a3eb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe46 expref: 16 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.041541:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129757.041545:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129757.041585:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949052338304:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 92us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129757.041591:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 580 00000100:00100000:1.0:1746129757.042276:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28768:x1830949052338176:12345-192.168.204.31@tcp:35:cat.0 Request processed in 981us (1130us total) trans 8589943758 rc 0/0 00000100:00100000:1.0:1746129757.042283:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3931 00010000:00010000:1.0:1746129757.047031:0:20054:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746129757.047458:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949052337664:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14617us (14811us total) trans 0 rc 770048/770048 00000100:00100000:3.0:1746129757.047468:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4249 00002000:00100000:3.0:1746129757.047478:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009a56ed80 x1830949052337664/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.047487:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56ed80 with x1830949052337664 ext(4194304->4964351) 00002000:00010000:3.0:1746129757.047492:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a56ed80 00000100:00100000:0.0:1746129757.051496:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.052296:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052338560 00000100:00100000:1.0:1746129757.052322:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052338560 00000100:00100000:1.0:1746129757.052376:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9960 00000100:00100000:1.0:1746129757.052382:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:28769:x1830949052338560:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129757.052398:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129757.052411:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a93b400/0x48868a4e4394a3f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fe4d expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746129757.052425:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746129757.052502:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a93b600/0x48868a4e4394a400 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.052517:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a93b600/0x48868a4e4394a400 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.052526:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a93b600/0x48868a4e4394a400 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.052536:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a93b000/0x48868a4e4394a407 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.052542:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a93b000/0x48868a4e4394a407 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.052546:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a93b000/0x48868a4e4394a407 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.052623:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a93b200/0x48868a4e4394a40e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.052629:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a93b200/0x48868a4e4394a40e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.052634:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a93b200/0x48868a4e4394a40e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:1.0:1746129757.052641:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129757.052699:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a93b600/0x48868a4e4394a400 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.052704:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a93b600/0x48868a4e4394a400 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.052708:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a93b600/0x48868a4e4394a400 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.052716:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a93b600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129757.052719:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a93b600/0x48868a4e4394a400 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.052725:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a93b600/0x48868a4e4394a400 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.052734:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129757.052736:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129757.052740:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a93b600/0x48868a4e4394a400 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.052745:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a93b600/0x48868a4e4394a400 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.052766:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a93b000/0x48868a4e4394a407 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.052771:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a93b000/0x48868a4e4394a407 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.052775:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a93b000/0x48868a4e4394a407 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.052779:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a93b000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129757.052781:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a93b000/0x48868a4e4394a407 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.052786:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a93b000/0x48868a4e4394a407 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.052792:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e8c7f00) 00010000:00010000:1.0:1746129757.052794:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129757.052796:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a93b000/0x48868a4e4394a407 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.052800:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a93b000/0x48868a4e4394a407 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.052827:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a93b400/0x48868a4e4394a3f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe4d expref: 292 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.052837:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a93b200/0x48868a4e4394a40e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe4d expref: 291 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.052842:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129757.052844:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129757.052862:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a93b200, rc 0) 00000100:00100000:1.0:1746129757.052913:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:28769:x1830949052338560:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 530us (1424us total) trans 8589943759 rc 0/0 00000100:00100000:1.0:1746129757.052918:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9960 00000100:00100000:0.0:1746129757.054686:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.054914:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.054976:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052338816 00000100:00100000:3.0:1746129757.054982:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052338816 00000100:00100000:3.0:1746129757.055006:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052338688 00000100:00100000:3.0:1746129757.055008:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052338688 00000100:00100000:3.0:1746129757.055019:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11310 00000100:00100000:3.0:1746129757.055024:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949052338816:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129757.055035:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129757.055045:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd3fa00/0x48868a4e4394a41c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fe5b expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129757.055084:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130504a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053364352:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129757.055147:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28780 going to sleep for 11 seconds 00000100:00100000:3.0:1746129757.055163:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11311 00000100:00100000:3.0:1746129757.055168:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949052338688:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129757.055174:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129757.055182:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a0e000/0x48868a4e4394a423 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fe54 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129757.055202:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130504e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053364480:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129757.055218:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129757.056411:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.056447:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.056506:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052339072 00000100:00100000:1.0:1746129757.056511:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052339072 00002000:00100000:1.0:1746129757.056544:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2064383) req@ffff88008fad3800 x1830949052339072/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129757.056553:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad3800 with x1830949052339072 ext(1048576->2064383) 00002000:00010000:1.0:1746129757.056557:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fad3800 00000100:00100000:1.0:1746129757.056567:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052339328 00000100:00100000:1.0:1746129757.056570:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052339328 00002000:00100000:1.0:1746129757.056581:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1536000->2097151) req@ffff88008fad1880 x1830949052339328/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129757.056587:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad1880 with x1830949052339328 ext(1536000->2097151) 00002000:00010000:1.0:1746129757.056590:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fad1880 00000100:00100000:1.0:1746129757.056598:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4250 00000100:00100000:1.0:1746129757.056603:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1963:x1830949052339072:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129757.057109:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4251 00000100:00100000:3.0:1746129757.057117:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1963:x1830949052339328:12345-192.168.204.31@tcp:3:cat.0 00000100:00080000:0.0:1746129757.060271:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746129757.060279:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746129757.061957:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.061991:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.062148:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130504a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053364352:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129757.062754:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3fa00/0x48868a4e4394a41c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe5b expref: 36 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129757.062773:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3fa00/0x48868a4e4394a41c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe5b expref: 36 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129757.062786:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3fa00, rc 0) 00000100:00100000:3.0:1746129757.062821:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949052338816:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7796us (8139us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129757.062828:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11310 00000100:00100000:0.0:1746129757.063107:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052339584 00000100:00100000:0.0:1746129757.063115:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052339584 00000100:00100000:0.0:1746129757.063142:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3932 00000100:00100000:0.0:1746129757.063148:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:28769:x1830949052339584:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129757.063154:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130504e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053364480:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129757.063170:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a0e000/0x48868a4e4394a423 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe54 expref: 19 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129757.063178:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a0e000/0x48868a4e4394a423 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe54 expref: 19 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129757.063185:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a0e000, rc 0) 00000100:00100000:3.0:1746129757.063199:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949052338688:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8031us (8286us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129757.063204:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11311 00000100:00100000:0.0:1746129757.063292:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:28769:x1830949052339584:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 144us (1342us total) trans 8589943760 rc 0/0 00000100:00100000:0.0:1746129757.063308:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3932 00000100:00100000:0.0:1746129757.063397:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052339712 00000100:00100000:0.0:1746129757.063400:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052339712 00000100:00100000:0.0:1746129757.063422:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 581 00000100:00100000:0.0:1746129757.063426:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:1961:x1830949052339712:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129757.063434:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129757.063449:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a93b200/0x48868a4e4394a40e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe4d expref: 292 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.063461:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129757.063464:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129757.063481:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:1961:x1830949052339712:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 54us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129757.063486:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 581 00000100:00100000:3.0:1746129757.069118:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1963:x1830949052339328:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11994us (12661us total) trans 0 rc 561152/561152 00000100:00100000:3.0:1746129757.069128:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4251 00002000:00100000:3.0:1746129757.069138:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1536000->2097151) req@ffff88008fad1880 x1830949052339328/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 561152/561152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.069152:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad1880 with x1830949052339328 ext(1536000->2097151) 00002000:00010000:3.0:1746129757.069156:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fad1880 00000100:00100000:0.0:1746129757.076305:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.076341:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.076447:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052339840 00000100:00100000:3.0:1746129757.076455:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052339840 00000100:00100000:3.0:1746129757.076485:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052339968 00000100:00100000:3.0:1746129757.076487:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052339968 00000100:00100000:3.0:1746129757.076505:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11312 00000100:00100000:3.0:1746129757.076511:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1962:x1830949052339840:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129757.076525:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129757.076539:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd3fa00/0x48868a4e4394a42a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fe62 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129757.076578:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130504e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053364608:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129757.076630:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129757.076808:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11313 00000100:00100000:0.0:1746129757.076815:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949052339968:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129757.076822:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129757.076831:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x48868a4e4394a431 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fe69 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129757.076875:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053364736:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129757.076913:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5188300 going to sleep for 11 seconds 00000100:00100000:1.0:1746129757.077090:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1963:x1830949052339072:12345-192.168.204.31@tcp:3:cat.0 Request processed in 20484us (20681us total) trans 0 rc 1015808/1015808 00000100:00100000:1.0:1746129757.077713:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4250 00002000:00100000:1.0:1746129757.077722:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2064383) req@ffff88008fad3800 x1830949052339072/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129757.077730:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad3800 with x1830949052339072 ext(1048576->2064383) 00002000:00010000:1.0:1746129757.077734:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fad3800 00000100:00100000:3.0:1746129757.078697:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130504e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053364608:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129757.078718:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3fa00/0x48868a4e4394a42a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe62 expref: 19 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129757.078730:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3fa00/0x48868a4e4394a42a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe62 expref: 19 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129757.079253:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3fa00, rc 0) 00000100:00100000:3.0:1746129757.079291:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1962:x1830949052339840:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2779us (3001us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129757.079305:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11312 00000100:00100000:0.0:1746129757.083293:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053364736:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129757.083329:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x48868a4e4394a431 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe69 expref: 36 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129757.083341:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10000/0x48868a4e4394a431 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe69 expref: 36 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129757.083350:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10000, rc 0) 00000100:00100000:0.0:1746129757.083382:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949052339968:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6568us (7041us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129757.083389:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11313 00000100:00100000:0.0:1746129757.092710:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.092767:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052340096 00000100:00100000:2.0:1746129757.092776:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052340096 00000100:00100000:2.0:1746129757.092822:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11314 00000100:00100000:2.0:1746129757.092829:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:28769:x1830949052340096:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129757.092844:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129757.092887:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05c00/0x48868a4e4394a438 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fe70 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.092910:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ee00/0x48868a4e4394a35f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdeb expref: 21 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.092917:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3f400/0x48868a4e4394a3c1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe31 expref: 36 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.092926:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129757.092927:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129757.092930:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05c00/0x48868a4e4394a438 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2461696->2719743] (req 2461696->2719743) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe70 expref: 36 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.092953:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd3f400/0x48868a4e4394a3c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe31 expref: 36 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.092963:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3f400/0x48868a4e4394a3c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe31 expref: 36 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746129757.092974:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053364864:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129757.093055:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ee00/0x48868a4e4394a35f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdeb expref: 21 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.093063:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ee00/0x48868a4e4394a35f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdeb expref: 21 pid: 10930 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746129757.093070:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053364992:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129757.093088:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129757.094823:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.094883:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052340352 00000100:00100000:2.0:1746129757.094889:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052340352 00000100:00100000:2.0:1746129757.094918:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3933 00000100:00100000:2.0:1746129757.094924:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012babe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:28759:x1830949052340352:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129757.095100:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012babe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:28759:x1830949052340352:12345-192.168.204.31@tcp:35:cat.0 Request processed in 175us (281us total) trans 8589943761 rc 0/0 00000100:00100000:2.0:1746129757.095107:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3933 00000100:00100000:2.0:1746129757.096328:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053364864:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129757.096338:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053364992:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129757.096359:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05c00/0x48868a4e4394a438 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2461696->2719743] (req 2461696->2719743) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe70 expref: 36 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.096372:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e05c00, rc 0) 00000100:00100000:2.0:1746129757.096390:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:28769:x1830949052340096:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3561us (3688us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129757.096395:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11314 00000100:00100000:0.0:1746129757.102082:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.102122:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.102159:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.102181:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052340736 00000100:00100000:2.0:1746129757.102189:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052340736 00000100:00100000:2.0:1746129757.102224:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11315 00000100:00100000:2.0:1746129757.102231:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:28768:x1830949052340736:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129757.102246:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129757.102260:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05000/0x48868a4e4394a43f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fe77 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.102279:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129757.102285:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05c00/0x48868a4e4394a438 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2461696->2719743] (req 2461696->2719743) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe70 expref: 35 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.102290:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129757.102292:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05000/0x48868a4e4394a43f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe77 expref: 23 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.102338:0:10930:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05c00/0x48868a4e4394a438 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2461696->2719743] (req 2461696->2719743) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe70 expref: 35 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.102348:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05000/0x48868a4e4394a43f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe77 expref: 23 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.102355:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e05000, rc 0) 00000100:00100000:2.0:1746129757.102392:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:28768:x1830949052340736:12345-192.168.204.31@tcp:101:cat.0 Request processed in 161us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129757.102397:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11315 00000100:00100000:3.0:1746129757.103018:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052340608 00000100:00100000:3.0:1746129757.103023:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052340608 00010000:00010000:3.0:1746129757.103042:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3f400/0x48868a4e4394a3c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe31 expref: 36 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746129757.103059:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052340480 00000100:00100000:3.0:1746129757.103061:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052340480 00010000:00010000:3.0:1746129757.103068:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ee00/0x48868a4e4394a35f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdeb expref: 23 pid: 10930 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746129757.103091:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5450 00000100:00100000:3.0:1746129757.103096:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1962:x1830949052340608:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129757.103104:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129757.103122:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd3f400/0x48868a4e4394a3c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe31 expref: 36 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.103130:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd3f400/0x48868a4e4394a3c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe31 expref: 36 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.103146:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3f400/0x48868a4e4394a3c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe31 expref: 36 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746129757.103158:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5451 00010000:00010000:3.0:1746129757.103159:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129757.103165:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1963:x1830949052340480:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129757.103172:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129757.103181:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ee00/0x48868a4e4394a35f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdeb expref: 23 pid: 10930 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.103190:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ee00/0x48868a4e4394a35f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdeb expref: 23 pid: 10930 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.103219:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ee00/0x48868a4e4394a35f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdeb expref: 23 pid: 10930 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.103244:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129757.103245:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129757.103251:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05c00/0x48868a4e4394a438 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2461696->2719743) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe70 expref: 35 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.103257:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05c00/0x48868a4e4394a438 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2461696->2719743) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe70 expref: 35 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.103289:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05c00/0x48868a4e4394a438 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2461696->2719743) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe70 expref: 35 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.103318:0:7108:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05c00/0x48868a4e4394a438 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2461696->2719743) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe70 expref: 35 pid: 10930 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746129757.103329:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053365248:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129757.104289:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949052340608:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1188us (2213us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129757.104304:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5450 00000100:00100000:2.0:1746129757.104372:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129757.112195:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.112367:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053365248:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129757.112388:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129757.112434:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1963:x1830949052340480:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 9269us (10273us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129757.112444:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5451 00000100:00100000:1.0:1746129757.112675:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052340992 00000100:00100000:1.0:1746129757.112682:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052340992 00002000:00100000:1.0:1746129757.113857:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2461696->2465791) req@ffff88008fad2a00 x1830949052340992/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129757.113866:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad2a00 with x1830949052340992 ext(2461696->2465791) 00010000:00010000:1.0:1746129757.113875:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05c00/0x48868a4e4394a438 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2719743) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe70 expref: 35 pid: 10930 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.113887:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05c00/0x48868a4e4394a438 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2719743) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe70 expref: 35 pid: 10930 timeout: 803 lvb_type: 0 00002000:00010000:1.0:1746129757.113893:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fad2a00 00000100:00100000:1.0:1746129757.113920:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 641 00000100:00100000:1.0:1746129757.113927:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949052340992:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129757.114060:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949052340992:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 134us (1873us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129757.114066:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 641 00002000:00100000:1.0:1746129757.114071:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2461696->2465791) req@ffff88008fad2a00 x1830949052340992/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/4536 e 0 to 0 dl 1746129768 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129757.114077:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad2a00 with x1830949052340992 ext(2461696->2465791) 00010000:00010000:1.0:1746129757.114082:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05c00/0x48868a4e4394a438 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2719743) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe70 expref: 35 pid: 10930 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.114090:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05c00/0x48868a4e4394a438 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2719743) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe70 expref: 35 pid: 10930 timeout: 803 lvb_type: 0 00002000:00010000:1.0:1746129757.114095:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fad2a00 00000100:00100000:0.0:1746129757.119891:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.120012:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052341248 00000100:00100000:3.0:1746129757.120020:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052341248 00002000:00100000:3.0:1746129757.120057:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2715648->2719743) req@ffff88008fad2680 x1830949052341248/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.120066:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad2680 with x1830949052341248 ext(2715648->2719743) 00010000:00010000:3.0:1746129757.120073:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05c00/0x48868a4e4394a438 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2719743) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe70 expref: 35 pid: 10930 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.120085:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05c00/0x48868a4e4394a438 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2719743) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe70 expref: 35 pid: 10930 timeout: 803 lvb_type: 0 00002000:00010000:3.0:1746129757.120091:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fad2680 00000100:00100000:3.0:1746129757.120108:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 642 00000100:00100000:3.0:1746129757.120115:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1964:x1830949052341248:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129757.120250:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1964:x1830949052341248:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 135us (366us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129757.120256:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 642 00002000:00100000:3.0:1746129757.120261:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2715648->2719743) req@ffff88008fad2680 x1830949052341248/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/4536 e 0 to 0 dl 1746129768 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.120267:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad2680 with x1830949052341248 ext(2715648->2719743) 00010000:00010000:3.0:1746129757.120271:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05c00/0x48868a4e4394a438 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2719743) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe70 expref: 35 pid: 10930 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.120281:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05c00/0x48868a4e4394a438 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2719743) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe70 expref: 35 pid: 10930 timeout: 803 lvb_type: 0 00002000:00010000:3.0:1746129757.120286:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fad2680 00000100:00100000:0.0:1746129757.128174:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.130826:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052341504 00000100:00100000:1.0:1746129757.130835:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052341504 00002000:00100000:1.0:1746129757.130881:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2461696->2719743) req@ffff88008fad3480 x1830949052341504/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129757.130890:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad3480 with x1830949052341504 ext(2461696->2719743) 00010000:00010000:1.0:1746129757.130898:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05c00/0x48868a4e4394a438 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2719743) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe70 expref: 35 pid: 10930 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.130909:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05c00/0x48868a4e4394a438 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2719743) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe70 expref: 35 pid: 10930 timeout: 803 lvb_type: 0 00002000:00010000:1.0:1746129757.130915:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fad3480 00000100:00100000:1.0:1746129757.130940:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 643 00000100:00100000:1.0:1746129757.130946:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1964:x1830949052341504:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:1.0:1746129757.141252:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1964:x1830949052341504:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 10297us (13085us total) trans 17179873248 rc 0/0 00000100:00100000:1.0:1746129757.141263:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 643 00002000:00100000:1.0:1746129757.141272:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2461696->2719743) req@ffff88008fad3480 x1830949052341504/t17179873248(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/448 e 0 to 0 dl 1746129768 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129757.141281:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad3480 with x1830949052341504 ext(2461696->2719743) 00010000:00010000:1.0:1746129757.141290:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05c00/0x48868a4e4394a438 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2719743) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe70 expref: 37 pid: 10930 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.141313:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05c00/0x48868a4e4394a438 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2719743) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe70 expref: 37 pid: 10930 timeout: 803 lvb_type: 0 00002000:00010000:1.0:1746129757.141319:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fad3480 00000100:00100000:0.0:1746129757.143751:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.145310:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052341760 00000100:00100000:1.0:1746129757.145320:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052341760 00000100:00100000:1.0:1746129757.145367:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9961 00000100:00100000:1.0:1746129757.145375:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28773:x1830949052341760:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129757.145392:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129757.145408:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb800/0x48868a4e4394a446 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fe7e expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.145496:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea000/0x48868a4e4394a44d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.145508:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea000/0x48868a4e4394a44d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.145516:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea000/0x48868a4e4394a44d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.145526:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb000/0x48868a4e4394a454 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.145532:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb000/0x48868a4e4394a454 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.145537:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb000/0x48868a4e4394a454 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.145619:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb600/0x48868a4e4394a45b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.145627:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb600/0x48868a4e4394a45b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.145633:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb600/0x48868a4e4394a45b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:1.0:1746129757.145640:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129757.145707:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea000/0x48868a4e4394a44d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.145713:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea000/0x48868a4e4394a44d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.145719:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea000/0x48868a4e4394a44d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.145723:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faea000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129757.145726:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea000/0x48868a4e4394a44d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.145732:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea000/0x48868a4e4394a44d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.145740:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129757.145742:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129757.145746:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea000/0x48868a4e4394a44d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.145750:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea000/0x48868a4e4394a44d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.145912:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb000/0x48868a4e4394a454 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.145917:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb000/0x48868a4e4394a454 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.145921:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb000/0x48868a4e4394a454 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.145925:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faeb000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129757.145927:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb000/0x48868a4e4394a454 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.145931:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb000/0x48868a4e4394a454 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.145937:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e8c7700) 00010000:00010000:1.0:1746129757.145939:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129757.145941:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb000/0x48868a4e4394a454 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.145945:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb000/0x48868a4e4394a454 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.145975:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb800/0x48868a4e4394a446 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe7e expref: 18 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.145985:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb600/0x48868a4e4394a45b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe7e expref: 17 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.145991:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129757.145993:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129757.145994:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faeb600, rc 0) 00000100:00100000:1.0:1746129757.147794:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28773:x1830949052341760:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2413us (4044us total) trans 8589943762 rc 0/0 00000100:00100000:1.0:1746129757.147803:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9961 00000100:00100000:0.0:1746129757.152778:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.152882:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052341888 00000100:00100000:2.0:1746129757.152890:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052341888 00010000:00010000:2.0:1746129757.152922:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05c00/0x48868a4e4394a438 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2719743) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe70 expref: 37 pid: 10930 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746129757.152954:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5452 00000100:00100000:2.0:1746129757.152959:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1962:x1830949052341888:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129757.152970:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129757.152988:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05c00/0x48868a4e4394a438 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2461696->2719743) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe70 expref: 37 pid: 10930 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.152998:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05c00/0x48868a4e4394a438 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2461696->2719743) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe70 expref: 37 pid: 10930 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.153015:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05c00/0x48868a4e4394a438 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2461696->2719743) gid 0 flags: 0x44801000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe70 expref: 37 pid: 10930 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.153036:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129757.153038:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129757.153044:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05000/0x48868a4e4394a43f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe77 expref: 21 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.153051:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05000/0x48868a4e4394a43f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe77 expref: 21 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.153079:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05000/0x48868a4e4394a43f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe77 expref: 21 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129757.153089:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053365376:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129757.153548:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129757.167937:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.167972:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.168027:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053365376:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129757.168048:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129757.168084:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1962:x1830949052341888:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 15123us (15313us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129757.168094:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5452 00000100:00100000:1.0:1746129757.168157:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052342272 00000100:00100000:1.0:1746129757.168162:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052342272 00002000:00100000:1.0:1746129757.168191:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009a56f800 x1830949052342272/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129757.168199:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56f800 with x1830949052342272 ext(2097152->3145727) 00002000:00010000:1.0:1746129757.168203:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a56f800 00000100:00100000:1.0:1746129757.168217:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052342400 00000100:00100000:1.0:1746129757.168218:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052342400 00002000:00100000:1.0:1746129757.168226:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009a56e680 x1830949052342400/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129757.168232:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56e680 with x1830949052342400 ext(3145728->4194303) 00002000:00010000:1.0:1746129757.168234:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a56e680 00000100:00100000:1.0:1746129757.168246:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4252 00000100:00100000:1.0:1746129757.168252:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1963:x1830949052342272:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129757.168288:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.168371:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4253 00000100:00100000:0.0:1746129757.168379:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1963:x1830949052342400:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129757.169456:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052342016 00000100:00100000:2.0:1746129757.169462:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052342016 00000100:00100000:2.0:1746129757.169490:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 582 00000100:00100000:2.0:1746129757.169495:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052342016:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129757.169503:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129757.169521:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb600/0x48868a4e4394a45b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe7e expref: 17 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.169536:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129757.169539:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129757.169556:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052342016:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 61us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129757.169560:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 582 00000100:00100000:1.0:1746129757.187820:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1963:x1830949052342272:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19558us (19880us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129757.187830:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4252 00002000:00100000:1.0:1746129757.187840:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009a56f800 x1830949052342272/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746129757.188592:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1963:x1830949052342400:12345-192.168.204.31@tcp:3:cat.0 Request processed in 20212us (20616us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129757.188601:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4253 00002000:00100000:0.0:1746129757.188606:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009a56e680 x1830949052342400/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129757.188615:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56e680 with x1830949052342400 ext(3145728->4194303) 00002000:00010000:0.0:1746129757.188620:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a56e680 00002000:00100000:1.0:1746129757.189898:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a56f800 with x1830949052342272 ext(2097152->3145727) 00002000:00010000:1.0:1746129757.189902:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a56f800 00000100:00100000:0.0:1746129757.195585:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.195945:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052342656 00000100:00100000:1.0:1746129757.195953:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052342656 00000100:00100000:1.0:1746129757.196932:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11316 00000100:00100000:1.0:1746129757.196943:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:28773:x1830949052342656:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129757.196964:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129757.196982:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a469 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fe85 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.197012:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05000/0x48868a4e4394a43f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe77 expref: 23 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.197019:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.197021:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.197024:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a469 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3223552->3567615] (req 3223552->3567615) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe85 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.197051:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05000/0x48868a4e4394a43f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe77 expref: 23 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.197064:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05000/0x48868a4e4394a43f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe77 expref: 23 pid: 10930 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746129757.197075:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053365504:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129757.197175:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129757.201618:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.202043:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052342912 00000100:00100000:1.0:1746129757.202050:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052342912 00002000:00100000:1.0:1746129757.202083:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880093289c00 x1830949052342912/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129757.202092:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289c00 with x1830949052342912 ext(4194304->4964351) 00010000:00010000:1.0:1746129757.202099:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05000/0x48868a4e4394a43f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe77 expref: 24 pid: 10930 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.202109:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05000/0x48868a4e4394a43f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe77 expref: 24 pid: 10930 timeout: 803 lvb_type: 0 00002000:00010000:1.0:1746129757.202115:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093289c00 00000100:00100000:1.0:1746129757.202132:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 644 00000100:00100000:1.0:1746129757.202138:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1964:x1830949052342912:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129757.212928:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.213320:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1964:x1830949052342912:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11180us (11707us total) trans 0 rc 770048/770048 00000100:00100000:0.0:1746129757.213329:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 644 00002000:00100000:0.0:1746129757.213338:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880093289c00 x1830949052342912/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:H/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129757.213347:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289c00 with x1830949052342912 ext(4194304->4964351) 00010000:00010000:0.0:1746129757.213356:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05000/0x48868a4e4394a43f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe77 expref: 24 pid: 10930 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746129757.213368:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05000/0x48868a4e4394a43f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe77 expref: 24 pid: 10930 timeout: 803 lvb_type: 0 00002000:00010000:0.0:1746129757.213375:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093289c00 00000100:00100000:3.0:1746129757.213892:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052343040 00000100:00100000:3.0:1746129757.213899:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052343040 00000100:00100000:3.0:1746129757.213942:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9962 00000100:00100000:3.0:1746129757.213949:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+6:28775:x1830949052343040:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129757.213964:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129757.213977:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ec00/0x48868a4e4394a470 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fe8c expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.214022:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ee00/0x48868a4e4394a477 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.214032:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ee00/0x48868a4e4394a477 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.214041:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ee00/0x48868a4e4394a477 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.214051:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3fa00/0x48868a4e4394a47e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.214056:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3fa00/0x48868a4e4394a47e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.214060:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3fa00/0x48868a4e4394a47e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.214143:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a485 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.214151:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841e00/0x48868a4e4394a327 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdd6 expref: 291 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.214156:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a485 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.214180:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841e00/0x48868a4e4394a327 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdd6 expref: 291 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.214189:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841e00/0x48868a4e4394a327 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdd6 expref: 291 pid: 16808 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746129757.214198:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130504e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053365632:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129757.214250:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129757.217420:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053365504:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129757.217445:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a469 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3223552->3567615] (req 3223552->3567615) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe85 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.217465:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5217200, rc 0) 00000100:00100000:1.0:1746129757.217527:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:28773:x1830949052342656:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 20586us (21948us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129757.217534:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11316 00000100:00100000:0.0:1746129757.222236:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.222740:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052343168 00000100:00100000:1.0:1746129757.222747:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052343168 00000100:00100000:1.0:1746129757.222788:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11317 00000100:00100000:1.0:1746129757.222795:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1964:x1830949052343168:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129757.222811:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129757.222824:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5217e00/0x48868a4e4394a48c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fe93 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.222842:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.224007:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5217e00/0x48868a4e4394a48c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe93 expref: 24 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.224021:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5217e00/0x48868a4e4394a48c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe93 expref: 24 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.225075:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5217e00, rc 0) 00000100:00100000:1.0:1746129757.225447:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1964:x1830949052343168:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2649us (3214us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129757.225455:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11317 00000100:00100000:0.0:1746129757.231395:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.231440:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.231479:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052343552 00000100:00100000:0.0:1746129757.231485:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052343552 00010000:00010000:0.0:1746129757.231516:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05000/0x48868a4e4394a43f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe77 expref: 23 pid: 10930 timeout: 803 lvb_type: 0 00000100:00100000:0.0:1746129757.231540:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5453 00000100:00100000:0.0:1746129757.231547:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1963:x1830949052343552:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129757.231558:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129757.231579:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05000/0x48868a4e4394a43f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe77 expref: 23 pid: 10930 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746129757.231594:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05000/0x48868a4e4394a43f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe77 expref: 23 pid: 10930 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746129757.231614:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05000/0x48868a4e4394a43f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe77 expref: 23 pid: 10930 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746129757.231651:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129757.231653:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129757.231659:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a469 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3223552->3567615) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe85 expref: 22 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.231666:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a469 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3223552->3567615) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe85 expref: 22 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.231694:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a469 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3223552->3567615) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe85 expref: 22 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129757.231705:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053365760:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129757.231768:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5188300 going to sleep for 11 seconds 00000100:00100000:2.0:1746129757.232198:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052343424 00000100:00100000:2.0:1746129757.232203:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052343424 00000100:00100000:2.0:1746129757.232239:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3934 00000100:00100000:2.0:1746129757.232244:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:27195:x1830949052343424:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746129757.232405:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:27195:x1830949052343424:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 159us (1017us total) trans 8589943763 rc 0/0 00000100:00100000:2.0:1746129757.232411:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3934 00000100:00100000:3.0:1746129757.232548:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130504e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053365632:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129757.232564:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a485 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:1.0:1746129757.235047:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053365760:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129757.235064:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129757.235109:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1963:x1830949052343552:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3562us (3668us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129757.235118:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5453 00000100:00100000:0.0:1746129757.235876:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.235915:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.236095:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052343808 00000100:00100000:2.0:1746129757.236102:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052343808 00002000:00100000:2.0:1746129757.236132:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3223552->3227647) req@ffff88012b8e5180 x1830949052343808/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.236140:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e5180 with x1830949052343808 ext(3223552->3227647) 00002000:00010000:2.0:1746129757.236145:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8e5180 00000100:00100000:2.0:1746129757.236170:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052344064 00000100:00100000:2.0:1746129757.236172:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052344064 00002000:00100000:2.0:1746129757.236182:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4960256->4964351) req@ffff88012b8e7b80 x1830949052344064/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.236188:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e7b80 with x1830949052344064 ext(4960256->4964351) 00002000:00010000:2.0:1746129757.236191:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8e7b80 00000100:00100000:2.0:1746129757.236209:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4254 00000100:00100000:2.0:1746129757.236215:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1961:x1830949052343808:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129757.236340:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1961:x1830949052343808:12345-192.168.204.31@tcp:3:cat.0 Request processed in 124us (493us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129757.236345:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4254 00002000:00100000:2.0:1746129757.236350:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3223552->3227647) req@ffff88012b8e5180 x1830949052343808/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/4536 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.236356:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e5180 with x1830949052343808 ext(3223552->3227647) 00002000:00010000:2.0:1746129757.236359:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8e5180 00000100:00100000:2.0:1746129757.236368:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4255 00000100:00100000:2.0:1746129757.236372:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1964:x1830949052344064:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129757.236423:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1964:x1830949052344064:12345-192.168.204.31@tcp:3:cat.0 Request processed in 50us (507us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129757.236428:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4255 00002000:00100000:2.0:1746129757.236432:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4960256->4964351) req@ffff88012b8e7b80 x1830949052344064/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/4536 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.236439:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e7b80 with x1830949052344064 ext(4960256->4964351) 00002000:00010000:2.0:1746129757.236441:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8e7b80 00000100:00100000:0.0:1746129757.242199:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.242252:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052344192 00000100:00100000:0.0:1746129757.242252:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.242261:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052344192 00010000:00010000:1.0:1746129757.242289:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841e00/0x48868a4e4394a327 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdd6 expref: 293 pid: 16808 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746129757.242335:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5454 00000100:00100000:1.0:1746129757.242342:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:1961:x1830949052344192:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129757.242353:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129757.242359:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841e00/0x48868a4e4394a327 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdd6 expref: 293 pid: 16808 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.242368:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841e00/0x48868a4e4394a327 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdd6 expref: 293 pid: 16808 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.242386:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841e00/0x48868a4e4394a327 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdd6 expref: 293 pid: 16808 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.242401:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129757.242406:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a485 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129757.242414:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a485 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129757.242419:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a485 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129757.242451:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129757.242487:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:1961:x1830949052344192:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 145us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129757.242493:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5454 00000100:00100000:2.0:1746129757.242616:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052344448 00000100:00100000:2.0:1746129757.242620:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052344448 00002000:00100000:2.0:1746129757.242644:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3563520->3567615) req@ffff88009206df80 x1830949052344448/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.242652:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206df80 with x1830949052344448 ext(3563520->3567615) 00002000:00010000:2.0:1746129757.242655:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009206df80 00000100:00100000:2.0:1746129757.242677:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4256 00000100:00100000:2.0:1746129757.242682:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949052344448:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129757.242785:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949052344448:12345-192.168.204.31@tcp:3:cat.0 Request processed in 103us (533us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129757.242791:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4256 00002000:00100000:2.0:1746129757.242795:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3563520->3567615) req@ffff88009206df80 x1830949052344448/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/4536 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.242802:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206df80 with x1830949052344448 ext(3563520->3567615) 00002000:00010000:2.0:1746129757.242805:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009206df80 00010000:00010000:3.0:1746129757.242893:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a485 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.242900:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a485 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129757.242929:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:3.0:1746129757.242932:0:1851:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129757.242942:0:1851:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a485 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.242950:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a485 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.242958:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ee00/0x48868a4e4394a477 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.242963:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ee00/0x48868a4e4394a477 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.242969:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ee00/0x48868a4e4394a477 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.242973:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd3ee00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129757.242976:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ee00/0x48868a4e4394a477 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.242982:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ee00/0x48868a4e4394a477 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.242989:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129757.242992:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129757.242994:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ee00/0x48868a4e4394a477 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.242998:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ee00/0x48868a4e4394a477 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.243018:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3fa00/0x48868a4e4394a47e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.243023:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3fa00/0x48868a4e4394a47e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.243027:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3fa00/0x48868a4e4394a47e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.243031:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd3fa00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129757.243033:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3fa00/0x48868a4e4394a47e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.243037:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3fa00/0x48868a4e4394a47e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.243047:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f99b000) 00010000:00010000:3.0:1746129757.243048:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129757.243050:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3fa00/0x48868a4e4394a47e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.243054:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3fa00/0x48868a4e4394a47e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.243078:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ec00/0x48868a4e4394a470 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe8c expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.243088:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a485 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe8c expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.243093:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129757.243095:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129757.243097:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3f200, rc 0) 00000100:00100000:3.0:1746129757.243116:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+7:28775:x1830949052343040:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 29168us (30196us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129757.243122:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9962 00000100:00100000:0.0:1746129757.245887:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.248276:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052344704 00000100:00100000:3.0:1746129757.248287:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052344704 00000100:00100000:3.0:1746129757.248348:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9963 00000100:00100000:3.0:1746129757.248356:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:28778:x1830949052344704:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129757.248374:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129757.248389:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ea00/0x48868a4e4394a493 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fe9a expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.248479:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f400/0x48868a4e4394a49a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.248489:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f400/0x48868a4e4394a49a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.248498:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f400/0x48868a4e4394a49a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.248508:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009536f200/0x48868a4e4394a4a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.248512:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009536f200/0x48868a4e4394a4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.248516:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009536f200/0x48868a4e4394a4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.248599:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a4a8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.248606:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a4a8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.248611:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a4a8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129757.248618:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129757.248674:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f400/0x48868a4e4394a49a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.248680:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f400/0x48868a4e4394a49a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.248688:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f400/0x48868a4e4394a49a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.248692:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd3f400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129757.248695:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f400/0x48868a4e4394a49a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.248699:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f400/0x48868a4e4394a49a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.248707:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129757.248709:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129757.248711:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f400/0x48868a4e4394a49a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.248715:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f400/0x48868a4e4394a49a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.248723:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009536f200/0x48868a4e4394a4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.248727:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009536f200/0x48868a4e4394a4a1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.248731:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009536f200/0x48868a4e4394a4a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.248734:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009536f200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129757.248736:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009536f200/0x48868a4e4394a4a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.248739:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009536f200/0x48868a4e4394a4a1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.248747:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f99bd00) 00010000:00010000:3.0:1746129757.248749:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129757.248750:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009536f200/0x48868a4e4394a4a1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.248754:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009536f200/0x48868a4e4394a4a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129757.248778:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ea00/0x48868a4e4394a493 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe9a expref: 295 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.248787:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a4a8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe9a expref: 294 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.248791:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129757.248793:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129757.248795:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b7f0600, rc 0) 00000100:00100000:3.0:1746129757.248864:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:28778:x1830949052344704:12345-192.168.204.31@tcp:101:cat.0 Request processed in 492us (2967us total) trans 8589943764 rc 0/0 00000100:00100000:3.0:1746129757.248869:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9963 00000100:00100000:0.0:1746129757.253908:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.253930:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.253957:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.253970:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.253982:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.254003:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.254027:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052344832 00000100:00100000:0.0:1746129757.254034:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052344832 00000100:00080000:0.0:1746129757.254056:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129757.254080:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052345088 00000100:00100000:0.0:1746129757.254082:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052345088 00000100:00100000:0.0:1746129757.254094:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052345344 00000100:00100000:0.0:1746129757.254096:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052345344 00000100:00100000:0.0:1746129757.254104:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052344960 00000100:00100000:0.0:1746129757.254105:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052344960 00000100:00100000:0.0:1746129757.254112:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052345216 00000100:00100000:0.0:1746129757.254113:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052345216 00000100:00100000:0.0:1746129757.254120:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052345472 00000100:00100000:0.0:1746129757.254122:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052345472 00000100:00100000:0.0:1746129757.254131:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11318 00000100:00100000:0.0:1746129757.254137:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052344832:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129757.254151:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129757.254166:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6200/0x48868a4e4394a4b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fea1 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.254183:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129757.254185:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129757.254192:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6200/0x48868a4e4394a4b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fea1 expref: 12 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129757.254204:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6200/0x48868a4e4394a4b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fea1 expref: 12 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129757.254213:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb6200, rc 0) 00000100:00100000:0.0:1746129757.254247:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+12:1964:x1830949052344832:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 110us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129757.254251:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11318 00000100:00100000:0.0:1746129757.254265:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11319 00000100:00100000:0.0:1746129757.254269:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052345088:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129757.254275:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129757.254283:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a4bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34feaf expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129757.254323:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053365888:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129757.254345:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11320 00000100:00100000:3.0:1746129757.254353:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052345344:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129757.254360:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129757.254367:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b7f1600/0x48868a4e4394a4c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34febd expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129757.254369:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5188300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129757.254385:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11321 00000100:00100000:3.0:1746129757.254388:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130504e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053366016:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129757.254391:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+12:1964:x1830949052344960:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129757.254397:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129757.254403:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c840600/0x48868a4e4394a4cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fea8 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129757.254409:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28d80 going to sleep for 11 seconds 00010000:00010000:0.0:1746129757.254412:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129757.254413:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129757.254418:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c840600/0x48868a4e4394a4cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fea8 expref: 13 pid: 4589 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129757.254421:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11322 00000100:00100000:3.0:1746129757.254426:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+12:1964:x1830949052345216:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129757.254427:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c840600/0x48868a4e4394a4cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fea8 expref: 13 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129757.254430:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129757.254433:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c840600, rc 0) 00010000:00010000:3.0:1746129757.254435:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b7f1000/0x48868a4e4394a4d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34feb6 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129757.254449:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130504a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053366144:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129757.254449:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+13:1964:x1830949052344960:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 59us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129757.254454:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11321 00000100:00100000:3.0:1746129757.254463:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129757.254464:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11323 00000100:00100000:0.0:1746129757.254469:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+12:1964:x1830949052345472:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129757.254474:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129757.254479:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c841400/0x48868a4e4394a4d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fec4 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.254488:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129757.254489:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129757.254492:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c841400/0x48868a4e4394a4d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fec4 expref: 13 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129757.254501:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c841400/0x48868a4e4394a4d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fec4 expref: 13 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129757.254507:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c841400, rc 0) 00000100:00100000:0.0:1746129757.254521:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6141239f-0c60-480d-830c-e22ba61457b0+13:1964:x1830949052345472:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 53us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129757.254526:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11323 00000100:00080000:0.0:1746129757.254540:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746129757.258364:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.260483:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052345728 00000100:00100000:0.0:1746129757.260493:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052345728 00000100:00100000:0.0:1746129757.260543:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3935 00000100:00100000:0.0:1746129757.260550:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28773:x1830949052345728:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:0.0:1746129757.260742:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28773:x1830949052345728:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 191us (2385us total) trans 8589943765 rc 0/0 00000100:00100000:0.0:1746129757.260747:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3935 00000100:00100000:2.0:1746129757.266468:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053365888:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129757.266495:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a4bd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34feaf expref: 12 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129757.266507:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a4bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34feaf expref: 12 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129757.266521:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb6600, rc 0) 00000100:00100000:2.0:1746129757.266557:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+11:1964:x1830949052345088:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 12286us (12625us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129757.266565:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11319 00000100:00100000:0.0:1746129757.269209:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.269227:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.269239:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.269258:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.269278:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052346368 00000100:00100000:0.0:1746129757.269283:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052346368 00000100:00100000:0.0:1746129757.269322:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9964 00000100:00100000:0.0:1746129757.269329:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:28780:x1830949052346368:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129757.269346:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129757.269359:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841a00/0x48868a4e4394a4e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fee0 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.269426:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840800/0x48868a4e4394a4e7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.269438:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a485 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe8c expref: 6 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.269444:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a4a8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe9a expref: 295 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.269449:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840800/0x48868a4e4394a4e7 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.269471:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a4a8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe9a expref: 295 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.269479:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a4a8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe9a expref: 295 pid: 1851 timeout: 803 lvb_type: 0 00000100:00100000:0.0:1746129757.269488:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c136d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053366272:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129757.269536:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a485 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe8c expref: 6 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.269542:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a485 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe8c expref: 6 pid: 1851 timeout: 803 lvb_type: 0 00000100:00100000:0.0:1746129757.269548:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c135c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053366400:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129757.269559:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5188180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129757.270003:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052345856 00000100:00100000:2.0:1746129757.270007:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052345856 00000100:00100000:2.0:1746129757.270028:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052345984 00000100:00100000:2.0:1746129757.270030:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052345984 00000100:00100000:2.0:1746129757.270046:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052346112 00000100:00100000:2.0:1746129757.270048:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052346112 00000100:00100000:2.0:1746129757.270057:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11324 00000100:00100000:2.0:1746129757.270062:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1964:x1830949052345856:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129757.270069:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129757.270077:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05a00/0x48868a4e4394a4ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fecb expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129757.270102:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053366528:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129757.270131:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129757.270143:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11325 00000100:00100000:2.0:1746129757.270147:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1963:x1830949052345984:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129757.270152:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129757.270158:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05800/0x48868a4e4394a4f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fed2 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129757.270176:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053366656:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129757.270190:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1240 going to sleep for 11 seconds 00000100:00100000:1.0:1746129757.270305:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11326 00000100:00100000:1.0:1746129757.270313:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1964:x1830949052346112:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129757.270319:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129757.270327:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5216e00/0x48868a4e4394a4fc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fed9 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129757.270347:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053366784:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129757.270370:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129757.272335:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053366528:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129757.272363:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05a00/0x48868a4e4394a4ee lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fecb expref: 19 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129757.272374:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05a00/0x48868a4e4394a4ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fecb expref: 19 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129757.272385:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e05a00, rc 0) 00000100:00100000:2.0:1746129757.272428:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1964:x1830949052345856:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2365us (3199us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129757.272435:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11324 00000100:00100000:0.0:1746129757.272983:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c136d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053366272:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129757.272993:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c135c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053366400:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129757.273007:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840800/0x48868a4e4394a4e7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:3.0:1746129757.273108:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130504a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053366144:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129757.273126:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b7f1000/0x48868a4e4394a4d2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34feb6 expref: 13 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129757.273135:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b7f1000/0x48868a4e4394a4d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34feb6 expref: 13 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129757.273160:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b7f1000, rc 0) 00000100:00100000:3.0:1746129757.273181:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+12:1964:x1830949052345216:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 18755us (19198us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129757.273186:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11322 00002000:00010000:3.0:1746129757.273214:0:1877:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime: 1746129756 -> 1746129757 00000100:00100000:3.0:1746129757.273223:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130504e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053366016:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129757.273235:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b7f1600/0x48868a4e4394a4c4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34febd expref: 11 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129757.273247:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b7f1600/0x48868a4e4394a4c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34febd expref: 11 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129757.273254:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b7f1600, rc 0) 00000100:00100000:3.0:1746129757.273268:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+10:1964:x1830949052345344:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 18917us (19311us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129757.273273:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11320 00000100:00100000:1.0:1746129757.279700:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053366656:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129757.279732:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05800/0x48868a4e4394a4f5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fed2 expref: 39 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.279744:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05800/0x48868a4e4394a4f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fed2 expref: 39 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.279757:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e05800, rc 0) 00000100:00100000:1.0:1746129757.279808:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1963:x1830949052345984:12345-192.168.204.31@tcp:101:cat.0 Request processed in 9659us (10565us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129757.279816:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11325 00000100:00100000:1.0:1746129757.279905:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053366784:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129757.279921:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5216e00/0x48868a4e4394a4fc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fed9 expref: 37 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.279929:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5216e00/0x48868a4e4394a4fc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fed9 expref: 37 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.279936:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5216e00, rc 0) 00000100:00100000:1.0:1746129757.279951:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1964:x1830949052346112:12345-192.168.204.31@tcp:101:cat.0 Request processed in 9639us (10691us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129757.279956:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11326 00000100:00100000:1.0:1746129757.280009:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.280081:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.280095:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052346496 00000100:00100000:1.0:1746129757.280100:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052346496 00010000:00010000:1.0:1746129757.280119:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a4a8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe9a expref: 296 pid: 1851 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746129757.280135:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052346624 00000100:00100000:1.0:1746129757.280137:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052346624 00010000:00010000:1.0:1746129757.280145:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a485 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe8c expref: 7 pid: 1851 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746129757.280156:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5455 00000100:00100000:1.0:1746129757.280161:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:1961:x1830949052346496:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129757.280171:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129757.280175:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a4a8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe9a expref: 296 pid: 1851 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.280187:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a4a8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe9a expref: 296 pid: 1851 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.280201:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a4a8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe9a expref: 296 pid: 1851 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.280212:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129757.280216:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840800/0x48868a4e4394a4e7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.280222:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840800/0x48868a4e4394a4e7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.280227:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129757.280242:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:1961:x1830949052346496:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 81us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129757.280247:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5455 00000100:00100000:1.0:1746129757.280276:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5456 00000100:00100000:1.0:1746129757.280280:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+7:1961:x1830949052346624:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129757.280285:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129757.280289:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a485 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe8c expref: 7 pid: 1851 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.280310:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a485 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe8c expref: 7 pid: 1851 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.280319:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e4394a485 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe8c expref: 7 pid: 1851 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.280327:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129757.280330:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840800/0x48868a4e4394a4e7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.280337:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840800/0x48868a4e4394a4e7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.280342:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840800/0x48868a4e4394a4e7 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.280355:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129757.280368:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+6:1961:x1830949052346624:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 87us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129757.280373:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5456 00000100:00100000:1.0:1746129757.280411:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.280427:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052346752 00000100:00100000:1.0:1746129757.280430:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052346752 00000100:00100000:1.0:1746129757.280447:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9965 00000100:00100000:1.0:1746129757.280451:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+6:28775:x1830949052346752:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129757.280463:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129757.280471:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217e00/0x48868a4e4394a503 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fee7 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.280507:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217e00/0x48868a4e4394a503 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fee7 expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.280515:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217e00/0x48868a4e4394a503 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fee7 expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.280530:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129757.280532:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129757.280533:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5217e00, rc 0) 00000100:00100000:1.0:1746129757.280547:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+7:28775:x1830949052346752:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 96us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129757.280551:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9965 00010000:00010000:0.0:1746129757.280845:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840800/0x48868a4e4394a4e7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.280879:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840800/0x48868a4e4394a4e7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:0.0:1746129757.280892:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129757.280993:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841a00/0x48868a4e4394a4e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fee0 expref: 296 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.281007:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840800/0x48868a4e4394a4e7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fee0 expref: 295 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.281012:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129757.281014:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129757.281015:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c840800, rc 0) 00000100:00100000:0.0:1746129757.281042:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:28780:x1830949052346368:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 11713us (11838us total) trans 8589943766 rc 0/0 00000100:00100000:0.0:1746129757.281048:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9964 00000100:00100000:0.0:1746129757.293318:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.293402:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052347136 00000100:00100000:2.0:1746129757.293409:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052347136 00000100:00100000:2.0:1746129757.293456:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9966 00000100:00100000:2.0:1746129757.293463:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+7:28775:x1830949052347136:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129757.293479:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129757.293492:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04a00/0x48868a4e4394a511 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fef5 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.293581:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a518 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.293592:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a518 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.293601:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a518 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.293611:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05600/0x48868a4e4394a51f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.293616:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05600/0x48868a4e4394a51f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.293622:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05600/0x48868a4e4394a51f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.293707:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04600/0x48868a4e4394a526 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.293714:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04600/0x48868a4e4394a526 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.293719:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04600/0x48868a4e4394a526 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:2.0:1746129757.293726:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129757.293789:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a518 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.293795:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a518 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.293800:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a518 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.293805:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8e05e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129757.293808:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a518 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.293813:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a518 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.293822:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129757.293825:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129757.293828:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a518 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.293835:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a518 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.293875:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05600/0x48868a4e4394a51f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.293879:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05600/0x48868a4e4394a51f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.293884:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05600/0x48868a4e4394a51f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.293888:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8e05600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129757.293890:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05600/0x48868a4e4394a51f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.293894:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05600/0x48868a4e4394a51f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.293900:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e2d8900) 00010000:00010000:2.0:1746129757.293902:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129757.293904:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05600/0x48868a4e4394a51f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.293908:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05600/0x48868a4e4394a51f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.293936:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04a00/0x48868a4e4394a511 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fef5 expref: 10 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.293945:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04600/0x48868a4e4394a526 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fef5 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.293954:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129757.293956:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129757.293958:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e04600, rc 0) 00000100:00100000:2.0:1746129757.293996:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+9:28775:x1830949052347136:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 533us (685us total) trans 8589943767 rc 0/0 00000100:00100000:2.0:1746129757.294002:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9966 00000100:00100000:1.0:1746129757.294321:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.294369:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052346880 00000100:00100000:0.0:1746129757.294373:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052346880 00000100:00100000:0.0:1746129757.294403:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11327 00000100:00100000:0.0:1746129757.294408:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:28778:x1830949052346880:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129757.294415:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129757.294424:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x48868a4e4394a534 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34feee expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.294440:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f000/0x48868a4e4394a3b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe23 expref: 13 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.294446:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129757.294447:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129757.294450:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x48868a4e4394a534 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34feee expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.294470:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f000/0x48868a4e4394a3b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe23 expref: 13 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.294479:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f000/0x48868a4e4394a3b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe23 expref: 13 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:0.0:1746129757.294489:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c136d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053366912:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129757.295326:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5188180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129757.301354:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.301389:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.301437:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c136d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053366912:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129757.301460:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x48868a4e4394a534 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34feee expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.301477:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:0.0:1746129757.301511:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:28778:x1830949052346880:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7102us (7189us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129757.301518:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11327 00000100:00100000:0.0:1746129757.301538:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052347392 00000100:00100000:0.0:1746129757.301543:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052347392 00000100:00100000:0.0:1746129757.301576:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052347264 00000100:00100000:0.0:1746129757.301578:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052347264 00000100:00100000:0.0:1746129757.301592:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11328 00000100:00100000:0.0:1746129757.301597:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052347392:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129757.301609:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129757.301620:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x48868a4e4394a53b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ff03 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129757.301655:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c136d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053367040:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129757.301733:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11329 00000100:00100000:2.0:1746129757.301740:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052347264:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129757.301746:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129757.301754:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04800/0x48868a4e4394a542 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fefc expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129757.301775:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053367168:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129757.301882:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.301897:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052347520 00000100:00100000:1.0:1746129757.301900:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052347520 00000100:00100000:1.0:1746129757.301915:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11330 00000100:00100000:1.0:1746129757.301920:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949052347520:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129757.301926:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129757.301932:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5217600/0x48868a4e4394a549 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ff0a expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129757.301953:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053367296:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129757.302065:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.302083:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052347648 00000100:00100000:1.0:1746129757.302085:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052347648 00002000:00100000:1.0:1746129757.302107:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (2064384->2097151) req@ffff88012ba38e00 x1830949052347648/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129757.302114:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba38e00 with x1830949052347648 ext(2064384->2097151) 00010000:00010000:1.0:1746129757.302120:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f000/0x48868a4e4394a3b3 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe23 expref: 14 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.302136:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f000/0x48868a4e4394a3b3 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe23 expref: 14 pid: 8436 timeout: 803 lvb_type: 0 00002000:00010000:1.0:1746129757.302141:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba38e00 00000100:00100000:1.0:1746129757.302153:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 645 00000100:00100000:1.0:1746129757.302158:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949052347648:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129757.303029:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5188180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129757.303079:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129757.303949:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d5106c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129757.305916:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.308247:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052347776 00000100:00100000:3.0:1746129757.308255:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052347776 00000100:00100000:3.0:1746129757.308305:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11331 00000100:00100000:3.0:1746129757.308312:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:28780:x1830949052347776:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129757.308326:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129757.308341:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a550 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ff11 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.308363:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129757.308368:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x48868a4e4394a534 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34feee expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.308373:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746129757.308376:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a550 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1396736->1646591] (req 1396736->1646591) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff11 expref: 20 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.308422:0:1877:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x48868a4e4394a534 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34feee expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.308438:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a550 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1396736->1646591] (req 1396736->1646591) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff11 expref: 20 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.308445:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b7f0600, rc 0) 00000100:00100000:3.0:1746129757.308464:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:28780:x1830949052347776:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 153us (2553us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129757.308469:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11331 00000100:00100000:1.0:1746129757.312099:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1961:x1830949052347648:12345-192.168.204.31@tcp:4:cat.0 Request processed in 5688us (5781us total) trans 21474840385 rc 0/0 00000100:00100000:1.0:1746129757.312112:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 645 00002000:00100000:1.0:1746129757.312125:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (2064384->2097151) req@ffff88012ba38e00 x1830949052347648/t21474840385(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/448 e 0 to 0 dl 1746129768 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129757.312133:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba38e00 with x1830949052347648 ext(2064384->2097151) 00010000:00010000:1.0:1746129757.312144:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f000/0x48868a4e4394a3b3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe23 expref: 16 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.312157:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f000/0x48868a4e4394a3b3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe23 expref: 16 pid: 8436 timeout: 803 lvb_type: 0 00002000:00010000:1.0:1746129757.312163:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba38e00 00000100:00100000:1.0:1746129757.316127:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053367296:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129757.316153:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5217600/0x48868a4e4394a549 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff0a expref: 13 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.316172:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5217600/0x48868a4e4394a549 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff0a expref: 13 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.316184:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5217600, rc 0) 00000100:00100000:0.0:1746129757.316259:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c136d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053367040:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129757.316274:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x48868a4e4394a53b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff03 expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129757.316287:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11200/0x48868a4e4394a53b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff03 expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129757.316322:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11200, rc 0) 00000100:00100000:1.0:1746129757.316565:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052347520:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 14642us (14680us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129757.316572:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11330 00000100:00100000:0.0:1746129757.316629:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052347392:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 15031us (15281us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129757.316633:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11328 00000100:00100000:2.0:1746129757.317282:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053367168:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129757.317320:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04800/0x48868a4e4394a542 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fefc expref: 12 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129757.317331:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04800/0x48868a4e4394a542 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fefc expref: 12 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129757.317351:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e04800, rc 0) 00000100:00100000:2.0:1746129757.317385:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052347264:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 15645us (15995us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129757.317394:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11329 00000100:00100000:0.0:1746129757.324374:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.325280:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052347904 00000100:00100000:2.0:1746129757.325288:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052347904 00010000:00010000:2.0:1746129757.325330:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f000/0x48868a4e4394a3b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe23 expref: 16 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746129757.325357:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5457 00000100:00100000:2.0:1746129757.325363:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c136d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052347904:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129757.325375:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129757.325393:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f000/0x48868a4e4394a3b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe23 expref: 16 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.325404:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f000/0x48868a4e4394a3b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe23 expref: 16 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.325420:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f000/0x48868a4e4394a3b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe23 expref: 16 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.325866:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129757.325869:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129757.325875:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x48868a4e4394a534 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34feee expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.325882:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x48868a4e4394a534 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34feee expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.325910:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x48868a4e4394a534 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34feee expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.325921:0:7108:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x48868a4e4394a534 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34feee expref: 19 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746129757.325931:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053367552:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129757.327250:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129757.331166:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.331274:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053367552:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129757.331303:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129757.331350:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c136d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949052347904:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5986us (6984us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129757.331359:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5457 00000100:00100000:3.0:1746129757.331794:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052348160 00000100:00100000:3.0:1746129757.331801:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052348160 00000100:00100000:3.0:1746129757.331838:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9967 00000100:00100000:3.0:1746129757.331844:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e192050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:28775:x1830949052348160:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129757.331886:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129757.331900:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1000/0x48868a4e4394a557 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ff18 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.331974:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0800/0x48868a4e4394a55e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.331987:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840800/0x48868a4e4394a4e7 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fee0 expref: 294 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.331993:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0800/0x48868a4e4394a55e lrc: 4/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.332017:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840800/0x48868a4e4394a4e7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fee0 expref: 294 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.332030:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840800/0x48868a4e4394a4e7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fee0 expref: 294 pid: 16808 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746129757.332039:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130504e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053367680:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129757.332098:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129757.335607:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.335668:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052348416 00000100:00100000:1.0:1746129757.335675:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052348416 00000100:00100000:3.0:1746129757.335814:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130504e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053367680:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129757.335834:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0800/0x48868a4e4394a55e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00002000:00100000:1.0:1746129757.335915:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880136884000 x1830949052348416/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129757.335925:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136884000 with x1830949052348416 ext(1048576->2097151) 00010000:00010000:1.0:1746129757.335932:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x48868a4e4394a534 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34feee expref: 20 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.335942:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x48868a4e4394a534 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34feee expref: 20 pid: 8436 timeout: 803 lvb_type: 0 00002000:00010000:1.0:1746129757.335948:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136884000 00000100:00100000:1.0:1746129757.335979:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 646 00000100:00100000:1.0:1746129757.335986:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949052348416:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129757.339252:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.339374:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052348544 00000100:00100000:3.0:1746129757.339380:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052348544 00010000:00010000:3.0:1746129757.339408:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840800/0x48868a4e4394a4e7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fee0 expref: 295 pid: 16808 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746129757.339433:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5458 00000100:00100000:3.0:1746129757.339440:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:1962:x1830949052348544:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129757.339452:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129757.339457:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840800/0x48868a4e4394a4e7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fee0 expref: 295 pid: 16808 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.339466:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840800/0x48868a4e4394a4e7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fee0 expref: 295 pid: 16808 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.339483:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840800/0x48868a4e4394a4e7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fee0 expref: 295 pid: 16808 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.339504:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129757.339509:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0800/0x48868a4e4394a55e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.339516:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0800/0x48868a4e4394a55e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.339522:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0800/0x48868a4e4394a55e lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.339539:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129757.339579:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:1962:x1830949052348544:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 139us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129757.339585:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5458 00010000:00010000:3.0:1746129757.339619:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0800/0x48868a4e4394a55e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.339625:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0800/0x48868a4e4394a55e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.339639:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0800/0x48868a4e4394a55e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.339644:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0800/0x48868a4e4394a55e lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.339650:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0800/0x48868a4e4394a55e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.339654:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b7f0800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129757.339657:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0800/0x48868a4e4394a55e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.339663:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0800/0x48868a4e4394a55e lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.339670:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129757.339672:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129757.339675:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0800/0x48868a4e4394a55e lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.339679:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0800/0x48868a4e4394a55e lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.339708:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1000/0x48868a4e4394a557 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff18 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.339715:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1000/0x48868a4e4394a557 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff18 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.339725:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b7f1000, rc 0) 00000100:00100000:3.0:1746129757.339744:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e192050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:28775:x1830949052348160:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 7901us (8586us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129757.339750:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9967 00000100:00100000:2.0:1746129757.345955:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.347411:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052348800 00000100:00100000:0.0:1746129757.347419:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052348800 00000100:00100000:0.0:1746129757.347461:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3936 00000100:00100000:0.0:1746129757.347467:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6141239f-0c60-480d-830c-e22ba61457b0+9:28775:x1830949052348800:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:1.0:1746129757.348098:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949052348416:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 12111us (12496us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129757.348107:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 646 00002000:00100000:1.0:1746129757.348116:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880136884000 x1830949052348416/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129757.348124:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136884000 with x1830949052348416 ext(1048576->2097151) 00010000:00010000:1.0:1746129757.348132:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x48868a4e4394a534 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34feee expref: 20 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.348144:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x48868a4e4394a534 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34feee expref: 20 pid: 8436 timeout: 803 lvb_type: 0 00002000:00010000:1.0:1746129757.348150:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136884000 00000100:00100000:0.0:1746129757.348696:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6141239f-0c60-480d-830c-e22ba61457b0+10:28775:x1830949052348800:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 1227us (2746us total) trans 8589943768 rc 0/0 00000100:00100000:0.0:1746129757.348703:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3936 00000100:00100000:0.0:1746129757.358532:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.358585:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.358676:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052349056 00000100:00100000:2.0:1746129757.358684:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052349056 00000100:00100000:2.0:1746129757.358719:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11332 00000100:00100000:2.0:1746129757.358726:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:28778:x1830949052349056:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129757.358741:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129757.358755:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04000/0x48868a4e4394a565 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ff1f expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.358779:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a0e800/0x48868a4e4394a3ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe2a expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.358786:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129757.358787:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129757.358791:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04000/0x48868a4e4394a565 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff1f expref: 37 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.358817:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a0e800/0x48868a4e4394a3ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe2a expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.358826:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a0e800/0x48868a4e4394a3ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe2a expref: 21 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746129757.358837:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053367808:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129757.358932:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129757.358988:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052348928 00000100:00100000:1.0:1746129757.359358:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052348928 00010000:00010000:1.0:1746129757.359377:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x48868a4e4394a534 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34feee expref: 20 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746129757.359405:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5459 00000100:00100000:1.0:1746129757.359410:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136886680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949052348928:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129757.359418:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129757.359434:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x48868a4e4394a534 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34feee expref: 20 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.359445:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x48868a4e4394a534 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34feee expref: 20 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.359460:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x48868a4e4394a534 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34feee expref: 20 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.359479:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.359481:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.359486:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a550 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1646591) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff11 expref: 19 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.359493:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a550 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1646591) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff11 expref: 19 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.359511:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a550 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1646591) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff11 expref: 19 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129757.359520:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053367936:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129757.359541:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d5106c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129757.361808:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053367808:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129757.361835:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04000/0x48868a4e4394a565 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff1f expref: 37 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.361882:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e04000, rc 0) 00000100:00100000:2.0:1746129757.361918:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:28778:x1830949052349056:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3192us (3393us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129757.361925:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11332 00000100:00100000:0.0:1746129757.362477:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.362501:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.362545:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052349184 00000100:00100000:0.0:1746129757.362549:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052349184 00002000:00100000:0.0:1746129757.362580:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1535999) req@ffff880136887100 x1830949052349184/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129757.362589:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136887100 with x1830949052349184 ext(1048576->1535999) 00010000:00010000:0.0:1746129757.362595:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130a0e800/0x48868a4e4394a3ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe2a expref: 22 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746129757.362605:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130a0e800/0x48868a4e4394a3ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe2a expref: 22 pid: 8436 timeout: 803 lvb_type: 0 00002000:00010000:0.0:1746129757.362611:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136887100 00000100:00100000:0.0:1746129757.362623:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052349440 00000100:00100000:0.0:1746129757.362626:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052349440 00002000:00100000:0.0:1746129757.362641:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1396736->1400831) req@ffff880136885f80 x1830949052349440/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129757.362647:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136885f80 with x1830949052349440 ext(1396736->1400831) 00002000:00010000:0.0:1746129757.362650:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136885f80 00000100:00100000:0.0:1746129757.362659:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 647 00000100:00100000:0.0:1746129757.362664:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949052349184:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129757.363153:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4257 00000100:00100000:3.0:1746129757.363161:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1964:x1830949052349440:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129757.363274:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1964:x1830949052349440:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 114us (771us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129757.363280:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4257 00002000:00100000:3.0:1746129757.363285:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1396736->1400831) req@ffff880136885f80 x1830949052349440/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/4536 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.363311:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136885f80 with x1830949052349440 ext(1396736->1400831) 00002000:00010000:3.0:1746129757.363314:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136885f80 00000100:00100000:1.0:1746129757.363870:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053367936:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129757.363883:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129757.363917:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136886680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949052348928:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4506us (5331us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129757.363923:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5459 00000100:00100000:2.0:1746129757.368543:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.369208:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052349696 00000100:00100000:3.0:1746129757.369216:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052349696 00002000:00100000:3.0:1746129757.369250:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1642496->1646591) req@ffff8800a00c6a00 x1830949052349696/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.369259:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c6a00 with x1830949052349696 ext(1642496->1646591) 00002000:00010000:3.0:1746129757.369264:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a00c6a00 00000100:00100000:3.0:1746129757.370956:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4258 00000100:00100000:3.0:1746129757.370968:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1963:x1830949052349696:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129757.371902:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1963:x1830949052349696:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 935us (3366us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129757.371909:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4258 00002000:00100000:3.0:1746129757.371916:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1642496->1646591) req@ffff8800a00c6a00 x1830949052349696/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/4536 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.371924:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c6a00 with x1830949052349696 ext(1642496->1646591) 00002000:00010000:3.0:1746129757.371929:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a00c6a00 00000100:00100000:0.0:1746129757.376902:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.376925:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052349952 00000100:00100000:0.0:1746129757.376933:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052349952 00000100:00100000:0.0:1746129757.376982:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3937 00000100:00100000:0.0:1746129757.376990:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:28780:x1830949052349952:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:0.0:1746129757.377208:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:28780:x1830949052349952:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 218us (312us total) trans 8589943769 rc 0/0 00000100:00100000:0.0:1746129757.377215:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3937 00000100:00100000:2.0:1746129757.378805:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1961:x1830949052349184:12345-192.168.204.31@tcp:4:cat.0 Request processed in 16135us (16324us total) trans 17179873249 rc 0/0 00000100:00100000:2.0:1746129757.378813:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 647 00002000:00100000:2.0:1746129757.378821:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1535999) req@ffff880136887100 x1830949052349184/t17179873249(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/448 e 0 to 0 dl 1746129768 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.378829:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136887100 with x1830949052349184 ext(1048576->1535999) 00010000:00010000:2.0:1746129757.378837:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130a0e800/0x48868a4e4394a3ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe2a expref: 24 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.378868:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130a0e800/0x48868a4e4394a3ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe2a expref: 24 pid: 8436 timeout: 803 lvb_type: 0 00002000:00010000:2.0:1746129757.378874:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136887100 00000100:00100000:0.0:1746129757.380053:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.380204:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052350208 00000100:00100000:3.0:1746129757.380211:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052350208 00000100:00100000:3.0:1746129757.380250:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9968 00000100:00100000:3.0:1746129757.380256:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28786:x1830949052350208:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129757.380272:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129757.380286:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0200/0x48868a4e4394a56c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ff26 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.380374:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0a00/0x48868a4e4394a573 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.380385:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0a00/0x48868a4e4394a573 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.380394:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0a00/0x48868a4e4394a573 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.380403:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1600/0x48868a4e4394a57a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.380408:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1600/0x48868a4e4394a57a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.380412:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1600/0x48868a4e4394a57a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.380501:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1000/0x48868a4e4394a581 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.380509:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1000/0x48868a4e4394a581 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.380514:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1000/0x48868a4e4394a581 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129757.380521:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129757.380581:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0a00/0x48868a4e4394a573 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.380587:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0a00/0x48868a4e4394a573 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.380595:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0a00/0x48868a4e4394a573 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.380600:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b7f0a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129757.380603:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0a00/0x48868a4e4394a573 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.380608:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0a00/0x48868a4e4394a573 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.380618:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129757.380621:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129757.380624:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0a00/0x48868a4e4394a573 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.380628:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0a00/0x48868a4e4394a573 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.380657:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1600/0x48868a4e4394a57a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.380663:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1600/0x48868a4e4394a57a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.380667:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1600/0x48868a4e4394a57a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.380671:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b7f1600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129757.380673:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1600/0x48868a4e4394a57a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.380678:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1600/0x48868a4e4394a57a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.380687:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009baa2600) 00010000:00010000:3.0:1746129757.380689:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129757.380691:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1600/0x48868a4e4394a57a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.380695:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1600/0x48868a4e4394a57a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.380725:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0200/0x48868a4e4394a56c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff26 expref: 20 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.380735:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1000/0x48868a4e4394a581 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff26 expref: 19 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.380740:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129757.380742:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129757.380744:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b7f1000, rc 0) 00000100:00100000:3.0:1746129757.380775:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:28786:x1830949052350208:12345-192.168.204.31@tcp:101:cat.0 Request processed in 519us (725us total) trans 8589943770 rc 0/0 00000100:00100000:3.0:1746129757.380780:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9968 00000100:00100000:2.0:1746129757.387268:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.388576:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.388656:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052350336 00000100:00100000:1.0:1746129757.388665:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052350336 00010000:00010000:1.0:1746129757.388695:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a0e800/0x48868a4e4394a3ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe2a expref: 24 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746129757.388723:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052350592 00000100:00100000:3.0:1746129757.388727:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052350592 00000100:00100000:1.0:1746129757.388728:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5460 00000100:00100000:1.0:1746129757.388736:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1962:x1830949052350336:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129757.388754:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129757.388763:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3938 00000100:00100000:3.0:1746129757.388769:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:28786:x1830949052350592:12345-192.168.204.31@tcp:35:cat.0 00010000:00010000:1.0:1746129757.388771:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a0e800/0x48868a4e4394a3ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe2a expref: 24 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.388783:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a0e800/0x48868a4e4394a3ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe2a expref: 24 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.388801:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a0e800/0x48868a4e4394a3ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe2a expref: 24 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.388819:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.388821:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.388827:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04000/0x48868a4e4394a565 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff1f expref: 36 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.388835:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04000/0x48868a4e4394a565 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff1f expref: 36 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.388879:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04000/0x48868a4e4394a565 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff1f expref: 36 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129757.388892:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053368064:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129757.388947:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:28786:x1830949052350592:12345-192.168.204.31@tcp:35:cat.0 Request processed in 177us (373us total) trans 8589943771 rc 0/0 00000100:00100000:3.0:1746129757.388952:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3938 00000100:00100000:1.0:1746129757.388956:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d5106c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129757.391013:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053368064:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129757.391030:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129757.391074:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1962:x1830949052350336:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2338us (3812us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129757.391083:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5460 00000100:00100000:0.0:1746129757.394803:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.394882:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.394950:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052350848 00000100:00100000:1.0:1746129757.394958:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052350848 00000100:00100000:1.0:1746129757.394990:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052350720 00000100:00100000:1.0:1746129757.394992:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052350720 00000100:00100000:1.0:1746129757.395019:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11333 00000100:00100000:1.0:1746129757.395027:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1964:x1830949052350848:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129757.395043:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129757.395057:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e4394a58f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ff34 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.395077:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.395078:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.395086:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e4394a58f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff34 expref: 24 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.395099:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e4394a58f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff34 expref: 24 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.395109:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:1.0:1746129757.395148:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1964:x1830949052350848:12345-192.168.204.31@tcp:101:cat.0 Request processed in 122us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129757.395154:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11333 00000100:00100000:1.0:1746129757.395168:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11334 00000100:00100000:1.0:1746129757.395172:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1964:x1830949052350720:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129757.395179:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129757.395188:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394a596 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ff2d expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129757.395223:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053368192:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129757.395277:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d5106c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129757.396362:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.396410:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052351104 00000100:00100000:2.0:1746129757.396414:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052351104 00002000:00100000:2.0:1746129757.396442:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880136886a00 x1830949052351104/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.396450:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136886a00 with x1830949052351104 ext(1048576->2097151) 00002000:00010000:2.0:1746129757.396453:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136886a00 00000100:00100000:2.0:1746129757.396480:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4259 00000100:00100000:2.0:1746129757.396485:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1962:x1830949052351104:12345-192.168.204.31@tcp:3:multiop.0 00002000:00010000:1.0:1746129757.398760:0:8436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime: 1746129757 -> 1746129758 00002000:00010000:1.0:1746129757.398766:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime: 1746129757 -> 1746129758 00002000:00010000:1.0:1746129757.398768:0:8436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime: 1746129757 -> 1746129758 00000100:00100000:1.0:1746129757.398787:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053368192:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129757.398812:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394a596 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff2d expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.398825:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394a596 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff2d expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.398865:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:1.0:1746129757.398974:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1964:x1830949052350720:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3799us (4090us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129757.398981:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11334 00000100:00100000:2.0:1746129757.405598:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.405652:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052351232 00000100:00100000:1.0:1746129757.405659:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052351232 00000100:00100000:1.0:1746129757.405704:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11335 00000100:00100000:1.0:1746129757.405713:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:28786:x1830949052351232:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129757.405732:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129757.405749:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394a59d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ff3b expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.405779:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a550 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1646591) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff11 expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.405786:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129757.405787:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129757.405790:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394a59d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff3b expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.405818:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a550 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1646591) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff11 expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.405828:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a550 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1646591) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff11 expref: 18 pid: 1877 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746129757.405839:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053368320:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129757.405950:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d5106c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129757.411561:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053368320:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129757.411565:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129757.411586:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394a59d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff3b expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.411602:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:1.0:1746129757.411644:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28786:x1830949052351232:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5932us (6054us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129757.411652:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11335 00000100:00100000:3.0:1746129757.412104:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052351360 00000100:00100000:3.0:1746129757.412111:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052351360 00002000:00100000:3.0:1746129757.412143:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1396736->1646591) req@ffff880136886d80 x1830949052351360/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.412152:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136886d80 with x1830949052351360 ext(1396736->1646591) 00010000:00010000:3.0:1746129757.412158:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a550 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff11 expref: 19 pid: 1877 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.412169:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a550 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff11 expref: 19 pid: 1877 timeout: 803 lvb_type: 0 00002000:00010000:3.0:1746129757.412176:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136886d80 00000100:00100000:3.0:1746129757.412201:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 648 00000100:00100000:3.0:1746129757.412207:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949052351360:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:2.0:1746129757.412238:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1962:x1830949052351104:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 15750us (15876us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129757.412245:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4259 00002000:00100000:2.0:1746129757.412251:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880136886a00 x1830949052351104/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.412258:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136886a00 with x1830949052351104 ext(1048576->2097151) 00002000:00010000:2.0:1746129757.412262:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136886a00 00000100:00100000:0.0:1746129757.421239:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.421664:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052351488 00000100:00100000:1.0:1746129757.421672:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052351488 00000100:00100000:1.0:1746129757.421720:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11336 00000100:00100000:1.0:1746129757.421729:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:28778:x1830949052351488:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129757.421743:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129757.421757:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5216e00/0x48868a4e4394a5a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ff42 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.421781:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a469 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3223552->3567615) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe85 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.421787:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129757.421789:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129757.421792:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5216e00/0x48868a4e4394a5a4 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff42 expref: 38 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.421817:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a469 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3223552->3567615) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe85 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.421826:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a469 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3223552->3567615) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe85 expref: 23 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746129757.421836:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053368448:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129757.425433:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052351360:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 13216us (13859us total) trans 21474840386 rc 0/0 00000100:00100000:3.0:1746129757.425445:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 648 00000100:00100000:1.0:1746129757.425445:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d5106c0 going to sleep for 11 seconds 00002000:00100000:3.0:1746129757.425456:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1396736->1646591) req@ffff880136886d80 x1830949052351360/t21474840386(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/448 e 0 to 0 dl 1746129768 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.425466:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136886d80 with x1830949052351360 ext(1396736->1646591) 00010000:00010000:3.0:1746129757.425475:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a550 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff11 expref: 21 pid: 1877 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.425488:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a550 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff11 expref: 21 pid: 1877 timeout: 803 lvb_type: 0 00002000:00010000:3.0:1746129757.425501:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136886d80 00000100:00100000:1.0:1746129757.429452:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053368448:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129757.429462:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129757.429475:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5216e00/0x48868a4e4394a5a4 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff42 expref: 38 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.429496:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5216e00, rc 0) 00000100:00100000:1.0:1746129757.429530:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:28778:x1830949052351488:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7802us (8299us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129757.429538:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11336 00000100:00100000:0.0:1746129757.429541:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.429567:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052351744 00000100:00100000:1.0:1746129757.429571:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052351744 00010000:00010000:1.0:1746129757.429587:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a550 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff11 expref: 21 pid: 1877 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746129757.429618:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5461 00000100:00100000:1.0:1746129757.429623:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052351744:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129757.429632:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129757.429648:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a550 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1396736->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff11 expref: 21 pid: 1877 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.430307:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a550 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1396736->1646591) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff11 expref: 21 pid: 1877 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.430326:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b7f0600/0x48868a4e4394a550 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1396736->1646591) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff11 expref: 21 pid: 1877 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746129757.430338:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052351616 00000100:00100000:3.0:1746129757.430342:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052351616 00010000:00010000:1.0:1746129757.430461:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.430463:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.430503:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394a59d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff3b expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746129757.430936:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3223552->3567615) req@ffff88009476b800 x1830949052351616/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.430945:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476b800 with x1830949052351616 ext(3223552->3567615) 00010000:00010000:3.0:1746129757.430952:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a469 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3223552->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe85 expref: 24 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.430962:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a469 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3223552->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe85 expref: 24 pid: 8436 timeout: 803 lvb_type: 0 00002000:00010000:3.0:1746129757.430968:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009476b800 00000100:00100000:3.0:1746129757.430991:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 649 00000100:00100000:3.0:1746129757.430997:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+24:1961:x1830949052351616:12345-192.168.204.31@tcp:4:cat.0 00010000:00010000:1.0:1746129757.431953:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394a59d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff3b expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.431985:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394a59d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff3b expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129757.431995:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053368576:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129757.432202:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d5106c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129757.435129:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053368576:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129757.435144:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129757.435183:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949052351744:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5558us (5641us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129757.435193:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5461 00000100:00100000:3.0:1746129757.440477:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1961:x1830949052351616:12345-192.168.204.31@tcp:4:cat.0 Request processed in 9473us (11008us total) trans 17179873250 rc 0/0 00000100:00100000:3.0:1746129757.440489:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 649 00002000:00100000:3.0:1746129757.440499:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3223552->3567615) req@ffff88009476b800 x1830949052351616/t17179873250(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/448 e 0 to 0 dl 1746129768 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.440508:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476b800 with x1830949052351616 ext(3223552->3567615) 00010000:00010000:3.0:1746129757.440516:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a469 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3223552->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe85 expref: 26 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.440534:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a469 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3223552->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe85 expref: 26 pid: 8436 timeout: 803 lvb_type: 0 00002000:00010000:3.0:1746129757.440541:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009476b800 00000100:00100000:0.0:1746129757.441318:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.441720:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052352000 00000100:00100000:3.0:1746129757.441727:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052352000 00002000:00100000:3.0:1746129757.441755:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880094769880 x1830949052352000/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.441763:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769880 with x1830949052352000 ext(1048576->2097151) 00002000:00010000:3.0:1746129757.441766:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094769880 00000100:00100000:0.0:1746129757.441780:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.441834:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052352256 00000100:00100000:3.0:1746129757.441837:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052352256 00002000:00100000:3.0:1746129757.441863:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009476ad80 x1830949052352256/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.441870:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476ad80 with x1830949052352256 ext(1048576->2097151) 00002000:00010000:3.0:1746129757.441873:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009476ad80 00000100:00100000:2.0:1746129757.441877:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4260 00000100:00100000:2.0:1746129757.441889:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052352000:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129757.441897:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4261 00000100:00100000:3.0:1746129757.441901:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1961:x1830949052352256:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129757.450524:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.450683:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052352384 00000100:00100000:2.0:1746129757.450692:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052352384 00010000:00010000:2.0:1746129757.450724:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a469 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3223552->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe85 expref: 28 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746129757.450760:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5462 00000100:00100000:2.0:1746129757.450768:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+28:1964:x1830949052352384:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129757.450780:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129757.450796:0:16449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129757 -> 1746129758 00010000:00010000:2.0:1746129757.450801:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a469 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3223552->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe85 expref: 28 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.450813:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a469 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3223552->3567615) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe85 expref: 28 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.450834:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a469 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3223552->3567615) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe85 expref: 28 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.450865:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129757.450867:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129757.450873:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5216e00/0x48868a4e4394a5a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff42 expref: 37 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.450881:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5216e00/0x48868a4e4394a5a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff42 expref: 37 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.450917:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5216e00/0x48868a4e4394a5a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff42 expref: 37 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129757.450928:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053368704:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129757.451006:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1180 going to sleep for 11 seconds 00000100:00100000:3.0:1746129757.451483:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1961:x1830949052352256:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9579us (9701us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129757.451491:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4261 00002000:00100000:3.0:1746129757.451498:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009476ad80 x1830949052352256/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.451518:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476ad80 with x1830949052352256 ext(1048576->2097151) 00002000:00010000:3.0:1746129757.451522:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009476ad80 00000100:00100000:2.0:1746129757.453755:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053368704:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129757.453776:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129757.453820:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:1964:x1830949052352384:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3051us (3303us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129757.453828:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5462 00000100:00100000:3.0:1746129757.454193:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052352000:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12304us (12875us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129757.454199:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4260 00002000:00100000:3.0:1746129757.454206:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880094769880 x1830949052352000/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.454218:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769880 with x1830949052352000 ext(1048576->2097151) 00002000:00010000:3.0:1746129757.454223:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094769880 00000100:00100000:0.0:1746129757.461393:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.461433:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.461718:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052352640 00000100:00100000:3.0:1746129757.461727:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052352640 00000100:00100000:0.0:1746129757.461728:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:3.0:1746129757.461768:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880094768e00 x1830949052352640/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.461776:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094768e00 with x1830949052352640 ext(2097152->3145727) 00002000:00010000:3.0:1746129757.461781:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094768e00 00000100:00100000:3.0:1746129757.461923:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052352896 00000100:00100000:1.0:1746129757.461923:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052353024 00000100:00100000:3.0:1746129757.461926:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052352896 00000100:00100000:1.0:1746129757.461926:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052353024 00002000:00100000:3.0:1746129757.461937:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009476aa00 x1830949052352896/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.461944:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476aa00 with x1830949052352896 ext(3145728->4194303) 00002000:00010000:3.0:1746129757.461946:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009476aa00 00000100:00100000:1.0:1746129757.461951:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11337 00000100:00100000:1.0:1746129757.461956:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:28786:x1830949052353024:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129757.461968:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129757.461982:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a5ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ff49 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.462000:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.462002:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.462007:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a5ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff49 expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.462019:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a5ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff49 expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.462026:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5217200, rc 0) 00000100:00100000:3.0:1746129757.462098:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4262 00000100:00100000:3.0:1746129757.462104:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1961:x1830949052352640:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129757.462106:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4263 00000100:00100000:2.0:1746129757.462111:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1962:x1830949052352896:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129757.462356:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:28786:x1830949052353024:12345-192.168.204.31@tcp:101:cat.0 Request processed in 398us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129757.462360:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11337 00000100:00100000:0.0:1746129757.477645:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.477750:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052353280 00000100:00100000:3.0:1746129757.477757:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052353280 00002000:00100000:3.0:1746129757.477789:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009476a680 x1830949052353280/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.477796:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476a680 with x1830949052353280 ext(2097152->3145727) 00002000:00010000:3.0:1746129757.477801:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009476a680 00000100:00100000:3.0:1746129757.477829:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4264 00000100:00100000:3.0:1746129757.477835:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1963:x1830949052353280:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129757.478139:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1962:x1830949052352896:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16027us (16704us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129757.478144:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4263 00002000:00100000:0.0:1746129757.478150:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009476aa00 x1830949052352896/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129757.478156:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476aa00 with x1830949052352896 ext(3145728->4194303) 00002000:00010000:0.0:1746129757.478159:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009476aa00 00000100:00100000:2.0:1746129757.478415:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1961:x1830949052352640:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16310us (17029us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129757.478420:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4262 00002000:00100000:2.0:1746129757.478425:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880094768e00 x1830949052352640/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.478430:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094768e00 with x1830949052352640 ext(2097152->3145727) 00002000:00010000:2.0:1746129757.478433:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094768e00 00000100:00100000:2.0:1746129757.479106:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.480938:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052353536 00000100:00100000:1.0:1746129757.480947:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052353536 00002000:00100000:1.0:1746129757.480980:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800a00c6300 x1830949052353536/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129757.480988:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c6300 with x1830949052353536 ext(3145728->4194303) 00002000:00010000:1.0:1746129757.480992:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a00c6300 00000100:00100000:1.0:1746129757.481019:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4265 00000100:00100000:1.0:1746129757.481026:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+28:1963:x1830949052353536:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129757.485130:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+28:1963:x1830949052353280:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7286us (7483us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129757.485141:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4264 00002000:00100000:3.0:1746129757.485151:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009476a680 x1830949052353280/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.485159:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476a680 with x1830949052353280 ext(2097152->3145727) 00002000:00010000:3.0:1746129757.485164:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009476a680 00000100:00100000:0.0:1746129757.489123:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.489399:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052353664 00000100:00100000:1.0:1746129757.489407:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052353664 00000100:00100000:1.0:1746129757.489445:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11338 00000100:00100000:1.0:1746129757.489452:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1963:x1830949052353664:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129757.489466:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129757.489480:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b96ba00/0x48868a4e4394a5b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ff50 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.489499:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.489501:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.489508:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b96ba00/0x48868a4e4394a5b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff50 expref: 21 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.489521:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b96ba00/0x48868a4e4394a5b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff50 expref: 21 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.489530:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b96ba00, rc 0) 00000100:00100000:1.0:1746129757.490584:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949052353664:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1129us (1466us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129757.490590:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11338 00000100:00100000:1.0:1746129757.493722:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.493748:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052353920 00000100:00100000:2.0:1746129757.493758:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052353920 00000100:00100000:2.0:1746129757.493802:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9969 00000100:00100000:2.0:1746129757.493810:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:28789:x1830949052353920:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129757.493829:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129757.493844:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05400/0x48868a4e4394a5b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ff57 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.493936:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394a5c0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.493948:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1000/0x48868a4e4394a581 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff26 expref: 21 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.493954:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394a5c0 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.493977:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1000/0x48868a4e4394a581 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff26 expref: 21 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.493988:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1000/0x48868a4e4394a581 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff26 expref: 21 pid: 14315 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746129757.493998:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053368832:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129757.494066:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129757.494452:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1963:x1830949052353536:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13425us (15346us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129757.494464:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4265 00002000:00100000:0.0:1746129757.494471:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800a00c6300 x1830949052353536/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129757.494480:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c6300 with x1830949052353536 ext(3145728->4194303) 00002000:00010000:0.0:1746129757.494484:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a00c6300 00000100:00100000:0.0:1746129757.496902:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.497536:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052354176 00000100:00100000:2.0:1746129757.497546:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052354176 00000100:00100000:0.0:1746129757.497891:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.497943:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053368832:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129757.497962:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394a5c0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00002000:00100000:2.0:1746129757.498025:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009b00ea00 x1830949052354176/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.498034:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00ea00 with x1830949052354176 ext(4194304->4964351) 00002000:00010000:2.0:1746129757.498038:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00ea00 00000100:00100000:2.0:1746129757.498057:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4266 00000100:00100000:2.0:1746129757.498064:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1962:x1830949052354176:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129757.498912:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052354304 00000100:00100000:3.0:1746129757.498918:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052354304 00010000:00010000:3.0:1746129757.498939:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1000/0x48868a4e4394a581 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff26 expref: 22 pid: 14315 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746129757.498964:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5463 00000100:00100000:3.0:1746129757.498970:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949052354304:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129757.498978:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129757.498983:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1000/0x48868a4e4394a581 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff26 expref: 22 pid: 14315 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.498993:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1000/0x48868a4e4394a581 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff26 expref: 22 pid: 14315 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.499010:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f1000/0x48868a4e4394a581 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff26 expref: 22 pid: 14315 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.499043:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129757.499047:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394a5c0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129757.499055:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394a5c0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129757.499061:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394a5c0 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129757.499078:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129757.499086:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394a5c0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.499092:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394a5c0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:3.0:1746129757.499103:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1961:x1830949052354304:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 133us (1213us total) trans 0 rc 0/0 00000004:00200000:1.0:1746129757.499107:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000100:00100000:3.0:1746129757.499109:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5463 00010000:00010000:1.0:1746129757.499216:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05400/0x48868a4e4394a5b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff57 expref: 22 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.499249:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394a5c0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff57 expref: 21 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.499256:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129757.499258:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129757.499260:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e05c00, rc 0) 00000100:00100000:1.0:1746129757.499281:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:28789:x1830949052353920:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5472us (5567us total) trans 8589943772 rc 0/0 00000100:00100000:1.0:1746129757.499300:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9969 00000100:00100000:0.0:1746129757.501174:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.502589:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052354560 00000100:00100000:3.0:1746129757.502599:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052354560 00002000:00100000:3.0:1746129757.502810:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009b00f100 x1830949052354560/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.502831:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00f100 with x1830949052354560 ext(4194304->4964351) 00002000:00010000:3.0:1746129757.502836:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00f100 00000100:00100000:3.0:1746129757.502884:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4267 00000100:00100000:3.0:1746129757.502893:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1964:x1830949052354560:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129757.503915:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1962:x1830949052354176:12345-192.168.204.31@tcp:3:cat.0 Request processed in 5848us (7017us total) trans 0 rc 770048/770048 00000100:00100000:2.0:1746129757.503922:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4266 00002000:00100000:2.0:1746129757.503928:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009b00ea00 x1830949052354176/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.503935:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00ea00 with x1830949052354176 ext(4194304->4964351) 00002000:00010000:2.0:1746129757.503939:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00ea00 00000100:00100000:0.0:1746129757.508453:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.508538:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052354816 00000100:00100000:1.0:1746129757.508546:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052354816 00000100:00100000:1.0:1746129757.508595:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9970 00000100:00100000:1.0:1746129757.508603:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:28791:x1830949052354816:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129757.508622:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129757.508637:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b800/0x48868a4e4394a5ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ff5e expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.508724:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b600/0x48868a4e4394a5d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.508734:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b600/0x48868a4e4394a5d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.508743:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b600/0x48868a4e4394a5d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.508754:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b400/0x48868a4e4394a5dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.508759:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b400/0x48868a4e4394a5dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.508764:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b400/0x48868a4e4394a5dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.508875:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b200/0x48868a4e4394a5e3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.508883:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b200/0x48868a4e4394a5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.508889:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b200/0x48868a4e4394a5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:1.0:1746129757.508896:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129757.508961:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b600/0x48868a4e4394a5d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.508967:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b600/0x48868a4e4394a5d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.508972:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b600/0x48868a4e4394a5d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.508977:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b96b600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129757.508981:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b600/0x48868a4e4394a5d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.508986:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b600/0x48868a4e4394a5d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.508996:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129757.508998:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129757.509001:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b600/0x48868a4e4394a5d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.509006:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b600/0x48868a4e4394a5d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.509029:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b400/0x48868a4e4394a5dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.509034:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b400/0x48868a4e4394a5dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.509042:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b400/0x48868a4e4394a5dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.509046:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b96b400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129757.509048:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b400/0x48868a4e4394a5dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.509052:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b400/0x48868a4e4394a5dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.509057:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e8c7700) 00010000:00010000:1.0:1746129757.509059:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129757.509061:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b400/0x48868a4e4394a5dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.509065:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b400/0x48868a4e4394a5dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.509093:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b800/0x48868a4e4394a5ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff5e expref: 298 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.509102:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b200/0x48868a4e4394a5e3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff5e expref: 297 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.509108:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129757.509110:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129757.509112:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b96b200, rc 0) 00000100:00100000:1.0:1746129757.509157:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:28791:x1830949052354816:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 555us (711us total) trans 8589943773 rc 0/0 00000100:00100000:1.0:1746129757.509163:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9970 00000100:00100000:2.0:1746129757.511213:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1964:x1830949052354560:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8315us (10038us total) trans 0 rc 770048/770048 00000100:00100000:2.0:1746129757.511223:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4267 00002000:00100000:2.0:1746129757.511233:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009b00f100 x1830949052354560/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.511240:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00f100 with x1830949052354560 ext(4194304->4964351) 00002000:00010000:2.0:1746129757.511245:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00f100 00000100:00100000:0.0:1746129757.518149:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.518189:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.518273:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.518306:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052355328 00000100:00100000:0.0:1746129757.518313:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052355328 00000100:00100000:0.0:1746129757.518369:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 583 00000100:00100000:0.0:1746129757.518377:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:1962:x1830949052355328:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129757.518389:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129757.518410:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b200/0x48868a4e4394a5e3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff5e expref: 297 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.518429:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129757.518433:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129757.518465:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:1962:x1830949052355328:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 89us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129757.518471:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 583 00000100:00100000:2.0:1746129757.518554:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052355072 00000100:00100000:2.0:1746129757.518558:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052355072 00000100:00100000:2.0:1746129757.518591:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3939 00000100:00100000:2.0:1746129757.518596:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50eb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:28778:x1830949052355072:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129757.518735:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50eb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:28778:x1830949052355072:12345-192.168.204.31@tcp:35:cat.0 Request processed in 138us (594us total) trans 8589943774 rc 0/0 00000100:00100000:2.0:1746129757.518740:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3939 00000100:00100000:1.0:1746129757.518906:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052355200 00000100:00100000:1.0:1746129757.518910:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052355200 00000100:00100000:1.0:1746129757.518937:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11339 00000100:00100000:1.0:1746129757.518941:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:28791:x1830949052355200:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129757.518950:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129757.518961:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b96b000/0x48868a4e4394a5f1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ff65 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.518978:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5216e00/0x48868a4e4394a5a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff42 expref: 39 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.518986:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a5ab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff49 expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.518991:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.518992:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.518995:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b96b000/0x48868a4e4394a5f1 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2732032->2994175] (req 2732032->2994175) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff65 expref: 39 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.519020:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a5ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff49 expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.519030:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a5ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff49 expref: 25 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746129757.519046:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053368960:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129757.519997:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5216e00/0x48868a4e4394a5a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff42 expref: 39 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.520006:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b5216e00/0x48868a4e4394a5a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff42 expref: 39 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746129757.520014:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053369088:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129757.520068:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d5106c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129757.522448:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053368960:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129757.522458:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053369088:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129757.522481:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b96b000/0x48868a4e4394a5f1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2732032->2994175] (req 2732032->2994175) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff65 expref: 39 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.522495:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b96b000, rc 0) 00000100:00100000:1.0:1746129757.522536:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:28791:x1830949052355200:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3593us (4346us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129757.522544:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11339 00000100:00100000:0.0:1746129757.526471:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.526671:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052355456 00000100:00100000:3.0:1746129757.526677:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052355456 00010000:00010000:3.0:1746129757.526705:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a5ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff49 expref: 26 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746129757.526743:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5464 00000100:00100000:3.0:1746129757.526750:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1961:x1830949052355456:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129757.526762:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129757.526781:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a5ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff49 expref: 26 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.526791:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a5ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff49 expref: 26 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.526807:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a5ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff49 expref: 26 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.526837:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129757.527141:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:1961:x1830949052355456:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 387us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129757.527148:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5464 00000100:00100000:0.0:1746129757.529175:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.529337:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052355584 00000100:00100000:3.0:1746129757.529343:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052355584 00010000:00010000:3.0:1746129757.529368:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5216e00/0x48868a4e4394a5a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff42 expref: 39 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746129757.529401:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5465 00000100:00100000:3.0:1746129757.529408:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1961:x1830949052355584:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129757.529418:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129757.529436:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b5216e00/0x48868a4e4394a5a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff42 expref: 39 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.529447:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b5216e00/0x48868a4e4394a5a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff42 expref: 39 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.529463:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5216e00/0x48868a4e4394a5a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff42 expref: 39 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.529475:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129757.529477:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129757.529482:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b96b000/0x48868a4e4394a5f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->2994175) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff65 expref: 38 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.529489:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b96b000/0x48868a4e4394a5f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->2994175) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff65 expref: 38 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.529515:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b96b000/0x48868a4e4394a5f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->2994175) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff65 expref: 38 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129757.529530:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130507100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053369216:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129757.529609:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129757.531690:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.531747:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052355712 00000100:00100000:1.0:1746129757.531753:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052355712 00000100:00100000:1.0:1746129757.531795:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11340 00000100:00100000:1.0:1746129757.531802:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:28789:x1830949052355712:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129757.531816:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129757.531829:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b96a800/0x48868a4e4394a5f8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ff6c expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.531874:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b96b000/0x48868a4e4394a5f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2732032->2994175) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff65 expref: 38 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.531886:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129757.531888:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129757.531891:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b96a800/0x48868a4e4394a5f8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3579904->4018175] (req 3579904->4018175) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff6c expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.531913:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b96b000/0x48868a4e4394a5f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2732032->2994175) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff65 expref: 38 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.531923:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b96b000/0x48868a4e4394a5f1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2732032->2994175) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff65 expref: 38 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746129757.531933:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053369344:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129757.532360:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.532632:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d5106c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129757.532706:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052355968 00000100:00100000:2.0:1746129757.532710:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052355968 00000100:00100000:3.0:1746129757.532715:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130507100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053369216:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129757.532726:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746129757.532734:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2732032->2736127) req@ffff88009b00ca80 x1830949052355968/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.532741:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00ca80 with x1830949052355968 ext(2732032->2736127) 00010000:00010000:2.0:1746129757.532747:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b96b000/0x48868a4e4394a5f1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->2994175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff65 expref: 39 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746129757.532753:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1961:x1830949052355584:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3345us (3584us total) trans 0 rc 0/0 00010000:00010000:2.0:1746129757.532757:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b96b000/0x48868a4e4394a5f1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->2994175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff65 expref: 39 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746129757.532761:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5465 00002000:00010000:2.0:1746129757.532762:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b00ca80 00000100:00100000:2.0:1746129757.532775:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 650 00000100:00100000:2.0:1746129757.532780:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1963:x1830949052355968:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129757.533103:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053369344:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129757.533119:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b96a800/0x48868a4e4394a5f8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3579904->4018175] (req 3579904->4018175) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff6c expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.533127:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b96a800, rc 0) 00000100:00100000:1.0:1746129757.533146:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:28789:x1830949052355712:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1345us (1462us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129757.533151:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11340 00000100:00100000:2.0:1746129757.533465:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1963:x1830949052355968:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 684us (1105us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129757.533470:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 650 00002000:00100000:2.0:1746129757.533475:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2732032->2736127) req@ffff88009b00ca80 x1830949052355968/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/4536 e 0 to 0 dl 1746129768 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.533482:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00ca80 with x1830949052355968 ext(2732032->2736127) 00010000:00010000:2.0:1746129757.533486:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b96b000/0x48868a4e4394a5f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->2994175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff65 expref: 38 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.533495:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b96b000/0x48868a4e4394a5f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->2994175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff65 expref: 38 pid: 8436 timeout: 803 lvb_type: 0 00002000:00010000:2.0:1746129757.533500:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b00ca80 00000100:00100000:0.0:1746129757.536018:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.536148:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052356224 00000100:00100000:2.0:1746129757.536153:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052356224 00002000:00100000:2.0:1746129757.536183:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2990080->2994175) req@ffff88009b00d180 x1830949052356224/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.536190:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00d180 with x1830949052356224 ext(2990080->2994175) 00010000:00010000:2.0:1746129757.536197:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b96b000/0x48868a4e4394a5f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->2994175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff65 expref: 38 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.536406:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b96b000/0x48868a4e4394a5f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->2994175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff65 expref: 38 pid: 8436 timeout: 803 lvb_type: 0 00002000:00010000:2.0:1746129757.536413:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b00d180 00000100:00100000:2.0:1746129757.536435:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 651 00000100:00100000:2.0:1746129757.536441:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1964:x1830949052356224:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129757.536559:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1964:x1830949052356224:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 118us (547us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129757.536564:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 651 00002000:00100000:2.0:1746129757.536568:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2990080->2994175) req@ffff88009b00d180 x1830949052356224/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/4536 e 0 to 0 dl 1746129768 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.536574:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00d180 with x1830949052356224 ext(2990080->2994175) 00010000:00010000:2.0:1746129757.536578:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b96b000/0x48868a4e4394a5f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->2994175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff65 expref: 38 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.536586:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b96b000/0x48868a4e4394a5f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->2994175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff65 expref: 38 pid: 8436 timeout: 803 lvb_type: 0 00002000:00010000:2.0:1746129757.536596:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b00d180 00000100:00100000:0.0:1746129757.539239:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.539286:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.539477:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052356480 00000100:00100000:2.0:1746129757.539484:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052356480 00002000:00100000:2.0:1746129757.539516:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2732032->2994175) req@ffff88012c043800 x1830949052356480/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.539524:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c043800 with x1830949052356480 ext(2732032->2994175) 00010000:00010000:2.0:1746129757.539530:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b96b000/0x48868a4e4394a5f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->2994175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff65 expref: 38 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.539540:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b96b000/0x48868a4e4394a5f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->2994175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff65 expref: 38 pid: 8436 timeout: 803 lvb_type: 0 00002000:00010000:2.0:1746129757.539546:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c043800 00000100:00100000:2.0:1746129757.539564:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 652 00000100:00100000:2.0:1746129757.539570:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1961:x1830949052356480:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:3.0:1746129757.540487:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052356736 00000100:00100000:3.0:1746129757.540493:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052356736 00000100:00100000:3.0:1746129757.540518:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3940 00000100:00100000:3.0:1746129757.540523:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:28791:x1830949052356736:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129757.540700:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:28791:x1830949052356736:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 175us (1412us total) trans 8589943775 rc 0/0 00000100:00100000:3.0:1746129757.540706:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3940 00000100:00100000:2.0:1746129757.542665:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1961:x1830949052356480:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 3088us (3427us total) trans 17179873251 rc 0/0 00000100:00100000:2.0:1746129757.542674:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 652 00002000:00100000:2.0:1746129757.542682:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2732032->2994175) req@ffff88012c043800 x1830949052356480/t17179873251(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/448 e 0 to 0 dl 1746129768 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.542691:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c043800 with x1830949052356480 ext(2732032->2994175) 00010000:00010000:2.0:1746129757.542699:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b96b000/0x48868a4e4394a5f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->2994175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff65 expref: 40 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.542715:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b96b000/0x48868a4e4394a5f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->2994175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff65 expref: 40 pid: 8436 timeout: 803 lvb_type: 0 00002000:00010000:2.0:1746129757.542721:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c043800 00000100:00100000:0.0:1746129757.545565:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.545640:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052356864 00000100:00100000:3.0:1746129757.545647:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052356864 00010000:00010000:3.0:1746129757.545673:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b96b000/0x48868a4e4394a5f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->2994175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff65 expref: 40 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746129757.545695:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5466 00000100:00100000:3.0:1746129757.545701:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1963:x1830949052356864:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129757.545712:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746129757.545725:0:16449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129757 -> 1746129758 00010000:00010000:3.0:1746129757.545730:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b96b000/0x48868a4e4394a5f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2732032->2994175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff65 expref: 40 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.545740:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b96b000/0x48868a4e4394a5f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2732032->2994175) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff65 expref: 40 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.545758:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b96b000/0x48868a4e4394a5f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2732032->2994175) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff65 expref: 40 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.545785:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129757.545787:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129757.545792:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b96a800/0x48868a4e4394a5f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3579904->4018175) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff6c expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.545799:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b96a800/0x48868a4e4394a5f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3579904->4018175) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff6c expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.545824:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b96a800/0x48868a4e4394a5f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3579904->4018175) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff6c expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129757.545833:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130507100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053369472:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129757.545913:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28240 going to sleep for 11 seconds 00000100:00100000:3.0:1746129757.551229:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130507100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053369472:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129757.551287:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129757.551330:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1963:x1830949052356864:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5627us (5770us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129757.551339:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5466 00000100:00100000:0.0:1746129757.551533:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.551743:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052357120 00000100:00100000:3.0:1746129757.551748:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052357120 00002000:00100000:3.0:1746129757.551781:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3579904->3583999) req@ffff88012c042300 x1830949052357120/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.551787:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c042300 with x1830949052357120 ext(3579904->3583999) 00002000:00010000:3.0:1746129757.551791:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c042300 00000100:00100000:3.0:1746129757.551803:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4268 00000100:00100000:3.0:1746129757.551809:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1961:x1830949052357120:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129757.552273:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1961:x1830949052357120:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 462us (739us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129757.552279:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4268 00002000:00100000:3.0:1746129757.552284:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3579904->3583999) req@ffff88012c042300 x1830949052357120/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/4536 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.552297:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c042300 with x1830949052357120 ext(3579904->3583999) 00002000:00010000:3.0:1746129757.552300:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c042300 00000100:00100000:0.0:1746129757.557103:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.557203:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052357376 00000100:00100000:2.0:1746129757.557211:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052357376 00002000:00100000:2.0:1746129757.557244:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4014080->4018175) req@ffff88012c043480 x1830949052357376/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.557252:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c043480 with x1830949052357376 ext(4014080->4018175) 00002000:00010000:2.0:1746129757.557256:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c043480 00000100:00100000:2.0:1746129757.557280:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4269 00000100:00100000:2.0:1746129757.557285:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1963:x1830949052357376:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129757.557423:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1963:x1830949052357376:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 136us (326us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129757.557428:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4269 00002000:00100000:2.0:1746129757.557434:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4014080->4018175) req@ffff88012c043480 x1830949052357376/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/4536 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.557440:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c043480 with x1830949052357376 ext(4014080->4018175) 00002000:00010000:2.0:1746129757.557442:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c043480 00000100:00100000:0.0:1746129757.564606:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.564701:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052357504 00000100:00100000:1.0:1746129757.564708:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052357504 00000100:00100000:1.0:1746129757.564757:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9971 00000100:00100000:1.0:1746129757.564764:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+10:28795:x1830949052357504:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129757.564784:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129757.564798:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a200/0x48868a4e4394a5ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ff73 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.564872:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a000/0x48868a4e4394a606 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.564882:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a000/0x48868a4e4394a606 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.564891:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a000/0x48868a4e4394a606 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.564900:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b000/0x48868a4e4394a60d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.564905:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b000/0x48868a4e4394a60d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.564909:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b000/0x48868a4e4394a60d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.564997:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a614 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.565005:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394a5c0 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff57 expref: 20 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.565010:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a614 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.565033:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394a5c0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff57 expref: 20 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.565046:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394a5c0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff57 expref: 20 pid: 16808 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746129757.565055:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053369600:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129757.566234:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d5106c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129757.570575:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053369600:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129757.570600:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a614 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:0.0:1746129757.571183:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.571676:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052357760 00000100:00100000:2.0:1746129757.571682:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052357760 00000100:00100000:2.0:1746129757.571724:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3941 00000100:00100000:2.0:1746129757.571730:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:7659:x1830949052357760:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746129757.571945:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:7659:x1830949052357760:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 213us (762us total) trans 8589943776 rc 0/0 00000100:00100000:2.0:1746129757.571951:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3941 00000100:00100000:0.0:1746129757.574118:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.576317:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052357888 00000100:00100000:3.0:1746129757.576327:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052357888 00010000:00010000:3.0:1746129757.576359:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394a5c0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff57 expref: 22 pid: 16808 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746129757.576400:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5467 00000100:00100000:3.0:1746129757.576408:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052357888:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129757.576419:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129757.576424:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394a5c0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff57 expref: 22 pid: 16808 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.576438:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394a5c0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff57 expref: 22 pid: 16808 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.576456:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394a5c0 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff57 expref: 22 pid: 16808 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.576476:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129757.576480:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a614 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129757.576488:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a614 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129757.576493:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a614 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129757.576511:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129757.576547:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1962:x1830949052357888:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 141us (2435us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129757.576553:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5467 00010000:00010000:0.0:1746129757.576699:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a614 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.576705:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a614 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:0.0:1746129757.576737:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:0.0:1746129757.576741:0:16808:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129757.576754:0:16808:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a614 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.576761:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a614 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.576768:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a000/0x48868a4e4394a606 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.576773:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a000/0x48868a4e4394a606 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.576777:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a000/0x48868a4e4394a606 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.576782:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b96a000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129757.576785:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a000/0x48868a4e4394a606 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.576791:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a000/0x48868a4e4394a606 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.576798:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:0.0:1746129757.576800:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129757.576803:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a000/0x48868a4e4394a606 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.576806:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a000/0x48868a4e4394a606 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.577057:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b000/0x48868a4e4394a60d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.577063:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b000/0x48868a4e4394a60d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.577067:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b000/0x48868a4e4394a60d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.577071:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b96b000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129757.577073:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b000/0x48868a4e4394a60d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.577077:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b000/0x48868a4e4394a60d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.577083:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e8c7700) 00010000:00010000:0.0:1746129757.577085:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129757.577086:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b000/0x48868a4e4394a60d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.577093:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b000/0x48868a4e4394a60d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.577119:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a200/0x48868a4e4394a5ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff73 expref: 12 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.577128:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a614 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff73 expref: 11 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.577134:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129757.577135:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129757.577137:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b96aa00, rc 0) 00000100:00100000:1.0:1746129757.577463:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+11:28795:x1830949052357504:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 12698us (12864us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129757.577470:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9971 00000100:00100000:0.0:1746129757.580038:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.580071:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.580099:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.580164:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052358144 00000100:00100000:1.0:1746129757.580171:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052358144 00000100:00100000:1.0:1746129757.580198:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052358016 00000100:00100000:1.0:1746129757.580200:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052358016 00000100:00100000:1.0:1746129757.580209:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052358272 00000100:00100000:1.0:1746129757.580210:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052358272 00000100:00100000:1.0:1746129757.580221:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11341 00000100:00100000:1.0:1746129757.580227:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052358144:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129757.580243:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129757.580257:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b96bc00/0x48868a4e4394a61b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ff81 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.580275:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.580277:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.580284:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b96bc00/0x48868a4e4394a61b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff81 expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.580309:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b96bc00/0x48868a4e4394a61b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff81 expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.580318:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b96bc00, rc 0) 00000100:00100000:1.0:1746129757.580349:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949052358144:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 121us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129757.580354:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11341 00000100:00100000:1.0:1746129757.580370:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11342 00000100:00100000:1.0:1746129757.580374:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052358016:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129757.580380:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129757.580388:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b96a400/0x48868a4e4394a622 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ff7a expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.580397:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.580398:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.580401:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b96a400/0x48868a4e4394a622 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff7a expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.580410:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b96a400/0x48868a4e4394a622 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff7a expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.580415:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b96a400, rc 0) 00000100:00100000:1.0:1746129757.580429:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949052358016:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 55us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129757.580437:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11342 00000100:00100000:1.0:1746129757.580446:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11343 00000100:00100000:1.0:1746129757.580450:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052358272:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129757.580454:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129757.580459:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b96ac00/0x48868a4e4394a629 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ff88 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129757.580488:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053369728:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129757.580537:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d5106c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746129757.583780:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime: 1746129757 -> 1746129758 00000100:00100000:1.0:1746129757.583806:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053369728:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129757.583830:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b96ac00/0x48868a4e4394a629 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff88 expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.583843:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b96ac00/0x48868a4e4394a629 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff88 expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.584073:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b96ac00, rc 0) 00000100:00100000:1.0:1746129757.584247:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052358272:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 3794us (4144us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129757.584255:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11343 00000100:00100000:0.0:1746129757.586740:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.586814:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052358528 00000100:00100000:1.0:1746129757.586820:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052358528 00000100:00100000:1.0:1746129757.587382:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9972 00000100:00100000:1.0:1746129757.587390:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+11:28795:x1830949052358528:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129757.587405:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129757.587418:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b200/0x48868a4e4394a630 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ff8f expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.587490:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b800/0x48868a4e4394a637 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.587500:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a614 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff73 expref: 12 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.587506:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b800/0x48868a4e4394a637 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.587527:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a614 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff73 expref: 12 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.587536:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a614 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff73 expref: 12 pid: 16808 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746129757.587544:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053369856:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129757.587608:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d5106c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129757.591805:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053369856:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129757.591823:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b800/0x48868a4e4394a637 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:0.0:1746129757.595172:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.595239:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052358656 00000100:00100000:2.0:1746129757.595247:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052358656 00010000:00010000:2.0:1746129757.595277:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a614 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff73 expref: 13 pid: 16808 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746129757.595323:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5468 00000100:00100000:2.0:1746129757.595329:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949052358656:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129757.595340:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129757.595346:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a614 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff73 expref: 13 pid: 16808 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.595356:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a614 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff73 expref: 13 pid: 16808 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.595373:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a614 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff73 expref: 13 pid: 16808 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.595402:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129757.595406:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b800/0x48868a4e4394a637 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.595414:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b800/0x48868a4e4394a637 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.595420:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b800/0x48868a4e4394a637 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.595445:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129757.595713:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b800/0x48868a4e4394a637 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.595720:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b800/0x48868a4e4394a637 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:1.0:1746129757.595737:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000100:00100000:2.0:1746129757.595767:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949052358656:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 437us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129757.595774:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5468 00010000:00010000:1.0:1746129757.595868:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b200/0x48868a4e4394a630 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff8f expref: 13 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.596193:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b800/0x48868a4e4394a637 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff8f expref: 12 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.596200:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129757.596202:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129757.596204:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b96b800, rc 0) 00000100:00100000:1.0:1746129757.596636:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+12:28795:x1830949052358528:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 9245us (9900us total) trans 8589943777 rc 0/0 00000100:00100000:1.0:1746129757.596642:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9972 00000100:00100000:0.0:1746129757.598701:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.598818:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052358912 00000100:00100000:1.0:1746129757.598825:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052358912 00000100:00100000:1.0:1746129757.598877:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9973 00000100:00100000:1.0:1746129757.598884:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+12:28795:x1830949052358912:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129757.598902:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129757.598905:0:16808:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746129757.598923:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b800/0x48868a4e4394a637 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff8f expref: 12 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.598935:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129757.598938:0:16808:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129757.598948:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b600/0x48868a4e4394a645 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ff96 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.599022:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96be00/0x48868a4e4394a64c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.599030:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96be00/0x48868a4e4394a64c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.599037:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96be00/0x48868a4e4394a64c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:1.0:1746129757.599045:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129757.599126:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b600/0x48868a4e4394a645 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff96 expref: 14 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.599135:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96be00/0x48868a4e4394a64c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff96 expref: 13 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.599140:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129757.599142:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746129757.599144:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b96be00, rc 0) 00000100:00100000:1.0:1746129757.599186:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+13:28795:x1830949052358912:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 302us (490us total) trans 8589943778 rc 0/0 00000100:00100000:1.0:1746129757.599191:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9973 00000100:00100000:0.0:1746129757.601317:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.601351:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.601377:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.602567:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.602584:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.602622:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.602649:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052359168 00000100:00100000:0.0:1746129757.602655:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052359168 00000100:00100000:0.0:1746129757.602683:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052359424 00000100:00100000:0.0:1746129757.602684:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052359424 00000100:00100000:0.0:1746129757.602693:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052359680 00000100:00100000:0.0:1746129757.602695:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052359680 00000100:00100000:0.0:1746129757.602701:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052359040 00000100:00100000:0.0:1746129757.602703:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052359040 00000100:00100000:0.0:1746129757.602709:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052359296 00000100:00100000:0.0:1746129757.602710:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052359296 00000100:00100000:0.0:1746129757.603237:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052359552 00000100:00100000:0.0:1746129757.603240:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052359552 00000100:00100000:0.0:1746129757.603257:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11344 00000100:00100000:0.0:1746129757.603268:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+14:1963:x1830949052359168:12345-192.168.204.31@tcp:1:mirror_io.0 00000100:00100000:3.0:1746129757.603273:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11345 00000100:00100000:3.0:1746129757.603280:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+13:1963:x1830949052359424:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:3.0:1746129757.603308:0:20441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131819e00/0x48868a4e4394a661 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.603308:0:7976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04800/0x48868a4e4394a65a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.603323:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04000/0x48868a4e4394a565 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff1f expref: 38 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.603323:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e4394a312 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc8 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.603330:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c840600/0x48868a4e4394a4cb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fea8 expref: 14 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129757.603334:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b96bc00/0x48868a4e4394a61b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff81 expref: 13 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129757.603336:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b530ae00/0x48868a4e4394a366 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdf2 expref: 20 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129757.603340:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e4394a58f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff34 expref: 25 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129757.603341:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129757.603343:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129757.603344:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129757.603344:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129757.603345:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04800/0x48868a4e4394a65a lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.603346:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131819e00/0x48868a4e4394a661 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.603366:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e4394a58f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff34 expref: 25 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129757.603366:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b530ae00/0x48868a4e4394a366 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdf2 expref: 20 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129757.603376:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e4394a58f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff34 expref: 25 pid: 8436 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.603377:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b530ae00/0x48868a4e4394a366 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdf2 expref: 20 pid: 10930 timeout: 803 lvb_type: 1 00000100:00100000:3.0:1746129757.603386:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130507100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053370112:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129757.603386:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053369984:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129757.603445:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11346 00010000:00010000:0.0:1746129757.603450:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c840600/0x48868a4e4394a4cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fea8 expref: 14 pid: 4589 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129757.603455:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11347 00010000:00010000:0.0:1746129757.603457:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c840600/0x48868a4e4394a4cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fea8 expref: 14 pid: 4589 timeout: 803 lvb_type: 1 00000100:00100000:0.0:1746129757.603464:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053370240:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129757.603470:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+13:1963:x1830949052359040:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:1.0:1746129757.603484:0:1877:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b96ae00/0x48868a4e4394a668 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.603500:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135cab400/0x48868a4e4394a294 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd66 expref: 25 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.603506:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6200/0x48868a4e4394a4b6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fea1 expref: 13 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.603512:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800945ce400/0x48868a4e4394a2e1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd97 expref: 38 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.603517:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.603518:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.603520:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b96ae00/0x48868a4e4394a668 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.603532:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800945ce400/0x48868a4e4394a2e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd97 expref: 38 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.603539:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800945ce400/0x48868a4e4394a2e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd97 expref: 38 pid: 8437 timeout: 803 lvb_type: 1 00000100:00100000:1.0:1746129757.603545:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053370368:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129757.603596:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11348 00000100:00100000:2.0:1746129757.603604:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+14:1963:x1830949052359296:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:2.0:1746129757.603619:0:10930:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a6370c00/0x48868a4e4394a66f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.603629:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394a59d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff3b expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.603636:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b96a400/0x48868a4e4394a622 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff7a expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129757.603642:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b96ba00/0x48868a4e4394a5b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff50 expref: 20 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129757.603646:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129757.603648:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129757.603650:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6370c00/0x48868a4e4394a66f lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.603665:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b96ba00/0x48868a4e4394a5b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff50 expref: 20 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129757.603677:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b96ba00/0x48868a4e4394a5b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff50 expref: 20 pid: 8436 timeout: 803 lvb_type: 1 00000100:00100000:2.0:1746129757.603685:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053370496:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129757.603694:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b96bc00/0x48868a4e4394a61b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff81 expref: 13 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129757.603694:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e4394a312 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc8 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.603701:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b96bc00/0x48868a4e4394a61b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff81 expref: 13 pid: 8436 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.603702:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e4394a312 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc8 expref: 15 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746129757.603709:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130504700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053370752:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129757.603709:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053370624:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129757.603712:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b96a400/0x48868a4e4394a622 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff7a expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129757.603719:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b96a400/0x48868a4e4394a622 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff7a expref: 14 pid: 8436 timeout: 803 lvb_type: 1 00000100:00100000:2.0:1746129757.603725:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053370880:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129757.603725:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b56cb40 going to sleep for 11 seconds 00010000:00010000:3.0:1746129757.603735:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04000/0x48868a4e4394a565 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff1f expref: 38 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129757.603740:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11349 00010000:00010000:3.0:1746129757.603742:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04000/0x48868a4e4394a565 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff1f expref: 38 pid: 7976 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.603744:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394a59d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff3b expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129757.603745:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+13:1963:x1830949052359552:12345-192.168.204.31@tcp:1:mirror_io.0 00000100:00100000:3.0:1746129757.603748:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053371008:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129757.603751:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394a59d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff3b expref: 15 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746129757.603757:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053371136:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129757.603758:0:8435:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a676 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129757.603763:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129757.603769:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1300 going to sleep for 11 seconds 00010000:00010000:0.0:1746129757.603772:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b96a800/0x48868a4e4394a5f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3579904->4018175) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff6c expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.603776:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129757.603778:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129757.603779:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a676 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.603792:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b96a800/0x48868a4e4394a5f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3579904->4018175) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff6c expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.603800:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b96a800/0x48868a4e4394a5f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3579904->4018175) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff6c expref: 25 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:0.0:1746129757.603806:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053371264:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129757.603816:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6200/0x48868a4e4394a4b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fea1 expref: 13 pid: 1140 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129757.603818:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5188d80 going to sleep for 11 seconds 00010000:00010000:1.0:1746129757.603833:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6200/0x48868a4e4394a4b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fea1 expref: 13 pid: 1140 timeout: 803 lvb_type: 1 00000100:00100000:1.0:1746129757.603843:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053371392:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129757.604348:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135cab400/0x48868a4e4394a294 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd66 expref: 25 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.604356:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135cab400/0x48868a4e4394a294 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd66 expref: 25 pid: 10930 timeout: 803 lvb_type: 1 00000100:00100000:1.0:1746129757.604362:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053371520:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129757.604395:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d5106c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129757.604405:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+14:1963:x1830949052359680:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:1.0:1746129757.604420:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b96a600/0x48868a4e4394a67d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.604429:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a87c3a00/0x48868a4e4394a208 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd20 expref: 15 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.604435:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c841400/0x48868a4e4394a4d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fec4 expref: 14 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.604441:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e4394a2fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdb3 expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.604446:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.604447:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.604449:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b96a600/0x48868a4e4394a67d lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.604491:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e4394a2fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdb3 expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.604499:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e4394a2fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdb3 expref: 20 pid: 8437 timeout: 803 lvb_type: 1 00000100:00100000:1.0:1746129757.604506:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053371648:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129757.604532:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c841400/0x48868a4e4394a4d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fec4 expref: 14 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.604539:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c841400/0x48868a4e4394a4d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fec4 expref: 14 pid: 4589 timeout: 803 lvb_type: 1 00000100:00100000:1.0:1746129757.604545:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053371776:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129757.604564:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a87c3a00/0x48868a4e4394a208 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd20 expref: 15 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.604801:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a87c3a00/0x48868a4e4394a208 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd20 expref: 15 pid: 4589 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746129757.604812:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053371904:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129757.604831:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129757.613367:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.613382:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.613394:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.613405:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.613424:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052359808 00000100:00100000:0.0:1746129757.613430:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052359808 00010000:00010000:0.0:1746129757.613456:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e4394a58f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff34 expref: 26 pid: 8436 timeout: 803 lvb_type: 1 00000100:00100000:0.0:1746129757.613477:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052360064 00000100:00100000:0.0:1746129757.613479:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052360064 00010000:00010000:0.0:1746129757.613488:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b96bc00/0x48868a4e4394a61b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff81 expref: 14 pid: 8436 timeout: 803 lvb_type: 1 00000100:00100000:0.0:1746129757.613498:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052359936 00000100:00100000:0.0:1746129757.613499:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052359936 00010000:00010000:0.0:1746129757.613507:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c840600/0x48868a4e4394a4cb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fea8 expref: 15 pid: 4589 timeout: 803 lvb_type: 1 00000100:00100000:0.0:1746129757.613515:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052360192 00000100:00100000:0.0:1746129757.613517:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052360192 00010000:00010000:0.0:1746129757.613524:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b96a400/0x48868a4e4394a622 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff7a expref: 16 pid: 8436 timeout: 803 lvb_type: 1 00000100:00100000:0.0:1746129757.613534:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5469 00000100:00100000:0.0:1746129757.613540:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1964:x1830949052359808:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129757.613550:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129757.613568:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e4394a58f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff34 expref: 26 pid: 8436 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.613578:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e4394a58f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff34 expref: 26 pid: 8436 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.613598:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129757.613629:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1964:x1830949052359808:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 89us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129757.613635:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5469 00000100:00100000:0.0:1746129757.613647:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5470 00000100:00100000:0.0:1746129757.613651:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+14:1964:x1830949052360064:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129757.613658:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129757.613670:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b96bc00/0x48868a4e4394a61b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff81 expref: 14 pid: 8436 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.613677:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b96bc00/0x48868a4e4394a61b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff81 expref: 14 pid: 8436 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.613686:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129757.613701:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+14:1964:x1830949052360064:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 49us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129757.613705:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5470 00000100:00100000:0.0:1746129757.613714:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5471 00000100:00100000:0.0:1746129757.613718:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+16:1964:x1830949052359936:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129757.613724:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129757.613734:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c840600/0x48868a4e4394a4cb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fea8 expref: 16 pid: 4589 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.613740:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c840600/0x48868a4e4394a4cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fea8 expref: 16 pid: 4589 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.613749:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129757.613761:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+16:1964:x1830949052359936:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 43us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129757.613765:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5471 00000100:00100000:0.0:1746129757.613772:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5472 00000100:00100000:0.0:1746129757.613776:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+15:1964:x1830949052360192:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129757.613781:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129757.613788:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b96a400/0x48868a4e4394a622 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff7a expref: 15 pid: 8436 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.613794:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b96a400/0x48868a4e4394a622 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff7a expref: 15 pid: 8436 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.613802:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129757.613813:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+15:1964:x1830949052360192:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 37us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129757.613818:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5472 00000100:00100000:0.0:1746129757.613888:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053371264:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129757.613905:0:8435:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a676 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129757.613979:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba38000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053371648:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129757.614037:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053371776:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129757.614076:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053371904:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129757.614088:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009b96a600/0x48868a4e4394a67d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129757.614127:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053370368:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129757.614133:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053371392:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129757.614138:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053371520:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129757.614151:0:1877:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009b96ae00/0x48868a4e4394a668 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129757.614222:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053369984:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129757.614231:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c840600/0x48868a4e4394a4cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fea8 expref: 14 pid: 4589 timeout: 803 lvb_type: 1 00000100:00100000:1.0:1746129757.614240:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053370240:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129757.614393:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11e00/0x48868a4e4394a58f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff34 expref: 25 pid: 8436 timeout: 803 lvb_type: 1 00000100:00100000:3.0:1746129757.614406:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130507100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053370112:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129757.614415:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b96bc00/0x48868a4e4394a61b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff81 expref: 13 pid: 8436 timeout: 803 lvb_type: 1 00000100:00100000:3.0:1746129757.614422:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130504700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053370752:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129757.614430:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053371008:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129757.614443:0:20441:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131819e00/0x48868a4e4394a661 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129757.615357:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053370496:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129757.615367:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b96a400/0x48868a4e4394a622 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff7a expref: 13 pid: 8436 timeout: 803 lvb_type: 1 00000100:00100000:2.0:1746129757.615392:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053370880:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129757.615402:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053371136:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129757.615416:0:10930:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a6370c00/0x48868a4e4394a66f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129757.616274:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053370624:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129757.616304:0:7976:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04800/0x48868a4e4394a65a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129757.621120:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.621233:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.621699:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.621924:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.621950:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052360320 00000100:00100000:1.0:1746129757.621957:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052360320 00010000:00010000:1.0:1746129757.621985:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b530ae00/0x48868a4e4394a366 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdf2 expref: 21 pid: 10930 timeout: 803 lvb_type: 1 00000100:00100000:1.0:1746129757.622011:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052360576 00000100:00100000:1.0:1746129757.622012:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052360576 00010000:00010000:1.0:1746129757.622020:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394a59d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff3b expref: 16 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746129757.622029:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052361344 00000100:00100000:1.0:1746129757.622030:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052361344 00010000:00010000:1.0:1746129757.622036:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a87c3a00/0x48868a4e4394a208 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd20 expref: 17 pid: 4589 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746129757.622046:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5473 00000100:00100000:1.0:1746129757.622051:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052360320:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129757.622062:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129757.622079:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b530ae00/0x48868a4e4394a366 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdf2 expref: 21 pid: 10930 timeout: 803 lvb_type: 1 00010000:00010000:1.0:1746129757.622089:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b530ae00/0x48868a4e4394a366 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdf2 expref: 21 pid: 10930 timeout: 803 lvb_type: 1 00010000:00010000:1.0:1746129757.622104:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b530ae00/0x48868a4e4394a366 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdf2 expref: 21 pid: 10930 timeout: 803 lvb_type: 1 00010000:00010000:1.0:1746129757.622118:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129757.622147:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949052360320:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 96us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129757.622153:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5473 00000100:00100000:1.0:1746129757.622166:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5474 00000100:00100000:1.0:1746129757.622170:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052360576:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129757.622177:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129757.622185:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394a59d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff3b expref: 17 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.622192:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394a59d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff3b expref: 17 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.622202:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394a59d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff3b expref: 17 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.622209:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129757.622222:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052360576:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 52us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129757.622228:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5474 00000100:00100000:1.0:1746129757.622236:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5475 00000100:00100000:1.0:1746129757.622241:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1963:x1830949052361344:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129757.622246:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129757.622253:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a87c3a00/0x48868a4e4394a208 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd20 expref: 15 pid: 4589 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.622260:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a87c3a00/0x48868a4e4394a208 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd20 expref: 15 pid: 4589 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.622270:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a87c3a00/0x48868a4e4394a208 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd20 expref: 15 pid: 4589 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.622277:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129757.622301:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1963:x1830949052361344:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 48us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129757.622306:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5475 00000100:00100000:0.0:1746129757.624336:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052361088 00000100:00100000:0.0:1746129757.624344:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052361088 00010000:00010000:0.0:1746129757.624370:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c841400/0x48868a4e4394a4d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fec4 expref: 13 pid: 4589 timeout: 803 lvb_type: 1 00000100:00100000:0.0:1746129757.624391:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5476 00000100:00100000:0.0:1746129757.624396:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+13:1963:x1830949052361088:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129757.624405:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129757.624419:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c841400/0x48868a4e4394a4d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fec4 expref: 13 pid: 4589 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.624428:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c841400/0x48868a4e4394a4d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fec4 expref: 13 pid: 4589 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.624443:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c841400/0x48868a4e4394a4d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fec4 expref: 13 pid: 4589 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.624469:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129757.624496:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+12:1963:x1830949052361088:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 99us (2572us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129757.624504:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5476 00000100:00100000:0.0:1746129757.624549:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.624566:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.624576:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052361216 00000100:00100000:0.0:1746129757.624578:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052361216 00010000:00010000:0.0:1746129757.624587:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e4394a2fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdb3 expref: 20 pid: 8437 timeout: 803 lvb_type: 1 00000100:00100000:0.0:1746129757.624599:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5477 00000100:00100000:0.0:1746129757.624603:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949052361216:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129757.624608:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129757.624616:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e4394a2fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdb3 expref: 20 pid: 8437 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.624622:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e4394a2fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdb3 expref: 20 pid: 8437 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.624632:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c840c00/0x48868a4e4394a2fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdb3 expref: 20 pid: 8437 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.624639:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129757.624641:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129757.624644:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b96a600/0x48868a4e4394a67d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.624651:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b96a600/0x48868a4e4394a67d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.624672:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129757.624686:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949052361216:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 83us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129757.624691:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5477 00010000:00010000:0.0:1746129757.624706:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009b96a600/0x48868a4e4394a67d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.624712:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b96a600/0x48868a4e4394a67d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.624727:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b96a600/0x48868a4e4394a67d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.624734:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b96a600/0x48868a4e4394a67d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.624740:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b96a600/0x48868a4e4394a67d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.624745:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b96a600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129757.624748:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b96a600/0x48868a4e4394a67d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.624754:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b96a600/0x48868a4e4394a67d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.624768:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b96a600/0x48868a4e4394a67d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.624773:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b96a600/0x48868a4e4394a67d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129757.624811:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949052359680:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 21361us (23432us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129757.624817:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11346 00000100:00100000:0.0:1746129757.624938:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.624950:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052360448 00000100:00100000:0.0:1746129757.624953:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052360448 00010000:00010000:0.0:1746129757.624963:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b96ba00/0x48868a4e4394a5b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff50 expref: 19 pid: 8436 timeout: 803 lvb_type: 1 00000100:00100000:0.0:1746129757.624976:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5478 00000100:00100000:0.0:1746129757.624980:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949052360448:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129757.624985:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129757.624993:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b96ba00/0x48868a4e4394a5b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff50 expref: 19 pid: 8436 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.624999:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b96ba00/0x48868a4e4394a5b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff50 expref: 19 pid: 8436 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.625008:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b96ba00/0x48868a4e4394a5b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff50 expref: 19 pid: 8436 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.625017:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129757.625018:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129757.625021:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6370c00/0x48868a4e4394a66f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.625026:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6370c00/0x48868a4e4394a66f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129757.625130:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052360704 00000100:00100000:3.0:1746129757.625133:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052360704 00002000:00100000:3.0:1746129757.625156:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3579904->4018175) req@ffff880094d8c700 x1830949052360704/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.625164:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8c700 with x1830949052360704 ext(3579904->4018175) 00010000:00010000:3.0:1746129757.625170:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b96a800/0x48868a4e4394a5f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3579904->4018175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff6c expref: 25 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.625178:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b96a800/0x48868a4e4394a5f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3579904->4018175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff6c expref: 25 pid: 8436 timeout: 803 lvb_type: 0 00002000:00010000:3.0:1746129757.625184:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094d8c700 00000100:00100000:3.0:1746129757.625194:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 653 00000100:00100000:3.0:1746129757.625199:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:1962:x1830949052360704:12345-192.168.204.31@tcp:4:multiop.0 00010000:00010000:0.0:1746129757.628392:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129757.628432:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1962:x1830949052360448:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3448us (3490us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129757.628439:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5478 00000100:00100000:0.0:1746129757.628491:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.628508:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.628518:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052360832 00000100:00100000:0.0:1746129757.628523:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052360832 00010000:00010000:0.0:1746129757.628540:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800945ce400/0x48868a4e4394a2e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd97 expref: 39 pid: 8437 timeout: 803 lvb_type: 1 00000100:00100000:0.0:1746129757.628555:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052360960 00000100:00100000:0.0:1746129757.628556:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052360960 00010000:00010000:0.0:1746129757.628564:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6200/0x48868a4e4394a4b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fea1 expref: 13 pid: 1140 timeout: 803 lvb_type: 1 00000100:00100000:0.0:1746129757.628587:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5479 00000100:00100000:0.0:1746129757.628592:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1962:x1830949052360832:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129757.628604:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129757.628619:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800945ce400/0x48868a4e4394a2e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd97 expref: 39 pid: 8437 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.628627:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800945ce400/0x48868a4e4394a2e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd97 expref: 39 pid: 8437 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.628641:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800945ce400/0x48868a4e4394a2e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd97 expref: 39 pid: 8437 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.628652:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129757.628665:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1962:x1830949052360832:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 73us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129757.628669:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5479 00000100:00100000:0.0:1746129757.628677:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5480 00000100:00100000:0.0:1746129757.628681:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949052360960:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129757.628687:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129757.628692:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6200/0x48868a4e4394a4b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fea1 expref: 13 pid: 1140 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.628698:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6200/0x48868a4e4394a4b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fea1 expref: 13 pid: 1140 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.628706:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6200/0x48868a4e4394a4b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fea1 expref: 13 pid: 1140 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.628716:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129757.628724:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949052360960:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 43us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129757.628728:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5480 00000100:00100000:0.0:1746129757.628779:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.628790:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052361472 00000100:00100000:0.0:1746129757.628792:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052361472 00010000:00010000:0.0:1746129757.628801:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e4394a312 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc8 expref: 14 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:0.0:1746129757.628812:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5481 00000100:00100000:0.0:1746129757.628815:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052361472:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129757.628821:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129757.628831:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e4394a312 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc8 expref: 14 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746129757.628838:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e4394a312 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc8 expref: 14 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746129757.628869:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb6e800/0x48868a4e4394a312 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fdc8 expref: 14 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746129757.628877:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129757.628879:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129757.628882:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04800/0x48868a4e4394a65a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.628891:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04800/0x48868a4e4394a65a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.628903:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129757.628914:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949052361472:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 97us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129757.628919:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5481 00000100:00100000:0.0:1746129757.628943:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.628951:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052361600 00000100:00100000:0.0:1746129757.628953:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052361600 00010000:00010000:0.0:1746129757.628962:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04000/0x48868a4e4394a565 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff1f expref: 38 pid: 7976 timeout: 803 lvb_type: 0 00000100:00100000:0.0:1746129757.628973:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5482 00000100:00100000:0.0:1746129757.628977:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1963:x1830949052361600:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129757.628982:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129757.628990:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04000/0x48868a4e4394a565 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff1f expref: 38 pid: 7976 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746129757.628996:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04000/0x48868a4e4394a565 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff1f expref: 38 pid: 7976 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746129757.629005:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04000/0x48868a4e4394a565 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff1f expref: 38 pid: 7976 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746129757.629013:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129757.629015:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129757.629017:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131819e00/0x48868a4e4394a661 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.629022:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131819e00/0x48868a4e4394a661 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.629033:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129757.629042:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1963:x1830949052361600:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 65us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129757.629047:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5482 00000100:00100000:0.0:1746129757.629088:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.629098:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052361728 00000100:00100000:0.0:1746129757.629100:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052361728 00010000:00010000:0.0:1746129757.629110:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135cab400/0x48868a4e4394a294 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd66 expref: 27 pid: 10930 timeout: 803 lvb_type: 1 00000100:00100000:0.0:1746129757.629119:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5483 00000100:00100000:0.0:1746129757.629123:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+27:1961:x1830949052361728:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129757.629128:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129757.629134:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135cab400/0x48868a4e4394a294 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd66 expref: 27 pid: 10930 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.629141:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135cab400/0x48868a4e4394a294 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd66 expref: 27 pid: 10930 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.629150:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135cab400/0x48868a4e4394a294 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd66 expref: 27 pid: 10930 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746129757.629161:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129757.629162:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129757.629165:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b96ae00/0x48868a4e4394a668 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.629170:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b96ae00/0x48868a4e4394a668 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.629182:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129757.629193:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1961:x1830949052361728:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 70us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129757.629198:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5483 00010000:00010000:0.0:1746129757.629213:0:1877:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009b96ae00/0x48868a4e4394a668 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.629220:0:1877:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b96ae00/0x48868a4e4394a668 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.629235:0:1877:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b96ae00/0x48868a4e4394a668 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.629242:0:1877:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b96ae00/0x48868a4e4394a668 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.629248:0:1877:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b96ae00/0x48868a4e4394a668 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.629259:0:1877:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b96ae00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129757.629262:0:1877:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b96ae00/0x48868a4e4394a668 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.629269:0:1877:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b96ae00/0x48868a4e4394a668 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.629277:0:1877:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b96ae00/0x48868a4e4394a668 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.629282:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b96ae00/0x48868a4e4394a668 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129757.629337:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+11:1963:x1830949052359040:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 25877us (26773us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129757.629343:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11347 00010000:00010000:0.0:1746129757.629488:0:7976:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04800/0x48868a4e4394a65a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.629494:0:7976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04800/0x48868a4e4394a65a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.629506:0:7976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04800/0x48868a4e4394a65a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.629511:0:7976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04800/0x48868a4e4394a65a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.629517:0:7976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04800/0x48868a4e4394a65a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.629521:0:7976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8e04800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129757.629524:0:7976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04800/0x48868a4e4394a65a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.629529:0:7976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04800/0x48868a4e4394a65a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.629538:0:7976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04800/0x48868a4e4394a65a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.629543:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04800/0x48868a4e4394a65a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129757.629575:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+10:1963:x1830949052359168:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 26307us (28262us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129757.629580:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11344 00010000:00010000:2.0:1746129757.629676:0:10930:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a6370c00/0x48868a4e4394a66f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.629683:0:10930:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6370c00/0x48868a4e4394a66f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.629697:0:10930:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a6370c00/0x48868a4e4394a66f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.629703:0:10930:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6370c00/0x48868a4e4394a66f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.629708:0:10930:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a6370c00/0x48868a4e4394a66f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.629713:0:10930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6370c00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129757.629716:0:10930:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a6370c00/0x48868a4e4394a66f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.629722:0:10930:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a6370c00/0x48868a4e4394a66f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.629732:0:10930:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a6370c00/0x48868a4e4394a66f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.629737:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6370c00/0x48868a4e4394a66f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129757.629771:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+9:1963:x1830949052359296:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 26168us (27185us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129757.629777:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11348 00010000:00010000:3.0:1746129757.630506:0:20441:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131819e00/0x48868a4e4394a661 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.630514:0:20441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131819e00/0x48868a4e4394a661 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.630527:0:20441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131819e00/0x48868a4e4394a661 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.630533:0:20441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131819e00/0x48868a4e4394a661 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.630538:0:20441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131819e00/0x48868a4e4394a661 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.630543:0:20441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131819e00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129757.630545:0:20441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131819e00/0x48868a4e4394a661 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.630555:0:20441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131819e00/0x48868a4e4394a661 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.630563:0:20441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131819e00/0x48868a4e4394a661 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.630568:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131819e00/0x48868a4e4394a661 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129757.630602:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6141239f-0c60-480d-830c-e22ba61457b0+10:1963:x1830949052359424:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 27323us (29249us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129757.630607:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11345 00000100:00100000:3.0:1746129757.643608:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1962:x1830949052360704:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 18399us (19049us total) trans 17179873252 rc 0/0 00000100:00100000:3.0:1746129757.643618:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 653 00002000:00100000:3.0:1746129757.643628:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3579904->4018175) req@ffff880094d8c700 x1830949052360704/t17179873252(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/448 e 0 to 0 dl 1746129768 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.643636:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8c700 with x1830949052360704 ext(3579904->4018175) 00010000:00010000:3.0:1746129757.643644:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b96a800/0x48868a4e4394a5f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3579904->4018175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff6c expref: 26 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.643656:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b96a800/0x48868a4e4394a5f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3579904->4018175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff6c expref: 26 pid: 8436 timeout: 803 lvb_type: 0 00002000:00010000:3.0:1746129757.643661:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094d8c700 00000100:00100000:0.0:1746129757.651028:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.651339:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052361984 00000100:00100000:3.0:1746129757.651347:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052361984 00000100:00100000:3.0:1746129757.651402:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9974 00000100:00100000:3.0:1746129757.651409:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:28800:x1830949052361984:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129757.651427:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129757.651441:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131819c00/0x48868a4e4394a684 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ff9d expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.651520:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a68b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651530:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a68b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651537:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a68b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651547:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131819400/0x48868a4e4394a692 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651552:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131819400/0x48868a4e4394a692 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651556:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131819400/0x48868a4e4394a692 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651635:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131819800/0x48868a4e4394a699 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651642:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131819800/0x48868a4e4394a699 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651648:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131819800/0x48868a4e4394a699 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129757.651656:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129757.651712:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131819800/0x48868a4e4394a699 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651717:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131819800/0x48868a4e4394a699 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651722:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131819800/0x48868a4e4394a699 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651726:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131819800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129757.651729:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131819800/0x48868a4e4394a699 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651733:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131819800/0x48868a4e4394a699 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651741:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129757.651743:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129757.651746:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131819800/0x48868a4e4394a699 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651749:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131819800/0x48868a4e4394a699 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651772:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a68b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651776:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a68b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651780:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a68b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651787:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131819200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129757.651789:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a68b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651794:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a68b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651800:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129757.651802:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129757.651804:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a68b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651808:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a68b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651815:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131819400/0x48868a4e4394a692 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651819:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131819400/0x48868a4e4394a692 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651823:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131819400/0x48868a4e4394a692 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651826:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131819400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129757.651828:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131819400/0x48868a4e4394a692 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651832:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131819400/0x48868a4e4394a692 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651837:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009baa2300) 00010000:00010000:3.0:1746129757.651839:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129757.651841:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131819400/0x48868a4e4394a692 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651845:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131819400/0x48868a4e4394a692 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.651901:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131819c00/0x48868a4e4394a684 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff9d expref: 300 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.651908:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131819c00/0x48868a4e4394a684 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff9d expref: 300 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.651915:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131819c00, rc 0) 00000100:00100000:3.0:1746129757.651951:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:28800:x1830949052361984:12345-192.168.204.31@tcp:101:cat.0 Request processed in 542us (929us total) trans 8589943779 rc 301/301 00000100:00100000:3.0:1746129757.651957:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9974 00000100:00100000:0.0:1746129757.657987:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.658436:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052362112 00000100:00100000:1.0:1746129757.658444:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052362112 00010000:00010000:1.0:1746129757.658473:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b96a800/0x48868a4e4394a5f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3579904->4018175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff6c expref: 26 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746129757.658498:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5484 00000100:00100000:1.0:1746129757.658505:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1961:x1830949052362112:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129757.658517:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129757.658537:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b96a800/0x48868a4e4394a5f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3579904->4018175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff6c expref: 26 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.658547:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b96a800/0x48868a4e4394a5f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3579904->4018175) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff6c expref: 26 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.658565:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b96a800/0x48868a4e4394a5f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3579904->4018175) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff6c expref: 26 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746129757.658599:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.658601:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.658605:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a676 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.658612:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a676 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.658639:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129757.658678:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:1961:x1830949052362112:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 173us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129757.658683:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5484 00010000:00010000:0.0:1746129757.658830:0:8435:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a676 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.658838:0:8435:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a676 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.658895:0:8435:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a676 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.658902:0:8435:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a676 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.658907:0:8435:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a676 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.658913:0:8435:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbb6600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129757.658916:0:8435:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a676 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.658923:0:8435:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a676 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.658933:0:8435:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a676 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.658938:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a676 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129757.658991:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+9:1963:x1830949052359552:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 55245us (56367us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129757.658997:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11349 00000100:00100000:0.0:1746129757.660192:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.660234:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052362240 00000100:00100000:2.0:1746129757.660238:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052362240 00000100:00100000:2.0:1746129757.660393:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11350 00000100:00100000:2.0:1746129757.660400:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1961:x1830949052362240:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129757.660413:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129757.660425:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6371200/0x48868a4e4394a6a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ffa4 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129757.660439:0:8435:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e8:0x0] initial LVB size: 1048576, mtime: 0x6813d35b, atime: 0x6813d35b, ctime: 0x6813d35b, blocks: 0x809 00010000:00010000:2.0:1746129757.660452:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129757.660453:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129757.660459:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6371200/0x48868a4e4394a6a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffa4 expref: 38 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129757.660470:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6371200/0x48868a4e4394a6a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffa4 expref: 38 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129757.660482:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6371200, rc 0) 00000100:00100000:2.0:1746129757.661068:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1961:x1830949052362240:12345-192.168.204.31@tcp:101:cat.0 Request processed in 668us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129757.661074:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11350 00000100:00100000:0.0:1746129757.663785:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.663813:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.663834:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.664419:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.665126:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052362368 00000100:00100000:3.0:1746129757.665134:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052362368 00000100:00100000:3.0:1746129757.665176:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052362496 00000100:00100000:3.0:1746129757.665178:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052362496 00000100:00100000:3.0:1746129757.665194:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052362624 00000100:00100000:3.0:1746129757.665195:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052362624 00000100:00100000:3.0:1746129757.665211:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11351 00000100:00100000:3.0:1746129757.665217:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949052362368:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129757.665230:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129757.665246:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131819400/0x48868a4e4394a6ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ffab expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129757.665266:0:20441:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e6:0x0] initial LVB size: 2097152, mtime: 0x6813d35d, atime: 0x6813d35d, ctime: 0x6813d35d, blocks: 0x81f 00010000:00010000:3.0:1746129757.665295:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129757.665297:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129757.665304:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131819400/0x48868a4e4394a6ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffab expref: 20 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129757.665317:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131819400/0x48868a4e4394a6ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffab expref: 20 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129757.665326:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131819400, rc 0) 00000100:00100000:3.0:1746129757.665363:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949052362368:12345-192.168.204.31@tcp:101:cat.0 Request processed in 146us (1584us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129757.665367:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11351 00000100:00100000:3.0:1746129757.665382:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11352 00000100:00100000:3.0:1746129757.665386:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949052362496:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129757.665391:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129757.665398:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131819a00/0x48868a4e4394a6b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ffb2 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129757.665407:0:20441:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e7:0x0] initial LVB size: 2097152, mtime: 0x6813d35e, atime: 0x6813d35d, ctime: 0x6813d35e, blocks: 0x81f 00010000:00010000:3.0:1746129757.665414:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129757.665415:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129757.665419:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131819a00/0x48868a4e4394a6b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffb2 expref: 20 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129757.665426:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131819a00/0x48868a4e4394a6b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffb2 expref: 20 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129757.665432:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131819a00, rc 0) 00000100:00100000:3.0:1746129757.665446:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949052362496:12345-192.168.204.31@tcp:101:cat.0 Request processed in 60us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129757.665451:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11352 00000100:00100000:3.0:1746129757.665460:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11353 00000100:00100000:3.0:1746129757.665464:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1961:x1830949052362624:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129757.665470:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129757.665478:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131819600/0x48868a4e4394a6bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ffb9 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129757.665490:0:20441:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3ea:0x0] initial LVB size: 2097152, mtime: 0x6813d35d, atime: 0x6813d35d, ctime: 0x6813d35d, blocks: 0x821 00010000:00010000:3.0:1746129757.665497:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129757.665498:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129757.665502:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131819600/0x48868a4e4394a6bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffb9 expref: 39 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129757.665510:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131819600/0x48868a4e4394a6bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffb9 expref: 39 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129757.665515:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131819600, rc 0) 00000100:00100000:3.0:1746129757.665528:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1961:x1830949052362624:12345-192.168.204.31@tcp:101:cat.0 Request processed in 64us (1693us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129757.665532:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11353 00000100:00100000:0.0:1746129757.666908:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052362752 00000100:00100000:0.0:1746129757.666913:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052362752 00000100:00100000:0.0:1746129757.666947:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11354 00000100:00100000:0.0:1746129757.666953:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1961:x1830949052362752:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129757.666961:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129757.666971:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a6c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ffc0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129757.667106:0:1877:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3eb:0x0] initial LVB size: 4960928, mtime: 0x6813d35e, atime: 0x6813d35d, ctime: 0x6813d35e, blocks: 0x1629 00010000:00010000:0.0:1746129757.667117:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129757.667118:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129757.667123:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a6c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffc0 expref: 40 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129757.667133:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a6c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffc0 expref: 40 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129757.667140:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5217200, rc 0) 00000100:00100000:0.0:1746129757.667160:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1961:x1830949052362752:12345-192.168.204.31@tcp:101:cat.0 Request processed in 208us (2742us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129757.667165:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11354 00000100:00100000:0.0:1746129757.667204:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.667215:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052362880 00000100:00100000:0.0:1746129757.667218:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052362880 00000100:00100000:0.0:1746129757.667230:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11355 00000100:00100000:0.0:1746129757.667234:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949052362880:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129757.667240:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129757.667248:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a6ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ffc7 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129757.667258:0:1877:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e8:0x0] initial LVB size: 4194304, mtime: 0x6813d35c, atime: 0x6813d35b, ctime: 0x6813d35c, blocks: 0x1029 00010000:00010000:0.0:1746129757.667265:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129757.667266:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129757.667269:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a6ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffc7 expref: 21 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129757.667278:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a6ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffc7 expref: 21 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129757.667284:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5216e00, rc 0) 00000100:00100000:0.0:1746129757.667310:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052362880:12345-192.168.204.31@tcp:101:cat.0 Request processed in 75us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129757.667314:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11355 00000100:00100000:0.0:1746129757.667391:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.668958:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052363136 00000100:00100000:3.0:1746129757.668966:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052363136 00000100:00100000:3.0:1746129757.669005:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9975 00000100:00100000:3.0:1746129757.669010:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+13:28795:x1830949052363136:12345-192.168.204.31@tcp:36:mirror_io.0 00010000:00010000:3.0:1746129757.669047:0:14315:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1746129757.669065:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04600/0x48868a4e4394a526 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fef5 expref: 13 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.669372:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217e00/0x48868a4e4394a503 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fee7 expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.669425:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129757.669428:0:14315:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129757.669449:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a6d1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.669459:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f800/0x48868a4e4394a25c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd4a expref: 298 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.669465:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7600/0x48868a4e4394a263 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd51 expref: 20 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.669471:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x48868a4e4394a351 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fde4 expref: 298 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.669477:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217400/0x48868a4e4394a397 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe0e expref: 20 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.669482:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a6d1 lrc: 7/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.669505:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217400/0x48868a4e4394a397 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe0e expref: 20 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.669519:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217400/0x48868a4e4394a397 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe0e expref: 20 pid: 16808 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746129757.669529:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053372032:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129757.669611:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x48868a4e4394a351 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fde4 expref: 298 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.669619:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x48868a4e4394a351 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fde4 expref: 298 pid: 16808 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746129757.672678:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130504700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053372160:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129757.673399:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7600/0x48868a4e4394a263 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd51 expref: 20 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.673413:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7600/0x48868a4e4394a263 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd51 expref: 20 pid: 1851 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746129757.673423:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130507100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053372288:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129757.673451:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f800/0x48868a4e4394a25c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd4a expref: 298 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.673459:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f800/0x48868a4e4394a25c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd4a expref: 298 pid: 16808 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746129757.673466:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130506a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053372416:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129757.673483:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129757.675208:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053372032:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129757.675761:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.675788:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130506a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053372416:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129757.675832:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052363264 00000100:00100000:2.0:1746129757.675838:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052363264 00010000:00010000:2.0:1746129757.675885:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217400/0x48868a4e4394a397 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe0e expref: 21 pid: 16808 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746129757.675915:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5485 00000100:00100000:2.0:1746129757.675922:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1962:x1830949052363264:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129757.675932:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129757.675937:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217400/0x48868a4e4394a397 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe0e expref: 21 pid: 16808 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.675946:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217400/0x48868a4e4394a397 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe0e expref: 21 pid: 16808 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.675961:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217400/0x48868a4e4394a397 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fe0e expref: 21 pid: 16808 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.675980:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129757.675985:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a6d1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129757.675992:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129757.676021:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949052363264:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 100us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129757.676026:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5485 00000100:00100000:0.0:1746129757.685521:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.685589:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.685625:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.685704:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052363392 00000100:00100000:3.0:1746129757.685712:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052363392 00010000:00010000:3.0:1746129757.685743:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f800/0x48868a4e4394a25c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd4a expref: 299 pid: 16808 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746129757.685772:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052363520 00000100:00100000:3.0:1746129757.685774:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052363520 00010000:00010000:3.0:1746129757.685782:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x48868a4e4394a351 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fde4 expref: 300 pid: 16808 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746129757.685792:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052363648 00000100:00100000:3.0:1746129757.685794:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052363648 00010000:00010000:3.0:1746129757.685800:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7600/0x48868a4e4394a263 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd51 expref: 20 pid: 1851 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746129757.685812:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5486 00000100:00100000:3.0:1746129757.685818:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:1962:x1830949052363392:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129757.685829:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129757.685834:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f800/0x48868a4e4394a25c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd4a expref: 300 pid: 16808 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.685842:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f800/0x48868a4e4394a25c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd4a expref: 300 pid: 16808 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.685882:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f800/0x48868a4e4394a25c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd4a expref: 300 pid: 16808 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.685899:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129757.685904:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a6d1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.685910:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129757.685944:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:1962:x1830949052363392:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 126us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129757.685950:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5486 00000100:00100000:3.0:1746129757.685966:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5487 00000100:00100000:3.0:1746129757.685970:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:1964:x1830949052363520:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129757.685977:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129757.685981:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x48868a4e4394a351 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fde4 expref: 298 pid: 16808 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.685987:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x48868a4e4394a351 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fde4 expref: 298 pid: 16808 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.685996:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129757.685999:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a6d1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.686003:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129757.686015:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:1964:x1830949052363520:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 45us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129757.686020:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5487 00000100:00100000:3.0:1746129757.686032:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5488 00000100:00100000:3.0:1746129757.686036:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949052363648:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129757.686042:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129757.686045:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7600/0x48868a4e4394a263 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd51 expref: 20 pid: 1851 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.686052:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7600/0x48868a4e4394a263 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd51 expref: 20 pid: 1851 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746129757.686061:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129757.686063:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a6d1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.686068:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a6d1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.686073:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a6d1 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.686085:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129757.686097:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1964:x1830949052363648:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 61us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129757.686102:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5488 00010000:00010000:3.0:1746129757.686141:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x48868a4e4394a351 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fde4 expref: 297 pid: 16808 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746129757.686150:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130504700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053372160:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129757.686159:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7600/0x48868a4e4394a263 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fd51 expref: 19 pid: 1851 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746129757.686166:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130507100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053372288:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129757.686187:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a6d1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.686193:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a6d1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129757.686198:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a6d1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000040:00080000:3.0:1746129757.686744:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2896, 88 off241704 00000004:00080000:3.0:1746129757.686751:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 703744902361ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129757.686786:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2822, 88 off235272 00000004:00080000:3.0:1746129757.686791:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 703744943036ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129757.686802:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2823, 88 off235360 00000004:00080000:3.0:1746129757.686804:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 703744956510ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129757.686811:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2897, 88 off241792 00000004:00080000:3.0:1746129757.686813:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 703744964797ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129757.686818:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2898, 88 off241880 00000004:00080000:3.0:1746129757.686821:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 703744972706ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129757.686827:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2824, 88 off235448 00000004:00080000:3.0:1746129757.686829:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 703744981337ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129757.686836:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2825, 88 off235536 00000004:00080000:3.0:1746129757.686838:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 703744990212ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129757.686844:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2826, 88 off235624 00000004:00080000:3.0:1746129757.686871:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 703745022560ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129757.686880:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2899, 88 off241968 00000004:00080000:3.0:1746129757.686883:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 703745034697ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129757.686889:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2827, 88 off235712 00000004:00080000:3.0:1746129757.686891:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 703745043035ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129757.686897:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2900, 88 off242056 00000004:00080000:3.0:1746129757.686899:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 703745051420ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129757.686905:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2828, 88 off235800 00000004:00080000:3.0:1746129757.686907:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 703745059346ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129757.686913:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2901, 88 off242144 00000004:00080000:3.0:1746129757.686915:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 703745066895ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129757.686920:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2902, 88 off242232 00000004:00080000:3.0:1746129757.686922:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 703745074206ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129757.686928:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2903, 88 off242320 00000004:00080000:3.0:1746129757.686930:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 703745081907ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129757.686935:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2904, 88 off242408 00000004:00080000:3.0:1746129757.686937:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 703745088940ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129757.686942:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2829, 88 off235888 00000004:00080000:3.0:1746129757.686945:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 703745096728ns, next at 641623252291ns, rc = 0 00000100:00100000:2.0:1746129757.704673:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.704732:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052363904 00000100:00100000:1.0:1746129757.704740:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052363904 00000100:00100000:1.0:1746129757.704775:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9976 00000100:00100000:1.0:1746129757.704782:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:28804:x1830949052363904:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129757.704800:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129757.704814:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136a86800/0x48868a4e4394a6d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ffce expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.704929:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a86a00/0x48868a4e4394a6df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.704940:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136a86a00/0x48868a4e4394a6df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.704949:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136a86a00/0x48868a4e4394a6df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.704960:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a86c00/0x48868a4e4394a6e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.704965:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136a86c00/0x48868a4e4394a6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.704970:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136a86c00/0x48868a4e4394a6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:2.0:1746129757.709023:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.709047:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.709068:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.709086:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052364288 00000100:00100000:2.0:1746129757.709093:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052364288 00002000:00100000:2.0:1746129757.709127:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800a00c5880 x1830949052364288/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.709136:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c5880 with x1830949052364288 ext(0->1048575) 00002000:00010000:2.0:1746129757.709140:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a00c5880 00000100:00100000:2.0:1746129757.709157:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052364416 00000100:00100000:2.0:1746129757.709159:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052364416 00002000:00100000:2.0:1746129757.709169:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff8800a00c7800 x1830949052364416/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.709175:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c7800 with x1830949052364416 ext(1048576->2097151) 00002000:00010000:2.0:1746129757.709179:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a00c7800 00000100:00100000:2.0:1746129757.709188:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4270 00000100:00100000:2.0:1746129757.709194:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1962:x1830949052364288:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129757.709454:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052365184 00000100:00100000:0.0:1746129757.709458:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052365184 00000100:00100000:0.0:1746129757.709484:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9977 00000100:00100000:0.0:1746129757.709489:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:28803:x1830949052365184:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129757.709501:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129757.709515:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217600/0x48868a4e4394a6ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ffd5 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.709588:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217400/0x48868a4e4394a6f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129757.709599:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217400/0x48868a4e4394a6f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129757.709608:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217400/0x48868a4e4394a6f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129757.709617:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e4394a6fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129757.709622:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e4394a6fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129757.709627:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e4394a6fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129757.709711:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4271 00000100:00100000:0.0:1746129757.709716:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1961:x1830949052364416:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129757.711465:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.711492:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.711543:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052364800 00000100:00100000:0.0:1746129757.711549:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052364800 00002000:00100000:0.0:1746129757.711575:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800a8fd3100 x1830949052364800/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129757.711588:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd3100 with x1830949052364800 ext(1048576->2097151) 00002000:00010000:0.0:1746129757.711591:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8fd3100 00000100:00100000:0.0:1746129757.711603:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052364672 00000100:00100000:0.0:1746129757.711605:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052364672 00002000:00100000:0.0:1746129757.711614:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800a8fd1880 x1830949052364672/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129757.711620:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd1880 with x1830949052364672 ext(1048576->2097151) 00002000:00010000:0.0:1746129757.711622:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8fd1880 00000100:00100000:0.0:1746129757.711633:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4272 00000100:00100000:0.0:1746129757.711639:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052364800:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129757.712813:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4273 00000100:00100000:0.0:1746129757.712821:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949052364672:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129757.737107:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+42:1961:x1830949052364416:12345-192.168.204.31@tcp:3:cat.0 Request processed in 27384us (28031us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129757.737118:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4271 00002000:00100000:0.0:1746129757.737127:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff8800a00c7800 x1830949052364416/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129757.737136:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c7800 with x1830949052364416 ext(1048576->2097151) 00002000:00010000:0.0:1746129757.737141:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a00c7800 00000100:00100000:0.0:1746129757.737475:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949052364800:12345-192.168.204.31@tcp:3:cat.0 Request processed in 25835us (26016us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129757.737481:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4272 00002000:00100000:0.0:1746129757.737486:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800a8fd3100 x1830949052364800/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129757.737493:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd3100 with x1830949052364800 ext(1048576->2097151) 00002000:00010000:0.0:1746129757.737497:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8fd3100 00000100:00100000:0.0:1746129757.752168:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052364672:12345-192.168.204.31@tcp:3:cat.0 Request processed in 39340us (40667us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129757.752179:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4273 00002000:00100000:0.0:1746129757.752190:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800a8fd1880 x1830949052364672/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129757.752198:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd1880 with x1830949052364672 ext(1048576->2097151) 00002000:00010000:0.0:1746129757.752203:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8fd1880 00000100:00100000:2.0:1746129757.754230:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1962:x1830949052364288:12345-192.168.204.31@tcp:3:cat.0 Request processed in 45030us (45176us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129757.754239:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4270 00002000:00100000:2.0:1746129757.754246:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800a00c5880 x1830949052364288/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.754260:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c5880 with x1830949052364288 ext(0->1048575) 00002000:00010000:2.0:1746129757.754264:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a00c5880 00000004:00010000:3.0:1746129757.757373:0:14315:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880094d8e300 reply state ffff88012c460c00 transno 8589943780 ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a6d1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:3.0:1746129757.757385:0:14315:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746129757.757467:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+13:28795:x1830949052363136:12345-192.168.204.31@tcp:36:mirror_io.0 Request processed in 88453us (90072us total) trans 8589943780 rc 0/0 00000100:00100000:3.0:1746129757.757473:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9975 00010000:00010000:1.0:1746129757.757598:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeac00/0x48868a4e4394a702 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.757609:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96be00/0x48868a4e4394a64c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff96 expref: 12 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.757615:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeac00/0x48868a4e4394a702 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.757640:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96be00/0x48868a4e4394a64c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff96 expref: 12 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.757650:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96be00/0x48868a4e4394a64c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff96 expref: 12 pid: 16808 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746129757.757665:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053372544:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129757.757709:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510d80 going to sleep for 11 seconds 00000001:00080000:0.0:1746129757.758218:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943769 is committed 00000001:00080000:0.0:1746129757.758226:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943768 is committed 00000001:00080000:0.0:1746129757.758235:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943765 is committed 00000001:00080000:0.0:1746129757.758243:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943778 is committed 00000001:00080000:0.0:1746129757.758247:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943773 is committed 00000001:00080000:0.0:1746129757.758250:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943772 is committed 00000001:00080000:0.0:1746129757.758265:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943776 is committed 00000001:00080000:0.0:1746129757.758268:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943774 is committed 00000001:00080000:0.0:1746129757.758297:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943780 is committed 00000004:00080000:0.0:1746129757.758300:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2014 committed 00000004:00080000:0.0:1746129757.758306:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2085 committed 00000004:00080000:0.0:1746129757.758311:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2084 committed 00000004:00080000:0.0:1746129757.758312:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2083 committed 00000004:00080000:0.0:1746129757.758313:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2082 committed 00000004:00080000:0.0:1746129757.758315:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2013 committed 00000004:00080000:0.0:1746129757.758316:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2081 committed 00000004:00080000:0.0:1746129757.758318:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2012 committed 00000004:00080000:0.0:1746129757.758319:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2080 committed 00000004:00080000:0.0:1746129757.758321:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2011 committed 00000004:00080000:0.0:1746129757.758322:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2010 committed 00000004:00080000:0.0:1746129757.758324:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2009 committed 00000004:00080000:0.0:1746129757.758325:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2079 committed 00000004:00080000:0.0:1746129757.758326:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2078 committed 00000004:00080000:0.0:1746129757.758327:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2008 committed 00000004:00080000:0.0:1746129757.758328:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2007 committed 00000004:00080000:0.0:1746129757.758330:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2077 committed 00000001:00080000:0.0:1746129757.758333:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943779 is committed 00010000:00010000:0.0:1746129757.758358:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14dc00/0x48868a4e4394a709 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129757.758365:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14dc00/0x48868a4e4394a709 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129757.758371:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14dc00/0x48868a4e4394a709 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129757.758453:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053372800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129757.758488:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129757.758507:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053373312:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129757.758518:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129757.758530:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746129757.758533:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053372672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129757.758543:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129757.758553:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053373184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129757.758565:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129757.758580:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053373056:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129757.758593:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129757.758603:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053373568:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129757.758615:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129757.758626:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746129757.758629:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053372928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129757.758640:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129757.758648:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053373440:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129757.758658:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129757.758676:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053372800 00000100:00100000:0.0:1746129757.758681:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053372800 00000100:00100000:0.0:1746129757.758703:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053373312 00000100:00100000:0.0:1746129757.758704:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053373312 00000100:00100000:0.0:1746129757.758711:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053372672 00000100:00100000:0.0:1746129757.758713:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053372672 00000100:00100000:0.0:1746129757.758719:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053373184 00000100:00100000:0.0:1746129757.758720:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053373184 00000100:00100000:0.0:1746129757.758727:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053373056 00000100:00100000:0.0:1746129757.758728:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053373056 00000100:00100000:0.0:1746129757.758733:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053373568 00000100:00100000:0.0:1746129757.758734:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053373568 00000100:00100000:0.0:1746129757.758738:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053372928 00000100:00100000:0.0:1746129757.758740:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053372928 00000100:00100000:0.0:1746129757.758744:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053373440 00000100:00100000:0.0:1746129757.758745:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053373440 00000100:00100000:0.0:1746129757.758752:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11356 00000100:00100000:0.0:1746129757.758756:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+66:3297:x1830949053372800:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129757.758902:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129757.758905:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129757 -> 1746129757 00002000:00010000:0.0:1746129757.758907:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746129757 -> 1746129757 00002000:00010000:0.0:1746129757.758909:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129757 -> 1746129757 00002000:00010000:0.0:1746129757.758911:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129757.758931:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3297:x1830949053372800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 175us (444us total) trans 17179873253 rc 0/0 00000100:00100000:0.0:1746129757.758936:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11356 00000100:00100000:0.0:1746129757.758946:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11357 00000100:00100000:0.0:1746129757.758949:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+66:3297:x1830949053373312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129757.759007:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3297:x1830949053373312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (488us total) trans 17179873254 rc 0/0 00000100:00100000:0.0:1746129757.759011:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11357 00000100:00100000:0.0:1746129757.759018:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11358 00000100:00100000:0.0:1746129757.759021:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+66:3297:x1830949053372672:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129757.759068:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746129757.759070:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129755 -> 1746129755 00002000:00010000:0.0:1746129757.759072:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129755 -> 1746129755 00002000:00010000:0.0:1746129757.759074:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129755 -> 1746129755 00002000:00010000:0.0:1746129757.759075:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:0.0:1746129757.759088:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3297:x1830949053372672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (544us total) trans 17179873255 rc 0/0 00000100:00100000:0.0:1746129757.759092:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11358 00000100:00100000:0.0:1746129757.759098:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11359 00000100:00100000:0.0:1746129757.759101:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+66:3297:x1830949053373184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129757.759153:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3297:x1830949053373184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (587us total) trans 17179873256 rc 0/0 00000100:00100000:0.0:1746129757.759157:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11359 00000100:00100000:0.0:1746129757.759165:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11360 00000100:00100000:0.0:1746129757.759168:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+66:3299:x1830949053373056:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129757.759221:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129757.759223:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129757.759225:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129757.759226:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129757.759228:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129757.759245:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3299:x1830949053373056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (651us total) trans 17179873257 rc 0/0 00000100:00100000:0.0:1746129757.759249:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11360 00000100:00100000:0.0:1746129757.759256:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11361 00000100:00100000:0.0:1746129757.759259:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+66:3299:x1830949053373568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129757.759329:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3299:x1830949053373568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (712us total) trans 17179873258 rc 0/0 00000100:00100000:0.0:1746129757.759333:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11361 00000100:00100000:0.0:1746129757.759340:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11362 00000100:00100000:0.0:1746129757.759343:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+66:3299:x1830949053372928:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129757.759392:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:0.0:1746129757.759394:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129758 -> 1746129758 00002000:00010000:0.0:1746129757.759396:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129757 -> 1746129757 00002000:00010000:0.0:1746129757.759397:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129758 -> 1746129758 00002000:00010000:0.0:1746129757.759399:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5673 -> 5673 00000100:00100000:0.0:1746129757.759412:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3299:x1830949053372928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (771us total) trans 17179873259 rc 0/0 00000100:00100000:0.0:1746129757.759415:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11362 00000100:00100000:0.0:1746129757.759422:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11363 00000100:00100000:0.0:1746129757.759425:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+66:3299:x1830949053373440:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129757.759476:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3299:x1830949053373440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (817us total) trans 17179873260 rc 0/0 00000100:00100000:0.0:1746129757.759480:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11363 00000004:00080000:0.0:1746129757.759511:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8fd2300/2, rc 0, transno 17179873259 00000100:00100000:0.0:1746129757.759517:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053372928:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129757.759523:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095242300/2, rc 0, transno 17179873260 00000100:00100000:0.0:1746129757.759525:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053373440:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129757.759530:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8fd0000/2, rc 0, transno 17179873257 00000100:00100000:0.0:1746129757.759532:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053373056:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129757.759536:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095241880/2, rc 0, transno 17179873258 00000100:00100000:0.0:1746129757.759538:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053373568:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129757.759562:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8fd1c00/2, rc 0, transno 17179873255 00000100:00100000:0.0:1746129757.759564:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053372672:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129757.759569:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8fd2a00/2, rc 0, transno 17179873256 00000100:00100000:0.0:1746129757.759571:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053373184:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129757.759575:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8fd0e00/2, rc 0, transno 17179873253 00000100:00100000:0.0:1746129757.759577:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053372800:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129757.759581:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8fd1180/2, rc 0, transno 17179873254 00000100:00100000:0.0:1746129757.759583:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053373312:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129757.759586:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746129757.759589:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053373696:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129757.759603:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129757.759615:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053373696 00000100:00100000:0.0:1746129757.759617:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053373696 00000100:00100000:0.0:1746129757.759628:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11364 00000100:00100000:0.0:1746129757.759631:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+67:3297:x1830949053373696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129757.759704:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+68:3297:x1830949053373696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (100us total) trans 17179873261 rc 0/0 00000100:00100000:0.0:1746129757.759708:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11364 00000004:00080000:0.0:1746129757.759725:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095243800/2, rc 0, transno 17179873261 00000100:00100000:0.0:1746129757.759728:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053373696:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746129757.759885:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a6d1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129757.759892:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a6d1 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129757.759898:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a6d1 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129757.759902:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131819200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129757.759906:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a6d1 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129757.759911:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a6d1 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129757.759922:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129757.759925:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129757.759927:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a6d1 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129757.759932:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131819200/0x48868a4e4394a6d1 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00000100:00100000:1.0:1746129757.760045:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053373952:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129757.760065:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129757.760075:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053374464:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129757.760084:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129757.760092:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746129757.760095:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053374080:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129757.760104:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129757.760109:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053374592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129757.760118:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129757.760131:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053373952 00000100:00100000:1.0:1746129757.760134:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053373952 00000100:00100000:1.0:1746129757.760145:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053374464 00000100:00100000:1.0:1746129757.760147:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053374464 00000100:00100000:1.0:1746129757.760152:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053374080 00000100:00100000:1.0:1746129757.760153:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053374080 00000100:00100000:1.0:1746129757.760159:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053374592 00000100:00100000:1.0:1746129757.760160:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053374592 00000100:00100000:1.0:1746129757.760166:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11365 00000100:00100000:1.0:1746129757.760169:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+56:3298:x1830949053373952:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129757.760260:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129757.760262:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129758 -> 1746129758 00002000:00010000:1.0:1746129757.760264:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129757 -> 1746129757 00002000:00010000:1.0:1746129757.760265:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129758 -> 1746129758 00002000:00010000:1.0:1746129757.760267:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746129757.760294:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3298:x1830949053373952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (218us total) trans 21474840387 rc 0/0 00000100:00100000:1.0:1746129757.760299:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11365 00000100:00100000:1.0:1746129757.760309:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11366 00000100:00100000:1.0:1746129757.760313:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+56:3298:x1830949053374464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129757.760373:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3298:x1830949053374464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (287us total) trans 21474840388 rc 0/0 00000100:00100000:1.0:1746129757.760378:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11366 00000100:00100000:1.0:1746129757.760385:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11367 00000100:00100000:1.0:1746129757.760390:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+56:3298:x1830949053374080:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129757.760449:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746129757.760451:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129756 -> 1746129756 00002000:00010000:1.0:1746129757.760453:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129755 -> 1746129755 00002000:00010000:1.0:1746129757.760454:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129756 -> 1746129756 00002000:00010000:1.0:1746129757.760456:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746129757.760472:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3298:x1830949053374080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (367us total) trans 21474840389 rc 0/0 00000100:00100000:1.0:1746129757.760476:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11367 00000100:00100000:1.0:1746129757.760485:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11368 00000100:00100000:1.0:1746129757.760489:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+56:3298:x1830949053374592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129757.760555:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3298:x1830949053374592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (435us total) trans 21474840390 rc 0/0 00000100:00100000:1.0:1746129757.760559:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11368 00000004:00080000:1.0:1746129757.760579:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba39500/2, rc 0, transno 21474840389 00000100:00100000:1.0:1746129757.760583:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053374080:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129757.760589:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba38a80/2, rc 0, transno 21474840390 00000100:00100000:1.0:1746129757.760591:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053374592:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129757.760596:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba38700/2, rc 0, transno 21474840387 00000100:00100000:1.0:1746129757.760598:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053373952:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129757.760602:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba3bb80/2, rc 0, transno 21474840388 00000100:00100000:1.0:1746129757.760605:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053374464:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129757.760651:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053374208:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129757.760669:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129757.760678:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053374720:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129757.760688:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129757.760695:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746129757.760698:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053373824:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129757.760707:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129757.760713:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053374336:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129757.760722:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129757.760733:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053374208 00000100:00100000:2.0:1746129757.760735:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053374208 00000100:00100000:2.0:1746129757.760746:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053374720 00000100:00100000:2.0:1746129757.760747:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053374720 00000100:00100000:2.0:1746129757.760753:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053373824 00000100:00100000:2.0:1746129757.760754:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053373824 00000100:00100000:2.0:1746129757.760758:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053374336 00000100:00100000:2.0:1746129757.760759:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053374336 00000100:00100000:2.0:1746129757.760765:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11369 00000100:00100000:2.0:1746129757.760768:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:3296:x1830949053374208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129757.760836:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+61:3296:x1830949053374208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (166us total) trans 21474840391 rc 0/0 00000100:00100000:2.0:1746129757.760840:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11369 00000100:00100000:2.0:1746129757.760869:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11370 00000100:00100000:2.0:1746129757.760872:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:3296:x1830949053374720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129757.760930:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+61:3296:x1830949053374720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (241us total) trans 21474840392 rc 0/0 00000100:00100000:2.0:1746129757.760934:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11370 00000100:00100000:2.0:1746129757.760941:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11371 00000100:00100000:2.0:1746129757.760945:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:3296:x1830949053373824:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129757.760994:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129757.760996:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129757 -> 1746129757 00002000:00010000:2.0:1746129757.760998:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129757 -> 1746129757 00002000:00010000:2.0:1746129757.761000:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129757 -> 1746129757 00002000:00010000:2.0:1746129757.761002:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746129757.761015:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+61:3296:x1830949053373824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (307us total) trans 21474840393 rc 0/0 00000100:00100000:2.0:1746129757.761018:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11371 00000100:00100000:2.0:1746129757.761025:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11372 00000100:00100000:2.0:1746129757.761028:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:3296:x1830949053374336:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129757.761071:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746129757.761073:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746129757.761075:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746129757.761076:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746129757.761078:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746129757.761089:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+61:3296:x1830949053374336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (366us total) trans 21474840394 rc 0/0 00000100:00100000:2.0:1746129757.761093:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11372 00000004:00080000:2.0:1746129757.761110:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba39c00/2, rc 0, transno 21474840393 00000100:00100000:2.0:1746129757.761113:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053373824:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129757.761119:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba3b480/2, rc 0, transno 21474840394 00000100:00100000:2.0:1746129757.761122:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053374336:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129757.761127:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba39880/2, rc 0, transno 21474840391 00000100:00100000:2.0:1746129757.761129:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053374208:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129757.761133:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba38000/2, rc 0, transno 21474840392 00000100:00100000:2.0:1746129757.761136:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053374720:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129757.764680:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.764701:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052365312 00000100:00100000:1.0:1746129757.764708:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052365312 00000100:00100000:1.0:1746129757.764735:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9978 00000100:00100000:1.0:1746129757.764741:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+7:28795:x1830949052365312:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129757.764757:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129757.764770:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e4394a710 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ffdc expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.764815:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e4394a710 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffdc expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.764825:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e4394a710 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffdc expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.764837:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129757.764840:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129757.764842:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fb66800, rc 0) 00000100:00100000:1.0:1746129757.764889:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28795:x1830949052365312:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 148us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129757.764895:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9978 00000100:00100000:0.0:1746129757.765151:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053372544:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129757.765164:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeac00/0x48868a4e4394a702 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:0.0:1746129757.767684:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.768885:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.768910:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052365568 00000100:00100000:0.0:1746129757.768916:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052365568 00000100:00100000:0.0:1746129757.768949:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9979 00000100:00100000:0.0:1746129757.768956:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28800:x1830949052365568:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129757.768972:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129757.768986:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841a00/0x48868a4e4394a717 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ffe3 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.769045:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841a00/0x48868a4e4394a717 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffe3 expref: 284 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.769058:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841a00/0x48868a4e4394a717 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffe3 expref: 284 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.769076:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129757.769078:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129757.769081:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c841a00, rc 0) 00000100:00100000:0.0:1746129757.769116:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28800:x1830949052365568:12345-192.168.204.31@tcp:101:cat.0 Request processed in 160us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129757.769122:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9979 00000100:00100000:2.0:1746129757.769872:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052365440 00000100:00100000:2.0:1746129757.769877:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052365440 00010000:00010000:2.0:1746129757.769895:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96be00/0x48868a4e4394a64c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff96 expref: 8 pid: 16808 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746129757.769911:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5489 00000100:00100000:2.0:1746129757.769916:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052365440:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129757.769923:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129757.769927:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96be00/0x48868a4e4394a64c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff96 expref: 8 pid: 16808 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.769936:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96be00/0x48868a4e4394a64c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff96 expref: 8 pid: 16808 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.769949:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96be00/0x48868a4e4394a64c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ff96 expref: 8 pid: 16808 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746129757.769959:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129757.769962:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeac00/0x48868a4e4394a702 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.769968:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeac00/0x48868a4e4394a702 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.769972:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeac00/0x48868a4e4394a702 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.769977:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14dc00/0x48868a4e4394a709 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129757.769981:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14dc00/0x48868a4e4394a709 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129757.769987:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14dc00/0x48868a4e4394a709 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129757.770016:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129757.770035:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+7:1962:x1830949052365440:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 119us (2357us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129757.770035:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14dc00/0x48868a4e4394a709 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:2.0:1746129757.770040:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5489 00010000:00010000:1.0:1746129757.770042:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14dc00/0x48868a4e4394a709 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:1.0:1746129757.770055:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129757.770178:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14dc00/0x48868a4e4394a709 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129757.770184:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14dc00/0x48868a4e4394a709 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129757.770190:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14dc00/0x48868a4e4394a709 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129757.770195:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a14dc00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129757.770198:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14dc00/0x48868a4e4394a709 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129757.770204:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14dc00/0x48868a4e4394a709 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129757.770212:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129757.770214:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746129757.770217:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14dc00/0x48868a4e4394a709 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129757.770221:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a14dc00/0x48868a4e4394a709 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129757.770243:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217400/0x48868a4e4394a6f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129757.770249:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217400/0x48868a4e4394a6f4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129757.770253:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217400/0x48868a4e4394a6f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129757.770256:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b5217400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129757.770258:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217400/0x48868a4e4394a6f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129757.770262:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217400/0x48868a4e4394a6f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129757.770267:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129757.770269:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129757.770271:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217400/0x48868a4e4394a6f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129757.770275:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217400/0x48868a4e4394a6f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129757.770281:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e4394a6fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129757.770293:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e4394a6fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129757.770297:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e4394a6fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129757.770300:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b5216c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129757.770302:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e4394a6fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129757.770309:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e4394a6fb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129757.770314:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e8c7700) 00010000:00010000:1.0:1746129757.770316:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129757.770317:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e4394a6fb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129757.770321:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e4394a6fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129757.770346:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217600/0x48868a4e4394a6ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffd5 expref: 284 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.770352:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217600/0x48868a4e4394a6ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffd5 expref: 284 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.770357:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5217600, rc 0) 00000100:00100000:1.0:1746129757.770376:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28803:x1830949052365184:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 60887us (61361us total) trans 8589943781 rc 301/301 00000100:00100000:1.0:1746129757.770381:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9977 00010000:00010000:0.0:1746129757.770581:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeac00/0x48868a4e4394a702 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.770588:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeac00/0x48868a4e4394a702 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:0.0:1746129757.770596:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000100:00100000:1.0:1746129757.770602:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129757.770634:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeac00/0x48868a4e4394a702 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.770639:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeac00/0x48868a4e4394a702 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.770643:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeac00/0x48868a4e4394a702 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.770646:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faeac00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129757.770648:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeac00/0x48868a4e4394a702 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00000100:00100000:3.0:1746129757.770649:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052365824 00000100:00100000:3.0:1746129757.770652:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052365824 00010000:00010000:0.0:1746129757.770652:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeac00/0x48868a4e4394a702 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.770658:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129757.770660:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129757.770663:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeac00/0x48868a4e4394a702 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.770667:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeac00/0x48868a4e4394a702 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00000100:00100000:3.0:1746129757.770671:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3942 00000100:00100000:3.0:1746129757.770676:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6141239f-0c60-480d-830c-e22ba61457b0+7:28795:x1830949052365824:12345-192.168.204.31@tcp:35:mirror_io.0 00010000:00010000:0.0:1746129757.770678:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a86a00/0x48868a4e4394a6df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.770682:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136a86a00/0x48868a4e4394a6df lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.770686:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136a86a00/0x48868a4e4394a6df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.770689:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136a86a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129757.770691:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136a86a00/0x48868a4e4394a6df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.770694:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136a86a00/0x48868a4e4394a6df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.770699:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:0.0:1746129757.770700:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129757.770702:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136a86a00/0x48868a4e4394a6df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.770705:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a86a00/0x48868a4e4394a6df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.770710:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a86c00/0x48868a4e4394a6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.770714:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136a86c00/0x48868a4e4394a6e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.770718:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136a86c00/0x48868a4e4394a6e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.770722:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136a86c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129757.770723:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136a86c00/0x48868a4e4394a6e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.770727:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136a86c00/0x48868a4e4394a6e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.770731:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e8c7700) 00010000:00010000:0.0:1746129757.770732:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129757.770734:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136a86c00/0x48868a4e4394a6e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.770737:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a86c00/0x48868a4e4394a6e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00000100:00100000:3.0:1746129757.770758:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28795:x1830949052365824:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 80us (155us total) trans 8589943783 rc 0/0 00010000:00010000:0.0:1746129757.770758:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a86800/0x48868a4e4394a6d8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffce expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.770763:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a86800/0x48868a4e4394a6d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffce expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129757.770767:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3942 00010000:00010000:0.0:1746129757.770768:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a86800, rc 0) 00000100:00100000:0.0:1746129757.770784:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28804:x1830949052363904:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 66003us (66118us total) trans 8589943782 rc 301/301 00000100:00100000:0.0:1746129757.770789:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9976 00000100:00100000:0.0:1746129757.776085:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.777297:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.777323:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052366336 00000100:00100000:0.0:1746129757.777330:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052366336 00000100:00100000:0.0:1746129757.777366:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9980 00000100:00100000:0.0:1746129757.777372:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28807:x1830949052366336:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129757.777391:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129757.777406:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841e00/0x48868a4e4394a72c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ffea expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129757.777706:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052366080 00000100:00100000:2.0:1746129757.777709:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052366080 00000100:00100000:2.0:1746129757.777741:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3943 00000100:00100000:2.0:1746129757.777746:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6141239f-0c60-480d-830c-e22ba61457b0+8:28795:x1830949052366080:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:2.0:1746129757.777910:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6141239f-0c60-480d-830c-e22ba61457b0+9:28795:x1830949052366080:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 163us (1830us total) trans 8589943784 rc 0/0 00000100:00100000:2.0:1746129757.777916:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3943 00010000:00010000:0.0:1746129757.779607:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840600/0x48868a4e4394a733 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.779627:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840600/0x48868a4e4394a733 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.779636:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840600/0x48868a4e4394a733 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.779648:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841400/0x48868a4e4394a73a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.779659:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841400/0x48868a4e4394a73a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.779664:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841400/0x48868a4e4394a73a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.779763:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840c00/0x48868a4e4394a741 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.779770:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840c00/0x48868a4e4394a741 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.779775:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840c00/0x48868a4e4394a741 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:0.0:1746129757.779784:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129757.779877:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840600/0x48868a4e4394a733 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.779884:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840600/0x48868a4e4394a733 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.779890:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840600/0x48868a4e4394a733 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.779896:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c840600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129757.779899:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840600/0x48868a4e4394a733 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.779904:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840600/0x48868a4e4394a733 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.779915:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:0.0:1746129757.779917:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129757.779920:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840600/0x48868a4e4394a733 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.779925:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840600/0x48868a4e4394a733 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.779946:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841400/0x48868a4e4394a73a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.779950:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841400/0x48868a4e4394a73a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.779953:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841400/0x48868a4e4394a73a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.779961:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c841400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129757.779963:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841400/0x48868a4e4394a73a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.779967:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841400/0x48868a4e4394a73a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.779973:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129ed6900) 00010000:00010000:0.0:1746129757.779974:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129757.779976:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841400/0x48868a4e4394a73a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.779980:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841400/0x48868a4e4394a73a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.780016:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841e00/0x48868a4e4394a72c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffea expref: 11 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.780026:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840c00/0x48868a4e4394a741 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffea expref: 10 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.780031:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129757.780033:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129757.780035:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c840c00, rc 0) 00000100:00100000:0.0:1746129757.780087:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28807:x1830949052366336:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2714us (2801us total) trans 8589943785 rc 0/0 00000100:00100000:0.0:1746129757.780093:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9980 00000100:00100000:0.0:1746129757.785616:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.787275:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052366592 00000100:00100000:2.0:1746129757.787293:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052366592 00002000:00100000:2.0:1746129757.787329:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800a504c380 x1830949052366592/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.787337:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504c380 with x1830949052366592 ext(1048576->2097151) 00002000:00010000:2.0:1746129757.787340:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504c380 00000100:00100000:2.0:1746129757.787370:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4274 00000100:00100000:2.0:1746129757.787377:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052366592:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129757.788511:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.788801:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052366848 00000100:00100000:3.0:1746129757.788806:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052366848 00000100:00100000:3.0:1746129757.788829:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3944 00000100:00100000:3.0:1746129757.788835:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28807:x1830949052366848:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:3.0:1746129757.788993:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28807:x1830949052366848:12345-192.168.204.31@tcp:35:cat.0 Request processed in 157us (484us total) trans 8589943786 rc 0/0 00000100:00100000:3.0:1746129757.788999:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3944 00000100:00100000:0.0:1746129757.793778:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.794796:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052366976 00000100:00100000:1.0:1746129757.794802:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.794804:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052366976 00000100:00100000:1.0:1746129757.794831:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.794898:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052367104 00000100:00100000:2.0:1746129757.794901:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052367104 00000100:00100000:2.0:1746129757.794915:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052367232 00000100:00100000:2.0:1746129757.794917:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052367232 00000100:00100000:2.0:1746129757.794929:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11373 00000100:00100000:1.0:1746129757.794935:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.794936:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+25:1963:x1830949052366976:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129757.794950:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129757.794951:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052367360 00000100:00100000:1.0:1746129757.794954:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052367360 00010000:00010000:2.0:1746129757.794963:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6371600/0x48868a4e4394a74f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fff1 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129757.794973:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11374 00000100:00100000:1.0:1746129757.794978:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1964:x1830949052367104:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129757.794983:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129757.794985:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.794986:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129757.794992:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6371600/0x48868a4e4394a74f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fff1 expref: 27 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.794995:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394a756 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34fff8 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.795006:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6371600/0x48868a4e4394a74f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fff1 expref: 27 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.795007:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.795008:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.795013:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394a756 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fff8 expref: 15 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129757.795015:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6371600, rc 0) 00010000:00010000:1.0:1746129757.795023:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394a756 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fff8 expref: 15 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.795030:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:2.0:1746129757.795048:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+27:1963:x1830949052366976:12345-192.168.204.31@tcp:101:cat.0 Request processed in 113us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129757.795048:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1964:x1830949052367104:12345-192.168.204.31@tcp:101:cat.0 Request processed in 70us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129757.795054:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11373 00000100:00100000:1.0:1746129757.795086:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11374 00000100:00100000:1.0:1746129757.795098:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11375 00000100:00100000:1.0:1746129757.795103:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1964:x1830949052367232:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:0.0:1746129757.795107:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11376 00010000:00010000:1.0:1746129757.795109:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129757.795113:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+26:1963:x1830949052367360:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129757.795114:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e4394a75d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf34ffff expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129757.795119:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129757.795122:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.795124:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129757.795125:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05800/0x48868a4e4394a764 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350006 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.795127:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e4394a75d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffff expref: 15 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129757.795134:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129757.795135:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e4394a75d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffff expref: 15 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129757.795135:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129757.795139:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05800/0x48868a4e4394a764 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350006 expref: 27 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129757.795142:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10000, rc 0) 00010000:00010000:0.0:1746129757.795148:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05800/0x48868a4e4394a764 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350006 expref: 27 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129757.795154:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e05800, rc 0) 00000100:00100000:1.0:1746129757.795157:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1964:x1830949052367232:12345-192.168.204.31@tcp:101:cat.0 Request processed in 54us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129757.795162:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11375 00000100:00100000:0.0:1746129757.795168:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+27:1963:x1830949052367360:12345-192.168.204.31@tcp:101:cat.0 Request processed in 56us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129757.795173:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11376 00000100:00100000:0.0:1746129757.795879:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.795906:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.795930:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052367488 00000100:00100000:3.0:1746129757.795934:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052367488 00000100:00100000:3.0:1746129757.795950:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052367616 00000100:00100000:3.0:1746129757.795952:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052367616 00000100:00100000:3.0:1746129757.795991:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11377 00000100:00100000:3.0:1746129757.795997:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+27:1964:x1830949052367488:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:2.0:1746129757.795998:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11378 00010000:00010000:3.0:1746129757.796004:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129757.796004:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1964:x1830949052367616:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129757.796011:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b96b400/0x48868a4e4394a76b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35000d expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.796011:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129757.796017:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6371a00/0x48868a4e4394a772 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350014 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.796021:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129757.796022:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129757.796027:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129757.796028:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b96b400/0x48868a4e4394a76b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35000d expref: 28 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129757.796029:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129757.796033:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6371a00/0x48868a4e4394a772 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350014 expref: 16 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129757.796037:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b96b400/0x48868a4e4394a76b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35000d expref: 28 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129757.796042:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6371a00/0x48868a4e4394a772 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350014 expref: 16 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129757.796043:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b96b400, rc 0) 00010000:00010000:2.0:1746129757.796048:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6371a00, rc 0) 00000100:00100000:3.0:1746129757.796107:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eeb1e141-b927-4935-8f31-e7c2026fce6e+28:1964:x1830949052367488:12345-192.168.204.31@tcp:101:cat.0 Request processed in 109us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129757.796115:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11377 00000100:00100000:2.0:1746129757.796168:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949052367616:12345-192.168.204.31@tcp:101:cat.0 Request processed in 164us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129757.796172:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11378 00000100:00100000:3.0:1746129757.798724:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052366592:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11340us (13108us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129757.798733:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4274 00002000:00100000:3.0:1746129757.798742:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800a504c380 x1830949052366592/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.798751:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504c380 with x1830949052366592 ext(1048576->2097151) 00002000:00010000:3.0:1746129757.798755:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504c380 00000100:00100000:0.0:1746129757.811550:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.811615:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052367872 00000100:00100000:3.0:1746129757.811623:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052367872 00002000:00100000:3.0:1746129757.811661:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800a504ea00 x1830949052367872/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.811670:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504ea00 with x1830949052367872 ext(1048576->2097151) 00002000:00010000:3.0:1746129757.811674:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504ea00 00000100:00100000:3.0:1746129757.811700:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4275 00000100:00100000:3.0:1746129757.811706:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052367872:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129757.824491:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052367872:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12777us (12940us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129757.824501:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4275 00002000:00100000:3.0:1746129757.824511:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800a504ea00 x1830949052367872/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.824519:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504ea00 with x1830949052367872 ext(1048576->2097151) 00002000:00010000:3.0:1746129757.824525:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504ea00 00000100:00100000:2.0:1746129757.824679:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.824708:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.824733:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.824748:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052368128 00000100:00100000:2.0:1746129757.824755:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.824755:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052368128 00002000:00100000:1.0:1746129757.824790:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800a00c7480 x1830949052368128/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129757.824797:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c7480 with x1830949052368128 ext(0->1048575) 00002000:00010000:1.0:1746129757.824803:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a00c7480 00000100:00100000:1.0:1746129757.824827:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052368384 00000100:00100000:1.0:1746129757.824830:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052368384 00000100:00100000:2.0:1746129757.824844:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052368640 00002000:00100000:1.0:1746129757.824859:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800a00c4e00 x1830949052368384/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746129757.824860:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052368640 00002000:00100000:1.0:1746129757.824865:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c4e00 with x1830949052368384 ext(1048576->2097151) 00002000:00010000:1.0:1746129757.824868:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a00c4e00 00002000:00100000:2.0:1746129757.824877:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800a00c6d80 x1830949052368640/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746129757.824878:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052368896 00000100:00100000:1.0:1746129757.824880:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052368896 00002000:00100000:2.0:1746129757.824884:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c6d80 with x1830949052368640 ext(1048576->2097151) 00002000:00010000:2.0:1746129757.824886:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a00c6d80 00002000:00100000:1.0:1746129757.824890:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff8800a00c5f80 x1830949052368896/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129757.824895:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c5f80 with x1830949052368896 ext(1048576->2097151) 00000100:00100000:2.0:1746129757.824898:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4276 00002000:00010000:1.0:1746129757.824898:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a00c5f80 00000100:00100000:2.0:1746129757.824904:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+29:1963:x1830949052368128:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129757.824909:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4277 00000100:00100000:1.0:1746129757.824914:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1963:x1830949052368384:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129757.825164:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4278 00000100:00100000:1.0:1746129757.825170:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1963:x1830949052368640:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129757.827313:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4279 00000100:00100000:3.0:1746129757.827326:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+30:1963:x1830949052368896:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129757.832553:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+30:1963:x1830949052368128:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7641us (7867us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129757.832564:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4276 00002000:00100000:0.0:1746129757.832573:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800a00c7480 x1830949052368128/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129757.832588:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c7480 with x1830949052368128 ext(0->1048575) 00002000:00010000:0.0:1746129757.832593:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a00c7480 00000100:00100000:0.0:1746129757.851705:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.851757:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052369152 00000100:00100000:2.0:1746129757.851766:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052369152 00002000:00100000:2.0:1746129757.851801:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff8800a504f480 x1830949052369152/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.851815:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504f480 with x1830949052369152 ext(1048576->2097151) 00002000:00010000:2.0:1746129757.851820:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a504f480 00000100:00100000:2.0:1746129757.851861:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4280 00000100:00100000:2.0:1746129757.851868:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1962:x1830949052369152:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129757.854020:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1963:x1830949052368640:12345-192.168.204.31@tcp:3:cat.0 Request processed in 28842us (29278us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129757.854030:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4278 00002000:00100000:0.0:1746129757.854040:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800a00c6d80 x1830949052368640/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129757.854049:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c6d80 with x1830949052368640 ext(1048576->2097151) 00002000:00010000:0.0:1746129757.854053:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a00c6d80 00000100:00100000:0.0:1746129757.854569:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1963:x1830949052368384:12345-192.168.204.31@tcp:3:cat.0 Request processed in 29652us (29858us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129757.854576:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4277 00002000:00100000:0.0:1746129757.854582:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800a00c4e00 x1830949052368384/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129757.854589:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c4e00 with x1830949052368384 ext(1048576->2097151) 00002000:00010000:0.0:1746129757.854592:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a00c4e00 00000100:00100000:3.0:1746129757.863681:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+28:1963:x1830949052368896:12345-192.168.204.31@tcp:3:cat.0 Request processed in 36351us (38916us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129757.863691:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4279 00002000:00100000:3.0:1746129757.863701:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff8800a00c5f80 x1830949052368896/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.863708:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c5f80 with x1830949052368896 ext(1048576->2097151) 00002000:00010000:3.0:1746129757.863713:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a00c5f80 00000100:00100000:2.0:1746129757.870652:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1962:x1830949052369152:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18774us (21199us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129757.870663:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4280 00002000:00100000:2.0:1746129757.870673:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff8800a504f480 x1830949052369152/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.870681:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504f480 with x1830949052369152 ext(1048576->2097151) 00002000:00010000:2.0:1746129757.870686:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a504f480 00000100:00100000:0.0:1746129757.885275:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.886763:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052369408 00000100:00100000:2.0:1746129757.886772:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052369408 00002000:00100000:3.0:1746129757.886879:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a504e680 x1830949052369408/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.886890:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504e680 with x1830949052369408 ext(2097152->3145727) 00002000:00010000:3.0:1746129757.886896:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a504e680 00000100:00100000:1.0:1746129757.888207:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.889476:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129757.889564:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052369664 00000100:00100000:0.0:1746129757.889581:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4281 00000100:00100000:3.0:1746129757.889588:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052369664 00000100:00100000:0.0:1746129757.889593:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+29:1964:x1830949052369408:12345-192.168.204.31@tcp:3:cat.0 00002000:00100000:3.0:1746129757.889613:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88008fad2300 x1830949052369664/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.889621:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad2300 with x1830949052369664 ext(3145728->4194303) 00002000:00010000:3.0:1746129757.889624:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fad2300 00000100:00100000:1.0:1746129757.889706:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.889789:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052369920 00000100:00100000:2.0:1746129757.889793:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052369920 00002000:00100000:2.0:1746129757.889809:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88008fad1500 x1830949052369920/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.889815:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad1500 with x1830949052369920 ext(2097152->3145727) 00002000:00010000:2.0:1746129757.889819:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fad1500 00000100:00100000:2.0:1746129757.889828:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052370176 00000100:00100000:2.0:1746129757.889830:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052370176 00002000:00100000:2.0:1746129757.889836:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88008fad3b80 x1830949052370176/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.889841:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad3b80 with x1830949052370176 ext(3145728->4194303) 00002000:00010000:2.0:1746129757.889843:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fad3b80 00000100:00100000:2.0:1746129757.889865:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4282 00000100:00100000:2.0:1746129757.889870:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949052369920:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129757.890783:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4283 00000100:00100000:3.0:1746129757.890862:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4284 00000100:00100000:3.0:1746129757.890869:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+30:1964:x1830949052369664:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129757.897622:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949052370176:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129757.905813:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.910355:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.910636:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052370432 00000100:00100000:2.0:1746129757.910645:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052370432 00002000:00100000:2.0:1746129757.910687:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a504c700 x1830949052370432/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.910696:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504c700 with x1830949052370432 ext(2097152->3145727) 00002000:00010000:2.0:1746129757.910702:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a504c700 00000100:00100000:2.0:1746129757.910733:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052370688 00000100:00100000:2.0:1746129757.910737:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052370688 00002000:00100000:2.0:1746129757.910753:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800a504dc00 x1830949052370688/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.910759:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504dc00 with x1830949052370688 ext(3145728->4194303) 00002000:00010000:2.0:1746129757.910762:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a504dc00 00000100:00100000:2.0:1746129757.910791:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4285 00000100:00100000:2.0:1746129757.910800:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1962:x1830949052370432:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129757.911517:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4286 00000100:00100000:1.0:1746129757.911524:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+42:1962:x1830949052370688:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129757.915055:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.915139:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129757.915196:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052370944 00000100:00100000:1.0:1746129757.915204:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052370944 00002000:00100000:1.0:1746129757.915239:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800a504f800 x1830949052370944/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129757.915248:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504f800 with x1830949052370944 ext(2097152->3145727) 00002000:00010000:1.0:1746129757.915253:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504f800 00000100:00100000:1.0:1746129757.915268:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052371200 00000100:00100000:1.0:1746129757.915270:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052371200 00002000:00100000:1.0:1746129757.915281:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8800a504fb80 x1830949052371200/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129757.915298:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504fb80 with x1830949052371200 ext(3145728->4194303) 00002000:00010000:1.0:1746129757.915301:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504fb80 00000100:00100000:1.0:1746129757.915314:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4287 00000100:00100000:1.0:1746129757.915322:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052370944:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129757.915943:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+30:1964:x1830949052369408:12345-192.168.204.31@tcp:3:cat.0 Request processed in 26353us (30675us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129757.915948:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4281 00002000:00100000:0.0:1746129757.915953:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a504e680 x1830949052369408/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129757.915959:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504e680 with x1830949052369408 ext(2097152->3145727) 00002000:00010000:0.0:1746129757.915962:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a504e680 00000100:00100000:0.0:1746129757.915979:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4288 00000100:00100000:0.0:1746129757.915984:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949052371200:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129757.928095:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+28:1964:x1830949052369664:12345-192.168.204.31@tcp:3:cat.0 Request processed in 37216us (39879us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129757.928107:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4284 00002000:00100000:3.0:1746129757.928118:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88008fad2300 x1830949052369664/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129757.928126:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad2300 with x1830949052369664 ext(3145728->4194303) 00002000:00010000:3.0:1746129757.928132:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fad2300 00000100:00100000:0.0:1746129757.933671:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1964:x1830949052369920:12345-192.168.204.31@tcp:3:cat.0 Request processed in 43790us (44188us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129757.933683:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4282 00002000:00100000:0.0:1746129757.933694:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88008fad1500 x1830949052369920/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129757.933703:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad1500 with x1830949052369920 ext(2097152->3145727) 00002000:00010000:0.0:1746129757.933709:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fad1500 00000100:00100000:2.0:1746129757.955685:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1964:x1830949052370176:12345-192.168.204.31@tcp:3:cat.0 Request processed in 64888us (65970us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129757.955696:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4283 00002000:00100000:2.0:1746129757.955706:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88008fad3b80 x1830949052370176/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.955716:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad3b80 with x1830949052370176 ext(3145728->4194303) 00002000:00010000:2.0:1746129757.955721:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fad3b80 00000100:00100000:2.0:1746129757.958540:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+42:1962:x1830949052370432:12345-192.168.204.31@tcp:3:cat.0 Request processed in 47730us (52723us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129757.958551:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4285 00002000:00100000:2.0:1746129757.958562:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a504c700 x1830949052370432/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.958571:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504c700 with x1830949052370432 ext(2097152->3145727) 00002000:00010000:2.0:1746129757.958576:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a504c700 00000100:00100000:1.0:1746129757.972398:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1962:x1830949052370688:12345-192.168.204.31@tcp:3:cat.0 Request processed in 60865us (62040us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129757.972413:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4286 00002000:00100000:1.0:1746129757.972424:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800a504dc00 x1830949052370688/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129757.972433:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504dc00 with x1830949052370688 ext(3145728->4194303) 00002000:00010000:1.0:1746129757.972438:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a504dc00 00000100:00100000:0.0:1746129757.974710:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.976948:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.977119:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052371456 00000100:00100000:1.0:1746129757.977119:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052371584 00000100:00100000:2.0:1746129757.977126:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052371456 00000100:00100000:1.0:1746129757.977126:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052371584 00000100:00100000:2.0:1746129757.977168:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9981 00000100:00100000:1.0:1746129757.977172:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9982 00000100:00100000:2.0:1746129757.977174:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28803:x1830949052371456:12345-192.168.204.31@tcp:101:multiop.0 00000100:00100000:1.0:1746129757.977176:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28800:x1830949052371584:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129757.977203:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129757.977207:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129757.977209:0:16808:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746129757.977217:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cee00/0x48868a4e4394a779 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350022 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.977227:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841a00/0x48868a4e4394a717 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffe3 expref: 285 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.977252:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129757.977255:0:16808:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129757.977260:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8400/0x48868a4e4394a780 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35001b expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.977329:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a787 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129757.977341:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e4394a710 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffdc expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.977347:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840c00/0x48868a4e4394a741 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffea expref: 10 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.977357:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a787 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129757.977382:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840c00/0x48868a4e4394a741 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffea expref: 10 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.977392:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840c00/0x48868a4e4394a741 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffea expref: 10 pid: 16808 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746129757.977402:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130507100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053374848:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129757.977534:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a787 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.977542:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cee00/0x48868a4e4394a779 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350022 expref: 285 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.977551:0:1851:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a787 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.977560:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cee00/0x48868a4e4394a779 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350022 expref: 285 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129757.977570:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129757.977572:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129757.977575:0:1851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a787 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129757.977580:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800945cee00, rc 0) 00000100:00100000:1.0:1746129757.977613:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28800:x1830949052371584:12345-192.168.204.31@tcp:101:cat.0 Request processed in 435us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129757.977618:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9982 00010000:00010000:3.0:1746129757.977697:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e4394a710 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffdc expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129757.977705:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e4394a710 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffdc expref: 8 pid: 14315 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746129757.977714:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130504700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053374976:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129757.977734:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b37b600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129757.990823:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129757.990952:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.990957:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052371840 00000100:00100000:2.0:1746129757.990964:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052371840 00000100:00100000:0.0:1746129757.990968:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052371968 00000100:00100000:0.0:1746129757.990970:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052371968 00010000:00010000:0.0:1746129757.990991:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840c00/0x48868a4e4394a741 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffea expref: 11 pid: 16808 timeout: 804 lvb_type: 0 00002000:00100000:2.0:1746129757.990997:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff8800a504ce00 x1830949052371840/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1746129768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.991005:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504ce00 with x1830949052371840 ext(4194304->4964351) 00002000:00010000:2.0:1746129757.991008:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a504ce00 00000100:00100000:0.0:1746129757.991013:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5490 00000100:00100000:2.0:1746129757.991016:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4289 00000100:00100000:0.0:1746129757.991019:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949052371968:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129757.991020:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+28:1963:x1830949052371840:12345-192.168.204.31@tcp:3:cat.0 00010000:00010000:0.0:1746129757.991028:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129757.991033:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840c00/0x48868a4e4394a741 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffea expref: 11 pid: 16808 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746129757.991042:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840c00/0x48868a4e4394a741 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffea expref: 11 pid: 16808 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746129757.991056:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129757.991060:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a787 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.991066:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a787 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129757.991070:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129757.991100:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949052371968:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 81us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129757.991105:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5490 00000100:00100000:1.0:1746129757.992194:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949052370944:12345-192.168.204.31@tcp:3:cat.0 Request processed in 76869us (77142us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129757.992201:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4287 00002000:00100000:1.0:1746129757.992207:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800a504f800 x1830949052370944/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129757.992214:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504f800 with x1830949052370944 ext(2097152->3145727) 00002000:00010000:1.0:1746129757.992217:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504f800 00010000:00010000:3.0:1746129757.992447:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840c00/0x48868a4e4394a741 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffea expref: 10 pid: 16808 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746129757.992465:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130507100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053374848:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129757.994903:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052371200:12345-192.168.204.31@tcp:3:cat.0 Request processed in 78912us (79756us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129757.994914:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4288 00002000:00100000:0.0:1746129757.994922:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8800a504fb80 x1830949052371200/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129757.994932:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504fb80 with x1830949052371200 ext(3145728->4194303) 00002000:00010000:0.0:1746129757.994937:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504fb80 00000100:00100000:2.0:1746129757.995145:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129757.995161:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052372096 00000100:00100000:2.0:1746129757.995166:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052372096 00010000:00010000:2.0:1746129757.995186:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e4394a710 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffdc expref: 9 pid: 14315 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746129757.995213:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5491 00000100:00100000:2.0:1746129757.995218:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949052372096:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129757.995227:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129757.995232:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e4394a710 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffdc expref: 9 pid: 14315 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746129757.995241:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e4394a710 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffdc expref: 9 pid: 14315 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746129757.995257:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129757.995261:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a787 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.995268:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a787 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.995274:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a787 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129757.995289:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cee00/0x48868a4e4394a779 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350022 expref: 284 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129757.995302:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129757.995318:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949052372096:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 100us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129757.995322:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5491 00010000:00010000:3.0:1746129757.995426:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fb66800/0x48868a4e4394a710 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffdc expref: 8 pid: 14315 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746129757.995437:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130504700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053374976:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129757.995456:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a787 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129757.995462:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a787 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129757.995466:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a787 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00000040:00080000:3.0:1746129757.997249:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2905, 88 off242496 00000004:00080000:3.0:1746129757.997257:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 704055408992ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129757.997301:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2830, 88 off235976 00000004:00080000:3.0:1746129757.997304:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 704055456340ns, next at 641623252291ns, rc = 0 00000100:00100000:2.0:1746129757.997914:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+28:1963:x1830949052371840:12345-192.168.204.31@tcp:3:cat.0 Request processed in 6890us (7096us total) trans 0 rc 770048/770048 00000100:00100000:2.0:1746129757.997923:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4289 00002000:00100000:2.0:1746129757.997932:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff8800a504ce00 x1830949052371840/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:498/0 lens 488/440 e 0 to 0 dl 1746129768 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129757.997939:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504ce00 with x1830949052371840 ext(4194304->4964351) 00002000:00010000:2.0:1746129757.997944:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a504ce00 00000040:00080000:3.0:1746129758.000231:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2831, 88 off236064 00000004:00080000:3.0:1746129758.000243:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 704058394686ns, next at 641623252291ns, rc = 0 00000100:00100000:0.0:1746129758.000357:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.000383:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052372224 00000100:00100000:0.0:1746129758.000389:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052372224 00000100:00100000:0.0:1746129758.000418:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9983 00000100:00100000:0.0:1746129758.000425:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28807:x1830949052372224:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129758.000441:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129758.000456:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841400/0x48868a4e4394a78e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350029 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1746129758.001205:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2906, 88 off242584 00000004:00080000:3.0:1746129758.001213:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 704059364415ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129758.001241:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2907, 88 off242672 00000004:00080000:3.0:1746129758.001244:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 704059395990ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129758.001252:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2832, 88 off236152 00000004:00080000:3.0:1746129758.001254:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 704059406056ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129758.001260:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2833, 88 off236240 00000004:00080000:3.0:1746129758.001263:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 704059414757ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129758.001273:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2834, 88 off236328 00000004:00080000:3.0:1746129758.001276:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 704059427997ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129758.001291:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2908, 88 off242760 00000004:00080000:3.0:1746129758.001293:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 704059445431ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129758.001645:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2835, 88 off236416 00000004:00080000:3.0:1746129758.001648:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 704059800587ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129758.001656:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2909, 88 off242848 00000004:00080000:3.0:1746129758.001659:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 704059810756ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129758.001664:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2836, 88 off236504 00000004:00080000:3.0:1746129758.001666:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 704059818261ns, next at 641623252291ns, rc = 0 00000040:00080000:3.0:1746129758.001671:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2910, 88 off242936 00000004:00080000:3.0:1746129758.001673:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 704059825266ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129758.001678:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2911, 88 off243024 00000004:00080000:3.0:1746129758.001680:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 704059832266ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129758.001686:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2912, 88 off243112 00000004:00080000:3.0:1746129758.001687:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 704059839562ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129758.001692:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2913, 88 off243200 00000004:00080000:3.0:1746129758.001694:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 704059846276ns, next at 641639930618ns, rc = 0 00000040:00080000:3.0:1746129758.001699:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2837, 88 off236592 00000004:00080000:3.0:1746129758.001701:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 704059853306ns, next at 641623252291ns, rc = 0 00010000:00010000:0.0:1746129758.002603:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841400/0x48868a4e4394a78e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350029 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.002618:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841400/0x48868a4e4394a78e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350029 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.002630:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129758.002632:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129758.002635:0:1851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cee00/0x48868a4e4394a779 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350022 expref: 285 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.002641:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c841400, rc 0) 00000100:00100000:0.0:1746129758.002686:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28807:x1830949052372224:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2260us (2330us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129758.002693:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9983 00000001:00080000:1.0:1746129758.031861:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943785 is committed 00000001:00080000:1.0:1746129758.031875:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943781 is committed 00000001:00080000:1.0:1746129758.031881:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943784 is committed 00000001:00080000:1.0:1746129758.031885:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943787 is committed 00000004:00080000:1.0:1746129758.031887:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2022 committed 00000004:00080000:1.0:1746129758.031893:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2094 committed 00000004:00080000:1.0:1746129758.031898:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2093 committed 00000004:00080000:1.0:1746129758.031900:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2092 committed 00000004:00080000:1.0:1746129758.031901:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2091 committed 00000004:00080000:1.0:1746129758.031902:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2021 committed 00000004:00080000:1.0:1746129758.031904:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2090 committed 00000004:00080000:1.0:1746129758.031905:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2020 committed 00000004:00080000:1.0:1746129758.031907:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2089 committed 00000004:00080000:1.0:1746129758.031909:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2019 committed 00000004:00080000:1.0:1746129758.031910:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2018 committed 00000004:00080000:1.0:1746129758.031912:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2017 committed 00000004:00080000:1.0:1746129758.031914:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2088 committed 00000004:00080000:1.0:1746129758.031915:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2087 committed 00000004:00080000:1.0:1746129758.031917:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2016 committed 00000004:00080000:1.0:1746129758.031918:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2015 committed 00000004:00080000:1.0:1746129758.031919:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2086 committed 00000001:00080000:1.0:1746129758.031922:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943786 is committed 00000100:00100000:3.0:1746129758.032154:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746129758.032172:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053375104:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129758.032222:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129758.032270:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053375104 00000100:00100000:3.0:1746129758.032276:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053375104 00000100:00100000:3.0:1746129758.032322:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11379 00000100:00100000:3.0:1746129758.032329:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+61:3296:x1830949053375104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129758.032466:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129758.032469:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129757 -> 1746129757 00002000:00010000:3.0:1746129758.032470:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129757 -> 1746129757 00002000:00010000:3.0:1746129758.032472:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129757 -> 1746129757 00002000:00010000:3.0:1746129758.032474:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746129758.032498:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+62:3296:x1830949053375104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 170us (276us total) trans 21474840395 rc 0/0 00000100:00100000:3.0:1746129758.032504:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11379 00000100:00080000:3.0:1746129758.032524:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746129758.032596:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a787 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35001b expref: 284 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.032610:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129758.032612:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746129758.032616:0:16808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cee00/0x48868a4e4394a779 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350022 expref: 284 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.032625:0:16808:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cee00/0x48868a4e4394a779 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350022 expref: 284 pid: 1851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129758.032628:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053375232:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746129758.032632:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cee00/0x48868a4e4394a779 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350022 expref: 284 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.032638:0:16808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841400/0x48868a4e4394a78e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350029 expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.032648:0:16808:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841400/0x48868a4e4394a78e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350029 expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.032655:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841400/0x48868a4e4394a78e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350029 expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.032678:0:16808:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841400/0x48868a4e4394a78e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350029 expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129758.032686:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053375488:192.168.204.31@tcp:105: 00000004:00080000:3.0:1746129758.033341:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284f480/2, rc 0, transno 21474840395 00000100:00100000:3.0:1746129758.033346:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053375104:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129758.033354:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053375616:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129758.033406:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129758.033440:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053375872:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129758.033455:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129758.033464:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053376384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129758.033476:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129758.033483:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053376896:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129758.033492:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129758.033501:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746129758.033505:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053375360:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129758.033507:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053375232 00000100:00100000:0.0:1746129758.033511:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053375232 00000100:00100000:1.0:1746129758.033516:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129758.033526:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053376000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129758.033527:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053375872 00000100:00100000:0.0:1746129758.033529:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053375872 00000100:00100000:0.0:1746129758.033536:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053376384 00000100:00100000:1.0:1746129758.033538:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129758.033538:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053376384 00000100:00100000:1.0:1746129758.033546:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053376512:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129758.033551:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053376896 00000100:00100000:0.0:1746129758.033552:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053376896 00000100:00100000:1.0:1746129758.033556:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129758.033562:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053375360 00000100:00100000:0.0:1746129758.033563:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053375360 00000100:00100000:1.0:1746129758.033566:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053377024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129758.033571:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053376000 00000100:00100000:0.0:1746129758.033572:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053376000 00000100:00100000:1.0:1746129758.033577:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129758.033577:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053376512 00000100:00100000:0.0:1746129758.033578:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053376512 00000100:00100000:0.0:1746129758.033583:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053377024 00000100:00100000:0.0:1746129758.033585:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053377024 00000100:00100000:0.0:1746129758.033592:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11380 00000100:00100000:0.0:1746129758.033596:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+65:3298:x1830949053375232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129758.033629:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11381 00000100:00100000:1.0:1746129758.033634:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+65:3298:x1830949053375872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129758.033680:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129758.033682:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129758 -> 1746129758 00002000:00010000:0.0:1746129758.033684:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129757 -> 1746129757 00002000:00010000:0.0:1746129758.033685:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129758 -> 1746129758 00002000:00010000:0.0:1746129758.033687:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746129758.033714:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+66:3298:x1830949053375232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 117us (308us total) trans 21474840396 rc 0/0 00000100:00100000:0.0:1746129758.033719:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11380 00000100:00100000:0.0:1746129758.033729:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11382 00000100:00100000:0.0:1746129758.033733:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+71:3298:x1830949053376384:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129758.033813:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129758.033815:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129757 -> 1746129757 00002000:00010000:0.0:1746129758.033818:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746129757 -> 1746129757 00002000:00010000:0.0:1746129758.033819:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129757 -> 1746129757 00002000:00010000:0.0:1746129758.033820:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129758.033839:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+72:3298:x1830949053376384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (362us total) trans 17179873262 rc 0/0 00000100:00100000:0.0:1746129758.033843:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11382 00000100:00100000:0.0:1746129758.033868:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11383 00000100:00100000:0.0:1746129758.033872:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+71:3298:x1830949053376896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129758.033943:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+72:3298:x1830949053376896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (449us total) trans 17179873263 rc 0/0 00000100:00100000:0.0:1746129758.033947:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11383 00000100:00100000:0.0:1746129758.033956:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11384 00000100:00100000:0.0:1746129758.033959:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+65:3298:x1830949053375360:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129758.034017:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746129758.034020:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129756 -> 1746129756 00002000:00010000:0.0:1746129758.034021:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129755 -> 1746129755 00002000:00010000:0.0:1746129758.034023:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129756 -> 1746129756 00002000:00010000:0.0:1746129758.034024:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746129758.034042:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+66:3298:x1830949053375360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (524us total) trans 21474840397 rc 0/0 00000100:00100000:0.0:1746129758.034046:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11384 00000100:00100000:0.0:1746129758.034054:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11385 00000100:00100000:0.0:1746129758.034058:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+65:3298:x1830949053376000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129758.034122:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+66:3298:x1830949053376000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (583us total) trans 21474840398 rc 0/0 00000100:00100000:0.0:1746129758.034129:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11385 00000100:00100000:0.0:1746129758.034137:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11386 00000100:00100000:1.0:1746129758.034230:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+66:3298:x1830949053375872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 596us (774us total) trans 21474840399 rc 0/0 00000100:00100000:1.0:1746129758.034235:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11381 00000100:00100000:1.0:1746129758.034243:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11387 00000100:00100000:1.0:1746129758.034247:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+71:3298:x1830949053377024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129758.034328:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+72:3298:x1830949053377024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (748us total) trans 17179873264 rc 0/0 00000100:00100000:1.0:1746129758.034332:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11387 00000100:00100000:1.0:1746129758.034348:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053375744:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129758.034366:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129758.034377:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053376256:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129758.034389:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129758.034398:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053376768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129758.034409:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129758.034554:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053375744 00000100:00100000:1.0:1746129758.034558:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053375744 00000100:00100000:1.0:1746129758.034570:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053376256 00000100:00100000:1.0:1746129758.034572:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053376256 00000100:00100000:1.0:1746129758.034577:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053376768 00000100:00100000:1.0:1746129758.034579:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053376768 00000100:00100000:1.0:1746129758.034587:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11388 00000100:00100000:1.0:1746129758.034590:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+66:3297:x1830949053375744:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129758.034655:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746129758.034657:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746129758.034659:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746129758.034660:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746129758.034662:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129758.034683:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+67:3297:x1830949053375744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (316us total) trans 21474840400 rc 0/0 00000100:00100000:1.0:1746129758.034688:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11388 00000100:00100000:1.0:1746129758.034697:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11389 00000100:00100000:1.0:1746129758.034701:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+73:3297:x1830949053376256:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129758.034761:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746129758.034763:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129755 -> 1746129755 00002000:00010000:1.0:1746129758.034765:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129755 -> 1746129755 00002000:00010000:1.0:1746129758.034767:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129755 -> 1746129755 00002000:00010000:1.0:1746129758.034768:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:1.0:1746129758.034785:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+74:3297:x1830949053376256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (394us total) trans 17179873265 rc 0/0 00000100:00100000:1.0:1746129758.034789:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11389 00000100:00100000:1.0:1746129758.034797:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11390 00000100:00100000:1.0:1746129758.034801:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+73:3297:x1830949053376768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129758.034884:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+74:3297:x1830949053376768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (473us total) trans 17179873266 rc 0/0 00000100:00100000:1.0:1746129758.034888:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11390 00000004:00080000:1.0:1746129758.034909:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284d180/2, rc 0, transno 21474840400 00000100:00100000:1.0:1746129758.034912:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053375744:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129758.034919:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284d880/2, rc 0, transno 17179873265 00000100:00100000:1.0:1746129758.034925:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053376256:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129758.034930:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284df80/2, rc 0, transno 17179873266 00000100:00100000:1.0:1746129758.034933:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053376768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129758.034963:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053377280:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129758.034976:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129758.034988:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053377280 00000100:00100000:1.0:1746129758.034991:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053377280 00000100:00100000:1.0:1746129758.035002:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11391 00000100:00100000:1.0:1746129758.035006:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+74:3297:x1830949053377280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129758.035343:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+75:3297:x1830949053377280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 335us (365us total) trans 17179873267 rc 0/0 00000100:00100000:1.0:1746129758.035348:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11391 00000004:00080000:1.0:1746129758.035367:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8e6680/2, rc 0, transno 17179873267 00000100:00100000:1.0:1746129758.035370:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053377280:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129758.035382:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284ca80/2, rc 0, transno 21474840397 00000100:00100000:1.0:1746129758.035384:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053375360:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129758.035390:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284c700/2, rc 0, transno 21474840398 00000100:00100000:1.0:1746129758.035392:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053376000:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129758.035398:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009468c000/2, rc 0, transno 17179873264 00000100:00100000:1.0:1746129758.035400:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053377024:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129758.035405:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284c380/2, rc 0, transno 21474840399 00000100:00100000:1.0:1746129758.035407:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053375872:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129758.035412:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284dc00/2, rc 0, transno 17179873262 00000100:00100000:1.0:1746129758.035414:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053376384:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129758.035419:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284e680/2, rc 0, transno 17179873263 00000100:00100000:1.0:1746129758.035421:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053376896:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129758.035429:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284f100/2, rc 0, transno 21474840396 00000100:00100000:1.0:1746129758.035430:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053375232:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1746129758.036137:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746129758.036211:0:16808:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cee00/0x48868a4e4394a779 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350022 expref: 284 pid: 1851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129758.036222:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053377408:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129758.036235:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2ebcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129758.036314:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+74:3298:x1830949053376512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129758.036374:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129758.036388:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053376128:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129758.036398:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:0.0:1746129758.036400:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129758 -> 1746129758 00000100:00100000:3.0:1746129758.036401:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746129758.036402:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129757 -> 1746129757 00002000:00010000:0.0:1746129758.036404:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129758 -> 1746129758 00002000:00010000:0.0:1746129758.036405:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5673 -> 5673 00000100:00100000:3.0:1746129758.036410:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053376640:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129758.036422:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129758.036427:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+75:3298:x1830949053376512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2286us (2870us total) trans 17179873268 rc 0/0 00000100:00100000:3.0:1746129758.036430:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053377152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129758.036433:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11386 00000100:00100000:3.0:1746129758.036440:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129758.036458:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053375616 00000100:00100000:3.0:1746129758.036461:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053375616 00000100:00100000:3.0:1746129758.036474:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053376128 00000100:00100000:3.0:1746129758.036475:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053376128 00000100:00100000:3.0:1746129758.036482:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053376640 00000100:00100000:3.0:1746129758.036483:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053376640 00000100:00100000:3.0:1746129758.036489:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053377152 00000100:00100000:3.0:1746129758.036490:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053377152 00000100:00100000:3.0:1746129758.036498:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11392 00000100:00100000:3.0:1746129758.036502:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+68:3296:x1830949053375616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129758.036516:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11393 00000100:00100000:0.0:1746129758.036521:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+68:3296:x1830949053376128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129758.036563:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11394 00000100:00100000:0.0:1746129758.036567:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+76:3296:x1830949053376640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129758.036586:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+70:3296:x1830949053375616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (211us total) trans 21474840401 rc 0/0 00000100:00100000:3.0:1746129758.036591:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11392 00000100:00100000:3.0:1746129758.036604:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11395 00000100:00100000:3.0:1746129758.036607:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+76:3296:x1830949053377152:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129758.036625:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129758.036627:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129758.036629:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129758.036630:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129758.036632:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129758.036649:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+77:3296:x1830949053376640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (227us total) trans 17179873269 rc 0/0 00000100:00100000:0.0:1746129758.036654:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11394 00000100:00100000:3.0:1746129758.036675:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+77:3296:x1830949053377152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (233us total) trans 17179873270 rc 0/0 00000100:00100000:3.0:1746129758.036679:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11395 00000100:00100000:0.0:1746129758.036693:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+69:3296:x1830949053376128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 173us (291us total) trans 21474840402 rc 0/0 00000004:00080000:3.0:1746129758.036697:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284fb80/2, rc 0, transno 21474840401 00000100:00100000:0.0:1746129758.036698:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11393 00000100:00100000:3.0:1746129758.036699:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053375616:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129758.036705:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284f800/2, rc 0, transno 21474840402 00000100:00100000:3.0:1746129758.036707:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053376128:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129758.036713:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284c000/2, rc 0, transno 17179873269 00000100:00100000:3.0:1746129758.036716:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053376640:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129758.038113:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009468e680/2, rc 0, transno 17179873270 00000100:00100000:3.0:1746129758.038121:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053377152:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129758.038377:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284e300/2, rc 0, transno 17179873268 00000100:00100000:1.0:1746129758.038381:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053376512:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129758.039885:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053375488:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129758.039892:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053377408:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129758.039919:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8400/0x48868a4e4394a780 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35001b expref: 284 pid: 16808 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746129758.039933:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a787 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35001b expref: 283 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.039957:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b96aa00, rc 0) 00000100:00100000:2.0:1746129758.039988:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28803:x1830949052371456:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 62814us (65284us total) trans 8589943787 rc 0/0 00000100:00100000:2.0:1746129758.039995:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9981 00000100:00100000:0.0:1746129758.041391:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.041541:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052372352 00000100:00100000:2.0:1746129758.041546:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052372352 00000100:00100000:2.0:1746129758.041583:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3945 00000100:00100000:2.0:1746129758.041589:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50ea450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28800:x1830949052372352:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:2.0:1746129758.042277:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50ea450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28800:x1830949052372352:12345-192.168.204.31@tcp:49:cat.0 Request processed in 687us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.042290:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3945 00000100:00100000:0.0:1746129758.042471:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.042524:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.042560:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052372608 00000100:00100000:3.0:1746129758.042563:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052372608 00000100:00100000:3.0:1746129758.042578:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3946 00000100:00100000:3.0:1746129758.042582:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28803:x1830949052372608:12345-192.168.204.31@tcp:49:multiop.0 00000100:00100000:3.0:1746129758.042702:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28803:x1830949052372608:12345-192.168.204.31@tcp:49:multiop.0 Request processed in 118us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129758.042707:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3946 00000100:00100000:2.0:1746129758.042822:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052372480 00000100:00100000:2.0:1746129758.042825:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052372480 00000100:00100000:2.0:1746129758.042844:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9984 00000100:00100000:2.0:1746129758.042865:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28804:x1830949052372480:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129758.042874:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129758.042886:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f9400/0x48868a4e4394a795 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350030 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.042916:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f9400/0x48868a4e4394a795 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350030 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.042927:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f9400/0x48868a4e4394a795 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350030 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.042939:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129758.042941:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129758.042943:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800923f9400, rc 0) 00000100:00100000:2.0:1746129758.042961:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28804:x1830949052372480:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 113us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.042967:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9984 00000100:00100000:0.0:1746129758.045643:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.046102:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052372736 00000100:00100000:3.0:1746129758.046108:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052372736 00000100:00100000:3.0:1746129758.046665:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3947 00000100:00100000:3.0:1746129758.046673:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28807:x1830949052372736:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:3.0:1746129758.047035:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28807:x1830949052372736:12345-192.168.204.31@tcp:49:cat.0 Request processed in 361us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129758.047041:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3947 00010000:00010000:3.0:1746129758.050191:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129758.050366:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.050393:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.050460:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052372864 00000100:00100000:1.0:1746129758.050466:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052372864 00000100:00100000:1.0:1746129758.050516:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 584 00000100:00100000:1.0:1746129758.050523:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052372864:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129758.050535:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129758.050553:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f9400/0x48868a4e4394a795 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350030 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.050564:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129758.050567:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129758.050599:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1962:x1830949052372864:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 76us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129758.050604:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 584 00000100:00100000:3.0:1746129758.050694:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052372992 00000100:00100000:3.0:1746129758.050697:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052372992 00000100:00100000:3.0:1746129758.050715:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3948 00000100:00100000:3.0:1746129758.050720:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28804:x1830949052372992:12345-192.168.204.31@tcp:49:multiop.0 00000100:00100000:3.0:1746129758.050784:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28804:x1830949052372992:12345-192.168.204.31@tcp:49:multiop.0 Request processed in 64us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129758.050789:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3948 00000100:00100000:0.0:1746129758.062942:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.063059:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052373120 00000100:00100000:2.0:1746129758.063067:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052373120 00000100:00100000:2.0:1746129758.063109:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11396 00000100:00100000:2.0:1746129758.063116:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:28803:x1830949052373120:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129758.063136:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129758.063200:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800923f9000/0x48868a4e4394a79c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350037 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.063229:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131819600/0x48868a4e4394a6bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffb9 expref: 41 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129758.063239:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05800/0x48868a4e4394a764 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350006 expref: 27 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129758.063245:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.063249:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.063253:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800923f9000/0x48868a4e4394a79c lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1110016->1835007] (req 1110016->1835007) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350037 expref: 41 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.063308:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05800/0x48868a4e4394a764 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350006 expref: 27 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129758.063321:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05800/0x48868a4e4394a764 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350006 expref: 27 pid: 8436 timeout: 804 lvb_type: 1 00000100:00100000:2.0:1746129758.063335:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053377536:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129758.064491:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131819600/0x48868a4e4394a6bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffb9 expref: 41 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129758.064500:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131819600/0x48868a4e4394a6bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffb9 expref: 41 pid: 20441 timeout: 804 lvb_type: 1 00000100:00100000:2.0:1746129758.064509:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053377664:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129758.064528:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2eb240 going to sleep for 11 seconds 00000100:00100000:2.0:1746129758.065927:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053377536:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129758.065936:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053377664:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129758.065955:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800923f9000/0x48868a4e4394a79c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1110016->1835007] (req 1110016->1835007) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350037 expref: 41 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.065966:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800923f9000, rc 0) 00000100:00100000:2.0:1746129758.065989:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:28803:x1830949052373120:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2874us (3054us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.065996:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11396 00000100:00100000:0.0:1746129758.069732:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.069780:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.069874:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052373248 00000100:00100000:2.0:1746129758.069881:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052373248 00010000:00010000:2.0:1746129758.069909:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05800/0x48868a4e4394a764 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350006 expref: 28 pid: 8436 timeout: 804 lvb_type: 1 00000100:00100000:2.0:1746129758.069930:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052373376 00000100:00100000:2.0:1746129758.069932:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052373376 00010000:00010000:2.0:1746129758.069943:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131819600/0x48868a4e4394a6bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffb9 expref: 41 pid: 20441 timeout: 804 lvb_type: 1 00000100:00100000:2.0:1746129758.069963:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5492 00000100:00100000:2.0:1746129758.069970:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+28:1961:x1830949052373248:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129758.069981:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129758.069999:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05800/0x48868a4e4394a764 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350006 expref: 28 pid: 8436 timeout: 804 lvb_type: 1 00010000:00010000:2.0:1746129758.070008:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05800/0x48868a4e4394a764 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350006 expref: 28 pid: 8436 timeout: 804 lvb_type: 1 00010000:00010000:2.0:1746129758.070026:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05800/0x48868a4e4394a764 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350006 expref: 28 pid: 8436 timeout: 804 lvb_type: 1 00010000:00010000:2.0:1746129758.070058:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129758.070088:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+27:1961:x1830949052373248:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 119us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.070094:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5492 00000100:00100000:2.0:1746129758.070107:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5493 00000100:00100000:2.0:1746129758.070111:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1962:x1830949052373376:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129758.070117:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129758.070124:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131819600/0x48868a4e4394a6bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffb9 expref: 41 pid: 20441 timeout: 804 lvb_type: 1 00010000:00010000:2.0:1746129758.070132:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131819600/0x48868a4e4394a6bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffb9 expref: 41 pid: 20441 timeout: 804 lvb_type: 1 00010000:00010000:2.0:1746129758.070147:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131819600/0x48868a4e4394a6bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffb9 expref: 41 pid: 20441 timeout: 804 lvb_type: 1 00010000:00010000:2.0:1746129758.070155:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.070156:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.070161:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800923f9000/0x48868a4e4394a79c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1835007) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350037 expref: 40 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.070167:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800923f9000/0x48868a4e4394a79c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1835007) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350037 expref: 40 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.070190:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800923f9000/0x48868a4e4394a79c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1835007) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350037 expref: 40 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129758.070199:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053377792:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129758.070241:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2eb240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129758.074543:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.074658:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053377792:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129758.074675:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129758.075636:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1962:x1830949052373376:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5522us (5853us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.075644:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5493 00000100:00100000:3.0:1746129758.076574:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052373632 00000100:00100000:3.0:1746129758.076581:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052373632 00002000:00100000:3.0:1746129758.076614:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3ea:0x0] (1110016->1114111) req@ffff88009468fb80 x1830949052373632/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.076628:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468fb80 with x1830949052373632 ext(1110016->1114111) 00002000:00010000:3.0:1746129758.076632:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468fb80 00000100:00100000:3.0:1746129758.076654:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4290 00000100:00100000:3.0:1746129758.076660:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1963:x1830949052373632:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129758.076780:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1963:x1830949052373632:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 120us (2243us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129758.076786:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4290 00002000:00100000:3.0:1746129758.076791:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3ea:0x0] (1110016->1114111) req@ffff88009468fb80 x1830949052373632/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/4536 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.076797:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468fb80 with x1830949052373632 ext(1110016->1114111) 00002000:00010000:3.0:1746129758.076800:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468fb80 00000100:00100000:0.0:1746129758.083205:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.083234:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.083253:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.083270:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.083319:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.083338:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052373760 00000100:00100000:0.0:1746129758.083344:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052373760 00000100:00100000:0.0:1746129758.083367:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052374656 00000100:00100000:0.0:1746129758.083369:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052374656 00000100:00100000:0.0:1746129758.083380:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11397 00000100:00100000:0.0:1746129758.083386:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28804:x1830949052373760:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129758.083399:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129758.083411:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009faeac00/0x48868a4e4394a7a3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35003e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.083432:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a6ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffc7 expref: 20 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.083440:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6371a00/0x48868a4e4394a772 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350014 expref: 17 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.083445:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129758.083446:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129758.083449:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009faeac00/0x48868a4e4394a7a3 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2658304->3145727] (req 2658304->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35003e expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.083470:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6371a00/0x48868a4e4394a772 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350014 expref: 17 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.083478:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6371a00/0x48868a4e4394a772 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350014 expref: 17 pid: 3623 timeout: 804 lvb_type: 1 00000100:00100000:0.0:1746129758.083486:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053377920:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129758.083552:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a6ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffc7 expref: 20 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.083561:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a6ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffc7 expref: 20 pid: 1877 timeout: 804 lvb_type: 1 00000100:00100000:0.0:1746129758.083568:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053378048:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129758.083584:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b37b900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129758.083643:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052374144 00000100:00100000:0.0:1746129758.083646:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052374144 00002000:00100000:0.0:1746129758.083664:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009468ed80 x1830949052374144/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129758.083671:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468ed80 with x1830949052374144 ext(3145728->4194303) 00002000:00010000:0.0:1746129758.083675:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468ed80 00000100:00100000:0.0:1746129758.083683:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052374272 00000100:00100000:0.0:1746129758.083685:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052374272 00002000:00100000:0.0:1746129758.083692:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009468c380 x1830949052374272/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129758.083697:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468c380 with x1830949052374272 ext(2097152->3145727) 00010000:00010000:0.0:1746129758.083701:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a6ca lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffc7 expref: 21 pid: 1877 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746129758.083708:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a6ca lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffc7 expref: 21 pid: 1877 timeout: 804 lvb_type: 1 00002000:00010000:0.0:1746129758.083712:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009468c380 00000100:00100000:0.0:1746129758.083718:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052374400 00000100:00100000:0.0:1746129758.083720:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052374400 00002000:00100000:0.0:1746129758.083725:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009468e300 x1830949052374400/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129758.083731:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468e300 with x1830949052374400 ext(3145728->4194303) 00010000:00010000:0.0:1746129758.083734:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a6ca lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffc7 expref: 22 pid: 1877 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746129758.083739:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a6ca lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffc7 expref: 22 pid: 1877 timeout: 804 lvb_type: 1 00002000:00010000:0.0:1746129758.083748:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009468e300 00000100:00100000:0.0:1746129758.083754:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 654 00000100:00100000:0.0:1746129758.083758:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052374272:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129758.083934:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 655 00000100:00100000:1.0:1746129758.083941:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052374400:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129758.085714:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4291 00000100:00100000:3.0:1746129758.085724:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1962:x1830949052374144:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129758.087318:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11398 00000100:00100000:2.0:1746129758.087327:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+27:1964:x1830949052374656:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129758.087338:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129758.087352:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800923f9a00/0x48868a4e4394a7aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350045 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129758.087390:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053378176:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129758.087434:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2eb240 going to sleep for 11 seconds 00000100:00100000:3.0:1746129758.095533:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.095602:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052374912 00000100:00100000:1.0:1746129758.095610:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052374912 00002000:00100000:1.0:1746129758.095643:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1830912->1835007) req@ffff880130506680 x1830949052374912/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129758.095651:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130506680 with x1830949052374912 ext(1830912->1835007) 00002000:00010000:1.0:1746129758.095656:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130506680 00000100:00100000:1.0:1746129758.095683:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4292 00000100:00100000:1.0:1746129758.095689:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+42:1964:x1830949052374912:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129758.095813:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+42:1964:x1830949052374912:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 124us (287us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129758.095819:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4292 00002000:00100000:1.0:1746129758.095824:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1830912->1835007) req@ffff880130506680 x1830949052374912/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/4536 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129758.095830:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130506680 with x1830949052374912 ext(1830912->1835007) 00002000:00010000:1.0:1746129758.095833:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130506680 00000100:00100000:0.0:1746129758.102149:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00010000:0.0:1746129758.102670:0:7976:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime: 1746129757 -> 1746129758 00002000:00010000:0.0:1746129758.102673:0:7976:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime: 1746129757 -> 1746129758 00002000:00010000:0.0:1746129758.102675:0:7976:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime: 1746129757 -> 1746129758 00000100:00100000:0.0:1746129758.102692:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053378176:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129758.102720:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800923f9a00/0x48868a4e4394a7aa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350045 expref: 28 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.102731:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800923f9a00/0x48868a4e4394a7aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350045 expref: 28 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.102744:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800923f9a00, rc 0) 00000100:00100000:2.0:1746129758.103290:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053377920:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129758.103300:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053378048:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129758.103318:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009faeac00/0x48868a4e4394a7a3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2658304->3145727] (req 2658304->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35003e expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.103329:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faeac00, rc 0) 00000100:00100000:3.0:1746129758.103402:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052375040 00000100:00100000:3.0:1746129758.103407:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052375040 00010000:00010000:3.0:1746129758.103431:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6371a00/0x48868a4e4394a772 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350014 expref: 18 pid: 3623 timeout: 804 lvb_type: 1 00000100:00100000:3.0:1746129758.103452:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5494 00000100:00100000:3.0:1746129758.103457:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052375040:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129758.103467:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129758.103475:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6371a00/0x48868a4e4394a772 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350014 expref: 18 pid: 3623 timeout: 804 lvb_type: 1 00010000:00010000:3.0:1746129758.103484:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6371a00/0x48868a4e4394a772 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350014 expref: 18 pid: 3623 timeout: 804 lvb_type: 1 00010000:00010000:3.0:1746129758.103499:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6371a00/0x48868a4e4394a772 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350014 expref: 18 pid: 3623 timeout: 804 lvb_type: 1 00010000:00010000:3.0:1746129758.103509:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129758.103557:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+27:1964:x1830949052374656:12345-192.168.204.31@tcp:101:cat.0 Request processed in 16231us (20236us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129758.103564:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11398 00000100:00100000:1.0:1746129758.104844:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949052374400:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 20900us (21569us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129758.104864:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 655 00002000:00100000:1.0:1746129758.104873:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009468e300 x1830949052374400/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/440 e 0 to 0 dl 1746129769 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129758.104881:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468e300 with x1830949052374400 ext(3145728->4194303) 00010000:00010000:1.0:1746129758.104888:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a6ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffc7 expref: 23 pid: 1877 timeout: 804 lvb_type: 1 00010000:00010000:1.0:1746129758.104899:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a6ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffc7 expref: 23 pid: 1877 timeout: 804 lvb_type: 1 00002000:00010000:1.0:1746129758.104905:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009468e300 00000100:00100000:2.0:1746129758.104980:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28804:x1830949052373760:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 21593us (21780us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.104986:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11397 00000100:00100000:3.0:1746129758.105420:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052375040:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1960us (3275us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129758.105426:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5494 00000100:00100000:3.0:1746129758.109727:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1962:x1830949052374144:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 23996us (26481us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129758.109737:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4291 00002000:00100000:3.0:1746129758.109746:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009468ed80 x1830949052374144/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/440 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.109755:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468ed80 with x1830949052374144 ext(3145728->4194303) 00002000:00010000:3.0:1746129758.109761:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468ed80 00000100:00100000:0.0:1746129758.113377:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.113474:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.113507:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052375552 00000100:00100000:0.0:1746129758.113515:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052375552 00000100:00100000:0.0:1746129758.113559:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3949 00000100:00100000:0.0:1746129758.113565:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28803:x1830949052375552:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:0.0:1746129758.113756:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28803:x1830949052375552:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 190us (281us total) trans 8589943788 rc 0/0 00000100:00100000:0.0:1746129758.113761:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3949 00000100:00100000:1.0:1746129758.114719:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052374272:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 30958us (31462us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129758.114727:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 654 00002000:00100000:1.0:1746129758.114735:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009468c380 x1830949052374272/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/440 e 0 to 0 dl 1746129769 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129758.114743:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468c380 with x1830949052374272 ext(2097152->3145727) 00010000:00010000:1.0:1746129758.114751:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a6ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffc7 expref: 21 pid: 1877 timeout: 804 lvb_type: 1 00010000:00010000:1.0:1746129758.114762:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a6ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffc7 expref: 21 pid: 1877 timeout: 804 lvb_type: 1 00002000:00010000:1.0:1746129758.114768:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009468c380 00000100:00100000:1.0:1746129758.114778:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052375296 00000100:00100000:1.0:1746129758.114781:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052375296 00002000:00100000:1.0:1746129758.114799:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4960256->4964351) req@ffff880095242d80 x1830949052375296/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129758.114805:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095242d80 with x1830949052375296 ext(4960256->4964351) 00002000:00010000:1.0:1746129758.114808:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095242d80 00000100:00100000:1.0:1746129758.114819:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4293 00000100:00100000:1.0:1746129758.114824:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+27:1962:x1830949052375296:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129758.114947:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+27:1962:x1830949052375296:12345-192.168.204.31@tcp:3:cat.0 Request processed in 122us (1577us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129758.114952:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4293 00002000:00100000:1.0:1746129758.114956:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4960256->4964351) req@ffff880095242d80 x1830949052375296/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/4536 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129758.114969:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095242d80 with x1830949052375296 ext(4960256->4964351) 00002000:00010000:1.0:1746129758.114971:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095242d80 00000100:00100000:0.0:1746129758.134669:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.135379:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.135875:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052375808 00000100:00100000:3.0:1746129758.135883:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052375808 00010000:00010000:3.0:1746129758.135913:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a6ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffc7 expref: 21 pid: 1877 timeout: 804 lvb_type: 1 00000100:00100000:3.0:1746129758.135936:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5495 00000100:00100000:3.0:1746129758.135949:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949052375808:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129758.135963:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129758.135980:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a6ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffc7 expref: 21 pid: 1877 timeout: 804 lvb_type: 1 00010000:00010000:3.0:1746129758.135991:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a6ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffc7 expref: 21 pid: 1877 timeout: 804 lvb_type: 1 00010000:00010000:3.0:1746129758.136009:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5216e00/0x48868a4e4394a6ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffc7 expref: 21 pid: 1877 timeout: 804 lvb_type: 1 00000100:00100000:2.0:1746129758.136700:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052375680 00000100:00100000:2.0:1746129758.136705:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052375680 00000100:00100000:2.0:1746129758.136742:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11399 00000100:00100000:2.0:1746129758.136748:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:28800:x1830949052375680:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129758.136764:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129758.136773:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800923f9800/0x48868a4e4394a7b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35004c expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.136787:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.136789:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.136795:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800923f9800/0x48868a4e4394a7b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35004c expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.136809:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800923f9800/0x48868a4e4394a7b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35004c expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.136817:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.136818:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.136822:0:8437:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009faeac00/0x48868a4e4394a7a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2658304->3145727] (req 2658304->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35003e expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.136828:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009faeac00/0x48868a4e4394a7a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2658304->3145727] (req 2658304->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35003e expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.136863:0:8437:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009faeac00/0x48868a4e4394a7a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2658304->3145727] (req 2658304->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35003e expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129758.136873:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053378304:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129758.136956:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2ebd80 going to sleep for 11 seconds 00010000:00010000:3.0:1746129758.137431:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129758.137457:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949052375808:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1514us (2078us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129758.137464:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5495 00000100:00100000:2.0:1746129758.139079:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053378304:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129758.139093:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800923f9800, rc 0) 00000100:00100000:2.0:1746129758.140898:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:28800:x1830949052375680:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4142us (6228us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.140908:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11399 00000100:00100000:0.0:1746129758.143714:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.143943:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052376064 00000100:00100000:3.0:1746129758.143950:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052376064 00002000:00100000:3.0:1746129758.143984:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (2658304->2662399) req@ffff880095241f80 x1830949052376064/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.143993:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095241f80 with x1830949052376064 ext(2658304->2662399) 00002000:00010000:3.0:1746129758.143997:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095241f80 00000100:00100000:3.0:1746129758.144472:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4294 00000100:00100000:3.0:1746129758.144480:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052376064:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129758.144747:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052376064:12345-192.168.204.31@tcp:3:cat.0 Request processed in 267us (1039us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129758.144754:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4294 00002000:00100000:3.0:1746129758.144760:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (2658304->2662399) req@ffff880095241f80 x1830949052376064/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/4536 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.144767:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095241f80 with x1830949052376064 ext(2658304->2662399) 00002000:00010000:3.0:1746129758.144769:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095241f80 00000100:00100000:0.0:1746129758.145496:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.145688:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052376320 00000100:00100000:3.0:1746129758.145693:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052376320 00002000:00100000:3.0:1746129758.145711:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880095241c00 x1830949052376320/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.145718:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095241c00 with x1830949052376320 ext(3145728->4194303) 00002000:00010000:3.0:1746129758.145721:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095241c00 00000100:00100000:3.0:1746129758.145739:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4295 00000100:00100000:3.0:1746129758.145744:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052376320:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129758.152373:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.152507:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052376448 00000100:00100000:2.0:1746129758.152514:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052376448 00000100:00100000:2.0:1746129758.152550:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11400 00000100:00100000:2.0:1746129758.152556:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+27:28804:x1830949052376448:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129758.152572:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129758.152586:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800923f9e00/0x48868a4e4394a7b8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350053 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.152615:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a6c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffc0 expref: 39 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129758.152623:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b96b400/0x48868a4e4394a76b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35000d expref: 28 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129758.152629:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.152630:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.152633:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800923f9e00/0x48868a4e4394a7b8 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->3567615] (req 3145728->3567615) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350053 expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.152656:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b96b400/0x48868a4e4394a76b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35000d expref: 28 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129758.152666:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b96b400/0x48868a4e4394a76b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35000d expref: 28 pid: 7975 timeout: 804 lvb_type: 1 00000100:00100000:2.0:1746129758.152676:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053378432:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129758.152756:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a6c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffc0 expref: 39 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129758.152764:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a6c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffc0 expref: 39 pid: 1877 timeout: 804 lvb_type: 1 00000100:00100000:2.0:1746129758.152775:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053378560:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129758.152792:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2ebd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129758.154004:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052376320:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 8255us (8506us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129758.154013:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4295 00002000:00100000:3.0:1746129758.154021:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880095241c00 x1830949052376320/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/440 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.154028:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095241c00 with x1830949052376320 ext(3145728->4194303) 00002000:00010000:3.0:1746129758.154032:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095241c00 00000100:00100000:2.0:1746129758.156222:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053378432:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129758.156531:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053378560:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129758.156553:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800923f9e00/0x48868a4e4394a7b8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->3567615] (req 3145728->3567615) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350053 expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.156567:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800923f9e00, rc 0) 00000100:00100000:2.0:1746129758.156612:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+28:28804:x1830949052376448:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4055us (4246us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.156620:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11400 00000100:00100000:0.0:1746129758.156809:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.156843:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.156879:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052376576 00000100:00100000:1.0:1746129758.156884:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052376576 00010000:00010000:1.0:1746129758.156904:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b96b400/0x48868a4e4394a76b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35000d expref: 28 pid: 7975 timeout: 804 lvb_type: 1 00000100:00100000:1.0:1746129758.156919:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052376704 00000100:00100000:1.0:1746129758.156922:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052376704 00000100:00100000:3.0:1746129758.156923:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5496 00010000:00010000:1.0:1746129758.156929:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a6c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffc0 expref: 40 pid: 1877 timeout: 804 lvb_type: 1 00000100:00100000:3.0:1746129758.156931:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+28:1961:x1830949052376576:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129758.156941:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129758.156941:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5497 00000100:00100000:1.0:1746129758.156945:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1963:x1830949052376704:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129758.156949:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129758.156957:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b96b400/0x48868a4e4394a76b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35000d expref: 28 pid: 7975 timeout: 804 lvb_type: 1 00010000:00010000:1.0:1746129758.156957:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a6c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffc0 expref: 40 pid: 1877 timeout: 804 lvb_type: 1 00010000:00010000:1.0:1746129758.156965:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a6c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffc0 expref: 40 pid: 1877 timeout: 804 lvb_type: 1 00010000:00010000:3.0:1746129758.156975:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b96b400/0x48868a4e4394a76b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35000d expref: 28 pid: 7975 timeout: 804 lvb_type: 1 00010000:00010000:1.0:1746129758.156996:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5217200/0x48868a4e4394a6c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffc0 expref: 40 pid: 1877 timeout: 804 lvb_type: 1 00010000:00010000:3.0:1746129758.157090:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b96b400/0x48868a4e4394a76b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35000d expref: 28 pid: 7975 timeout: 804 lvb_type: 1 00010000:00010000:1.0:1746129758.157096:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129758.157098:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129758.157104:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800923f9e00/0x48868a4e4394a7b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350053 expref: 27 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.157112:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800923f9e00/0x48868a4e4394a7b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350053 expref: 27 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.157133:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129758.157144:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800923f9e00/0x48868a4e4394a7b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350053 expref: 27 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129758.157150:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+27:1961:x1830949052376576:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 222us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129758.157153:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053378688:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129758.157156:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5496 00000100:00100000:1.0:1746129758.157719:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129758.158405:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.158438:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.158556:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052376832 00000100:00100000:1.0:1746129758.158560:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052376832 00000100:00100000:2.0:1746129758.158597:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052376960 00000100:00100000:2.0:1746129758.158601:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052376960 00000100:00100000:2.0:1746129758.158763:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11401 00000100:00100000:2.0:1746129758.158770:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052376960:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129758.158782:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129758.158793:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800923f9c00/0x48868a4e4394a7bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350061 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.158812:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800923f9c00/0x48868a4e4394a7bf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350061 expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129758.158820:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800923f9c00/0x48868a4e4394a7bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350061 expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129758.158900:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11402 00000100:00100000:1.0:1746129758.158906:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1961:x1830949052376832:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129758.158912:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129758.158919:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05a00/0x48868a4e4394a7c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35005a expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129758.158945:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053378816:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129758.158989:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510c00 going to sleep for 11 seconds 00010000:00010000:2.0:1746129758.159177:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800923f9c00, rc 0) 00000100:00100000:2.0:1746129758.159198:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052376960:12345-192.168.204.31@tcp:101:cat.0 Request processed in 429us (759us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129758.159203:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11401 00000100:00100000:2.0:1746129758.159536:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053378688:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129758.159546:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129758.159573:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1963:x1830949052376704:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2627us (2729us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.159580:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5497 00002000:00010000:1.0:1746129758.160940:0:7976:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime: 1746129757 -> 1746129758 00000100:00100000:1.0:1746129758.160961:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053378816:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129758.160980:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05a00/0x48868a4e4394a7c6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35005a expref: 40 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129758.160995:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05a00/0x48868a4e4394a7c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35005a expref: 40 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129758.161009:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e05a00, rc 0) 00000100:00100000:1.0:1746129758.161492:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1961:x1830949052376832:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2584us (3089us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129758.161498:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11402 00000100:00100000:0.0:1746129758.162452:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.162529:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052377216 00000100:00100000:3.0:1746129758.162534:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052377216 00002000:00100000:3.0:1746129758.162565:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3563520->3567615) req@ffff88012ba39180 x1830949052377216/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.162574:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba39180 with x1830949052377216 ext(3563520->3567615) 00002000:00010000:3.0:1746129758.162578:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba39180 00000100:00100000:3.0:1746129758.162606:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4296 00000100:00100000:3.0:1746129758.162612:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+27:1962:x1830949052377216:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129758.162727:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+27:1962:x1830949052377216:12345-192.168.204.31@tcp:3:cat.0 Request processed in 115us (277us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129758.162732:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4296 00002000:00100000:3.0:1746129758.162737:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3563520->3567615) req@ffff88012ba39180 x1830949052377216/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/4536 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.163140:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba39180 with x1830949052377216 ext(3563520->3567615) 00002000:00010000:3.0:1746129758.163143:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba39180 00000100:00100000:0.0:1746129758.163794:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.164045:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052377344 00000100:00100000:1.0:1746129758.164050:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052377344 00000100:00100000:1.0:1746129758.164082:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11403 00000100:00100000:1.0:1746129758.164088:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:28800:x1830949052377344:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129758.164214:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129758.164228:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04600/0x48868a4e4394a7cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350068 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.164249:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800923f9e00/0x48868a4e4394a7b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350053 expref: 26 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.164257:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129758.164259:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129758.164261:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04600/0x48868a4e4394a7cd lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [4194304->4964351] (req 4194304->4964351) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350068 expref: 40 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.164295:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800923f9e00/0x48868a4e4394a7b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350053 expref: 26 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.164311:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800923f9e00/0x48868a4e4394a7b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350053 expref: 26 pid: 8437 timeout: 804 lvb_type: 0 00000100:00100000:1.0:1746129758.164322:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053378944:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129758.164390:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129758.164408:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.164475:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052377600 00000100:00100000:3.0:1746129758.164479:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052377600 00000100:00100000:3.0:1746129758.164576:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3950 00000100:00100000:3.0:1746129758.164582:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:28804:x1830949052377600:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129758.164730:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28804:x1830949052377600:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 147us (321us total) trans 8589943789 rc 0/0 00000100:00100000:3.0:1746129758.164735:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3950 00000100:00100000:1.0:1746129758.167118:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053378944:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129758.167335:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04600/0x48868a4e4394a7cd lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [4194304->4964351] (req 4194304->4964351) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350068 expref: 40 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.167352:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e04600, rc 0) 00000100:00100000:1.0:1746129758.167395:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:28800:x1830949052377344:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3306us (3602us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129758.167402:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11403 00000100:00100000:1.0:1746129758.168252:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.168423:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052377728 00000100:00100000:3.0:1746129758.168430:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052377728 00002000:00100000:3.0:1746129758.168460:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3567615) req@ffff88012b8e5880 x1830949052377728/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.168468:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e5880 with x1830949052377728 ext(3145728->3567615) 00010000:00010000:3.0:1746129758.168474:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800923f9e00/0x48868a4e4394a7b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350053 expref: 27 pid: 8437 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.168484:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800923f9e00/0x48868a4e4394a7b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350053 expref: 27 pid: 8437 timeout: 804 lvb_type: 0 00002000:00010000:3.0:1746129758.168489:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b8e5880 00000100:00100000:3.0:1746129758.168503:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 656 00000100:00100000:3.0:1746129758.168509:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+27:1962:x1830949052377728:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129758.174733:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+29:1962:x1830949052377728:12345-192.168.204.31@tcp:4:cat.0 Request processed in 6216us (6474us total) trans 17179873271 rc 0/0 00000100:00100000:3.0:1746129758.174743:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 656 00002000:00100000:3.0:1746129758.174753:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3567615) req@ffff88012b8e5880 x1830949052377728/t17179873271(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/448 e 0 to 0 dl 1746129769 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.174761:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e5880 with x1830949052377728 ext(3145728->3567615) 00010000:00010000:3.0:1746129758.174769:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800923f9e00/0x48868a4e4394a7b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350053 expref: 29 pid: 8437 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.174782:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800923f9e00/0x48868a4e4394a7b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350053 expref: 29 pid: 8437 timeout: 804 lvb_type: 0 00002000:00010000:3.0:1746129758.174788:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b8e5880 00000100:00100000:0.0:1746129758.176368:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.176429:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052377856 00000100:00100000:2.0:1746129758.176436:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052377856 00010000:00010000:2.0:1746129758.176461:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800923f9e00/0x48868a4e4394a7b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350053 expref: 29 pid: 8437 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746129758.176534:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5498 00000100:00100000:2.0:1746129758.176541:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+29:1963:x1830949052377856:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129758.176553:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129758.176569:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800923f9e00/0x48868a4e4394a7b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350053 expref: 29 pid: 8437 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746129758.176577:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800923f9e00/0x48868a4e4394a7b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350053 expref: 29 pid: 8437 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746129758.176595:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800923f9e00/0x48868a4e4394a7b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350053 expref: 29 pid: 8437 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746129758.176764:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.176767:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.176774:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04600/0x48868a4e4394a7cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350068 expref: 39 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.176782:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04600/0x48868a4e4394a7cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350068 expref: 39 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.176808:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04600/0x48868a4e4394a7cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350068 expref: 39 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129758.176817:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053379072:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129758.176900:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2ebd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129758.178162:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053379072:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129758.178173:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129758.178195:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+28:1963:x1830949052377856:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1654us (1830us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.178201:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5498 00000100:00100000:0.0:1746129758.180632:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.180696:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052378112 00000100:00100000:3.0:1746129758.180703:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052378112 00002000:00100000:3.0:1746129758.180737:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88012ba3b100 x1830949052378112/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.180745:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3b100 with x1830949052378112 ext(4194304->4964351) 00002000:00010000:3.0:1746129758.180749:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba3b100 00000100:00100000:3.0:1746129758.180819:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4297 00000100:00100000:3.0:1746129758.180826:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1962:x1830949052378112:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129758.186703:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1962:x1830949052378112:12345-192.168.204.31@tcp:3:cat.0 Request processed in 5870us (6070us total) trans 0 rc 770048/770048 00000100:00100000:3.0:1746129758.186714:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4297 00002000:00100000:3.0:1746129758.186723:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88012ba3b100 x1830949052378112/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/440 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.186732:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3b100 with x1830949052378112 ext(4194304->4964351) 00002000:00010000:3.0:1746129758.186737:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba3b100 00000100:00100000:0.0:1746129758.190069:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.190215:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052378240 00000100:00100000:1.0:1746129758.190223:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052378240 00000100:00100000:1.0:1746129758.190273:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11404 00000100:00100000:1.0:1746129758.190289:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052378240:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129758.190303:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129758.190318:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05000/0x48868a4e4394a7d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35006f expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.190343:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05000/0x48868a4e4394a7d4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35006f expref: 22 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129758.190356:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05000/0x48868a4e4394a7d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35006f expref: 22 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129758.190372:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e05000, rc 0) 00000100:00100000:1.0:1746129758.190406:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052378240:12345-192.168.204.31@tcp:101:cat.0 Request processed in 127us (344us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129758.190411:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11404 00000100:00100000:0.0:1746129758.192447:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.193137:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052378368 00000100:00100000:2.0:1746129758.193144:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052378368 00000100:00100000:2.0:1746129758.193268:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11405 00000100:00100000:2.0:1746129758.193275:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052378368:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129758.193297:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129758.193310:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800923f8200/0x48868a4e4394a7db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350076 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.193337:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800923f8200/0x48868a4e4394a7db lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350076 expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129758.193346:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800923f8200/0x48868a4e4394a7db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350076 expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129758.193490:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800923f8200, rc 0) 00000100:00100000:2.0:1746129758.193605:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052378368:12345-192.168.204.31@tcp:101:cat.0 Request processed in 329us (1162us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129758.193610:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11405 00000100:00100000:0.0:1746129758.197476:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.197560:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052378624 00000100:00100000:3.0:1746129758.197566:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052378624 00000100:00100000:3.0:1746129758.197607:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3951 00000100:00100000:3.0:1746129758.197615:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28800:x1830949052378624:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:3.0:1746129758.197766:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28800:x1830949052378624:12345-192.168.204.31@tcp:35:cat.0 Request processed in 152us (296us total) trans 8589943790 rc 0/0 00000100:00100000:3.0:1746129758.197772:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3951 00000100:00100000:0.0:1746129758.207840:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.208107:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052378752 00000100:00100000:2.0:1746129758.208114:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052378752 00000100:00100000:2.0:1746129758.208174:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9985 00000100:00100000:2.0:1746129758.208181:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+6:28812:x1830949052378752:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129758.208201:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129758.208215:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8e00/0x48868a4e4394a7e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35007d expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.208259:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8c00/0x48868a4e4394a7e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.208269:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8c00/0x48868a4e4394a7e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.208288:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8c00/0x48868a4e4394a7e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.208299:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8600/0x48868a4e4394a7f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.208305:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8600/0x48868a4e4394a7f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.208310:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8600/0x48868a4e4394a7f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.208397:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a7f7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.208403:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.208409:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129758.208433:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:2.0:1746129758.208437:0:1851:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129758.208447:0:1851:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.208455:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.208460:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8c00/0x48868a4e4394a7e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.208464:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8c00/0x48868a4e4394a7e9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.208468:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8c00/0x48868a4e4394a7e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.208473:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800923f8c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129758.208475:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8c00/0x48868a4e4394a7e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.208481:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8c00/0x48868a4e4394a7e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.208489:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129758.208491:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129758.208495:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8c00/0x48868a4e4394a7e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.208499:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8c00/0x48868a4e4394a7e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.208523:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8600/0x48868a4e4394a7f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.208528:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8600/0x48868a4e4394a7f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.208532:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8600/0x48868a4e4394a7f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.208535:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800923f8600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129758.208537:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8600/0x48868a4e4394a7f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.208541:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8600/0x48868a4e4394a7f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.208547:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e2d8e00) 00010000:00010000:2.0:1746129758.208548:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129758.208550:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8600/0x48868a4e4394a7f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.208554:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8600/0x48868a4e4394a7f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.208575:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8e00/0x48868a4e4394a7e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35007d expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.208584:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a7f7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35007d expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.208589:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129758.208590:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129758.208592:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800923f8a00, rc 0) 00000100:00100000:2.0:1746129758.208628:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+7:28812:x1830949052378752:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 448us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.208633:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9985 00000100:00080000:1.0:1746129758.208811:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129758.213554:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.213584:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.213605:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.213627:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.213634:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052378880 00000100:00100000:0.0:1746129758.213639:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.213642:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052378880 00000100:00100000:1.0:1746129758.213656:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052379136 00000100:00100000:1.0:1746129758.213657:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052379136 00000100:00100000:0.0:1746129758.213668:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.213681:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052379008 00000100:00100000:0.0:1746129758.213682:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052379264 00000100:00100000:1.0:1746129758.213683:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052379008 00000100:00100000:0.0:1746129758.213684:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052379264 00000100:00100000:1.0:1746129758.213692:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052379392 00000100:00100000:1.0:1746129758.213693:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052379392 00000100:00100000:0.0:1746129758.213695:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052379520 00000100:00100000:0.0:1746129758.213696:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052379520 00000100:00100000:1.0:1746129758.213705:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11406 00000100:00100000:1.0:1746129758.213710:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052379136:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129758.213727:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129758.213742:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05800/0x48868a4e4394a7fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350092 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.213760:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129758.213761:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129758.213769:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05800/0x48868a4e4394a7fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350092 expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129758.213786:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05800/0x48868a4e4394a7fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350092 expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129758.213795:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e05800, rc 0) 00000100:00100000:1.0:1746129758.213832:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949052379136:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 120us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129758.214793:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11407 00000100:00100000:1.0:1746129758.214801:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11406 00000100:00100000:0.0:1746129758.214803:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949052379008:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129758.214811:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129758.214816:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11408 00010000:00010000:0.0:1746129758.214818:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f897e00/0x48868a4e4394a805 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35008b expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129758.214821:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052379264:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129758.214827:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129758.214834:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04e00/0x48868a4e4394a80c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350099 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129758.214883:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053379200:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129758.214952:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129758.214954:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129758.214959:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f897e00/0x48868a4e4394a805 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35008b expref: 12 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.214969:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f897e00/0x48868a4e4394a805 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35008b expref: 12 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.214977:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f897e00, rc 0) 00000100:00100000:0.0:1746129758.214993:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949052379008:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 193us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129758.214998:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11407 00000100:00100000:0.0:1746129758.215009:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11409 00000100:00100000:0.0:1746129758.215013:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949052379392:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129758.215019:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129758.215025:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f897000/0x48868a4e4394a813 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3500a0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.215034:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129758.215036:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129758.215040:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f897000/0x48868a4e4394a813 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500a0 expref: 13 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.215048:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f897000/0x48868a4e4394a813 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500a0 expref: 13 pid: 7975 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129758.215054:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11410 00010000:00010000:0.0:1746129758.215054:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f897000, rc 0) 00000100:00100000:3.0:1746129758.215061:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052379520:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:0.0:1746129758.215066:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949052379392:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 53us (1427us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129758.215067:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129758.215070:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11409 00010000:00010000:3.0:1746129758.215073:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7600/0x48868a4e4394a81a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3500a7 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.215087:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7600/0x48868a4e4394a81a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500a7 expref: 12 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129758.215094:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7600/0x48868a4e4394a81a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500a7 expref: 12 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129758.215119:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb7600, rc 0) 00000100:00100000:3.0:1746129758.215134:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052379520:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 74us (1464us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129758.215138:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11410 00000100:00100000:0.0:1746129758.215228:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11411 00000100:00100000:0.0:1746129758.215232:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949052378880:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129758.215238:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129758.215244:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f897200/0x48868a4e4394a821 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350084 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.215252:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129758.215253:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129758.215257:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f897200/0x48868a4e4394a821 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350084 expref: 13 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.215265:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f897200/0x48868a4e4394a821 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350084 expref: 13 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.215271:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f897200, rc 0) 00000100:00100000:0.0:1746129758.215299:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949052378880:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 66us (1752us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129758.215307:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11411 00000100:00100000:1.0:1746129758.216041:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129758.218158:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053379200:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129758.218189:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04e00/0x48868a4e4394a80c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350099 expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129758.218201:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04e00/0x48868a4e4394a80c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350099 expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129758.218448:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e04e00, rc 0) 00000100:00100000:2.0:1746129758.218496:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052379264:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3672us (4865us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129758.218504:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11408 00000100:00100000:0.0:1746129758.221103:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.221161:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052379776 00000100:00100000:3.0:1746129758.221167:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052379776 00000100:00100000:3.0:1746129758.221211:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9986 00000100:00100000:3.0:1746129758.221218:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+7:28812:x1830949052379776:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129758.221235:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129758.221249:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7400/0x48868a4e4394a828 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3500ae expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.221332:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a82f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129758.221343:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a7f7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35007d expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.221349:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a82f lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129758.221372:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a7f7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35007d expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.221382:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a7f7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35007d expref: 8 pid: 1851 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746129758.221392:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130504e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053379328:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129758.221461:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129758.224543:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.224623:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130504e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053379328:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129758.224641:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a82f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:2.0:1746129758.224784:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052379904 00000100:00100000:2.0:1746129758.224790:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052379904 00010000:00010000:2.0:1746129758.224814:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a7f7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35007d expref: 9 pid: 1851 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746129758.224969:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5499 00000100:00100000:2.0:1746129758.224976:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052379904:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129758.224987:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129758.224992:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a7f7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35007d expref: 9 pid: 1851 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746129758.225001:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a7f7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35007d expref: 9 pid: 1851 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746129758.225017:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a7f7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35007d expref: 9 pid: 1851 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746129758.225027:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129758.225031:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a82f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.225038:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a82f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.225044:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a82f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.225058:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129758.225102:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052379904:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 126us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.225108:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5499 00010000:00010000:0.0:1746129758.225153:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a82f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129758.225159:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a82f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:0.0:1746129758.225174:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129758.225287:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7400/0x48868a4e4394a828 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500ae expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.225303:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a82f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500ae expref: 8 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.225308:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129758.225310:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129758.225312:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb6600, rc 0) 00000100:00100000:0.0:1746129758.225338:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:28812:x1830949052379776:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4121us (4240us total) trans 8589943791 rc 0/0 00000100:00100000:0.0:1746129758.225344:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9986 00000100:00100000:0.0:1746129758.232742:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.232838:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052380032 00000100:00100000:1.0:1746129758.232866:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052380032 00000100:00100000:1.0:1746129758.232914:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9987 00000100:00100000:1.0:1746129758.232922:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:28812:x1830949052380032:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129758.232943:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129758.232958:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a83d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3500b5 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.233064:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04c00/0x48868a4e4394a844 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.233077:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a82f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500ae expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.233083:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04c00/0x48868a4e4394a844 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.233108:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a82f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500ae expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.233118:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a82f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500ae expref: 9 pid: 16808 timeout: 804 lvb_type: 0 00000100:00100000:1.0:1746129758.233128:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053379456:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129758.233407:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129758.238614:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.238707:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053379456:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129758.238731:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04c00/0x48868a4e4394a844 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:3.0:1746129758.238840:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052380160 00000100:00100000:3.0:1746129758.238896:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052380160 00010000:00010000:3.0:1746129758.238925:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a82f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500ae expref: 10 pid: 16808 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746129758.238962:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5500 00000100:00100000:3.0:1746129758.238969:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949052380160:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129758.238981:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129758.238986:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a82f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500ae expref: 10 pid: 16808 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.238995:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a82f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500ae expref: 10 pid: 16808 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.239013:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6600/0x48868a4e4394a82f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500ae expref: 10 pid: 16808 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.239027:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129758.239031:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04c00/0x48868a4e4394a844 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129758.239039:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04c00/0x48868a4e4394a844 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129758.239044:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04c00/0x48868a4e4394a844 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129758.239066:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129758.239099:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+9:1961:x1830949052380160:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 130us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129758.239105:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5500 00010000:00010000:1.0:1746129758.239193:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04c00/0x48868a4e4394a844 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.239199:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04c00/0x48868a4e4394a844 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:1.0:1746129758.239231:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:1.0:1746129758.239234:0:16808:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746129758.239246:0:16808:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04c00/0x48868a4e4394a844 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.239269:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a83d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500b5 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.239299:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04c00/0x48868a4e4394a844 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500b5 expref: 8 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.239304:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129758.239306:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129758.239309:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e04c00, rc 0) 00000100:00100000:1.0:1746129758.239329:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:28812:x1830949052380032:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 6409us (6594us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129758.239335:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9987 00000100:00100000:0.0:1746129758.242946:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.243032:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052380416 00000100:00100000:1.0:1746129758.243040:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052380416 00000100:00100000:1.0:1746129758.243121:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9988 00000100:00100000:1.0:1746129758.243129:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28815:x1830949052380416:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129758.243154:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129758.243167:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05600/0x48868a4e4394a84b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3500bc expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.243241:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05200/0x48868a4e4394a852 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.243249:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05200/0x48868a4e4394a852 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.243255:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05200/0x48868a4e4394a852 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.243261:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a859 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.243267:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a859 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.243270:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a859 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.243352:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04400/0x48868a4e4394a860 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.243357:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04400/0x48868a4e4394a860 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.243360:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04400/0x48868a4e4394a860 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:1.0:1746129758.243365:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129758.243415:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05200/0x48868a4e4394a852 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.243419:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05200/0x48868a4e4394a852 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.243422:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05200/0x48868a4e4394a852 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.243425:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8e05200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129758.243427:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05200/0x48868a4e4394a852 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.243430:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05200/0x48868a4e4394a852 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.243436:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129758.243438:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129758.243441:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05200/0x48868a4e4394a852 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.243443:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05200/0x48868a4e4394a852 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.243465:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a859 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.243469:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a859 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.243473:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a859 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.243477:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8e05e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129758.243479:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a859 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.243484:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a859 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.243490:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012bfcaf00) 00010000:00010000:1.0:1746129758.243581:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129758.243586:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a859 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.243591:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a859 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.243628:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05600/0x48868a4e4394a84b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500bc expref: 288 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.243642:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04400/0x48868a4e4394a860 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500bc expref: 287 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.243648:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129758.243649:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129758.243652:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e04400, rc 0) 00000100:00100000:1.0:1746129758.243688:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:28815:x1830949052380416:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 560us (750us total) trans 8589943792 rc 0/0 00000100:00100000:1.0:1746129758.243694:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9988 00000100:00100000:0.0:1746129758.244081:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.244117:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052380544 00000100:00100000:2.0:1746129758.244121:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052380544 00000100:00100000:2.0:1746129758.244150:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11412 00000100:00100000:2.0:1746129758.244156:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052380544:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:0.0:1746129758.244161:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129758.244164:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129758.244173:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800923f8800/0x48868a4e4394a86e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3500c3 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129758.244219:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052380672 00000100:00100000:1.0:1746129758.244222:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052380672 00000100:00100000:1.0:1746129758.244238:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11413 00000100:00100000:1.0:1746129758.244243:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052380672:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129758.244250:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129758.244259:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04000/0x48868a4e4394a875 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3500ca expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.244274:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04000/0x48868a4e4394a875 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500ca expref: 12 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129758.244294:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04000/0x48868a4e4394a875 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500ca expref: 12 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129758.244300:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e04000, rc 0) 00000100:00100000:1.0:1746129758.244320:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052380672:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 77us (157us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129758.244325:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11413 00000100:00100000:2.0:1746129758.244376:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053379584:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129758.244428:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2ebd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129758.248383:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053379584:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129758.248415:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800923f8800/0x48868a4e4394a86e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500c3 expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129758.248428:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800923f8800/0x48868a4e4394a86e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500c3 expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129758.248441:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800923f8800, rc 0) 00000100:00100000:2.0:1746129758.248482:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052380544:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4325us (4401us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129758.248489:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11412 00000100:00100000:0.0:1746129758.250829:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.251099:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052380928 00000100:00100000:1.0:1746129758.251106:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052380928 00000100:00100000:1.0:1746129758.251155:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9989 00000100:00100000:1.0:1746129758.251162:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:28812:x1830949052380928:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129758.251177:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129758.251190:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05400/0x48868a4e4394a87c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3500d1 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.251261:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05a00/0x48868a4e4394a883 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.251271:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05a00/0x48868a4e4394a883 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.251294:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05a00/0x48868a4e4394a883 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.251305:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05a00/0x48868a4e4394a883 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.251310:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05a00/0x48868a4e4394a883 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.251315:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05a00/0x48868a4e4394a883 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.251320:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8e05a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129758.251323:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05a00/0x48868a4e4394a883 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.251331:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05a00/0x48868a4e4394a883 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.251340:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129758.251342:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746129758.251345:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05a00/0x48868a4e4394a883 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.251350:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05a00/0x48868a4e4394a883 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.251378:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05400/0x48868a4e4394a87c lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500d1 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.251384:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05400/0x48868a4e4394a87c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500d1 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.251391:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e05400, rc 0) 00000100:00100000:1.0:1746129758.251423:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:28812:x1830949052380928:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 263us (601us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129758.251428:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9989 00000100:00100000:0.0:1746129758.252522:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.252719:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052381056 00000100:00100000:2.0:1746129758.252724:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052381056 00000100:00100000:2.0:1746129758.252753:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11414 00000100:00100000:2.0:1746129758.252759:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:28815:x1830949052381056:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129758.252768:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129758.252778:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a88a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3500d8 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.252802:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800923f9800/0x48868a4e4394a7b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35004c expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.252809:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129758.252811:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129758.252814:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a88a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3162112->3362815] (req 3162112->3362815) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500d8 expref: 22 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.252837:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800923f9800/0x48868a4e4394a7b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35004c expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.252868:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800923f9800/0x48868a4e4394a7b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35004c expref: 22 pid: 8437 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746129758.252880:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053379712:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129758.253268:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2ebd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129758.253947:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.253992:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052381312 00000100:00100000:1.0:1746129758.253996:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052381312 00000100:00100000:1.0:1746129758.254029:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3952 00000100:00100000:1.0:1746129758.254034:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:28812:x1830949052381312:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:1.0:1746129758.254178:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:28812:x1830949052381312:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 142us (231us total) trans 8589943793 rc 0/0 00000100:00100000:1.0:1746129758.254184:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3952 00000100:00100000:2.0:1746129758.258453:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053379712:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129758.258480:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a88a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3162112->3362815] (req 3162112->3362815) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500d8 expref: 22 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.258495:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800923f8a00, rc 0) 00000100:00100000:2.0:1746129758.258717:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:28815:x1830949052381056:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5957us (6197us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.258724:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11414 00000100:00100000:0.0:1746129758.263529:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.263638:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052381440 00000100:00100000:2.0:1746129758.263646:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052381440 00010000:00010000:2.0:1746129758.263673:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800923f9800/0x48868a4e4394a7b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35004c expref: 22 pid: 8437 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746129758.263706:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5501 00000100:00100000:2.0:1746129758.263712:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949052381440:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129758.263726:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129758.263743:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800923f9800/0x48868a4e4394a7b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35004c expref: 22 pid: 8437 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746129758.263754:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800923f9800/0x48868a4e4394a7b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35004c expref: 22 pid: 8437 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746129758.263772:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800923f9800/0x48868a4e4394a7b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35004c expref: 22 pid: 8437 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746129758.263795:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.263797:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.263803:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a88a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3162112->18446744073709551615] (req 3162112->3362815) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500d8 expref: 21 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.263810:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a88a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3162112->18446744073709551615] (req 3162112->3362815) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500d8 expref: 21 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.263837:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a88a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3162112->18446744073709551615] (req 3162112->3362815) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500d8 expref: 21 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129758.263872:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053379840:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129758.263948:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2ebd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129758.266947:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.267042:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052381696 00000100:00100000:3.0:1746129758.267049:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052381696 00002000:00100000:3.0:1746129758.267088:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (3162112->3166207) req@ffff88009be67100 x1830949052381696/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.267097:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be67100 with x1830949052381696 ext(3162112->3166207) 00002000:00010000:3.0:1746129758.267102:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009be67100 00000100:00100000:3.0:1746129758.267133:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4298 00000100:00100000:3.0:1746129758.267139:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1964:x1830949052381696:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129758.267294:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1964:x1830949052381696:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 154us (353us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129758.267300:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4298 00002000:00100000:3.0:1746129758.267305:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (3162112->3166207) req@ffff88009be67100 x1830949052381696/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/4536 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.267311:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be67100 with x1830949052381696 ext(3162112->3166207) 00002000:00010000:3.0:1746129758.267313:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009be67100 00000100:00100000:2.0:1746129758.267493:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053379840:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129758.267509:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129758.267531:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052381440:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3819us (4009us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.267539:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5501 00000100:00100000:0.0:1746129758.271971:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.272115:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052381952 00000100:00100000:1.0:1746129758.272122:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052381952 00002000:00100000:1.0:1746129758.272154:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3358720->3362815) req@ffff88009be64000 x1830949052381952/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129758.272163:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be64000 with x1830949052381952 ext(3358720->3362815) 00002000:00010000:1.0:1746129758.272167:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009be64000 00000100:00100000:1.0:1746129758.272180:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4299 00000100:00100000:1.0:1746129758.272186:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949052381952:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129758.272326:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949052381952:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 139us (362us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129758.272332:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4299 00002000:00100000:1.0:1746129758.272337:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3358720->3362815) req@ffff88009be64000 x1830949052381952/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/4536 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129758.272343:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be64000 with x1830949052381952 ext(3358720->3362815) 00002000:00010000:1.0:1746129758.272346:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009be64000 00000100:00100000:0.0:1746129758.279647:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.279829:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052382208 00000100:00100000:3.0:1746129758.279837:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052382208 00000100:00100000:3.0:1746129758.280064:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3953 00000100:00100000:3.0:1746129758.280073:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:28815:x1830949052382208:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129758.280229:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:28815:x1830949052382208:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 157us (589us total) trans 8589943794 rc 0/0 00000100:00100000:3.0:1746129758.280235:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3953 00000100:00100000:0.0:1746129758.292157:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.292377:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052382464 00000100:00100000:2.0:1746129758.292385:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052382464 00000100:00100000:2.0:1746129758.292463:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9990 00000100:00100000:2.0:1746129758.292470:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28818:x1830949052382464:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129758.292490:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129758.292503:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f9400/0x48868a4e4394a891 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3500df expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.292583:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8e00/0x48868a4e4394a898 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.292593:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8e00/0x48868a4e4394a898 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.292601:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8e00/0x48868a4e4394a898 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.292611:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8600/0x48868a4e4394a89f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.292617:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8600/0x48868a4e4394a89f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.292622:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8600/0x48868a4e4394a89f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.292700:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8c00/0x48868a4e4394a8a6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.292706:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8c00/0x48868a4e4394a8a6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.292711:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8c00/0x48868a4e4394a8a6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129758.292717:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129758.292778:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8e00/0x48868a4e4394a898 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.292784:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8e00/0x48868a4e4394a898 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.292789:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8e00/0x48868a4e4394a898 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.292793:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800923f8e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129758.292796:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8e00/0x48868a4e4394a898 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.292801:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8e00/0x48868a4e4394a898 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.292808:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129758.292810:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129758.292813:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8e00/0x48868a4e4394a898 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.292821:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8e00/0x48868a4e4394a898 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.294710:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8600/0x48868a4e4394a89f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.294721:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8600/0x48868a4e4394a89f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.294726:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8600/0x48868a4e4394a89f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.294730:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800923f8600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129758.294734:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8600/0x48868a4e4394a89f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.294738:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8600/0x48868a4e4394a89f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.294750:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e2d8f00) 00010000:00010000:2.0:1746129758.294752:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129758.294754:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8600/0x48868a4e4394a89f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.294758:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8600/0x48868a4e4394a89f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.294805:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f9400/0x48868a4e4394a891 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500df expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.294816:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8c00/0x48868a4e4394a8a6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500df expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.294825:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129758.294826:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129758.294828:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800923f8c00, rc 0) 00000100:00100000:2.0:1746129758.294903:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28818:x1830949052382464:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2432us (2752us total) trans 8589943795 rc 0/0 00000100:00100000:2.0:1746129758.294911:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9990 00000100:00100000:0.0:1746129758.301619:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.301760:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052382592 00000100:00100000:2.0:1746129758.301768:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052382592 00000100:00100000:2.0:1746129758.301805:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11415 00000100:00100000:2.0:1746129758.301811:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+28:28818:x1830949052382592:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129758.301827:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129758.301841:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800923f8200/0x48868a4e4394a8b4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3500e6 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.301888:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04600/0x48868a4e4394a7cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350068 expref: 39 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.301896:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f897000/0x48868a4e4394a813 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500a0 expref: 10 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129758.301901:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.301903:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.301906:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800923f8200/0x48868a4e4394a8b4 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3272704->3334143] (req 3272704->3334143) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500e6 expref: 29 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.301932:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f897000/0x48868a4e4394a813 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500a0 expref: 10 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129758.301944:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f897000/0x48868a4e4394a813 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500a0 expref: 10 pid: 7975 timeout: 804 lvb_type: 1 00000100:00100000:2.0:1746129758.301954:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053379968:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129758.302042:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04600/0x48868a4e4394a7cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350068 expref: 39 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.302049:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04600/0x48868a4e4394a7cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350068 expref: 39 pid: 7976 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746129758.302057:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053380096:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129758.302074:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2eb480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129758.305475:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.305514:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.305757:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052382848 00000100:00100000:3.0:1746129758.305764:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052382848 00010000:00010000:3.0:1746129758.305793:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04600/0x48868a4e4394a7cd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350068 expref: 40 pid: 7976 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746129758.305816:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052382720 00000100:00100000:3.0:1746129758.305818:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052382720 00010000:00010000:3.0:1746129758.305827:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f897000/0x48868a4e4394a813 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500a0 expref: 11 pid: 7975 timeout: 804 lvb_type: 1 00000100:00100000:3.0:1746129758.305871:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5502 00000100:00100000:3.0:1746129758.305877:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1962:x1830949052382848:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129758.305890:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129758.305908:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04600/0x48868a4e4394a7cd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350068 expref: 40 pid: 7976 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.305917:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04600/0x48868a4e4394a7cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350068 expref: 40 pid: 7976 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.305937:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129758.305967:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1962:x1830949052382848:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 90us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129758.305971:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5502 00000100:00100000:3.0:1746129758.306006:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5503 00000100:00100000:3.0:1746129758.306010:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052382720:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129758.306015:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129758.306020:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f897000/0x48868a4e4394a813 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500a0 expref: 11 pid: 7975 timeout: 804 lvb_type: 1 00010000:00010000:3.0:1746129758.306030:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f897000/0x48868a4e4394a813 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500a0 expref: 11 pid: 7975 timeout: 804 lvb_type: 1 00010000:00010000:3.0:1746129758.306039:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129758.306040:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129758.306045:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800923f8200/0x48868a4e4394a8b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3272704->3334143) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500e6 expref: 29 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.306051:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800923f8200/0x48868a4e4394a8b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3272704->3334143) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500e6 expref: 29 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.306072:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800923f8200/0x48868a4e4394a8b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3272704->3334143) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500e6 expref: 29 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129758.306081:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130504e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053380224:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129758.306119:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c13c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746129758.306584:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f897000/0x48868a4e4394a813 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500a0 expref: 11 pid: 7975 timeout: 804 lvb_type: 1 00000100:00100000:2.0:1746129758.307481:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053379968:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129758.307496:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04600/0x48868a4e4394a7cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350068 expref: 39 pid: 7976 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746129758.307505:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053380096:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129758.307522:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800923f8200/0x48868a4e4394a8b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->3334143) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500e6 expref: 29 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.307536:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800923f8200, rc 0) 00000100:00100000:2.0:1746129758.307575:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+29:28818:x1830949052382592:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5763us (5963us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.307581:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11415 00000100:00100000:2.0:1746129758.307990:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130504e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053380224:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129758.307999:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129758.308017:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052382720:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2005us (2502us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.308022:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5503 00000100:00100000:0.0:1746129758.311118:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.312094:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052383104 00000100:00100000:3.0:1746129758.312103:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052383104 00002000:00100000:3.0:1746129758.312138:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3272704->3276799) req@ffff88009423f480 x1830949052383104/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.312148:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423f480 with x1830949052383104 ext(3272704->3276799) 00002000:00010000:3.0:1746129758.312152:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009423f480 00000100:00100000:3.0:1746129758.312175:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4300 00000100:00100000:3.0:1746129758.312181:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+29:1961:x1830949052383104:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129758.312316:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+29:1961:x1830949052383104:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 134us (1204us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129758.312322:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4300 00002000:00100000:3.0:1746129758.312326:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3272704->3276799) req@ffff88009423f480 x1830949052383104/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/4536 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.312332:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423f480 with x1830949052383104 ext(3272704->3276799) 00002000:00010000:3.0:1746129758.312335:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009423f480 00000100:00100000:0.0:1746129758.320752:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.320950:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052383360 00000100:00100000:1.0:1746129758.320958:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052383360 00002000:00100000:1.0:1746129758.320997:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3330048->3334143) req@ffff88009423ca80 x1830949052383360/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129758.321006:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423ca80 with x1830949052383360 ext(3330048->3334143) 00002000:00010000:1.0:1746129758.321011:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009423ca80 00000100:00100000:1.0:1746129758.321040:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4301 00000100:00100000:1.0:1746129758.321048:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+29:1962:x1830949052383360:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129758.321192:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+29:1962:x1830949052383360:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 145us (448us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129758.321199:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4301 00002000:00100000:1.0:1746129758.321204:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3330048->3334143) req@ffff88009423ca80 x1830949052383360/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/4536 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129758.321209:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423ca80 with x1830949052383360 ext(3330048->3334143) 00002000:00010000:1.0:1746129758.321212:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009423ca80 00000100:00100000:0.0:1746129758.324561:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.324638:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052383616 00000100:00100000:2.0:1746129758.324645:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052383616 00000100:00100000:1.0:1746129758.326620:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9991 00000100:00100000:1.0:1746129758.326632:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:28822:x1830949052383616:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129758.326652:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129758.326668:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04600/0x48868a4e4394a8bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3500ed expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.326742:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04a00/0x48868a4e4394a8c2 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.326753:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04a00/0x48868a4e4394a8c2 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.326762:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04a00/0x48868a4e4394a8c2 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:1.0:1746129758.326771:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129758.326877:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04600/0x48868a4e4394a8bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500ed expref: 291 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.329106:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04a00/0x48868a4e4394a8c2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500ed expref: 290 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.329118:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129758.329122:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746129758.329126:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e04a00, rc 0) 00000100:00100000:1.0:1746129758.329205:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:28822:x1830949052383616:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2576us (4650us total) trans 8589943796 rc 0/0 00000100:00100000:1.0:1746129758.329213:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9991 00000100:00100000:1.0:1746129758.330692:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.330828:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052383872 00000100:00100000:0.0:1746129758.330834:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052383872 00000100:00100000:0.0:1746129758.330896:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3954 00000100:00100000:0.0:1746129758.330903:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28818:x1830949052383872:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:0.0:1746129758.331088:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28818:x1830949052383872:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 184us (401us total) trans 8589943797 rc 0/0 00000100:00100000:0.0:1746129758.331094:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3954 00000100:00100000:0.0:1746129758.336582:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.336837:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052384000 00000100:00100000:2.0:1746129758.336845:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052384000 00000100:00100000:2.0:1746129758.336903:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11416 00000100:00100000:2.0:1746129758.336911:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1961:x1830949052384000:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129758.336929:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129758.336944:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800923f9e00/0x48868a4e4394a8d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3500f4 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129758.336992:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053380352:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129758.337065:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2eb480 going to sleep for 11 seconds 00000100:00100000:1.0:1746129758.337182:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.337318:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052384128 00000100:00100000:0.0:1746129758.337321:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052384128 00000100:00100000:0.0:1746129758.337349:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11417 00000100:00100000:0.0:1746129758.337355:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052384128:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129758.337362:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129758.337371:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f897c00/0x48868a4e4394a8d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3500fb expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129758.337394:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053380480:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129758.337418:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b37bd80 going to sleep for 11 seconds 00002000:00010000:0.0:1746129758.344000:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime: 1746129756 -> 1746129758 00002000:00010000:0.0:1746129758.344007:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746129755 -> 1746129758 00002000:00010000:0.0:1746129758.344008:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime: 1746129756 -> 1746129758 00000100:00100000:0.0:1746129758.344026:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053380480:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129758.344051:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f897c00/0x48868a4e4394a8d7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500fb expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.344064:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f897c00/0x48868a4e4394a8d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500fb expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.344090:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f897c00, rc 0) 00000100:00100000:0.0:1746129758.344132:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052384128:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6776us (6950us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129758.344140:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11417 00000100:00100000:2.0:1746129758.344479:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053380352:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129758.344495:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800923f9e00/0x48868a4e4394a8d0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500f4 expref: 40 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129758.344508:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800923f9e00/0x48868a4e4394a8d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500f4 expref: 40 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129758.344530:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800923f9e00, rc 0) 00000100:00100000:2.0:1746129758.344551:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1961:x1830949052384000:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7641us (7978us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129758.344556:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11416 00000100:00100000:0.0:1746129758.363956:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.364046:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052384256 00000100:00100000:2.0:1746129758.364055:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052384256 00000100:00100000:2.0:1746129758.364100:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11418 00000100:00100000:2.0:1746129758.364107:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+29:1961:x1830949052384256:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129758.364123:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129758.364137:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800923f8400/0x48868a4e4394a8de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350102 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129758.364179:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053380608:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129758.364253:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2eb480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129758.371246:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.371405:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052384384 00000100:00100000:2.0:1746129758.371412:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052384384 00000100:00100000:2.0:1746129758.371449:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11419 00000100:00100000:2.0:1746129758.371455:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052384384:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129758.371471:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129758.371484:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800923f9600/0x48868a4e4394a8e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350109 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129758.371528:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053380736:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129758.371593:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2eb240 going to sleep for 11 seconds 00002000:00010000:3.0:1746129758.371888:0:10930:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime: 1746129758 -> 1746129759 00000100:00100000:3.0:1746129758.371909:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053380608:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129758.371930:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800923f8400/0x48868a4e4394a8de lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350102 expref: 30 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129758.371940:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800923f8400/0x48868a4e4394a8de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350102 expref: 30 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129758.371959:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800923f8400, rc 0) 00000100:00100000:3.0:1746129758.371991:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+29:1961:x1830949052384256:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7884us (8041us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129758.371996:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11418 00000100:00100000:0.0:1746129758.374166:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.374637:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.374668:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.374681:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.376429:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052384896 00000100:00100000:2.0:1746129758.376439:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052384896 00000100:00100000:0.0:1746129758.376474:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052384768 00000100:00100000:0.0:1746129758.376477:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052384768 00002000:00100000:2.0:1746129758.376478:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009ba86680 x1830949052384896/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.376488:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba86680 with x1830949052384896 ext(1048576->2097151) 00002000:00100000:0.0:1746129758.376490:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ba86300 x1830949052384768/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:2.0:1746129758.376493:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba86680 00002000:00100000:0.0:1746129758.376496:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba86300 with x1830949052384768 ext(1048576->2097151) 00002000:00010000:0.0:1746129758.376499:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba86300 00000100:00100000:0.0:1746129758.376530:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052385280 00000100:00100000:0.0:1746129758.376533:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052385280 00000100:00100000:1.0:1746129758.376538:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4302 00002000:00100000:0.0:1746129758.376543:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009ba87800 x1830949052385280/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 504/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746129758.376546:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949052384896:12345-192.168.204.31@tcp:3:cat.0 00002000:00100000:0.0:1746129758.376549:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba87800 with x1830949052385280 ext(1048576->2097151) 00002000:00010000:0.0:1746129758.376552:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba87800 00000100:00100000:0.0:1746129758.376567:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4303 00000100:00100000:0.0:1746129758.376571:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949052384768:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129758.376620:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4304 00000100:00100000:0.0:1746129758.376624:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1963:x1830949052385280:12345-192.168.204.31@tcp:3:cat.0 00002000:00010000:3.0:1746129758.376677:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746129758 -> 1746129759 00000100:00100000:3.0:1746129758.376689:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053380736:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129758.376713:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800923f9600/0x48868a4e4394a8e5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350109 expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129758.376723:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800923f9600/0x48868a4e4394a8e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350109 expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129758.376736:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800923f9600, rc 0) 00000100:00100000:3.0:1746129758.376768:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052384384:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5313us (5529us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129758.376773:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11419 00000100:00100000:2.0:1746129758.378119:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052385152 00000100:00100000:2.0:1746129758.378128:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052385152 00002000:00100000:2.0:1746129758.378154:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009ba87100 x1830949052385152/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.378161:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba87100 with x1830949052385152 ext(0->1048575) 00002000:00010000:2.0:1746129758.378165:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba87100 00000100:00100000:2.0:1746129758.378187:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4305 00000100:00100000:2.0:1746129758.378193:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1963:x1830949052385152:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129758.386347:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1963:x1830949052385280:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9715us (11657us total) trans 0 rc 323584/323584 00000100:00100000:1.0:1746129758.386357:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4304 00002000:00100000:1.0:1746129758.386367:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009ba87800 x1830949052385280/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 504/440 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 323584/323584 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129758.386375:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba87800 with x1830949052385280 ext(1048576->2097151) 00002000:00010000:1.0:1746129758.386379:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba87800 00000100:00100000:0.0:1746129758.396529:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.397258:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949052384768:12345-192.168.204.31@tcp:3:cat.0 Request processed in 20684us (22619us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129758.397268:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4303 00002000:00100000:2.0:1746129758.397285:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ba86300 x1830949052384768/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/440 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.397293:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba86300 with x1830949052384768 ext(1048576->2097151) 00002000:00010000:2.0:1746129758.397299:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba86300 00000100:00100000:1.0:1746129758.399576:0:14311:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052385536 00000100:00100000:1.0:1746129758.399584:0:14311:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052385536 00000100:00100000:1.0:1746129758.399628:0:14311:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 169 00000100:00100000:1.0:1746129758.399635:0:14311:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008edfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5278c6ae-40e3-4880-9941-e4a223d3f965+15:1962:x1830949052385536:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1746129758.399677:0:14311:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008edfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5278c6ae-40e3-4880-9941-e4a223d3f965+15:1962:x1830949052385536:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 42us (3157us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129758.399682:0:14311:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 169 00000100:00100000:3.0:1746129758.400210:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949052384896:12345-192.168.204.31@tcp:3:cat.0 Request processed in 23663us (26048us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129758.400218:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4302 00002000:00100000:3.0:1746129758.400225:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009ba86680 x1830949052384896/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/440 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.400234:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba86680 with x1830949052384896 ext(1048576->2097151) 00002000:00010000:3.0:1746129758.400238:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba86680 00000100:00100000:0.0:1746129758.405843:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.405899:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.405925:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.406762:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052385792 00000100:00100000:2.0:1746129758.406771:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052385792 00002000:00100000:2.0:1746129758.406806:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009adace00 x1830949052385792/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.406816:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adace00 with x1830949052385792 ext(0->1048575) 00002000:00010000:2.0:1746129758.406821:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adace00 00000100:00100000:2.0:1746129758.406837:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052386048 00000100:00100000:2.0:1746129758.406839:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052386048 00002000:00100000:2.0:1746129758.406872:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009adadf80 x1830949052386048/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.406879:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adadf80 with x1830949052386048 ext(1048576->2097151) 00002000:00010000:2.0:1746129758.406882:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adadf80 00000100:00100000:2.0:1746129758.406889:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052386304 00000100:00100000:2.0:1746129758.406892:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052386304 00002000:00100000:2.0:1746129758.406900:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009adaed80 x1830949052386304/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.406905:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adaed80 with x1830949052386304 ext(1048576->2097151) 00002000:00010000:2.0:1746129758.406907:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adaed80 00000100:00100000:2.0:1746129758.406917:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4306 00000100:00100000:2.0:1746129758.406923:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+29:1961:x1830949052385792:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129758.407987:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4307 00000100:00100000:2.0:1746129758.407995:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052386048:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129758.409037:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4308 00000100:00100000:2.0:1746129758.409045:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949052386304:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129758.419906:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1963:x1830949052385152:12345-192.168.204.31@tcp:3:cat.0 Request processed in 41704us (45228us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129758.419921:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4305 00002000:00100000:2.0:1746129758.419935:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009ba87100 x1830949052385152/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/440 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.419944:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba87100 with x1830949052385152 ext(0->1048575) 00002000:00010000:2.0:1746129758.419949:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba87100 00000100:00100000:3.0:1746129758.432741:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949052386048:12345-192.168.204.31@tcp:3:cat.0 Request processed in 24739us (26832us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129758.432752:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4307 00002000:00100000:3.0:1746129758.432761:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009adadf80 x1830949052386048/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/440 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.432770:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adadf80 with x1830949052386048 ext(1048576->2097151) 00002000:00010000:3.0:1746129758.432775:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adadf80 00000100:00100000:2.0:1746129758.433218:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+29:1961:x1830949052385792:12345-192.168.204.31@tcp:3:cat.0 Request processed in 26294us (27381us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129758.433225:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4306 00002000:00100000:2.0:1746129758.433230:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009adace00 x1830949052385792/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/440 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.433237:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adace00 with x1830949052385792 ext(0->1048575) 00002000:00010000:2.0:1746129758.433241:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adace00 00000100:00100000:2.0:1746129758.443963:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1961:x1830949052386304:12345-192.168.204.31@tcp:3:cat.0 Request processed in 34911us (38027us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129758.443974:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4308 00002000:00100000:2.0:1746129758.443984:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009adaed80 x1830949052386304/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/440 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.443997:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adaed80 with x1830949052386304 ext(1048576->2097151) 00002000:00010000:2.0:1746129758.444003:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adaed80 00000100:00100000:0.0:1746129758.444643:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.444721:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052386560 00000100:00100000:1.0:1746129758.444728:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052386560 00000100:00100000:1.0:1746129758.444771:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9992 00000100:00100000:1.0:1746129758.444777:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:28829:x1830949052386560:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129758.444794:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129758.444809:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05600/0x48868a4e4394a8ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350110 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.444907:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a8f3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.444918:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04c00/0x48868a4e4394a844 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500b5 expref: 8 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.444924:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04400/0x48868a4e4394a860 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500bc expref: 291 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.444929:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8c00/0x48868a4e4394a8a6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500df expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.444934:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a8f3 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.444955:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8c00/0x48868a4e4394a8a6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500df expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.444964:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8c00/0x48868a4e4394a8a6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500df expref: 11 pid: 1851 timeout: 804 lvb_type: 0 00000100:00100000:1.0:1746129758.444973:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053380864:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129758.445044:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04400/0x48868a4e4394a860 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500bc expref: 291 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.445051:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04400/0x48868a4e4394a860 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500bc expref: 291 pid: 16808 timeout: 804 lvb_type: 0 00000100:00100000:1.0:1746129758.445057:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053380992:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129758.445080:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04c00/0x48868a4e4394a844 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500b5 expref: 8 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.445087:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04c00/0x48868a4e4394a844 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500b5 expref: 8 pid: 16808 timeout: 804 lvb_type: 0 00000100:00100000:1.0:1746129758.445093:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053381120:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129758.445107:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129758.448161:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.448254:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052386688 00000100:00100000:3.0:1746129758.448261:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052386688 00000100:00100000:3.0:1746129758.448308:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11420 00000100:00100000:3.0:1746129758.448314:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:28822:x1830949052386688:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129758.448328:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129758.448343:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131819800/0x48868a4e4394a8fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350117 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.448366:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800923f8200/0x48868a4e4394a8b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->3334143) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500e6 expref: 28 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.448372:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129758.448374:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129758.448378:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131819800/0x48868a4e4394a8fa lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350117 expref: 40 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.448400:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800923f8200/0x48868a4e4394a8b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->3334143) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500e6 expref: 28 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.448408:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800923f8200/0x48868a4e4394a8b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->3334143) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500e6 expref: 28 pid: 10930 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746129758.448418:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130504a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053381248:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129758.450376:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129758.455306:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.455409:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053380864:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129758.455418:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053380992:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129758.455423:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053381120:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129758.455446:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a8f3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:0.0:1746129758.455506:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.455565:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.455594:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052386816 00000100:00100000:0.0:1746129758.455598:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052386816 00010000:00010000:0.0:1746129758.455620:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8c00/0x48868a4e4394a8a6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500df expref: 12 pid: 1851 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746129758.455645:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052386944 00000100:00100000:0.0:1746129758.455647:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052386944 00010000:00010000:0.0:1746129758.455653:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04400/0x48868a4e4394a860 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500bc expref: 292 pid: 16808 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746129758.455933:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052387072 00000100:00100000:0.0:1746129758.455936:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052387072 00010000:00010000:0.0:1746129758.455945:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04c00/0x48868a4e4394a844 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500b5 expref: 9 pid: 16808 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746129758.455978:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5504 00000100:00100000:3.0:1746129758.455986:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1964:x1830949052386816:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129758.455996:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129758.456001:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8c00/0x48868a4e4394a8a6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500df expref: 12 pid: 1851 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.456008:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8c00/0x48868a4e4394a8a6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500df expref: 12 pid: 1851 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.456027:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f8c00/0x48868a4e4394a8a6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500df expref: 12 pid: 1851 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.456042:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129758.456045:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a8f3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129758.456052:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a8f3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129758.456055:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129758.456094:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949052386816:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 110us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129758.456098:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5504 00000100:00100000:3.0:1746129758.456110:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5505 00000100:00100000:3.0:1746129758.456114:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:1964:x1830949052386944:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129758.456119:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129758.456122:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04400/0x48868a4e4394a860 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500bc expref: 292 pid: 16808 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.456128:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04400/0x48868a4e4394a860 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500bc expref: 292 pid: 16808 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.456137:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04400/0x48868a4e4394a860 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500bc expref: 292 pid: 16808 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.456143:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129758.456146:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a8f3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129758.456151:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a8f3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129758.456154:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129758.456162:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:1964:x1830949052386944:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 49us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129758.456166:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5505 00000100:00100000:3.0:1746129758.456171:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5506 00000100:00100000:3.0:1746129758.456175:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+9:1964:x1830949052387072:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129758.456180:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129758.456182:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04c00/0x48868a4e4394a844 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500b5 expref: 9 pid: 16808 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.456188:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04c00/0x48868a4e4394a844 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500b5 expref: 9 pid: 16808 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.456196:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04c00/0x48868a4e4394a844 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500b5 expref: 9 pid: 16808 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.456201:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129758.456203:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a8f3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129758.456208:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a8f3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129758.456213:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a8f3 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129758.456224:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129758.456232:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6141239f-0c60-480d-830c-e22ba61457b0+8:1964:x1830949052387072:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 57us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129758.456236:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5506 00010000:00010000:3.0:1746129758.456245:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a8f3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129758.456249:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a8f3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:3.0:1746129758.456261:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129758.456373:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05600/0x48868a4e4394a8ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350110 expref: 292 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.456385:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a8f3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350110 expref: 291 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.456390:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129758.456392:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129758.456394:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e05e00, rc 0) 00000100:00100000:3.0:1746129758.456415:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:28829:x1830949052386560:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 11638us (11773us total) trans 8589943798 rc 0/0 00000100:00100000:3.0:1746129758.456420:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9992 00000100:00100000:0.0:1746129758.459304:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.459334:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052387200 00000100:00100000:0.0:1746129758.459341:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052387200 00002000:00100000:0.0:1746129758.459375:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3272704->3334143) req@ffff88009adaf100 x1830949052387200/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129758.459384:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adaf100 with x1830949052387200 ext(3272704->3334143) 00010000:00010000:0.0:1746129758.459392:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800923f8200/0x48868a4e4394a8b4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->3334143) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500e6 expref: 29 pid: 10930 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746129758.459403:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800923f8200/0x48868a4e4394a8b4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->3334143) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500e6 expref: 29 pid: 10930 timeout: 804 lvb_type: 0 00002000:00010000:0.0:1746129758.459409:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009adaf100 00000100:00100000:0.0:1746129758.459423:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 657 00000100:00100000:0.0:1746129758.459430:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+29:1962:x1830949052387200:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129758.459535:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130504a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053381248:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129758.459555:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131819800/0x48868a4e4394a8fa lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350117 expref: 40 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.459568:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131819800, rc 0) 00000100:00100000:2.0:1746129758.459600:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:28822:x1830949052386688:12345-192.168.204.31@tcp:101:cat.0 Request processed in 11286us (11446us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.459606:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11420 00000100:00100000:0.0:1746129758.462818:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.462964:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052387328 00000100:00100000:3.0:1746129758.462971:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052387328 00000100:00100000:3.0:1746129758.463010:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11421 00000100:00100000:3.0:1746129758.463018:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+31:28826:x1830949052387328:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129758.463030:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129758.463054:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ff6000/0x48868a4e4394a908 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35011e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.463077:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800923f9000/0x48868a4e4394a79c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1835007) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350037 expref: 39 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.463084:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129758.463085:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129758.463088:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ff6000/0x48868a4e4394a908 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35011e expref: 32 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.463110:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800923f9000/0x48868a4e4394a79c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1835007) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350037 expref: 39 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.463119:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800923f9000/0x48868a4e4394a79c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1835007) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350037 expref: 39 pid: 4589 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746129758.463129:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130507480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053381376:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129758.464781:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129758.467708:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130507480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053381376:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129758.467732:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ff6000/0x48868a4e4394a908 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35011e expref: 32 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.467746:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ff6000, rc 0) 00000100:00100000:3.0:1746129758.467781:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+32:28826:x1830949052387328:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4763us (4968us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129758.467788:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11421 00000100:00100000:2.0:1746129758.469215:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+32:1962:x1830949052387200:12345-192.168.204.31@tcp:4:cat.0 Request processed in 9781us (9913us total) trans 17179873272 rc 0/0 00000100:00100000:2.0:1746129758.469225:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 657 00002000:00100000:2.0:1746129758.469232:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3272704->3334143) req@ffff88009adaf100 x1830949052387200/t17179873272(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/448 e 0 to 0 dl 1746129769 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.469241:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adaf100 with x1830949052387200 ext(3272704->3334143) 00010000:00010000:2.0:1746129758.469248:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800923f8200/0x48868a4e4394a8b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->3334143) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500e6 expref: 32 pid: 10930 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746129758.469258:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800923f8200/0x48868a4e4394a8b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->3334143) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500e6 expref: 32 pid: 10930 timeout: 804 lvb_type: 0 00002000:00010000:2.0:1746129758.469264:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009adaf100 00000100:00100000:1.0:1746129758.469473:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.470638:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052387456 00000100:00100000:3.0:1746129758.470645:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052387456 00002000:00100000:3.0:1746129758.470677:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1110016->1835007) req@ffff88012ba19180 x1830949052387456/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.470684:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba19180 with x1830949052387456 ext(1110016->1835007) 00010000:00010000:3.0:1746129758.470690:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800923f9000/0x48868a4e4394a79c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1835007) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350037 expref: 40 pid: 4589 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.470698:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800923f9000/0x48868a4e4394a79c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1835007) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350037 expref: 40 pid: 4589 timeout: 804 lvb_type: 0 00002000:00010000:3.0:1746129758.470702:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ba19180 00000100:00100000:3.0:1746129758.470718:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 658 00000100:00100000:3.0:1746129758.470724:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1962:x1830949052387456:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129758.478066:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.479384:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052387584 00000100:00100000:1.0:1746129758.479393:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052387584 00010000:00010000:1.0:1746129758.479434:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800923f8200/0x48868a4e4394a8b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->3334143) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500e6 expref: 32 pid: 10930 timeout: 804 lvb_type: 0 00000100:00100000:1.0:1746129758.479459:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5507 00000100:00100000:1.0:1746129758.479467:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+32:1961:x1830949052387584:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129758.479477:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129758.479497:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800923f8200/0x48868a4e4394a8b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3272704->3334143) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500e6 expref: 32 pid: 10930 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746129758.479506:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800923f8200/0x48868a4e4394a8b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3272704->3334143) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500e6 expref: 32 pid: 10930 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746129758.479523:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800923f8200/0x48868a4e4394a8b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3272704->3334143) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500e6 expref: 32 pid: 10930 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746129758.479543:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129758.479545:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129758.479550:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131819800/0x48868a4e4394a8fa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350117 expref: 41 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.479557:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131819800/0x48868a4e4394a8fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350117 expref: 41 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.479583:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131819800/0x48868a4e4394a8fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350117 expref: 41 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129758.479594:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053381504:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129758.479666:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129758.486685:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.486993:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053381504:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129758.487019:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129758.487069:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+31:1961:x1830949052387584:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7600us (9009us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129758.487079:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5507 00000100:00100000:2.0:1746129758.487186:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052387840 00000100:00100000:2.0:1746129758.487194:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052387840 00002000:00100000:2.0:1746129758.487234:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009adac700 x1830949052387840/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.487243:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adac700 with x1830949052387840 ext(2097152->3145727) 00002000:00010000:2.0:1746129758.487247:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adac700 00000100:00100000:2.0:1746129758.487293:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4309 00000100:00100000:2.0:1746129758.487302:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+42:1964:x1830949052387840:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129758.496627:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+44:1962:x1830949052387456:12345-192.168.204.31@tcp:4:cat.0 Request processed in 25892us (27144us total) trans 17179873273 rc 0/0 00000100:00100000:3.0:1746129758.496638:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 658 00002000:00100000:3.0:1746129758.496649:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1110016->1835007) req@ffff88012ba19180 x1830949052387456/t17179873273(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/448 e 0 to 0 dl 1746129769 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.496658:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba19180 with x1830949052387456 ext(1110016->1835007) 00010000:00010000:3.0:1746129758.496666:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800923f9000/0x48868a4e4394a79c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1835007) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350037 expref: 44 pid: 4589 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.496681:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800923f9000/0x48868a4e4394a79c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1835007) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350037 expref: 44 pid: 4589 timeout: 804 lvb_type: 0 00002000:00010000:3.0:1746129758.496692:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ba19180 00000100:00100000:2.0:1746129758.501130:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+42:1964:x1830949052387840:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13818us (14443us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129758.501143:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4309 00002000:00100000:2.0:1746129758.501155:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009adac700 x1830949052387840/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/440 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.501163:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adac700 with x1830949052387840 ext(2097152->3145727) 00002000:00010000:2.0:1746129758.501168:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adac700 00000100:00100000:0.0:1746129758.507142:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.507178:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.507266:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052387968 00000100:00100000:1.0:1746129758.507281:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052387968 00010000:00010000:1.0:1746129758.507310:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800923f9000/0x48868a4e4394a79c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1835007) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350037 expref: 42 pid: 4589 timeout: 804 lvb_type: 0 00000100:00100000:1.0:1746129758.507341:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5508 00000100:00100000:1.0:1746129758.507347:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+42:1961:x1830949052387968:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129758.507359:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129758.507377:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800923f9000/0x48868a4e4394a79c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1110016->1835007) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350037 expref: 42 pid: 4589 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746129758.507386:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800923f9000/0x48868a4e4394a79c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1110016->1835007) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350037 expref: 42 pid: 4589 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746129758.507405:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800923f9000/0x48868a4e4394a79c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1110016->1835007) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350037 expref: 42 pid: 4589 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746129758.507419:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129758.507421:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129758.507428:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ff6000/0x48868a4e4394a908 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35011e expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.507434:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ff6000/0x48868a4e4394a908 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35011e expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.507469:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091ff6000/0x48868a4e4394a908 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35011e expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129758.507481:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053381632:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129758.507550:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510180 going to sleep for 11 seconds 00000100:00100000:3.0:1746129758.508036:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052388096 00000100:00100000:3.0:1746129758.508040:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052388096 00000100:00100000:0.0:1746129758.509193:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11422 00000100:00100000:0.0:1746129758.509203:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:28822:x1830949052388096:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129758.509224:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129758.509238:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bd2000/0x48868a4e4394a90f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350125 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.509258:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009faeac00/0x48868a4e4394a7a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2658304->3145727] (req 2658304->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35003e expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.509263:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129758.509264:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129758.509267:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bd2000/0x48868a4e4394a90f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350125 expref: 22 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.509298:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009faeac00/0x48868a4e4394a7a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2658304->3145727] (req 2658304->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35003e expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.509308:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009faeac00/0x48868a4e4394a7a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2658304->3145727] (req 2658304->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35003e expref: 15 pid: 8437 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746129758.509316:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135402a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053381760:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129758.509375:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b37bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129758.511683:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.511747:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135402a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053381760:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129758.511763:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053381632:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129758.511775:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093bd2000/0x48868a4e4394a90f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350125 expref: 22 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.511779:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129758.511787:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bd2000, rc 0) 00000100:00100000:0.0:1746129758.511809:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:28822:x1830949052388096:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2608us (4629us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129758.511810:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1961:x1830949052387968:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4461us (4674us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129758.511816:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11422 00000100:00100000:1.0:1746129758.511818:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5508 00000100:00100000:0.0:1746129758.511836:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052388224 00000100:00100000:0.0:1746129758.511840:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052388224 00000100:00100000:1.0:1746129758.512060:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11423 00000100:00100000:1.0:1746129758.512068:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:28829:x1830949052388224:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129758.512078:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129758.512088:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04e00/0x48868a4e4394a916 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35012c expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.512107:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ff6000/0x48868a4e4394a908 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35011e expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.512113:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129758.512114:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129758.512117:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04e00/0x48868a4e4394a916 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1888256->2097151] (req 1888256->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35012c expref: 42 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.512134:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091ff6000/0x48868a4e4394a908 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35011e expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.512143:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091ff6000/0x48868a4e4394a908 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35011e expref: 30 pid: 8437 timeout: 804 lvb_type: 0 00000100:00100000:1.0:1746129758.512152:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053381888:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129758.512211:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129758.512740:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.514391:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052388352 00000100:00100000:2.0:1746129758.514397:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052388352 00002000:00100000:2.0:1746129758.514435:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2658304->3145727) req@ffff880135402a00 x1830949052388352/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.514443:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135402a00 with x1830949052388352 ext(2658304->3145727) 00010000:00010000:2.0:1746129758.514451:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009faeac00/0x48868a4e4394a7a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2658304->3145727] (req 2658304->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35003e expref: 16 pid: 8437 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746129758.514461:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009faeac00/0x48868a4e4394a7a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2658304->3145727] (req 2658304->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35003e expref: 16 pid: 8437 timeout: 804 lvb_type: 0 00002000:00010000:2.0:1746129758.514472:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135402a00 00000100:00100000:2.0:1746129758.514500:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 659 00000100:00100000:2.0:1746129758.514507:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:1962:x1830949052388352:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129758.516712:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.516836:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052388608 00000100:00100000:3.0:1746129758.516842:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052388608 00002000:00100000:3.0:1746129758.516882:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880094d8df80 x1830949052388608/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.516891:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8df80 with x1830949052388608 ext(1048576->2097151) 00010000:00010000:3.0:1746129758.516898:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091ff6000/0x48868a4e4394a908 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35011e expref: 31 pid: 8437 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.516907:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091ff6000/0x48868a4e4394a908 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35011e expref: 31 pid: 8437 timeout: 804 lvb_type: 0 00002000:00010000:3.0:1746129758.516913:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094d8df80 00000100:00100000:3.0:1746129758.516934:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 660 00000100:00100000:3.0:1746129758.516940:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+31:1961:x1830949052388608:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129758.522021:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053381888:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129758.522045:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04e00/0x48868a4e4394a916 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1888256->2097151] (req 1888256->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35012c expref: 42 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.522059:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e04e00, rc 0) 00000100:00100000:1.0:1746129758.522105:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+42:28829:x1830949052388224:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 10037us (10426us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129758.522112:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11423 00000100:00100000:3.0:1746129758.523396:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052388352:12345-192.168.204.31@tcp:4:cat.0 Request processed in 8883us (10650us total) trans 21474840403 rc 0/0 00000100:00100000:3.0:1746129758.523406:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 659 00002000:00100000:3.0:1746129758.523414:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2658304->3145727) req@ffff880135402a00 x1830949052388352/t21474840403(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/448 e 0 to 0 dl 1746129769 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.523426:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135402a00 with x1830949052388352 ext(2658304->3145727) 00010000:00010000:3.0:1746129758.523434:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009faeac00/0x48868a4e4394a7a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2658304->3145727] (req 2658304->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35003e expref: 18 pid: 8437 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.523444:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009faeac00/0x48868a4e4394a7a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2658304->3145727] (req 2658304->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35003e expref: 18 pid: 8437 timeout: 804 lvb_type: 0 00002000:00010000:3.0:1746129758.523450:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135402a00 00000100:00100000:3.0:1746129758.524057:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+31:1961:x1830949052388608:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7115us (7350us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129758.524063:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 660 00002000:00100000:3.0:1746129758.524069:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880094d8df80 x1830949052388608/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/440 e 0 to 0 dl 1746129769 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.524076:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8df80 with x1830949052388608 ext(1048576->2097151) 00010000:00010000:3.0:1746129758.524082:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091ff6000/0x48868a4e4394a908 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35011e expref: 31 pid: 8437 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.524091:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091ff6000/0x48868a4e4394a908 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35011e expref: 31 pid: 8437 timeout: 804 lvb_type: 0 00002000:00010000:3.0:1746129758.524096:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094d8df80 00000100:00100000:0.0:1746129758.525343:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.525391:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052388736 00000100:00100000:1.0:1746129758.525397:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052388736 00010000:00010000:1.0:1746129758.525421:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009faeac00/0x48868a4e4394a7a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2658304->3145727] (req 2658304->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35003e expref: 18 pid: 8437 timeout: 804 lvb_type: 0 00000100:00100000:1.0:1746129758.525454:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5509 00000100:00100000:1.0:1746129758.525461:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052388736:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129758.525472:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129758.525487:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009faeac00/0x48868a4e4394a7a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2658304->3145727] (req 2658304->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35003e expref: 18 pid: 8437 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746129758.525500:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009faeac00/0x48868a4e4394a7a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2658304->3145727] (req 2658304->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35003e expref: 18 pid: 8437 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746129758.525518:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009faeac00/0x48868a4e4394a7a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2658304->3145727] (req 2658304->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35003e expref: 18 pid: 8437 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746129758.525545:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129758.525547:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129758.525554:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093bd2000/0x48868a4e4394a90f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350125 expref: 21 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.525561:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bd2000/0x48868a4e4394a90f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350125 expref: 21 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.525587:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093bd2000/0x48868a4e4394a90f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350125 expref: 21 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129758.525596:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053382016:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129758.525660:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129758.533449:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.533580:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053382016:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129758.533597:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129758.533643:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1962:x1830949052388736:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8181us (8302us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129758.533652:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5509 00000100:00100000:3.0:1746129758.533745:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052388992 00000100:00100000:3.0:1746129758.533751:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052388992 00002000:00100000:3.0:1746129758.533783:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880135403100 x1830949052388992/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.533790:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135403100 with x1830949052388992 ext(2097152->3145727) 00002000:00010000:3.0:1746129758.533793:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135403100 00000100:00100000:0.0:1746129758.533909:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.534230:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052389248 00000100:00100000:3.0:1746129758.534234:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052389248 00000100:00100000:2.0:1746129758.534237:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4310 00000100:00100000:2.0:1746129758.534245:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052388992:12345-192.168.204.31@tcp:3:multiop.0 00002000:00100000:3.0:1746129758.534248:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880135401880 x1830949052389248/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.534254:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135401880 with x1830949052389248 ext(3145728->4194303) 00002000:00010000:3.0:1746129758.534257:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135401880 00000100:00100000:3.0:1746129758.534283:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4311 00000100:00100000:3.0:1746129758.534288:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+42:1962:x1830949052389248:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129758.534565:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.534593:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.534611:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.534637:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.534646:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052389760 00000100:00100000:1.0:1746129758.534649:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052389760 00010000:00010000:1.0:1746129758.534663:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091ff6000/0x48868a4e4394a908 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35011e expref: 31 pid: 8437 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746129758.534693:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5510 00000100:00100000:2.0:1746129758.534699:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+31:1962:x1830949052389760:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129758.534704:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052389376 00010000:00010000:2.0:1746129758.534707:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129758.534707:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052389376 00010000:00010000:2.0:1746129758.534721:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091ff6000/0x48868a4e4394a908 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35011e expref: 32 pid: 8437 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746129758.534723:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052389504 00000100:00100000:0.0:1746129758.534724:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052389504 00010000:00010000:2.0:1746129758.534731:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091ff6000/0x48868a4e4394a908 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35011e expref: 33 pid: 8437 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746129758.534736:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052389632 00000100:00100000:0.0:1746129758.534737:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052389632 00010000:00010000:2.0:1746129758.534748:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ff6000/0x48868a4e4394a908 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35011e expref: 33 pid: 8437 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746129758.534748:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11424 00000100:00100000:0.0:1746129758.534752:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+33:1964:x1830949052389376:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129758.534760:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129758.534763:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.534765:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129758.534768:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bd3400/0x48868a4e4394a91d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350133 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.534771:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04e00/0x48868a4e4394a916 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35012c expref: 42 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.534777:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04e00/0x48868a4e4394a916 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35012c expref: 42 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129758.534940:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135401f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053382144:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129758.534985:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04e00/0x48868a4e4394a916 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35012c expref: 42 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129758.534994:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053382272:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129758.534994:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11425 00000100:00100000:1.0:1746129758.534999:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+33:1964:x1830949052389504:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129758.535005:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129758.535011:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acc7c800/0x48868a4e4394a924 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35013a expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.535019:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129758.535021:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129758.535025:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acc7c800/0x48868a4e4394a924 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35013a expref: 34 pid: 1877 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129758.535030:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2eb9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746129758.535033:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acc7c800/0x48868a4e4394a924 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35013a expref: 34 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129758.535040:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc7c800, rc 0) 00000100:00100000:1.0:1746129758.535054:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+34:1964:x1830949052389504:12345-192.168.204.31@tcp:101:cat.0 Request processed in 56us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129758.535059:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11425 00000100:00100000:1.0:1746129758.535069:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11426 00000100:00100000:1.0:1746129758.535073:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949052389632:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129758.535078:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129758.535084:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acc7ca00/0x48868a4e4394a92b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350141 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129758.535100:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053382400:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129758.535115:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129758.535209:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b37bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129758.541206:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135401f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053382144:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129758.541236:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093bd3400/0x48868a4e4394a91d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350133 expref: 33 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.541249:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bd3400/0x48868a4e4394a91d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350133 expref: 33 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.541279:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bd3400, rc 0) 00000100:00100000:0.0:1746129758.541316:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+32:1964:x1830949052389376:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6562us (6751us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129758.541325:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11424 00000100:00100000:0.0:1746129758.541392:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.541408:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052389888 00000100:00100000:0.0:1746129758.541412:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052389888 00000100:00100000:0.0:1746129758.541433:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11427 00000100:00100000:0.0:1746129758.541438:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+44:28829:x1830949052389888:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129758.541450:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129758.541460:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800923f9800/0x48868a4e4394a932 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350148 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.541479:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131819800/0x48868a4e4394a8fa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350117 expref: 45 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.541486:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acc7c800/0x48868a4e4394a924 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35013a expref: 31 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.541491:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129758.541493:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129758.541496:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800923f9800/0x48868a4e4394a932 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->2445311] (req 2097152->2445311) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350148 expref: 45 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.541520:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800acc7c800/0x48868a4e4394a924 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35013a expref: 31 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.541530:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800acc7c800/0x48868a4e4394a924 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35013a expref: 31 pid: 1877 timeout: 804 lvb_type: 1 00000100:00100000:0.0:1746129758.541540:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135403b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053382528:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129758.541588:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131819800/0x48868a4e4394a8fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350117 expref: 45 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.541595:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131819800/0x48868a4e4394a8fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350117 expref: 45 pid: 8437 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746129758.541602:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135402300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053382656:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129758.541618:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b37bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129758.541738:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053382272:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129758.541748:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129758.541767:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+31:1962:x1830949052389760:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7069us (7129us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.541773:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5510 00000100:00100000:1.0:1746129758.541869:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053382400:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129758.541883:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acc7ca00/0x48868a4e4394a92b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350141 expref: 18 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129758.541891:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acc7ca00/0x48868a4e4394a92b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350141 expref: 18 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129758.541900:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc7ca00, rc 0) 00000100:00100000:1.0:1746129758.541915:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1964:x1830949052389632:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6842us (7303us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129758.541920:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11426 00000100:00100000:1.0:1746129758.547566:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135403b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053382528:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129758.547578:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135402300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053382656:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129758.547602:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800923f9800/0x48868a4e4394a932 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->2445311] (req 2097152->2445311) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350148 expref: 45 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.547616:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800923f9800, rc 0) 00000100:00100000:1.0:1746129758.547653:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+45:28829:x1830949052389888:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6215us (6261us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129758.547664:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11427 00000100:00100000:0.0:1746129758.548455:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.548542:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.548566:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052390144 00000100:00100000:0.0:1746129758.548571:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052390144 00000100:00100000:0.0:1746129758.548594:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11428 00000100:00100000:0.0:1746129758.548599:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+31:28826:x1830949052390144:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129758.548610:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129758.548622:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800923f8000/0x48868a4e4394a939 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35014f expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129758.548624:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052388992:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 14380us (15184us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129758.548631:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4310 00002000:00100000:2.0:1746129758.548638:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880135403100 x1830949052388992/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/440 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00010000:00010000:0.0:1746129758.548638:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129758.548642:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800923f9800/0x48868a4e4394a932 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->2445311] (req 2097152->2445311) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350148 expref: 44 pid: 3624 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746129758.548646:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135403100 with x1830949052388992 ext(2097152->3145727) 00010000:00010000:0.0:1746129758.548647:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00002000:00010000:2.0:1746129758.548650:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135403100 00010000:00010000:0.0:1746129758.548650:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800923f8000/0x48868a4e4394a939 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35014f expref: 32 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.548672:0:3624:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800923f9800/0x48868a4e4394a932 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->2445311] (req 2097152->2445311) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350148 expref: 44 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.548682:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800923f8000/0x48868a4e4394a939 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35014f expref: 32 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.548689:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800923f8000, rc 0) 00000100:00100000:0.0:1746129758.548707:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+32:28826:x1830949052390144:12345-192.168.204.31@tcp:101:cat.0 Request processed in 108us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129758.548712:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11428 00000100:00100000:3.0:1746129758.548897:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052390016 00000100:00100000:3.0:1746129758.548900:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052390016 00010000:00010000:3.0:1746129758.549063:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800acc7c800/0x48868a4e4394a924 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35013a expref: 32 pid: 1877 timeout: 804 lvb_type: 1 00000100:00100000:3.0:1746129758.549086:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5511 00000100:00100000:3.0:1746129758.549091:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135400380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+32:1964:x1830949052390016:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129758.549099:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129758.549114:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800acc7c800/0x48868a4e4394a924 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35013a expref: 32 pid: 1877 timeout: 804 lvb_type: 1 00010000:00010000:3.0:1746129758.549123:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800acc7c800/0x48868a4e4394a924 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35013a expref: 32 pid: 1877 timeout: 804 lvb_type: 1 00010000:00010000:3.0:1746129758.549136:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acc7c800/0x48868a4e4394a924 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35013a expref: 32 pid: 1877 timeout: 804 lvb_type: 1 00010000:00010000:3.0:1746129758.549159:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129758.550209:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135400380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+31:1964:x1830949052390016:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1114us (1752us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129758.550216:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5511 00000100:00100000:3.0:1746129758.551781:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+43:1962:x1830949052389248:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 17488us (17866us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129758.551789:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4311 00002000:00100000:3.0:1746129758.551797:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880135401880 x1830949052389248/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/440 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.551804:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135401880 with x1830949052389248 ext(3145728->4194303) 00010000:00010000:3.0:1746129758.551812:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131819800/0x48868a4e4394a8fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350117 expref: 43 pid: 8437 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.551823:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131819800/0x48868a4e4394a8fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350117 expref: 43 pid: 8437 timeout: 804 lvb_type: 0 00002000:00010000:3.0:1746129758.551829:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135401880 00000100:00100000:0.0:1746129758.558522:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.559008:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.559135:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052390272 00000100:00100000:3.0:1746129758.559144:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052390272 00010000:00010000:3.0:1746129758.559201:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131819800/0x48868a4e4394a8fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350117 expref: 43 pid: 8437 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746129758.559590:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5512 00000100:00100000:3.0:1746129758.559599:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135403b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+43:1964:x1830949052390272:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129758.559611:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129758.559635:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131819800/0x48868a4e4394a8fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350117 expref: 43 pid: 8437 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.559650:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131819800/0x48868a4e4394a8fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350117 expref: 43 pid: 8437 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746129758.559656:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052390400 00000100:00100000:2.0:1746129758.559660:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052390400 00010000:00010000:3.0:1746129758.559669:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131819800/0x48868a4e4394a8fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350117 expref: 44 pid: 8437 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746129758.559690:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11429 00000100:00100000:2.0:1746129758.559696:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+43:28822:x1830949052390400:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129758.559708:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129758.559717:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a940 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350156 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.559732:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.559734:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.559740:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a940 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350156 expref: 44 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.559752:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a940 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350156 expref: 44 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.559765:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.559766:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.559770:0:1877:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800923f9800/0x48868a4e4394a932 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2445311) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350148 expref: 44 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.559777:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800923f9800/0x48868a4e4394a932 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2445311) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350148 expref: 44 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.559800:0:1877:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800923f9800/0x48868a4e4394a932 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2445311) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350148 expref: 44 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.559809:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800923f9800/0x48868a4e4394a932 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2445311) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350148 expref: 44 pid: 3624 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746129758.559819:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053382912:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129758.559897:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2eb9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746129758.560115:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129758.560140:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135403b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+44:1964:x1830949052390272:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 542us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129758.560147:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5512 00000100:00100000:2.0:1746129758.566748:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053382912:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129758.566767:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb6600, rc 0) 00000100:00100000:2.0:1746129758.566827:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+43:28822:x1830949052390400:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7130us (8311us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.566836:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11429 00000100:00100000:0.0:1746129758.567362:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.567661:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052390656 00000100:00100000:3.0:1746129758.567668:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052390656 00002000:00100000:3.0:1746129758.567705:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (2441216->2445311) req@ffff8800a645f800 x1830949052390656/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.567714:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645f800 with x1830949052390656 ext(2441216->2445311) 00010000:00010000:3.0:1746129758.567721:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800923f9800/0x48868a4e4394a932 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2445311) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350148 expref: 43 pid: 3624 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.567733:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800923f9800/0x48868a4e4394a932 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2445311) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350148 expref: 43 pid: 3624 timeout: 804 lvb_type: 0 00002000:00010000:3.0:1746129758.567739:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a645f800 00000100:00100000:3.0:1746129758.567752:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 661 00000100:00100000:3.0:1746129758.567758:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+43:1962:x1830949052390656:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129758.567892:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+43:1962:x1830949052390656:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 134us (531us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129758.567898:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 661 00002000:00100000:3.0:1746129758.567903:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (2441216->2445311) req@ffff8800a645f800 x1830949052390656/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/4536 e 0 to 0 dl 1746129769 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.567909:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645f800 with x1830949052390656 ext(2441216->2445311) 00010000:00010000:3.0:1746129758.567913:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800923f9800/0x48868a4e4394a932 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2445311) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350148 expref: 43 pid: 3624 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.567921:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800923f9800/0x48868a4e4394a932 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2445311) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350148 expref: 43 pid: 3624 timeout: 804 lvb_type: 0 00002000:00010000:3.0:1746129758.567927:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a645f800 00000100:00100000:0.0:1746129758.570772:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.571611:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052390912 00000100:00100000:2.0:1746129758.571620:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052390912 00002000:00100000:2.0:1746129758.571651:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800a645fb80 x1830949052390912/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.571664:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645fb80 with x1830949052390912 ext(3145728->4194303) 00002000:00010000:2.0:1746129758.571668:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a645fb80 00000100:00100000:2.0:1746129758.571699:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4312 00000100:00100000:2.0:1746129758.571705:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+43:1962:x1830949052390912:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129758.572243:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.572373:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052391168 00000100:00100000:3.0:1746129758.572377:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052391168 00002000:00100000:3.0:1746129758.572393:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->2445311) req@ffff8800a645c700 x1830949052391168/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.572400:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645c700 with x1830949052391168 ext(2097152->2445311) 00010000:00010000:3.0:1746129758.572407:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800923f9800/0x48868a4e4394a932 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2445311) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350148 expref: 44 pid: 3624 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.572419:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800923f9800/0x48868a4e4394a932 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2445311) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350148 expref: 44 pid: 3624 timeout: 804 lvb_type: 0 00002000:00010000:3.0:1746129758.572425:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a645c700 00000100:00100000:3.0:1746129758.572447:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 662 00000100:00100000:3.0:1746129758.572452:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+44:1964:x1830949052391168:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:0.0:1746129758.576667:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.578120:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+47:1964:x1830949052391168:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 5662us (5872us total) trans 17179873274 rc 0/0 00000100:00100000:3.0:1746129758.578129:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 662 00002000:00100000:3.0:1746129758.578138:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->2445311) req@ffff8800a645c700 x1830949052391168/t17179873274(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/448 e 0 to 0 dl 1746129769 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.578145:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645c700 with x1830949052391168 ext(2097152->2445311) 00010000:00010000:3.0:1746129758.578154:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800923f9800/0x48868a4e4394a932 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2445311) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350148 expref: 47 pid: 3624 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.578167:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800923f9800/0x48868a4e4394a932 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2445311) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350148 expref: 47 pid: 3624 timeout: 804 lvb_type: 0 00002000:00010000:3.0:1746129758.578173:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a645c700 00000100:00100000:2.0:1746129758.578264:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052391424 00000100:00100000:2.0:1746129758.578278:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052391424 00000100:00100000:2.0:1746129758.578307:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9993 00000100:00100000:2.0:1746129758.578314:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28831:x1830949052391424:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129758.578329:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129758.578343:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7400/0x48868a4e4394a947 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35015d expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.578417:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6e00/0x48868a4e4394a94e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.578427:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6e00/0x48868a4e4394a94e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.578436:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6e00/0x48868a4e4394a94e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.578446:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6370a00/0x48868a4e4394a955 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.578451:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6370a00/0x48868a4e4394a955 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.578456:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6370a00/0x48868a4e4394a955 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.578537:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6371400/0x48868a4e4394a95c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.578544:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6371400/0x48868a4e4394a95c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.578549:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6371400/0x48868a4e4394a95c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:2.0:1746129758.578556:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129758.578606:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6e00/0x48868a4e4394a94e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.578612:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6e00/0x48868a4e4394a94e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.578617:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6e00/0x48868a4e4394a94e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.578621:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbb6e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129758.578624:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6e00/0x48868a4e4394a94e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.578628:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6e00/0x48868a4e4394a94e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.578636:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129758.578638:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129758.578641:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6e00/0x48868a4e4394a94e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.578645:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6e00/0x48868a4e4394a94e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.578661:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6370a00/0x48868a4e4394a955 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.578666:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6370a00/0x48868a4e4394a955 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.578669:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6370a00/0x48868a4e4394a955 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.578673:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6370a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129758.578674:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6370a00/0x48868a4e4394a955 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.578678:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6370a00/0x48868a4e4394a955 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.578682:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e2d8e00) 00010000:00010000:2.0:1746129758.578683:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129758.578685:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6370a00/0x48868a4e4394a955 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.578688:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6370a00/0x48868a4e4394a955 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.578729:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7400/0x48868a4e4394a947 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35015d expref: 14 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.578737:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6371400/0x48868a4e4394a95c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35015d expref: 13 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.578741:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129758.578744:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129758.578746:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6371400, rc 0) 00000100:00100000:2.0:1746129758.578779:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28831:x1830949052391424:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 466us (2119us total) trans 8589943799 rc 0/0 00000100:00100000:2.0:1746129758.578783:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9993 00000100:00100000:2.0:1746129758.580049:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+45:1962:x1830949052390912:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 8339us (9279us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129758.580057:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4312 00002000:00100000:2.0:1746129758.580064:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800a645fb80 x1830949052390912/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/440 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.580071:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645fb80 with x1830949052390912 ext(3145728->4194303) 00002000:00010000:2.0:1746129758.580075:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a645fb80 00000100:00100000:1.0:1746129758.582442:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.582517:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052391552 00000100:00100000:3.0:1746129758.582524:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052391552 00010000:00010000:3.0:1746129758.582551:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800923f9800/0x48868a4e4394a932 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2445311) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350148 expref: 45 pid: 3624 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746129758.582573:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5513 00000100:00100000:3.0:1746129758.582579:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+45:1963:x1830949052391552:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129758.582590:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746129758.582603:0:7108:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129758 -> 1746129759 00002000:00010000:3.0:1746129758.582606:0:7108:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129758 -> 1746129759 00010000:00010000:3.0:1746129758.582611:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800923f9800/0x48868a4e4394a932 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2445311) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350148 expref: 45 pid: 3624 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.582626:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800923f9800/0x48868a4e4394a932 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2445311) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350148 expref: 45 pid: 3624 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.582643:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800923f9800/0x48868a4e4394a932 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2445311) gid 0 flags: 0x44801000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350148 expref: 45 pid: 3624 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.582657:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129758.582658:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129758.582664:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800923f8000/0x48868a4e4394a939 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35014f expref: 30 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.582671:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800923f8000/0x48868a4e4394a939 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35014f expref: 30 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.582697:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800923f8000/0x48868a4e4394a939 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35014f expref: 30 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129758.582708:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130507480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053383040:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129758.583539:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129758.585591:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130507480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053383040:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129758.585607:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129758.585641:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+44:1963:x1830949052391552:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3061us (3204us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129758.585648:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5513 00000100:00100000:0.0:1746129758.589714:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.589797:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.589872:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052391808 00000100:00100000:2.0:1746129758.589880:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052391808 00000100:00100000:2.0:1746129758.589915:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11430 00000100:00100000:2.0:1746129758.589922:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:28822:x1830949052391808:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129758.589937:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129758.589951:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6371800/0x48868a4e4394a96a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350164 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.589976:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a88a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3162112->18446744073709551615] (req 3162112->3362815) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500d8 expref: 23 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.589983:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129758.589985:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129758.589987:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6371800/0x48868a4e4394a96a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350164 expref: 23 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.590016:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a88a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3162112->18446744073709551615] (req 3162112->3362815) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500d8 expref: 23 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.590026:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a88a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3162112->18446744073709551615] (req 3162112->3362815) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500d8 expref: 23 pid: 10930 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746129758.590037:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053383168:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129758.590113:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2ebd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129758.590178:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052391936 00000100:00100000:3.0:1746129758.590182:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052391936 00002000:00100000:3.0:1746129758.590208:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a645e680 x1830949052391936/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.590215:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645e680 with x1830949052391936 ext(2097152->3145727) 00002000:00010000:3.0:1746129758.590219:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a645e680 00000100:00100000:3.0:1746129758.590231:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4313 00000100:00100000:3.0:1746129758.590237:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+31:1963:x1830949052391936:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129758.593521:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.593614:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053383168:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129758.593638:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6371800/0x48868a4e4394a96a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350164 expref: 23 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.593653:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6371800, rc 0) 00000100:00100000:2.0:1746129758.593687:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:28822:x1830949052391808:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3764us (3980us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.593695:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11430 00000100:00100000:2.0:1746129758.593724:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052392064 00000100:00100000:2.0:1746129758.593728:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052392064 00002000:00100000:2.0:1746129758.593751:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (3162112->3362815) req@ffff8800a645f480 x1830949052392064/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.593759:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645f480 with x1830949052392064 ext(3162112->3362815) 00010000:00010000:2.0:1746129758.593764:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a88a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3162112->18446744073709551615] (req 3162112->3362815) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500d8 expref: 23 pid: 10930 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746129758.593779:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a88a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3162112->18446744073709551615] (req 3162112->3362815) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500d8 expref: 23 pid: 10930 timeout: 804 lvb_type: 0 00002000:00010000:2.0:1746129758.593786:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a645f480 00000100:00100000:2.0:1746129758.593815:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 663 00000100:00100000:2.0:1746129758.593821:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949052392064:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:2.0:1746129758.603921:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949052392064:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 10091us (10397us total) trans 21474840404 rc 0/0 00000100:00100000:2.0:1746129758.603932:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 663 00002000:00100000:2.0:1746129758.603941:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (3162112->3362815) req@ffff8800a645f480 x1830949052392064/t21474840404(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/448 e 0 to 0 dl 1746129769 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.603950:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645f480 with x1830949052392064 ext(3162112->3362815) 00010000:00010000:2.0:1746129758.603958:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a88a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3162112->18446744073709551615] (req 3162112->3362815) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500d8 expref: 25 pid: 10930 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746129758.603970:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a88a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3162112->18446744073709551615] (req 3162112->3362815) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500d8 expref: 25 pid: 10930 timeout: 804 lvb_type: 0 00002000:00010000:2.0:1746129758.603977:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a645f480 00000100:00100000:3.0:1746129758.605649:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+31:1963:x1830949052391936:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15406us (15846us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129758.605658:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4313 00002000:00100000:3.0:1746129758.605668:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a645e680 x1830949052391936/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/440 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.605674:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645e680 with x1830949052391936 ext(2097152->3145727) 00002000:00010000:3.0:1746129758.605678:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a645e680 00000100:00100000:0.0:1746129758.605972:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.606025:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052392192 00000100:00100000:3.0:1746129758.606031:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052392192 00010000:00010000:3.0:1746129758.606050:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a88a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3162112->18446744073709551615] (req 3162112->3362815) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500d8 expref: 25 pid: 10930 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746129758.606078:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5514 00000100:00100000:3.0:1746129758.606083:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1963:x1830949052392192:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129758.606096:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746129758.606109:0:7108:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129758 -> 1746129759 00010000:00010000:3.0:1746129758.606114:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a88a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3162112->18446744073709551615] (req 3162112->3362815) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500d8 expref: 25 pid: 10930 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.606128:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a88a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3162112->18446744073709551615] (req 3162112->3362815) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500d8 expref: 25 pid: 10930 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.606327:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800923f8a00/0x48868a4e4394a88a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3162112->18446744073709551615] (req 3162112->3362815) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500d8 expref: 25 pid: 10930 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.606351:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129758.606352:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129758.606358:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6371800/0x48868a4e4394a96a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350164 expref: 24 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.606365:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6371800/0x48868a4e4394a96a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350164 expref: 24 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.606396:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6371800/0x48868a4e4394a96a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350164 expref: 24 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129758.606407:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130507480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053383296:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129758.606463:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129758.622981:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.623191:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052392320 00000100:00100000:2.0:1746129758.623198:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052392320 00000100:00100000:2.0:1746129758.623240:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11431 00000100:00100000:2.0:1746129758.623246:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28826:x1830949052392320:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129758.623261:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129758.623285:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f897c00/0x48868a4e4394a971 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35016b expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.623308:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.623309:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.623315:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f897c00/0x48868a4e4394a971 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35016b expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.623326:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f897c00/0x48868a4e4394a971 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35016b expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.623334:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f897c00, rc 0) 00000100:00100000:2.0:1746129758.623367:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28826:x1830949052392320:12345-192.168.204.31@tcp:101:cat.0 Request processed in 121us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.623371:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11431 00000100:00100000:3.0:1746129758.623446:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130507480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053383296:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129758.623459:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129758.623473:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949052392192:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 17390us (17502us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129758.623479:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5514 00000100:00100000:0.0:1746129758.625713:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.625772:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052392576 00000100:00100000:3.0:1746129758.625778:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052392576 00002000:00100000:3.0:1746129758.625805:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009207d500 x1830949052392576/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.625812:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207d500 with x1830949052392576 ext(3145728->4194303) 00002000:00010000:3.0:1746129758.625816:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207d500 00000100:00100000:3.0:1746129758.626680:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4314 00000100:00100000:3.0:1746129758.626688:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052392576:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129758.654949:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052392576:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 28251us (29229us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129758.654961:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4314 00002000:00100000:3.0:1746129758.654973:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009207d500 x1830949052392576/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/440 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.654982:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207d500 with x1830949052392576 ext(3145728->4194303) 00002000:00010000:3.0:1746129758.654988:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207d500 00000100:00100000:0.0:1746129758.665886:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.665965:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052392704 00000100:00100000:1.0:1746129758.665973:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052392704 00000100:00100000:1.0:1746129758.666018:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11432 00000100:00100000:1.0:1746129758.666025:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+44:1961:x1830949052392704:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129758.666040:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129758.666054:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e600/0x48868a4e4394a978 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350172 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.666072:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129758.666074:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129758.666081:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e600/0x48868a4e4394a978 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350172 expref: 45 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129758.666093:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e600/0x48868a4e4394a978 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350172 expref: 45 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129758.666102:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb6e600, rc 0) 00000100:00100000:1.0:1746129758.666137:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+45:1961:x1830949052392704:12345-192.168.204.31@tcp:101:cat.0 Request processed in 113us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129758.666142:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11432 00000100:00100000:0.0:1746129758.667724:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.669503:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052393216 00000100:00100000:3.0:1746129758.669512:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052393216 00002000:00100000:3.0:1746129758.669552:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009207ce00 x1830949052393216/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.669561:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207ce00 with x1830949052393216 ext(3145728->4194303) 00002000:00010000:3.0:1746129758.669566:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207ce00 00000100:00100000:3.0:1746129758.669599:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4315 00000100:00100000:3.0:1746129758.669606:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+31:1963:x1830949052393216:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129758.674165:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.674208:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.674238:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052392960 00000100:00100000:2.0:1746129758.674245:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052392960 00002000:00100000:2.0:1746129758.674290:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009207e680 x1830949052392960/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746129758.674293:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052393344 00000100:00100000:1.0:1746129758.674297:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052393344 00002000:00100000:2.0:1746129758.674298:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207e680 with x1830949052392960 ext(2097152->3145727) 00002000:00010000:2.0:1746129758.674303:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207e680 00002000:00100000:1.0:1746129758.674315:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009207f480 x1830949052393344/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129758.674326:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207f480 with x1830949052393344 ext(3145728->4194303) 00002000:00010000:1.0:1746129758.674330:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207f480 00000100:00100000:2.0:1746129758.674334:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4316 00000100:00100000:2.0:1746129758.674345:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1963:x1830949052392960:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129758.674370:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4317 00000100:00100000:1.0:1746129758.674375:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1963:x1830949052393344:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129758.685893:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.686057:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052393728 00000100:00100000:3.0:1746129758.686066:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052393728 00002000:00100000:3.0:1746129758.686105:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009207d880 x1830949052393728/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.686112:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207d880 with x1830949052393728 ext(4194304->4964351) 00002000:00010000:3.0:1746129758.686117:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207d880 00000100:00100000:3.0:1746129758.686135:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4318 00000100:00100000:3.0:1746129758.686141:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+45:1964:x1830949052393728:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129758.688323:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+31:1963:x1830949052393216:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18710us (20596us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129758.688336:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4315 00002000:00100000:2.0:1746129758.688345:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009207ce00 x1830949052393216/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/440 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.688352:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207ce00 with x1830949052393216 ext(3145728->4194303) 00002000:00010000:2.0:1746129758.688357:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207ce00 00000100:00100000:2.0:1746129758.697099:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1963:x1830949052392960:12345-192.168.204.31@tcp:3:cat.0 Request processed in 22749us (22931us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129758.697111:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4316 00002000:00100000:2.0:1746129758.697122:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009207e680 x1830949052392960/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/440 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.697129:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207e680 with x1830949052392960 ext(2097152->3145727) 00002000:00010000:2.0:1746129758.697135:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207e680 00000100:00100000:0.0:1746129758.700989:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.704515:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052393856 00000100:00100000:2.0:1746129758.704525:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052393856 00000100:00100000:2.0:1746129758.704581:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11433 00000100:00100000:2.0:1746129758.704588:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:28831:x1830949052393856:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129758.704604:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129758.704620:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f897400/0x48868a4e4394a97f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350179 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.704644:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131819a00/0x48868a4e4394a6b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffb2 expref: 23 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129758.704652:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05800/0x48868a4e4394a7fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350092 expref: 10 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129758.704658:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e4394a75d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffff expref: 21 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129758.704664:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.704665:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.704668:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f897400/0x48868a4e4394a97f lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1474560->2097151] (req 1474560->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350179 expref: 21 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.704692:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e4394a75d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffff expref: 21 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129758.704702:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e4394a75d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffff expref: 21 pid: 3624 timeout: 804 lvb_type: 1 00000100:00100000:2.0:1746129758.704712:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053383424:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129758.704799:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05800/0x48868a4e4394a7fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350092 expref: 10 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129758.704807:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05800/0x48868a4e4394a7fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350092 expref: 10 pid: 10930 timeout: 804 lvb_type: 1 00000100:00100000:2.0:1746129758.704815:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053383552:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129758.704838:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131819a00/0x48868a4e4394a6b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffb2 expref: 23 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129758.704875:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131819a00/0x48868a4e4394a6b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffb2 expref: 23 pid: 20441 timeout: 804 lvb_type: 1 00000100:00100000:2.0:1746129758.704882:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053383680:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129758.704911:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2ebd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129758.705803:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1963:x1830949052393344:12345-192.168.204.31@tcp:3:cat.0 Request processed in 31425us (31592us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129758.705810:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4317 00002000:00100000:1.0:1746129758.705817:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009207f480 x1830949052393344/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/440 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129758.705824:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207f480 with x1830949052393344 ext(3145728->4194303) 00002000:00010000:1.0:1746129758.705828:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207f480 00000100:00100000:3.0:1746129758.710075:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+45:1964:x1830949052393728:12345-192.168.204.31@tcp:3:cat.0 Request processed in 23924us (24181us total) trans 0 rc 770048/770048 00000100:00100000:3.0:1746129758.710086:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4318 00002000:00100000:3.0:1746129758.710095:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009207d880 x1830949052393728/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/440 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.710104:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207d880 with x1830949052393728 ext(4194304->4964351) 00002000:00010000:3.0:1746129758.710109:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207d880 00000100:00100000:3.0:1746129758.710539:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053383424:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129758.714534:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.714564:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.714659:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052393984 00000100:00100000:1.0:1746129758.714666:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052393984 00010000:00010000:1.0:1746129758.714694:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05800/0x48868a4e4394a7fe lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350092 expref: 11 pid: 10930 timeout: 804 lvb_type: 1 00000100:00100000:1.0:1746129758.714714:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052394112 00000100:00100000:1.0:1746129758.714716:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052394112 00010000:00010000:1.0:1746129758.714723:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e4394a75d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffff expref: 20 pid: 3624 timeout: 804 lvb_type: 1 00000100:00100000:1.0:1746129758.714734:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5515 00000100:00100000:1.0:1746129758.714739:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052393984:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129758.714749:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129758.714766:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05800/0x48868a4e4394a7fe lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350092 expref: 11 pid: 10930 timeout: 804 lvb_type: 1 00010000:00010000:1.0:1746129758.714775:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05800/0x48868a4e4394a7fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350092 expref: 11 pid: 10930 timeout: 804 lvb_type: 1 00010000:00010000:1.0:1746129758.714795:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129758.714825:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052393984:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 85us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129758.714830:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5515 00000100:00100000:1.0:1746129758.714842:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5516 00000100:00100000:1.0:1746129758.714860:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949052394112:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129758.714870:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129758.714877:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e4394a75d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffff expref: 20 pid: 3624 timeout: 804 lvb_type: 1 00010000:00010000:1.0:1746129758.714884:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e4394a75d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffff expref: 20 pid: 3624 timeout: 804 lvb_type: 1 00010000:00010000:1.0:1746129758.714894:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e4394a75d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffff expref: 20 pid: 3624 timeout: 804 lvb_type: 1 00010000:00010000:1.0:1746129758.714907:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129758.714920:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949052394112:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 74us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129758.714925:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5516 00010000:00010000:3.0:1746129758.715215:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05800/0x48868a4e4394a7fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350092 expref: 10 pid: 10930 timeout: 804 lvb_type: 1 00000100:00100000:3.0:1746129758.715232:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053383552:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129758.715242:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053383680:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129758.715266:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f897400/0x48868a4e4394a97f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1474560->2097151] (req 1474560->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350179 expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.715286:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f897400, rc 0) 00000100:00100000:3.0:1746129758.715307:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28831:x1830949052393856:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 10720us (14326us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129758.715313:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11433 00000100:00100000:0.0:1746129758.717555:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.717636:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052394240 00000100:00100000:2.0:1746129758.717642:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052394240 00010000:00010000:2.0:1746129758.717666:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131819a00/0x48868a4e4394a6b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffb2 expref: 24 pid: 20441 timeout: 804 lvb_type: 1 00000100:00100000:0.0:1746129758.718124:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.718161:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.718177:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052394368 00000100:00100000:0.0:1746129758.718180:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052394368 00000100:00100000:0.0:1746129758.718198:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052394496 00000100:00100000:0.0:1746129758.718199:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052394496 00000100:00100000:0.0:1746129758.718211:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11434 00000100:00100000:0.0:1746129758.718217:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949052394368:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129758.718229:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129758.718240:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05600/0x48868a4e4394a986 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350180 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.718255:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129758.718263:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05600/0x48868a4e4394a986 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350180 expref: 19 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.718290:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05600/0x48868a4e4394a986 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350180 expref: 19 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.718303:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e05600, rc 0) 00000100:00100000:0.0:1746129758.718335:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949052394368:12345-192.168.204.31@tcp:101:cat.0 Request processed in 118us (211us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129758.718339:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11434 00000100:00100000:0.0:1746129758.718352:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11435 00000100:00100000:0.0:1746129758.718356:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+31:1961:x1830949052394496:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129758.718362:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129758.718370:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05200/0x48868a4e4394a98d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350187 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129758.718402:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053383808:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129758.718446:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b37bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129758.718629:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5517 00000100:00100000:2.0:1746129758.718635:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052394240:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129758.718643:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129758.718657:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131819a00/0x48868a4e4394a6b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffb2 expref: 24 pid: 20441 timeout: 804 lvb_type: 1 00010000:00010000:2.0:1746129758.718666:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131819a00/0x48868a4e4394a6b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffb2 expref: 24 pid: 20441 timeout: 804 lvb_type: 1 00010000:00010000:2.0:1746129758.718679:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131819a00/0x48868a4e4394a6b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffb2 expref: 24 pid: 20441 timeout: 804 lvb_type: 1 00010000:00010000:2.0:1746129758.718694:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.718696:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.718702:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f897400/0x48868a4e4394a97f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350179 expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.718709:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f897400/0x48868a4e4394a97f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350179 expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.718725:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f897400/0x48868a4e4394a97f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350179 expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129758.718731:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053383936:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129758.718749:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2eb240 going to sleep for 11 seconds 00002000:00010000:0.0:1746129758.721754:0:3624:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime: 1746129758 -> 1746129759 00002000:00010000:0.0:1746129758.721760:0:3624:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime: 1746129758 -> 1746129759 00000100:00100000:0.0:1746129758.721779:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053383808:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129758.721807:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05200/0x48868a4e4394a98d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350187 expref: 32 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.721818:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05200/0x48868a4e4394a98d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350187 expref: 32 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.721833:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e05200, rc 0) 00000100:00100000:3.0:1746129758.722042:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053383936:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129758.722053:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129758.722338:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949052394240:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3701us (4788us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129758.722349:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5517 00000100:00100000:0.0:1746129758.722965:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+31:1961:x1830949052394496:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4606us (4801us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129758.722971:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11435 00000100:00100000:2.0:1746129758.723081:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.723194:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052394752 00000100:00100000:3.0:1746129758.723199:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052394752 00002000:00100000:3.0:1746129758.723229:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1474560->1478655) req@ffff880094d8e680 x1830949052394752/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.723237:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8e680 with x1830949052394752 ext(1474560->1478655) 00002000:00010000:3.0:1746129758.723241:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d8e680 00000100:00100000:3.0:1746129758.723256:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4319 00000100:00100000:3.0:1746129758.723262:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052394752:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129758.723396:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052394752:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 134us (315us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129758.723402:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4319 00002000:00100000:3.0:1746129758.723407:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1474560->1478655) req@ffff880094d8e680 x1830949052394752/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/4536 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.723413:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8e680 with x1830949052394752 ext(1474560->1478655) 00002000:00010000:3.0:1746129758.723416:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d8e680 00000100:00100000:0.0:1746129758.728214:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.729631:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052395008 00000100:00100000:2.0:1746129758.729641:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052395008 00002000:00100000:2.0:1746129758.729681:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009207f100 x1830949052395008/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.729690:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207f100 with x1830949052395008 ext(4194304->4964351) 00002000:00010000:2.0:1746129758.729695:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207f100 00000100:00100000:2.0:1746129758.729916:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4320 00000100:00100000:2.0:1746129758.729924:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+31:1961:x1830949052395008:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129758.733548:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.733637:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052395136 00000100:00100000:2.0:1746129758.733645:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052395136 00000100:00100000:2.0:1746129758.734409:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11436 00000100:00100000:2.0:1746129758.734418:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+33:28831:x1830949052395136:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129758.734434:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129758.734448:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130fcee00/0x48868a4e4394a994 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35018e expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.734476:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04e00/0x48868a4e4394a916 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35012c expref: 44 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.734483:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129758.734485:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129758.734488:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130fcee00/0x48868a4e4394a994 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->1150975] (req 1048576->1150975) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35018e expref: 34 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.734517:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04e00/0x48868a4e4394a916 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35012c expref: 44 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.734527:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04e00/0x48868a4e4394a916 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35012c expref: 44 pid: 7976 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746129758.734537:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053384064:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129758.734622:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2eb480 going to sleep for 11 seconds 00000100:00100000:2.0:1746129758.736357:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+33:1961:x1830949052395008:12345-192.168.204.31@tcp:3:cat.0 Request processed in 6428us (8143us total) trans 0 rc 770048/770048 00000100:00100000:2.0:1746129758.736366:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4320 00002000:00100000:2.0:1746129758.736375:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009207f100 x1830949052395008/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/440 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.736384:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207f100 with x1830949052395008 ext(4194304->4964351) 00002000:00010000:2.0:1746129758.736388:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207f100 00000100:00100000:3.0:1746129758.736770:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053384064:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129758.736790:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130fcee00/0x48868a4e4394a994 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->1150975] (req 1048576->1150975) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35018e expref: 32 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.736804:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130fcee00, rc 0) 00000100:00100000:3.0:1746129758.736832:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+32:28831:x1830949052395136:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2417us (3293us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129758.736838:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11436 00000100:00100000:0.0:1746129758.737363:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.737414:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052395264 00000100:00100000:2.0:1746129758.737419:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052395264 00002000:00100000:2.0:1746129758.737446:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1888256->2097151) req@ffff88009a04df80 x1830949052395264/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.737453:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04df80 with x1830949052395264 ext(1888256->2097151) 00010000:00010000:2.0:1746129758.737459:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04e00/0x48868a4e4394a916 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35012c expref: 45 pid: 7976 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746129758.737469:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04e00/0x48868a4e4394a916 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35012c expref: 45 pid: 7976 timeout: 804 lvb_type: 0 00002000:00010000:2.0:1746129758.737475:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a04df80 00000100:00100000:2.0:1746129758.737549:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 664 00000100:00100000:2.0:1746129758.737556:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+45:1962:x1830949052395264:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129758.740582:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.740724:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052395392 00000100:00100000:3.0:1746129758.740732:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052395392 00000100:00100000:3.0:1746129758.740766:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11437 00000100:00100000:3.0:1746129758.740773:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+32:1962:x1830949052395392:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129758.740786:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129758.740799:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e0eca00/0x48868a4e4394a99b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350195 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129758.740837:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130507100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053384192:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129758.740922:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129758.742819:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+47:1962:x1830949052395264:12345-192.168.204.31@tcp:4:cat.0 Request processed in 5258us (5451us total) trans 17179873275 rc 0/0 00000100:00100000:3.0:1746129758.742829:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 664 00002000:00100000:3.0:1746129758.742839:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1888256->2097151) req@ffff88009a04df80 x1830949052395264/t17179873275(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/448 e 0 to 0 dl 1746129769 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.742861:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04df80 with x1830949052395264 ext(1888256->2097151) 00010000:00010000:3.0:1746129758.742870:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04e00/0x48868a4e4394a916 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35012c expref: 47 pid: 7976 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.742886:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04e00/0x48868a4e4394a916 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35012c expref: 47 pid: 7976 timeout: 804 lvb_type: 0 00002000:00010000:3.0:1746129758.742892:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a04df80 00000100:00100000:3.0:1746129758.745842:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130507100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053384192:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129758.745956:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e0eca00/0x48868a4e4394a99b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350195 expref: 33 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129758.745969:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e0eca00/0x48868a4e4394a99b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350195 expref: 33 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129758.745993:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e0eca00, rc 0) 00000100:00100000:3.0:1746129758.746342:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+32:1962:x1830949052395392:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5568us (5765us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129758.746350:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11437 00000100:00100000:0.0:1746129758.746483:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.746629:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052395520 00000100:00100000:3.0:1746129758.746634:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052395520 00010000:00010000:3.0:1746129758.746654:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04e00/0x48868a4e4394a916 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35012c expref: 47 pid: 7976 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746129758.746739:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5518 00000100:00100000:3.0:1746129758.746746:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+47:1961:x1830949052395520:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129758.746757:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129758.746766:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04e00/0x48868a4e4394a916 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35012c expref: 47 pid: 7976 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.746775:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04e00/0x48868a4e4394a916 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35012c expref: 47 pid: 7976 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.746791:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04e00/0x48868a4e4394a916 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35012c expref: 47 pid: 7976 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746129758.746800:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129758.746802:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129758.746809:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130fcee00/0x48868a4e4394a994 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35018e expref: 31 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.746821:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130fcee00/0x48868a4e4394a994 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35018e expref: 31 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.746845:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130fcee00/0x48868a4e4394a994 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35018e expref: 31 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129758.747245:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130507100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053384320:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129758.747325:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129758.749719:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.750003:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130507100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053384320:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129758.750019:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129758.750055:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+46:1961:x1830949052395520:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3309us (3571us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.750064:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5518 00000100:00100000:3.0:1746129758.750320:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052395648 00000100:00100000:3.0:1746129758.750326:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052395648 00000100:00100000:3.0:1746129758.750697:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11438 00000100:00100000:3.0:1746129758.750705:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+32:1961:x1830949052395648:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129758.750719:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129758.750732:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e0ec200/0x48868a4e4394a9a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35019c expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129758.750770:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053384448:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129758.750824:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129758.753531:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.753964:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052395904 00000100:00100000:3.0:1746129758.753971:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052395904 00002000:00100000:3.0:1746129758.754007:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1146880->1150975) req@ffff88009a04c380 x1830949052395904/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.754015:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04c380 with x1830949052395904 ext(1146880->1150975) 00002000:00010000:3.0:1746129758.754020:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04c380 00000100:00100000:3.0:1746129758.754049:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4321 00000100:00100000:3.0:1746129758.754056:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+34:1962:x1830949052395904:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129758.754388:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053384448:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129758.754412:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e0ec200/0x48868a4e4394a9a2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35019c expref: 34 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129758.754422:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e0ec200/0x48868a4e4394a9a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35019c expref: 34 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129758.755158:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e0ec200, rc 0) 00000100:00100000:3.0:1746129758.755199:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+33:1961:x1830949052395648:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4494us (5487us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129758.755206:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11438 00000100:00100000:3.0:1746129758.755321:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+32:1962:x1830949052395904:12345-192.168.204.31@tcp:3:cat.0 Request processed in 1265us (1795us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129758.755329:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4321 00002000:00100000:3.0:1746129758.755334:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1146880->1150975) req@ffff88009a04c380 x1830949052395904/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/4536 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129758.755340:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04c380 with x1830949052395904 ext(1146880->1150975) 00002000:00010000:3.0:1746129758.755343:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04c380 00000100:00100000:0.0:1746129758.761725:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.761814:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052396160 00000100:00100000:2.0:1746129758.761822:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052396160 00000100:00100000:2.0:1746129758.761878:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3955 00000100:00100000:2.0:1746129758.761885:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28831:x1830949052396160:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129758.763806:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28831:x1830949052396160:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 1912us (2080us total) trans 8589943800 rc 0/0 00000100:00100000:2.0:1746129758.763816:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3955 00000100:00100000:0.0:1746129758.782521:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.782834:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052396288 00000100:00100000:3.0:1746129758.782842:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052396288 00000100:00100000:3.0:1746129758.782915:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9994 00000100:00100000:3.0:1746129758.782924:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:28837:x1830949052396288:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129758.782944:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129758.782960:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec000/0x48868a4e4394a9a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3501a3 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.783010:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ece00/0x48868a4e4394a9b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.783021:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ece00/0x48868a4e4394a9b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.783030:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ece00/0x48868a4e4394a9b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.783040:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec600/0x48868a4e4394a9b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.783045:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec600/0x48868a4e4394a9b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.783050:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec600/0x48868a4e4394a9b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.783146:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0eca00/0x48868a4e4394a9be lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.783155:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a8f3 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350110 expref: 290 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.783161:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0eca00/0x48868a4e4394a9be lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.783186:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a8f3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350110 expref: 290 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.783196:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a8f3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350110 expref: 290 pid: 16808 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746129758.783205:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053384576:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129758.783287:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1240 going to sleep for 11 seconds 00000100:00100000:3.0:1746129758.795881:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053384576:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129758.795902:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0eca00/0x48868a4e4394a9be lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:1.0:1746129758.796173:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.797831:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052396544 00000100:00100000:2.0:1746129758.797840:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052396544 00000100:00100000:2.0:1746129758.800419:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3956 00000100:00100000:2.0:1746129758.800434:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:27192:x1830949052396544:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746129758.800637:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:27192:x1830949052396544:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 208us (4465us total) trans 8589943801 rc 0/0 00000100:00100000:2.0:1746129758.800643:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3956 00000100:00100000:0.0:1746129758.800960:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.801097:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052396800 00000100:00100000:2.0:1746129758.801103:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052396800 00000100:00100000:2.0:1746129758.801137:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9995 00000100:00100000:2.0:1746129758.801143:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:28839:x1830949052396800:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129758.801152:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129758.801165:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130fcfc00/0x48868a4e4394a9c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3501aa expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.801229:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130fcfe00/0x48868a4e4394a9cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.801239:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130fcfe00/0x48868a4e4394a9cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.801247:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130fcfe00/0x48868a4e4394a9cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.801254:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130fcf400/0x48868a4e4394a9d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.801259:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130fcf400/0x48868a4e4394a9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.801263:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130fcf400/0x48868a4e4394a9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.801353:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130fcea00/0x48868a4e4394a9da lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.801361:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130fcea00/0x48868a4e4394a9da lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.801365:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130fcea00/0x48868a4e4394a9da lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:2.0:1746129758.801372:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129758.801413:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130fcfe00/0x48868a4e4394a9cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.801419:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130fcfe00/0x48868a4e4394a9cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.801423:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130fcfe00/0x48868a4e4394a9cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.801428:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130fcfe00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129758.801431:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130fcfe00/0x48868a4e4394a9cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.801436:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130fcfe00/0x48868a4e4394a9cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.801445:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129758.801448:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129758.801451:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130fcfe00/0x48868a4e4394a9cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.801455:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130fcfe00/0x48868a4e4394a9cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.801466:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130fcf400/0x48868a4e4394a9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.801469:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130fcf400/0x48868a4e4394a9d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.801473:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130fcf400/0x48868a4e4394a9d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.801477:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130fcf400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129758.801478:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130fcf400/0x48868a4e4394a9d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.801482:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130fcf400/0x48868a4e4394a9d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.801486:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880130e02300) 00010000:00010000:2.0:1746129758.801488:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129758.801490:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130fcf400/0x48868a4e4394a9d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.801494:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130fcf400/0x48868a4e4394a9d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129758.801517:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130fcfc00/0x48868a4e4394a9c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501aa expref: 295 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.801526:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130fcea00/0x48868a4e4394a9da lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501aa expref: 294 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.801531:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129758.801533:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129758.801536:0:16808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0eca00/0x48868a4e4394a9be lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.801541:0:16808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0eca00/0x48868a4e4394a9be lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.801545:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130fcea00, rc 0) 00000100:00100000:2.0:1746129758.801570:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:28839:x1830949052396800:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 426us (610us total) trans 8589943802 rc 0/0 00000100:00100000:2.0:1746129758.801575:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9995 00000100:00100000:0.0:1746129758.802806:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.803832:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052396928 00000100:00100000:2.0:1746129758.803840:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052396928 00010000:00010000:2.0:1746129758.803884:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a8f3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350110 expref: 294 pid: 16808 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746129758.804839:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5519 00000100:00100000:2.0:1746129758.805006:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:1961:x1830949052396928:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129758.805020:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129758.805026:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a8f3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350110 expref: 294 pid: 16808 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746129758.805037:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a8f3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350110 expref: 294 pid: 16808 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746129758.805055:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05e00/0x48868a4e4394a8f3 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350110 expref: 294 pid: 16808 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746129758.805069:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129758.805074:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0eca00/0x48868a4e4394a9be lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.805081:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0eca00/0x48868a4e4394a9be lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.805087:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0eca00/0x48868a4e4394a9be lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.805112:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129758.805186:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0eca00/0x48868a4e4394a9be lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.805193:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0eca00/0x48868a4e4394a9be lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129758.805226:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:3.0:1746129758.805230:0:1851:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129758.805241:0:1851:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0eca00/0x48868a4e4394a9be lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.805249:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0eca00/0x48868a4e4394a9be lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.805257:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ece00/0x48868a4e4394a9b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.805262:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ece00/0x48868a4e4394a9b0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.805277:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ece00/0x48868a4e4394a9b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.805281:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e0ece00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129758.805284:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ece00/0x48868a4e4394a9b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.805290:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ece00/0x48868a4e4394a9b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.805297:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129758.805299:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129758.805302:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ece00/0x48868a4e4394a9b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.805306:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ece00/0x48868a4e4394a9b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.814297:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec600/0x48868a4e4394a9b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.814311:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec600/0x48868a4e4394a9b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.814321:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec600/0x48868a4e4394a9b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.814326:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e0ec600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129758.814329:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec600/0x48868a4e4394a9b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.814335:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec600/0x48868a4e4394a9b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.814350:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880130e02300) 00010000:00010000:3.0:1746129758.814352:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129758.814355:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec600/0x48868a4e4394a9b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.814360:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec600/0x48868a4e4394a9b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.814406:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec000/0x48868a4e4394a9a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501a3 expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.814417:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0eca00/0x48868a4e4394a9be lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501a3 expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.814422:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129758.814424:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129758.814426:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e0eca00, rc 0) 00000100:00100000:2.0:1746129758.814624:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:1961:x1830949052396928:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 9774us (11818us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.814634:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5519 00000100:00100000:3.0:1746129758.815480:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:28837:x1830949052396288:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 32555us (32965us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129758.815487:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9994 00000100:00100000:0.0:1746129758.834755:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.834845:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052397056 00000100:00100000:3.0:1746129758.834878:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052397056 00000100:00100000:3.0:1746129758.834929:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11439 00000100:00100000:3.0:1746129758.834936:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052397056:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129758.834951:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129758.834964:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e0ecc00/0x48868a4e4394a9e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3501b1 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129758.835009:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053384704:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129758.835085:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129758.835511:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.835534:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.835559:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.835573:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052397312 00000100:00100000:0.0:1746129758.835577:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052397312 00000100:00100000:0.0:1746129758.835592:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052397184 00000100:00100000:0.0:1746129758.835594:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052397184 00000100:00100000:0.0:1746129758.835602:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052397440 00000100:00100000:0.0:1746129758.835604:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052397440 00000100:00100000:0.0:1746129758.835627:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11440 00000100:00100000:0.0:1746129758.835631:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052397312:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129758.835640:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129758.835648:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04800/0x48868a4e4394a9ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3501bf expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.835659:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129758.835660:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129758.835667:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04800/0x48868a4e4394a9ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501bf expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.835679:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04800/0x48868a4e4394a9ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501bf expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.835687:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e04800, rc 0) 00000100:00100000:0.0:1746129758.835709:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949052397312:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 77us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129758.835714:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11440 00000100:00100000:0.0:1746129758.835727:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11441 00000100:00100000:0.0:1746129758.835731:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052397184:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129758.835735:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129758.835740:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05a00/0x48868a4e4394a9f6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3501b8 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129758.835759:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053384832:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129758.835779:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b37bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129758.835791:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11442 00000100:00100000:0.0:1746129758.835796:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+12:1962:x1830949052397440:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129758.835802:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129758.835809:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04400/0x48868a4e4394a9fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3501c6 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.835818:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129758.835819:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129758.835823:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04400/0x48868a4e4394a9fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501c6 expref: 13 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.835832:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04400/0x48868a4e4394a9fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501c6 expref: 13 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.835838:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e04400, rc 0) 00000100:00100000:0.0:1746129758.835870:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6141239f-0c60-480d-830c-e22ba61457b0+13:1962:x1830949052397440:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 73us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129758.835875:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11442 00002000:00010000:3.0:1746129758.839102:0:3624:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime: 1746129758 -> 1746129759 00002000:00010000:3.0:1746129758.839108:0:3624:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime: 1746129757 -> 1746129759 00002000:00010000:3.0:1746129758.839110:0:3624:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime: 1746129758 -> 1746129759 00000100:00100000:3.0:1746129758.839129:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053384704:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129758.839153:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e0ecc00/0x48868a4e4394a9e8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501b1 expref: 12 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129758.839164:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e0ecc00/0x48868a4e4394a9e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501b1 expref: 12 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129758.839176:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e0ecc00, rc 0) 00000100:00100000:3.0:1746129758.839207:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052397056:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4272us (4460us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129758.839214:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11439 00000100:00100000:1.0:1746129758.839307:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053384832:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129758.839324:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05a00/0x48868a4e4394a9f6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501b8 expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129758.839332:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05a00/0x48868a4e4394a9f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501b8 expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129758.839351:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e05a00, rc 0) 00000100:00100000:1.0:1746129758.839366:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052397184:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3635us (3832us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129758.839371:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11441 00000100:00100000:0.0:1746129758.850672:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.850769:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052397696 00000100:00100000:3.0:1746129758.850777:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052397696 00000100:00100000:3.0:1746129758.850825:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9996 00000100:00100000:3.0:1746129758.850833:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:28837:x1830949052397696:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129758.850874:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129758.850891:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ed000/0x48868a4e4394aa04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3501cd expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.850968:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec000/0x48868a4e4394aa0b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.850980:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0eca00/0x48868a4e4394a9be lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501a3 expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.850986:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec000/0x48868a4e4394aa0b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.851010:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0eca00/0x48868a4e4394a9be lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501a3 expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.851019:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0eca00/0x48868a4e4394a9be lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501a3 expref: 10 pid: 1851 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746129758.851029:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053384960:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129758.851105:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1240 going to sleep for 11 seconds 00000100:00100000:3.0:1746129758.858412:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053384960:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129758.858434:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec000/0x48868a4e4394aa0b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129758.860025:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.861079:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052397824 00000100:00100000:2.0:1746129758.861086:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052397824 00010000:00010000:2.0:1746129758.861121:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0eca00/0x48868a4e4394a9be lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501a3 expref: 11 pid: 1851 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746129758.861154:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5520 00000100:00100000:2.0:1746129758.861161:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052397824:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129758.861170:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129758.861175:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0eca00/0x48868a4e4394a9be lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501a3 expref: 11 pid: 1851 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746129758.861185:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0eca00/0x48868a4e4394a9be lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501a3 expref: 11 pid: 1851 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746129758.861201:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0eca00/0x48868a4e4394a9be lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501a3 expref: 11 pid: 1851 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746129758.861233:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129758.861237:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec000/0x48868a4e4394aa0b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.861245:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec000/0x48868a4e4394aa0b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.861250:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec000/0x48868a4e4394aa0b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.861284:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129758.861320:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949052397824:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 159us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.861325:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5520 00010000:00010000:3.0:1746129758.861476:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec000/0x48868a4e4394aa0b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.861486:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec000/0x48868a4e4394aa0b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129758.861501:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129758.861605:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ed000/0x48868a4e4394aa04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501cd expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.861622:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec000/0x48868a4e4394aa0b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501cd expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.861628:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129758.861630:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129758.861632:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e0ec000, rc 0) 00000100:00100000:3.0:1746129758.861655:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+10:28837:x1830949052397696:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 10823us (10992us total) trans 8589943803 rc 0/0 00000100:00100000:3.0:1746129758.861660:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9996 00000100:00100000:2.0:1746129758.868709:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.868775:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052397952 00000100:00100000:3.0:1746129758.868783:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052397952 00000100:00100000:3.0:1746129758.868835:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9997 00000100:00100000:3.0:1746129758.868843:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+10:28837:x1830949052397952:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129758.868889:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129758.868904:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec600/0x48868a4e4394aa19 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3501d4 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.868971:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ece00/0x48868a4e4394aa20 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.868983:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec000/0x48868a4e4394aa0b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501cd expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.869008:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ece00/0x48868a4e4394aa20 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129758.869042:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec000/0x48868a4e4394aa0b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501cd expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.869051:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec000/0x48868a4e4394aa0b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501cd expref: 11 pid: 1851 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746129758.869065:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053385088:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129758.869131:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1240 going to sleep for 11 seconds 00000100:00100000:3.0:1746129758.873446:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053385088:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129758.873466:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ece00/0x48868a4e4394aa20 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129758.876133:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.878151:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052398080 00000100:00100000:1.0:1746129758.878160:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052398080 00010000:00010000:1.0:1746129758.878191:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec000/0x48868a4e4394aa0b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501cd expref: 12 pid: 1851 timeout: 804 lvb_type: 0 00000100:00100000:1.0:1746129758.878224:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5521 00000100:00100000:1.0:1746129758.878231:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949052398080:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129758.878244:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129758.878249:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec000/0x48868a4e4394aa0b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501cd expref: 12 pid: 1851 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746129758.878259:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec000/0x48868a4e4394aa0b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501cd expref: 12 pid: 1851 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746129758.878286:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec000/0x48868a4e4394aa0b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501cd expref: 12 pid: 1851 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746129758.879719:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129758.879726:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ece00/0x48868a4e4394aa20 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129758.879736:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ece00/0x48868a4e4394aa20 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129758.879742:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ece00/0x48868a4e4394aa20 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129758.879771:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129758.879814:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052398080:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1583us (3686us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129758.879821:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5521 00010000:00010000:2.0:1746129758.879895:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ece00/0x48868a4e4394aa20 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.879902:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ece00/0x48868a4e4394aa20 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129758.879935:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:2.0:1746129758.879939:0:1851:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129758.879952:0:1851:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ece00/0x48868a4e4394aa20 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.879978:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ec600/0x48868a4e4394aa19 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501d4 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.879998:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ece00/0x48868a4e4394aa20 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501d4 expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.880005:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129758.880007:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129758.880009:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e0ece00, rc 0) 00000100:00100000:2.0:1746129758.880033:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+10:28837:x1830949052397952:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 11191us (11332us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.880039:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9997 00000100:00100000:0.0:1746129758.886980:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.887054:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052398208 00000100:00100000:1.0:1746129758.887062:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052398208 00000100:00100000:1.0:1746129758.887693:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11443 00000100:00100000:1.0:1746129758.887705:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052398208:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129758.887721:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129758.887734:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b96a400/0x48868a4e4394aa27 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3501db expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129758.887777:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053385216:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129758.889036:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510780 going to sleep for 11 seconds 00000100:00100000:1.0:1746129758.890924:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.891841:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.891877:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052398592 00000100:00100000:1.0:1746129758.891884:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052398592 00000100:00100000:1.0:1746129758.891921:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9998 00000100:00100000:1.0:1746129758.891927:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28843:x1830949052398592:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129758.891943:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129758.891958:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96be00/0x48868a4e4394aa2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3501e9 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.892034:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129758.892043:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129758.892052:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129758.892061:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a800/0x48868a4e4394aa3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129758.892065:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a800/0x48868a4e4394aa3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129758.892070:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a800/0x48868a4e4394aa3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129758.892145:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b600/0x48868a4e4394aa43 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129758.892152:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b600/0x48868a4e4394aa43 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129758.892156:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b600/0x48868a4e4394aa43 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:1.0:1746129758.892166:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129758.892225:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129758.892231:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa35 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129758.892236:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129758.892241:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b96a600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129758.892244:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129758.892249:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129758.892257:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129758.892259:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129758.892262:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129758.892281:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129758.892300:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a800/0x48868a4e4394aa3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129758.892304:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a800/0x48868a4e4394aa3c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129758.892309:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a800/0x48868a4e4394aa3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129758.892316:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b96a800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129758.892318:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a800/0x48868a4e4394aa3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129758.892322:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a800/0x48868a4e4394aa3c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129758.892328:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012bfcaf00) 00010000:00010000:1.0:1746129758.892330:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129758.892331:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a800/0x48868a4e4394aa3c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129758.892335:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a800/0x48868a4e4394aa3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129758.892366:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96be00/0x48868a4e4394aa2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501e9 expref: 17 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.892375:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b600/0x48868a4e4394aa43 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501e9 expref: 16 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.892381:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129758.892382:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129758.892384:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b96b600, rc 0) 00000100:00100000:1.0:1746129758.892418:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28843:x1830949052398592:12345-192.168.204.31@tcp:101:cat.0 Request processed in 491us (579us total) trans 8589943804 rc 0/0 00000100:00100000:1.0:1746129758.892424:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9998 00000100:00100000:3.0:1746129758.894376:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052398336 00000100:00100000:3.0:1746129758.894383:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052398336 00000100:00100000:3.0:1746129758.894416:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11444 00000100:00100000:3.0:1746129758.894422:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052398336:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129758.894433:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129758.894443:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e0ec400/0x48868a4e4394aa51 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3501e2 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129758.894482:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053385344:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129758.894551:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129758.897100:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.897175:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053385344:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129758.897199:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e0ec400/0x48868a4e4394aa51 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501e2 expref: 12 pid: 3624 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129758.897201:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053385216:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129758.897211:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e0ec400/0x48868a4e4394aa51 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501e2 expref: 12 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129758.897215:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b96a400/0x48868a4e4394aa27 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501db expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129758.897223:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e0ec400, rc 0) 00010000:00010000:1.0:1746129758.897224:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b96a400/0x48868a4e4394aa27 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501db expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129758.897230:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b96a400, rc 0) 00000100:00100000:3.0:1746129758.897260:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052398336:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 2838us (6342us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129758.897276:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11444 00000100:00100000:1.0:1746129758.897428:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052398208:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 9726us (10454us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129758.897433:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11443 00000100:00100000:2.0:1746129758.899797:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052398848 00000100:00100000:2.0:1746129758.899807:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052398848 00000100:00100000:2.0:1746129758.899845:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3957 00000100:00100000:2.0:1746129758.899871:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+16:28843:x1830949052398848:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129758.900012:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28843:x1830949052398848:12345-192.168.204.31@tcp:35:cat.0 Request processed in 141us (2919us total) trans 8589943805 rc 0/0 00000100:00100000:2.0:1746129758.900018:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3957 00000100:00100000:1.0:1746129758.917434:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.917500:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052399104 00000100:00100000:1.0:1746129758.917507:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052399104 00000100:00100000:1.0:1746129758.917660:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9999 00000100:00100000:1.0:1746129758.917667:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28844:x1830949052399104:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129758.917687:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129758.917700:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a800/0x48868a4e4394aa58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3501f0 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.917772:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa5f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129758.917784:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ece00/0x48868a4e4394aa20 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501d4 expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.917790:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b600/0x48868a4e4394aa43 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501e9 expref: 18 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.917795:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa5f lrc: 5/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129758.917819:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b600/0x48868a4e4394aa43 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501e9 expref: 18 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.917827:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b600/0x48868a4e4394aa43 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501e9 expref: 18 pid: 14315 timeout: 804 lvb_type: 0 00000100:00100000:1.0:1746129758.917837:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053385472:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129758.917919:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ece00/0x48868a4e4394aa20 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501d4 expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.917926:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ece00/0x48868a4e4394aa20 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501d4 expref: 9 pid: 1851 timeout: 804 lvb_type: 0 00000100:00100000:1.0:1746129758.917932:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053385600:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129758.917954:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129758.926786:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.926820:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.926867:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052399360 00000100:00100000:0.0:1746129758.926874:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052399360 00000100:00100000:0.0:1746129758.926905:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11445 00000100:00100000:0.0:1746129758.926912:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+46:28839:x1830949052399360:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129758.926929:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129758.926942:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05e00/0x48868a4e4394aa66 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3501f7 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.926966:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800923f8000/0x48868a4e4394a939 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35014f expref: 31 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.926973:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04800/0x48868a4e4394a9ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501bf expref: 10 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.926979:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e600/0x48868a4e4394a978 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350172 expref: 47 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.926984:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129758.926986:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129758.926988:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05e00/0x48868a4e4394aa66 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2330624->3071999] (req 2330624->3071999) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501f7 expref: 47 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.927010:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e600/0x48868a4e4394a978 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350172 expref: 47 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.927018:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e600/0x48868a4e4394a978 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350172 expref: 47 pid: 3624 timeout: 804 lvb_type: 1 00000100:00100000:0.0:1746129758.927027:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053385728:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129758.927086:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04800/0x48868a4e4394a9ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501bf expref: 10 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.927097:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04800/0x48868a4e4394a9ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501bf expref: 10 pid: 10930 timeout: 804 lvb_type: 1 00000100:00100000:0.0:1746129758.927103:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053385856:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129758.927118:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800923f8000/0x48868a4e4394a939 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35014f expref: 31 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.927124:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800923f8000/0x48868a4e4394a939 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35014f expref: 31 pid: 3624 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746129758.927130:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053385984:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129758.927140:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b37b900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129758.927157:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052399744 00000100:00100000:0.0:1746129758.927159:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052399744 00000100:00100000:0.0:1746129758.927176:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10000 00000100:00100000:0.0:1746129758.927180:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+10:28837:x1830949052399744:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129758.927187:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129758.927195:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04200/0x48868a4e4394aa6d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3501fe expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129758.934326:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.934346:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.934362:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.934388:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.934430:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053385728:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129758.937429:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052399488 00000100:00100000:2.0:1746129758.937439:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052399488 00002000:00100000:2.0:1746129758.937478:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->1474559) req@ffff88009fbee300 x1830949052399488/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.937488:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbee300 with x1830949052399488 ext(1048576->1474559) 00002000:00010000:2.0:1746129758.937493:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbee300 00000100:00100000:2.0:1746129758.937507:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052400128 00000100:00100000:2.0:1746129758.937510:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052400128 00002000:00100000:2.0:1746129758.937520:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3ea:0x0] (1150976->2097151) req@ffff88009fbef800 x1830949052400128/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.937526:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbef800 with x1830949052400128 ext(1150976->2097151) 00002000:00010000:2.0:1746129758.937530:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbef800 00000100:00100000:2.0:1746129758.937541:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4322 00000100:00100000:2.0:1746129758.937548:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052399488:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129758.938078:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052399872 00000100:00100000:2.0:1746129758.938081:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052399872 00010000:00010000:2.0:1746129758.938098:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b600/0x48868a4e4394aa43 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501e9 expref: 19 pid: 14315 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746129758.938117:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052400256 00000100:00100000:2.0:1746129758.938119:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052400256 00010000:00010000:2.0:1746129758.938128:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ece00/0x48868a4e4394aa20 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501d4 expref: 12 pid: 1851 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746129758.938140:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5522 00000100:00100000:2.0:1746129758.938145:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1961:x1830949052399872:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129758.938155:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129758.938159:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b600/0x48868a4e4394aa43 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501e9 expref: 19 pid: 14315 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746129758.938168:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b600/0x48868a4e4394aa43 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501e9 expref: 19 pid: 14315 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746129758.938186:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129758.938189:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa5f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129758.938196:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa5f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129758.938203:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129758.938226:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1961:x1830949052399872:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 80us (3907us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.938231:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5522 00000100:00100000:2.0:1746129758.938244:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5523 00000100:00100000:2.0:1746129758.938248:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949052400256:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129758.938254:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129758.938257:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ece00/0x48868a4e4394aa20 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501d4 expref: 12 pid: 1851 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746129758.938274:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ece00/0x48868a4e4394aa20 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501d4 expref: 12 pid: 1851 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746129758.938284:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129758.938286:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa5f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129758.938292:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa5f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129758.938297:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa5f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129758.938309:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129758.938322:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+12:1961:x1830949052400256:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 74us (3934us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.938327:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5523 00000100:00100000:2.0:1746129758.938376:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4323 00000100:00100000:2.0:1746129758.938382:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+32:1961:x1830949052400128:12345-192.168.204.31@tcp:3:cat.0 00010000:00010000:1.0:1746129758.940768:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96b600/0x48868a4e4394aa43 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501e9 expref: 18 pid: 14315 timeout: 804 lvb_type: 0 00000100:00100000:1.0:1746129758.940788:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053385472:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129758.940800:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ece00/0x48868a4e4394aa20 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501d4 expref: 11 pid: 1851 timeout: 804 lvb_type: 0 00000100:00100000:1.0:1746129758.940807:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053385600:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129758.940825:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa5f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129758.940836:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa5f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129758.940840:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa5f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:1.0:1746129758.940878:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129758.942203:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a800/0x48868a4e4394aa58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501f0 expref: 19 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.942219:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa5f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501f0 expref: 18 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.942227:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129758.942230:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129758.942232:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b96a600, rc 0) 00000100:00100000:1.0:1746129758.942286:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28844:x1830949052399104:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 24618us (24861us total) trans 8589943806 rc 0/0 00000100:00100000:1.0:1746129758.942293:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9999 00010000:00010000:1.0:1746129758.942333:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e4394aa7b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129758.942345:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa5f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501f0 expref: 17 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.942350:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e4394aa7b lrc: 4/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129758.942375:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa5f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501f0 expref: 17 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.942385:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa5f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501f0 expref: 17 pid: 14315 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746129758.942395:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053386112:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129758.942432:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129758.943010:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053385856:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129758.943018:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053385984:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129758.943040:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05e00/0x48868a4e4394aa66 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2330624->3071999] (req 2330624->3071999) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501f7 expref: 47 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129758.943050:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e05e00, rc 0) 00000100:00100000:3.0:1746129758.943067:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+47:28839:x1830949052399360:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 16156us (16288us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129758.943073:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11445 00000100:00100000:2.0:1746129758.950081:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.950101:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.950122:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.950142:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052400384 00000100:00100000:2.0:1746129758.950150:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052400384 00010000:00010000:2.0:1746129758.950182:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e600/0x48868a4e4394a978 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350172 expref: 47 pid: 3624 timeout: 804 lvb_type: 1 00000100:00100000:2.0:1746129758.950202:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052400640 00000100:00100000:2.0:1746129758.950204:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052400640 00010000:00010000:2.0:1746129758.950212:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800923f8000/0x48868a4e4394a939 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35014f expref: 34 pid: 3624 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746129758.950224:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052400512 00000100:00100000:2.0:1746129758.950226:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052400512 00010000:00010000:2.0:1746129758.950233:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04800/0x48868a4e4394a9ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501bf expref: 11 pid: 10930 timeout: 804 lvb_type: 1 00000100:00100000:2.0:1746129758.950246:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5524 00000100:00100000:1.0:1746129758.950305:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5525 00000100:00100000:1.0:1746129758.950312:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+34:1962:x1830949052400640:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129758.950324:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129758.950343:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5526 00010000:00010000:1.0:1746129758.950343:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff8800923f8000/0x48868a4e4394a939 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35014f expref: 34 pid: 3624 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746129758.950348:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052400512:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129758.950353:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800923f8000/0x48868a4e4394a939 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35014f expref: 34 pid: 3624 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746129758.950354:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129758.950360:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04800/0x48868a4e4394a9ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501bf expref: 11 pid: 10930 timeout: 804 lvb_type: 1 00010000:00010000:1.0:1746129758.950374:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800923f8000/0x48868a4e4394a939 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35014f expref: 34 pid: 3624 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746129758.950607:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053386112:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129758.950626:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e4394aa7b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129758.951095:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04800/0x48868a4e4394a9ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501bf expref: 11 pid: 10930 timeout: 804 lvb_type: 1 00010000:00010000:1.0:1746129758.951106:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129758.951688:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04800/0x48868a4e4394a9ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501bf expref: 11 pid: 10930 timeout: 804 lvb_type: 1 00010000:00010000:2.0:1746129758.951699:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129758.952443:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052399488:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14893us (18094us total) trans 0 rc 425984/425984 00000100:00100000:2.0:1746129758.952452:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4322 00002000:00100000:2.0:1746129758.952460:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->1474559) req@ffff88009fbee300 x1830949052399488/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/440 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 425984/425984 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.952468:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbee300 with x1830949052399488 ext(1048576->1474559) 00002000:00010000:2.0:1746129758.952472:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbee300 00000100:00100000:2.0:1746129758.952498:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+47:1962:x1830949052400384:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129758.952508:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129758.952522:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e600/0x48868a4e4394a978 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350172 expref: 47 pid: 3624 timeout: 804 lvb_type: 1 00010000:00010000:2.0:1746129758.952532:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e600/0x48868a4e4394a978 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350172 expref: 47 pid: 3624 timeout: 804 lvb_type: 1 00010000:00010000:2.0:1746129758.952543:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6e600/0x48868a4e4394a978 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350172 expref: 47 pid: 3624 timeout: 804 lvb_type: 1 00010000:00010000:2.0:1746129758.952550:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.952552:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129758.952558:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05e00/0x48868a4e4394aa66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2330624->3145727] (req 2330624->3071999) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501f7 expref: 46 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.952564:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05e00/0x48868a4e4394aa66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2330624->3145727] (req 2330624->3071999) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501f7 expref: 46 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129758.952589:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05e00/0x48868a4e4394aa66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2330624->3145727] (req 2330624->3071999) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501f7 expref: 46 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129758.952599:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053386240:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129758.952639:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1abaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129758.952654:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6141239f-0c60-480d-830c-e22ba61457b0+10:1962:x1830949052400512:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2306us (2531us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.952660:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5526 00000100:00100000:0.0:1746129758.956626:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+33:1962:x1830949052400640:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6306us (6514us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129758.956638:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5525 00000100:00100000:0.0:1746129758.963034:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.963068:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129758.964698:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052401024 00000100:00100000:1.0:1746129758.964708:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052401024 00000100:00100000:1.0:1746129758.966354:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10001 00000100:00100000:1.0:1746129758.966367:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:28847:x1830949052401024:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129758.966392:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129758.966408:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df200/0x48868a4e4394aa82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350205 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129758.966507:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df400/0x48868a4e4394aa89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.966518:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df400/0x48868a4e4394aa89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.966533:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df400/0x48868a4e4394aa89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.966545:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3dea00/0x48868a4e4394aa90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.966551:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3dea00/0x48868a4e4394aa90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129758.966556:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3dea00/0x48868a4e4394aa90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:2.0:1746129758.971715:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+31:1961:x1830949052400128:12345-192.168.204.31@tcp:3:cat.0 Request processed in 33322us (37341us total) trans 0 rc 946176/946176 00000100:00100000:2.0:1746129758.971728:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4323 00002000:00100000:2.0:1746129758.971739:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3ea:0x0] (1150976->2097151) req@ffff88009fbef800 x1830949052400128/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:499/0 lens 488/440 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 946176/946176 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.971747:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbef800 with x1830949052400128 ext(1150976->2097151) 00002000:00010000:2.0:1746129758.971752:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbef800 00000100:00100000:0.0:1746129758.971830:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052400768 00000100:00100000:0.0:1746129758.971836:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052400768 00000100:00100000:2.0:1746129758.971842:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053386240:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129758.971871:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129758.971871:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa5f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501f0 expref: 18 pid: 14315 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746129758.971890:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5527 00000100:00100000:2.0:1746129758.971896:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+46:1962:x1830949052400384:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 21644us (21823us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129758.971896:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1961:x1830949052400768:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129758.971901:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5524 00010000:00010000:0.0:1746129758.971905:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129758.971910:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa5f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501f0 expref: 18 pid: 14315 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746129758.971919:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa5f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501f0 expref: 18 pid: 14315 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746129758.971937:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96a600/0x48868a4e4394aa5f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501f0 expref: 18 pid: 14315 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746129758.971953:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129758.971958:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e4394aa7b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129758.971965:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e4394aa7b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129758.971970:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e4394aa7b lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129758.971984:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129758.971998:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:1961:x1830949052400768:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 102us (8985us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129758.972002:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.972003:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5527 00000100:00100000:2.0:1746129758.972014:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052401280 00000100:00100000:2.0:1746129758.972017:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052401280 00010000:00010000:0.0:1746129758.972025:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e4394aa7b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129758.972030:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e4394aa7b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00002000:00100000:2.0:1746129758.972035:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (2330624->2334719) req@ffff880094d8ed80 x1830949052401280/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.972041:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8ed80 with x1830949052401280 ext(2330624->2334719) 00002000:00010000:2.0:1746129758.972044:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8ed80 00010000:00010000:0.0:1746129758.972046:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e4394aa7b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129758.972051:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e4394aa7b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00000100:00100000:2.0:1746129758.972052:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4324 00010000:00010000:0.0:1746129758.972056:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e4394aa7b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00000100:00100000:2.0:1746129758.972057:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+46:1963:x1830949052401280:12345-192.168.204.31@tcp:3:multiop.0 00010000:00010000:0.0:1746129758.972062:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012a3de200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129758.972065:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e4394aa7b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129758.972070:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e4394aa7b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129758.972079:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129758.972081:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129758.972084:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e4394aa7b lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129758.972087:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e4394aa7b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129758.972116:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04200/0x48868a4e4394aa6d lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501fe expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.972122:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04200/0x48868a4e4394aa6d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501fe expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.972128:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e04200, rc 0) 00000100:00100000:0.0:1746129758.972145:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+9:28837:x1830949052399744:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 44965us (45325us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129758.972151:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10000 00000100:00100000:2.0:1746129758.972153:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+46:1963:x1830949052401280:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 96us (151us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129758.972158:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4324 00002000:00100000:2.0:1746129758.972162:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (2330624->2334719) req@ffff880094d8ed80 x1830949052401280/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/4536 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.972167:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8ed80 with x1830949052401280 ext(2330624->2334719) 00002000:00010000:2.0:1746129758.972170:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8ed80 00010000:00010000:0.0:1746129758.974006:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05600/0x48868a4e4394aa97 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129758.974020:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05600/0x48868a4e4394aa97 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129758.974028:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05600/0x48868a4e4394aa97 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:0.0:1746129758.974037:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:0.0:1746129758.974120:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df400/0x48868a4e4394aa89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129758.974130:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df400/0x48868a4e4394aa89 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129758.974135:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df400/0x48868a4e4394aa89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129758.974139:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012a3df400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129758.974141:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df400/0x48868a4e4394aa89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129758.974147:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df400/0x48868a4e4394aa89 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129758.974154:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:0.0:1746129758.974157:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129758.974159:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df400/0x48868a4e4394aa89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129758.974163:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df400/0x48868a4e4394aa89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129758.974172:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3dea00/0x48868a4e4394aa90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129758.974176:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3dea00/0x48868a4e4394aa90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129758.974181:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3dea00/0x48868a4e4394aa90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129758.974184:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012a3dea00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129758.974186:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3dea00/0x48868a4e4394aa90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129758.974193:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3dea00/0x48868a4e4394aa90 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129758.974198:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008fe79400) 00010000:00010000:0.0:1746129758.974200:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129758.974201:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3dea00/0x48868a4e4394aa90 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129758.974206:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3dea00/0x48868a4e4394aa90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129758.974239:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df200/0x48868a4e4394aa82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350205 expref: 296 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.974248:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05600/0x48868a4e4394aa97 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350205 expref: 295 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.974254:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:0.0:1746129758.974255:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129758.974257:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e05600, rc 0) 00000100:00100000:0.0:1746129758.974308:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:28847:x1830949052401024:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7943us (11238us total) trans 8589943807 rc 0/0 00000100:00100000:0.0:1746129758.974314:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10001 00000100:00100000:0.0:1746129758.977375:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.978131:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052401536 00000100:00100000:2.0:1746129758.978138:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052401536 00000100:00100000:2.0:1746129758.978172:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3958 00000100:00100000:2.0:1746129758.978179:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6141239f-0c60-480d-830c-e22ba61457b0+9:28837:x1830949052401536:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:2.0:1746129758.978341:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6141239f-0c60-480d-830c-e22ba61457b0+10:28837:x1830949052401536:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 161us (970us total) trans 8589943808 rc 0/0 00000100:00100000:2.0:1746129758.978347:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3958 00000100:00100000:0.0:1746129758.985517:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.986641:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052401792 00000100:00100000:2.0:1746129758.986649:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052401792 00000100:00100000:2.0:1746129758.986685:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3959 00000100:00100000:2.0:1746129758.986692:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:28847:x1830949052401792:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129758.986873:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:28847:x1830949052401792:12345-192.168.204.31@tcp:35:cat.0 Request processed in 180us (1362us total) trans 8589943809 rc 0/0 00000100:00100000:2.0:1746129758.986880:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3959 00000100:00100000:2.0:1746129758.991304:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.991332:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052402048 00000100:00100000:2.0:1746129758.991338:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052402048 00002000:00100000:2.0:1746129758.991373:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3067904->3071999) req@ffff880094d8d880 x1830949052402048/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1746129769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.991382:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8d880 with x1830949052402048 ext(3067904->3071999) 00002000:00010000:2.0:1746129758.991387:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8d880 00000100:00100000:2.0:1746129758.991403:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4325 00000100:00100000:2.0:1746129758.991410:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+46:1963:x1830949052402048:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129758.991534:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+46:1963:x1830949052402048:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 123us (239us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129758.991540:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4325 00002000:00100000:2.0:1746129758.991546:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3067904->3071999) req@ffff880094d8d880 x1830949052402048/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:499/0 lens 488/4536 e 0 to 0 dl 1746129769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129758.991552:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8d880 with x1830949052402048 ext(3067904->3071999) 00002000:00010000:2.0:1746129758.991555:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8d880 00000100:00100000:0.0:1746129758.992520:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.992536:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.992555:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052402176 00000100:00100000:3.0:1746129758.992560:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052402176 00000100:00100000:3.0:1746129758.992582:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052402304 00000100:00100000:3.0:1746129758.992583:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052402304 00000100:00100000:0.0:1746129758.992585:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129758.992594:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052402432 00000100:00100000:3.0:1746129758.992595:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052402432 00000100:00100000:0.0:1746129758.992604:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11446 00000100:00100000:3.0:1746129758.992609:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11447 00000100:00100000:0.0:1746129758.992611:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949052402176:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:3.0:1746129758.992616:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+47:1964:x1830949052402304:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129758.992621:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129758.992624:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129758.992634:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ff99600/0x48868a4e4394aaac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350213 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.992634:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04200/0x48868a4e4394aaa5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35020c expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129758.992671:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053386368:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129758.992671:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b026a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053386496:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129758.992714:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11448 00000100:00100000:3.0:1746129758.992719:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129758.992720:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+48:1964:x1830949052402432:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129758.992725:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129758.992732:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05200/0x48868a4e4394aab3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35021a expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.992748:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05200/0x48868a4e4394aab3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35021a expref: 49 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.992757:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05200/0x48868a4e4394aab3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35021a expref: 49 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129758.992770:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e05200, rc 0) 00000100:00100000:0.0:1746129758.993246:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+48:1964:x1830949052402432:12345-192.168.204.31@tcp:101:cat.0 Request processed in 525us (660us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129758.993252:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11448 00000100:00100000:0.0:1746129758.993332:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b37b480 going to sleep for 11 seconds 00000100:00100000:3.0:1746129758.996409:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129758.996439:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052402816 00000100:00100000:2.0:1746129758.996445:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052402816 00000100:00100000:3.0:1746129758.996468:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053386368:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129758.996476:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3960 00000100:00100000:2.0:1746129758.996483:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:28839:x1830949052402816:12345-192.168.204.31@tcp:35:multiop.0 00010000:00010000:3.0:1746129758.996497:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ff99600/0x48868a4e4394aaac lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350213 expref: 47 pid: 3624 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129758.996633:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:28839:x1830949052402816:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 150us (231us total) trans 8589943810 rc 0/0 00000100:00100000:2.0:1746129758.996638:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3960 00000100:00100000:1.0:1746129758.996702:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b026a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053386496:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129758.996719:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04200/0x48868a4e4394aaa5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35020c expref: 24 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129758.996728:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04200/0x48868a4e4394aaa5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35020c expref: 24 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129758.996736:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e04200, rc 0) 00000100:00100000:1.0:1746129758.996760:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949052402176:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4150us (4241us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129758.996766:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11446 00010000:00010000:3.0:1746129758.997231:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ff99600/0x48868a4e4394aaac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350213 expref: 47 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129758.997241:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff99600, rc 0) 00000100:00100000:3.0:1746129758.997278:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+46:1964:x1830949052402304:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4646us (4724us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129758.997285:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11447 00000100:00100000:2.0:1746129758.997665:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129758.997739:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052402560 00000100:00100000:0.0:1746129758.997743:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052402560 00000100:00100000:0.0:1746129758.997774:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11449 00000100:00100000:0.0:1746129758.997780:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+31:28843:x1830949052402560:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129758.997788:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129758.997800:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04c00/0x48868a4e4394aaba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350221 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.997819:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05e00/0x48868a4e4394aa66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2330624->3145727] (req 2330624->3071999) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501f7 expref: 45 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.997826:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129758.997827:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129758.997830:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04c00/0x48868a4e4394aaba lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350221 expref: 32 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.997866:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05e00/0x48868a4e4394aa66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2330624->3145727] (req 2330624->3071999) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501f7 expref: 45 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129758.997876:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05e00/0x48868a4e4394aa66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2330624->3145727] (req 2330624->3071999) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501f7 expref: 45 pid: 10930 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746129758.997885:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b024e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053386624:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129758.997935:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b37bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129759.007335:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.007336:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b024e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053386624:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129759.007357:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052402944 00000100:00100000:2.0:1746129759.007363:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052402944 00010000:00010000:0.0:1746129759.007364:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04c00/0x48868a4e4394aaba lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350221 expref: 32 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.007379:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e04c00, rc 0) 00002000:00100000:2.0:1746129759.007397:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (2330624->3071999) req@ffff88009207ea00 x1830949052402944/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.007405:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207ea00 with x1830949052402944 ext(2330624->3071999) 00010000:00010000:2.0:1746129759.007410:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05e00/0x48868a4e4394aa66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2330624->3145727] (req 2330624->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501f7 expref: 46 pid: 10930 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746129759.007411:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+32:28843:x1830949052402560:12345-192.168.204.31@tcp:101:cat.0 Request processed in 9632us (9747us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129759.007419:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11449 00010000:00010000:2.0:1746129759.007421:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05e00/0x48868a4e4394aa66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2330624->3145727] (req 2330624->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501f7 expref: 46 pid: 10930 timeout: 805 lvb_type: 0 00002000:00010000:2.0:1746129759.007426:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009207ea00 00000100:00100000:2.0:1746129759.007437:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 665 00000100:00100000:2.0:1746129759.007443:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+46:1962:x1830949052402944:12345-192.168.204.31@tcp:4:multiop.0 00000100:00080000:2.0:1746129759.007998:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129759.018497:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.018527:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052403072 00000100:00100000:0.0:1746129759.018534:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052403072 00000100:00100000:0.0:1746129759.019297:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11450 00000100:00100000:0.0:1746129759.019305:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:28847:x1830949052403072:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129759.019319:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129759.019334:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05800/0x48868a4e4394aac1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350228 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.019358:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f897400/0x48868a4e4394a97f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350179 expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.019365:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129759.019367:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129759.019370:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05800/0x48868a4e4394aac1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350228 expref: 24 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.019391:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f897400/0x48868a4e4394a97f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350179 expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.019400:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f897400/0x48868a4e4394a97f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350179 expref: 17 pid: 1877 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746129759.019409:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b024000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053386752:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129759.019471:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b37bf00 going to sleep for 11 seconds 00000100:00080000:3.0:1746129759.019766:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129759.027246:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129759.027337:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b024000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053386752:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129759.027475:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05800/0x48868a4e4394aac1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350228 expref: 24 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129759.027632:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e05800, rc 0) 00000100:00100000:1.0:1746129759.027802:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:28847:x1830949052403072:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8497us (9312us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129759.028029:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11450 00000100:00100000:3.0:1746129759.030275:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052403200 00000100:00100000:3.0:1746129759.030285:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052403200 00002000:00100000:3.0:1746129759.030322:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1474560->2097151) req@ffff88012b027b80 x1830949052403200/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129759.030331:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b027b80 with x1830949052403200 ext(1474560->2097151) 00010000:00010000:3.0:1746129759.030338:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f897400/0x48868a4e4394a97f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350179 expref: 18 pid: 1877 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746129759.030349:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f897400/0x48868a4e4394a97f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350179 expref: 18 pid: 1877 timeout: 805 lvb_type: 0 00002000:00010000:3.0:1746129759.030356:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b027b80 00000100:00100000:3.0:1746129759.030371:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 666 00000100:00100000:3.0:1746129759.030377:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:1962:x1830949052403200:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129759.031385:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.031406:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052403328 00000100:00100000:0.0:1746129759.031409:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052403328 00000100:00100000:0.0:1746129759.031428:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11451 00000100:00100000:0.0:1746129759.031433:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:28844:x1830949052403328:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129759.031442:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129759.031454:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05000/0x48868a4e4394aac8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35022f expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.031474:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6371800/0x48868a4e4394a96a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350164 expref: 23 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.031481:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04400/0x48868a4e4394a9fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501c6 expref: 10 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129759.031486:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f897c00/0x48868a4e4394a971 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35016b expref: 20 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.031492:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093bd2000/0x48868a4e4394a90f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350125 expref: 23 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.031497:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129759.031498:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129759.031501:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05000/0x48868a4e4394aac8 lrc: 7/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2920448->3145727] (req 2920448->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35022f expref: 20 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.031525:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093bd2000/0x48868a4e4394a90f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350125 expref: 23 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.031533:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093bd2000/0x48868a4e4394a90f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350125 expref: 23 pid: 10930 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746129759.031544:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053386880:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129759.031604:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f897c00/0x48868a4e4394a971 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35016b expref: 20 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.031611:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f897c00/0x48868a4e4394a971 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35016b expref: 20 pid: 1877 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746129759.031619:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b025500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053387008:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129759.031636:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04400/0x48868a4e4394a9fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501c6 expref: 10 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129759.031643:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04400/0x48868a4e4394a9fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501c6 expref: 10 pid: 7976 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1746129759.031649:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b024a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053387136:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129759.031663:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6371800/0x48868a4e4394a96a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350164 expref: 23 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.031668:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6371800/0x48868a4e4394a96a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350164 expref: 23 pid: 1877 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746129759.031680:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b026300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053387264:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129759.031691:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8e900 going to sleep for 11 seconds 00000100:00080000:0.0:1746129759.032302:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746129759.032769:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+48:1962:x1830949052402944:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 25322us (25440us total) trans 17179873276 rc 0/0 00000100:00100000:2.0:1746129759.032776:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 665 00002000:00100000:2.0:1746129759.032783:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (2330624->3071999) req@ffff88009207ea00 x1830949052402944/t17179873276(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/448 e 0 to 0 dl 1746129770 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.032797:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207ea00 with x1830949052402944 ext(2330624->3071999) 00010000:00010000:2.0:1746129759.032804:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05e00/0x48868a4e4394aa66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2330624->3145727] (req 2330624->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501f7 expref: 48 pid: 10930 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746129759.032815:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05e00/0x48868a4e4394aa66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2330624->3145727] (req 2330624->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501f7 expref: 48 pid: 10930 timeout: 805 lvb_type: 0 00002000:00010000:2.0:1746129759.032820:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009207ea00 00000100:00100000:0.0:1746129759.038454:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.038470:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.038486:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.038524:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.038546:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052403456 00000100:00100000:0.0:1746129759.038553:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052403456 00010000:00010000:0.0:1746129759.038582:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093bd2000/0x48868a4e4394a90f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350125 expref: 24 pid: 10930 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746129759.038603:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052403712 00000100:00100000:0.0:1746129759.038605:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052403712 00010000:00010000:0.0:1746129759.038613:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f897c00/0x48868a4e4394a971 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35016b expref: 22 pid: 1877 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746129759.038624:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052403584 00000100:00100000:0.0:1746129759.038626:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052403584 00010000:00010000:0.0:1746129759.038640:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04400/0x48868a4e4394a9fd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501c6 expref: 11 pid: 7976 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1746129759.038648:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052403840 00000100:00100000:0.0:1746129759.038650:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052403840 00010000:00010000:0.0:1746129759.038656:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6371800/0x48868a4e4394a96a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350164 expref: 25 pid: 1877 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746129759.038671:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5528 00000100:00100000:0.0:1746129759.038677:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949052403456:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129759.038688:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129759.038706:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093bd2000/0x48868a4e4394a90f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350125 expref: 25 pid: 10930 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746129759.038714:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093bd2000/0x48868a4e4394a90f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350125 expref: 25 pid: 10930 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746129759.038736:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129759.038766:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949052403456:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 88us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129759.038771:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5528 00000100:00100000:0.0:1746129759.038784:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5529 00000100:00100000:0.0:1746129759.038789:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052403712:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129759.038795:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129759.038801:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f897c00/0x48868a4e4394a971 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35016b expref: 22 pid: 1877 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746129759.038809:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f897c00/0x48868a4e4394a971 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35016b expref: 22 pid: 1877 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746129759.038817:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129759.038831:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1962:x1830949052403712:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 42us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129759.038836:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5529 00000100:00100000:0.0:1746129759.038845:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5530 00000100:00100000:0.0:1746129759.038872:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052403584:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129759.038878:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129759.038884:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04400/0x48868a4e4394a9fd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501c6 expref: 11 pid: 7976 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746129759.038891:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04400/0x48868a4e4394a9fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501c6 expref: 11 pid: 7976 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746129759.038900:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129759.038913:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+11:1962:x1830949052403584:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 42us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129759.038917:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5530 00000100:00100000:0.0:1746129759.038945:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5531 00000100:00100000:0.0:1746129759.038949:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949052403840:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129759.038955:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129759.038961:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6371800/0x48868a4e4394a96a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350164 expref: 24 pid: 1877 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746129759.038968:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6371800/0x48868a4e4394a96a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350164 expref: 24 pid: 1877 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746129759.038978:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129759.038979:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129759.038987:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05000/0x48868a4e4394aac8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2920448->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35022f expref: 21 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.038993:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05000/0x48868a4e4394aac8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2920448->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35022f expref: 21 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.039015:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05000/0x48868a4e4394aac8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2920448->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35022f expref: 21 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129759.039024:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b027100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053387392:192.168.204.31@tcp:105: 00000100:00080000:3.0:1746129759.045404:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746129759.045557:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bd2000/0x48868a4e4394a90f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350125 expref: 24 pid: 10930 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746129759.045573:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053386880:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129759.045584:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f897c00/0x48868a4e4394a971 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35016b expref: 21 pid: 1877 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746129759.045593:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b025500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053387008:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129759.045603:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e04400/0x48868a4e4394a9fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501c6 expref: 10 pid: 7976 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1746129759.045610:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b024a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053387136:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129759.045621:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6371800/0x48868a4e4394a96a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350164 expref: 23 pid: 1877 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746129759.045628:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b026300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053387264:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129759.045658:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05000/0x48868a4e4394aac8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2920448->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35022f expref: 20 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.045669:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e05000, rc 0) 00000100:00100000:2.0:1746129759.045714:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:28844:x1830949052403328:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 14280us (14331us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129759.045723:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11451 00000100:00100000:0.0:1746129759.048694:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.048736:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129759.050727:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949052403200:12345-192.168.204.31@tcp:4:cat.0 Request processed in 20344us (23480us total) trans 21474840405 rc 0/0 00000100:00100000:2.0:1746129759.050737:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 666 00002000:00100000:2.0:1746129759.050745:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1474560->2097151) req@ffff88012b027b80 x1830949052403200/t21474840405(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/448 e 0 to 0 dl 1746129770 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.050754:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b027b80 with x1830949052403200 ext(1474560->2097151) 00010000:00010000:2.0:1746129759.050762:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f897400/0x48868a4e4394a97f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350179 expref: 20 pid: 1877 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746129759.050773:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f897400/0x48868a4e4394a97f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350179 expref: 20 pid: 1877 timeout: 805 lvb_type: 0 00002000:00010000:2.0:1746129759.050779:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b027b80 00000100:00100000:2.0:1746129759.050809:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052403968 00000100:00100000:2.0:1746129759.050814:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052403968 00010000:00010000:2.0:1746129759.050833:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05e00/0x48868a4e4394aa66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2330624->3145727] (req 2330624->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501f7 expref: 48 pid: 10930 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746129759.053826:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5532 00000100:00100000:3.0:1746129759.053839:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+48:1962:x1830949052403968:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129759.053864:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746129759.053882:0:10980:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5673 -> 5675 00010000:00010000:3.0:1746129759.053889:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05e00/0x48868a4e4394aa66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2330624->3145727] (req 2330624->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501f7 expref: 48 pid: 10930 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746129759.053911:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05e00/0x48868a4e4394aa66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2330624->3145727] (req 2330624->3071999) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501f7 expref: 48 pid: 10930 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746129759.053929:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05e00/0x48868a4e4394aa66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2330624->3145727] (req 2330624->3071999) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501f7 expref: 48 pid: 10930 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746129759.053944:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129759.053946:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129759.053952:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04c00/0x48868a4e4394aaba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350221 expref: 31 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.053964:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04c00/0x48868a4e4394aaba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350221 expref: 31 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.053991:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04c00/0x48868a4e4394aaba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350221 expref: 31 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129759.054002:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053387520:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129759.054079:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1600 going to sleep for 11 seconds 00010000:00010000:2.0:1746129759.055496:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746129759.057340:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129759.057359:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052404224 00000100:00100000:3.0:1746129759.057367:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052404224 00002000:00100000:3.0:1746129759.057400:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (2920448->2924543) req@ffff88009a04c700 x1830949052404224/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129759.057410:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04c700 with x1830949052404224 ext(2920448->2924543) 00002000:00010000:3.0:1746129759.057414:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a04c700 00000100:00100000:3.0:1746129759.057441:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4326 00000100:00100000:3.0:1746129759.057448:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949052404224:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129759.057504:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b027100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053387392:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129759.057520:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129759.057823:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949052403840:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 18871us (19296us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129759.057831:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5531 00000100:00100000:3.0:1746129759.058149:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949052404224:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 701us (814us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129759.058155:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4326 00002000:00100000:3.0:1746129759.058161:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (2920448->2924543) req@ffff88009a04c700 x1830949052404224/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/4536 e 0 to 0 dl 1746129770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129759.058168:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04c700 with x1830949052404224 ext(2920448->2924543) 00002000:00010000:3.0:1746129759.058171:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a04c700 00000001:00080000:3.0:1746129759.058189:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873269 is committed 00000001:00080000:3.0:1746129759.058213:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873246 is committed 00000001:00080000:3.0:1746129759.058245:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873194 is committed 00000001:00080000:3.0:1746129759.058274:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873176 is committed 00000001:00080000:3.0:1746129759.058287:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873248 is committed 00000001:00080000:3.0:1746129759.058298:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873227 is committed 00000001:00080000:3.0:1746129759.058310:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873272 is committed 00000001:00080000:3.0:1746129759.058314:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873251 is committed 00000001:00080000:3.0:1746129759.058355:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873275 is committed 00000001:00080000:3.0:1746129759.058368:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873270 is committed 00000100:00100000:3.0:1746129759.058419:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053387520:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129759.058426:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129759.058441:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052403968:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4606us (9753us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129759.058446:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5532 00000100:00100000:0.0:1746129759.067296:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.067331:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129759.067710:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052404352 00000100:00100000:3.0:1746129759.067719:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052404352 00010000:00010000:3.0:1746129759.067749:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f897400/0x48868a4e4394a97f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350179 expref: 20 pid: 1877 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746129759.068331:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5533 00000100:00100000:3.0:1746129759.068343:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949052404352:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129759.068511:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129759.068691:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f897400/0x48868a4e4394a97f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350179 expref: 20 pid: 1877 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746129759.068704:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f897400/0x48868a4e4394a97f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350179 expref: 20 pid: 1877 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746129759.068877:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f897400/0x48868a4e4394a97f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350179 expref: 20 pid: 1877 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746129759.068891:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129759.068892:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129759.068898:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05800/0x48868a4e4394aac1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350228 expref: 21 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.068905:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05800/0x48868a4e4394aac1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350228 expref: 21 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.068934:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05800/0x48868a4e4394aac1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350228 expref: 21 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129759.068945:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053387648:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129759.069413:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052404864 00000100:00100000:2.0:1746129759.069418:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052404864 00002000:00100000:2.0:1746129759.069443:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (3149824->4194303) req@ffff88012b026300 x1830949052404864/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.069451:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b026300 with x1830949052404864 ext(3149824->4194303) 00002000:00010000:2.0:1746129759.069455:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b026300 00000100:00100000:2.0:1746129759.069468:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4327 00000100:00100000:2.0:1746129759.069473:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1961:x1830949052404864:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129759.069715:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129759.070514:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.070543:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.070575:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.070591:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052404736 00000100:00100000:0.0:1746129759.070595:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052404736 00002000:00100000:0.0:1746129759.070613:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3149823) req@ffff88012b024a80 x1830949052404736/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 504/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129759.070621:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b024a80 with x1830949052404736 ext(2097152->3149823) 00002000:00010000:0.0:1746129759.070624:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b024a80 00000100:00100000:0.0:1746129759.070633:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052405120 00000100:00100000:0.0:1746129759.070635:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052405120 00002000:00100000:0.0:1746129759.070649:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012b025500 x1830949052405120/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129759.070661:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b025500 with x1830949052405120 ext(2097152->3145727) 00002000:00010000:0.0:1746129759.070664:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b025500 00000100:00100000:0.0:1746129759.070670:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052405248 00000100:00100000:0.0:1746129759.070672:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052405248 00002000:00100000:0.0:1746129759.070679:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012b025f80 x1830949052405248/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129759.070685:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b025f80 with x1830949052405248 ext(3145728->4194303) 00002000:00010000:0.0:1746129759.070688:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b025f80 00000100:00100000:0.0:1746129759.070695:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4328 00000100:00100000:0.0:1746129759.070700:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+22:1961:x1830949052404736:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129759.071642:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4329 00000100:00100000:0.0:1746129759.071649:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1961:x1830949052405120:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129759.073866:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4330 00000100:00100000:0.0:1746129759.073878:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052405248:12345-192.168.204.31@tcp:3:multiop.0 00000100:00080000:3.0:1746129759.074378:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746129759.089663:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129759.089725:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052405632 00000100:00100000:3.0:1746129759.089732:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052405632 00002000:00100000:3.0:1746129759.089766:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009a04d880 x1830949052405632/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129759.089775:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04d880 with x1830949052405632 ext(1048576->2097151) 00002000:00010000:3.0:1746129759.089780:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a04d880 00000100:00100000:3.0:1746129759.089809:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4331 00000100:00100000:3.0:1746129759.089816:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949052405632:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129759.090901:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053387648:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129759.090916:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129759.090939:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+23:1961:x1830949052404352:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 22599us (23650us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129759.090948:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5533 00000100:00100000:0.0:1746129759.092251:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1961:x1830949052404736:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 21545us (21734us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129759.092269:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4328 00002000:00100000:0.0:1746129759.092278:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3149823) req@ffff88012b024a80 x1830949052404736/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 504/440 e 0 to 0 dl 1746129770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129759.092286:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b024a80 with x1830949052404736 ext(2097152->3149823) 00002000:00010000:0.0:1746129759.092290:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b024a80 00000100:00100000:2.0:1746129759.102412:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052405120:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 30755us (31858us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129759.102423:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4329 00002000:00100000:2.0:1746129759.102434:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012b025500 x1830949052405120/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/440 e 0 to 0 dl 1746129770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.102443:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b025500 with x1830949052405120 ext(2097152->3145727) 00002000:00010000:2.0:1746129759.102449:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b025500 00000100:00100000:2.0:1746129759.111912:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1961:x1830949052404864:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 42430us (44571us total) trans 0 rc 1044480/1044480 00000100:00100000:2.0:1746129759.111921:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4327 00002000:00100000:2.0:1746129759.111930:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (3149824->4194303) req@ffff88012b026300 x1830949052404864/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/440 e 0 to 0 dl 1746129770 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.111939:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b026300 with x1830949052404864 ext(3149824->4194303) 00002000:00010000:2.0:1746129759.111945:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b026300 00000100:00100000:0.0:1746129759.129607:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129759.130101:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052405760 00000100:00100000:3.0:1746129759.130108:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052405760 00000100:00100000:3.0:1746129759.130150:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11452 00000100:00100000:3.0:1746129759.130156:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28844:x1830949052405760:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129759.130171:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129759.130185:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e4394aacf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350236 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.130208:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04c00/0x48868a4e4394aaba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350221 expref: 11 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.130215:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a940 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350156 expref: 20 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.130220:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129759.130221:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129759.130224:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e4394aacf lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->3485695] (req 3145728->3485695) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350236 expref: 11 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.130246:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a940 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350156 expref: 20 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.130269:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a940 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350156 expref: 20 pid: 1877 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746129759.130279:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053387776:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129759.130355:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04c00/0x48868a4e4394aaba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350221 expref: 11 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.130362:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04c00/0x48868a4e4394aaba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350221 expref: 11 pid: 3624 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746129759.130369:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130506a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053387904:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129759.130382:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129759.131362:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052405248:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 57485us (60784us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129759.131371:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4330 00002000:00100000:2.0:1746129759.131379:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012b025f80 x1830949052405248/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/440 e 0 to 0 dl 1746129770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.131387:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b025f80 with x1830949052405248 ext(3145728->4194303) 00010000:00010000:2.0:1746129759.131392:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04c00/0x48868a4e4394aaba lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350221 expref: 10 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746129759.131401:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04c00/0x48868a4e4394aaba lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350221 expref: 10 pid: 3624 timeout: 805 lvb_type: 0 00002000:00010000:2.0:1746129759.131406:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b025f80 00000100:00100000:0.0:1746129759.142222:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.142252:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052405888 00000100:00100000:0.0:1746129759.142266:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052405888 00010000:00010000:0.0:1746129759.142293:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a940 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350156 expref: 21 pid: 1877 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746129759.142326:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5534 00000100:00100000:0.0:1746129759.142332:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1964:x1830949052405888:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129759.142344:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129759.142367:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a940 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350156 expref: 21 pid: 1877 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746129759.142378:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a940 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350156 expref: 21 pid: 1877 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746129759.142398:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129759.142437:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1964:x1830949052405888:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 105us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129759.142443:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5534 00000100:00100000:3.0:1746129759.143079:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949052405632:12345-192.168.204.31@tcp:3:cat.0 Request processed in 53261us (53421us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129759.143087:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4331 00002000:00100000:3.0:1746129759.143094:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009a04d880 x1830949052405632/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/440 e 0 to 0 dl 1746129770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129759.143103:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04d880 with x1830949052405632 ext(1048576->2097151) 00002000:00010000:3.0:1746129759.143107:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a04d880 00010000:00010000:2.0:1746129759.143221:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4394a940 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350156 expref: 20 pid: 1877 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746129759.143236:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053387776:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129759.143245:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130506a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053387904:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129759.143277:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e4394aacf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->3485695] (req 3145728->3485695) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350236 expref: 9 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.143288:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a1ef000, rc 0) 00000100:00100000:2.0:1746129759.143304:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28844:x1830949052405760:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 13148us (13706us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129759.143310:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11452 00000100:00100000:0.0:1746129759.146685:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.146731:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129759.146791:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052406016 00000100:00100000:1.0:1746129759.146798:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052406016 00000100:00100000:1.0:1746129759.146828:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052406144 00000100:00100000:1.0:1746129759.146830:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052406144 00000100:00100000:1.0:1746129759.146878:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11453 00000100:00100000:1.0:1746129759.146886:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1962:x1830949052406016:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129759.146901:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129759.146915:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d37800/0x48868a4e4394aad6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35023d expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129759.146932:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129759.146934:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129759.146946:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d37800/0x48868a4e4394aad6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35023d expref: 20 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129759.146964:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d37800/0x48868a4e4394aad6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35023d expref: 20 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129759.146972:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d37800, rc 0) 00000100:00100000:0.0:1746129759.146972:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11454 00000100:00100000:0.0:1746129759.146978:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052406144:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129759.146984:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129759.146992:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a4c800/0x48868a4e4394aadd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350244 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129759.147003:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1962:x1830949052406016:12345-192.168.204.31@tcp:101:cat.0 Request processed in 119us (325us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129759.147004:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746129759.147007:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11453 00010000:00010000:0.0:1746129759.147011:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a4c800/0x48868a4e4394aadd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350244 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129759.147017:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a4c800/0x48868a4e4394aadd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350244 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129759.147028:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a4c800, rc 0) 00000100:00100000:0.0:1746129759.147040:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052406144:12345-192.168.204.31@tcp:101:cat.0 Request processed in 63us (309us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129759.147044:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11454 00000100:00100000:1.0:1746129759.150226:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129759.150256:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.150337:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052406400 00000100:00100000:2.0:1746129759.150343:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052406400 00000100:00100000:2.0:1746129759.150374:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11455 00000100:00100000:2.0:1746129759.150380:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:28847:x1830949052406400:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129759.150394:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129759.150407:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a14c600/0x48868a4e4394aae4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35024b expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.150429:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130fcee00/0x48868a4e4394a994 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35018e expref: 8 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.150435:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129759.150437:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129759.150440:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a14c600/0x48868a4e4394aae4 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35024b expref: 21 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.150464:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130fcee00/0x48868a4e4394a994 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35018e expref: 8 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.150473:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130fcee00/0x48868a4e4394a994 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35018e expref: 8 pid: 3624 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746129759.150483:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053388032:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129759.150543:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aba840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129759.150589:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052406272 00000100:00100000:0.0:1746129759.150592:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052406272 00010000:00010000:0.0:1746129759.150608:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04c00/0x48868a4e4394aaba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350221 expref: 9 pid: 3624 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746129759.150624:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5535 00000100:00100000:0.0:1746129759.150629:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1961:x1830949052406272:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129759.150636:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129759.150652:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04c00/0x48868a4e4394aaba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350221 expref: 9 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746129759.150661:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04c00/0x48868a4e4394aaba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350221 expref: 9 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746129759.150681:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e04c00/0x48868a4e4394aaba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350221 expref: 9 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746129759.150691:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129759.150692:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129759.150696:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e4394aacf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350236 expref: 8 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.150703:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e4394aacf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350236 expref: 8 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.150720:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e4394aacf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350236 expref: 8 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129759.150728:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053388160:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129759.150747:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8e900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129759.163326:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.163739:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052406528 00000100:00100000:2.0:1746129759.163747:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052406528 00000100:00100000:2.0:1746129759.163949:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11456 00000100:00100000:2.0:1746129759.163957:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28843:x1830949052406528:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129759.163972:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129759.163985:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800924f5200/0x48868a4e4394aaeb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350252 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.164010:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e4394aacf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350236 expref: 10 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.164016:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129759.164018:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129759.164021:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800924f5200/0x48868a4e4394aaeb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4194304->4964351] (req 4194304->4964351) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350252 expref: 10 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.164047:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e4394aacf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350236 expref: 10 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.164057:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e4394aacf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350236 expref: 10 pid: 3624 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746129759.164068:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053388288:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129759.164127:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1abac00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129759.168825:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.169051:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053388032:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129759.169075:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a14c600/0x48868a4e4394aae4 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35024b expref: 21 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.169090:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a14c600, rc 0) 00000100:00100000:3.0:1746129759.169116:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052406656 00000100:00100000:3.0:1746129759.169123:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052406656 00000100:00100000:2.0:1746129759.169128:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:28847:x1830949052406400:12345-192.168.204.31@tcp:101:cat.0 Request processed in 18747us (18870us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129759.169136:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11455 00002000:00100000:3.0:1746129759.169154:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1150975) req@ffff88012ba1a680 x1830949052406656/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746129759.169165:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053388288:192.168.204.31@tcp:104: 00002000:00100000:3.0:1746129759.169169:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba1a680 with x1830949052406656 ext(1048576->1150975) 00010000:00010000:3.0:1746129759.169176:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130fcee00/0x48868a4e4394a994 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35018e expref: 11 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746129759.169177:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800924f5200/0x48868a4e4394aaeb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4194304->4964351] (req 4194304->4964351) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350252 expref: 11 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.169185:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924f5200, rc 0) 00010000:00010000:3.0:1746129759.169187:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130fcee00/0x48868a4e4394a994 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35018e expref: 11 pid: 3624 timeout: 805 lvb_type: 0 00002000:00010000:3.0:1746129759.169193:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ba1a680 00000100:00100000:2.0:1746129759.169198:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28843:x1830949052406528:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5242us (5878us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129759.169202:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11456 00000100:00100000:3.0:1746129759.169212:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 667 00000100:00100000:3.0:1746129759.169217:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949052406656:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129759.169363:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053388160:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129759.169375:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129759.169394:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052406272:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 18765us (19175us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129759.169401:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5535 00000100:00100000:0.0:1746129759.174947:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.175026:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052406912 00000100:00100000:2.0:1746129759.175034:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052406912 00002000:00100000:2.0:1746129759.175067:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (3481600->3485695) req@ffff880094d8d180 x1830949052406912/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.175076:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8d180 with x1830949052406912 ext(3481600->3485695) 00010000:00010000:2.0:1746129759.175084:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e4394aacf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350236 expref: 11 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746129759.175094:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e4394aacf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350236 expref: 11 pid: 3624 timeout: 805 lvb_type: 0 00002000:00010000:2.0:1746129759.175101:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094d8d180 00000100:00100000:2.0:1746129759.175119:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 668 00000100:00100000:2.0:1746129759.175126:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052406912:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129759.175253:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052406912:12345-192.168.204.31@tcp:3:cat.0 Request processed in 127us (311us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129759.175460:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 668 00002000:00100000:2.0:1746129759.175466:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (3481600->3485695) req@ffff880094d8d180 x1830949052406912/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/4536 e 0 to 0 dl 1746129770 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.175474:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8d180 with x1830949052406912 ext(3481600->3485695) 00010000:00010000:2.0:1746129759.175479:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e4394aacf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350236 expref: 11 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746129759.175487:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e4394aacf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350236 expref: 11 pid: 3624 timeout: 805 lvb_type: 0 00002000:00010000:2.0:1746129759.175492:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094d8d180 00000100:00100000:3.0:1746129759.178984:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052406656:12345-192.168.204.31@tcp:4:cat.0 Request processed in 9759us (10157us total) trans 17179873277 rc 0/0 00000100:00100000:3.0:1746129759.178994:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 667 00002000:00100000:3.0:1746129759.179003:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1150975) req@ffff88012ba1a680 x1830949052406656/t17179873277(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/448 e 0 to 0 dl 1746129770 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129759.179011:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba1a680 with x1830949052406656 ext(1048576->1150975) 00010000:00010000:3.0:1746129759.179018:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130fcee00/0x48868a4e4394a994 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35018e expref: 11 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746129759.179028:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130fcee00/0x48868a4e4394a994 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35018e expref: 11 pid: 3624 timeout: 805 lvb_type: 0 00002000:00010000:3.0:1746129759.179034:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ba1a680 00000100:00100000:0.0:1746129759.186741:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.186770:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052407040 00000100:00100000:0.0:1746129759.186777:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052407040 00010000:00010000:0.0:1746129759.186803:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130fcee00/0x48868a4e4394a994 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35018e expref: 11 pid: 3624 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746129759.186827:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5536 00000100:00100000:0.0:1746129759.186833:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052407040:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129759.186844:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129759.186879:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130fcee00/0x48868a4e4394a994 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35018e expref: 11 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746129759.186889:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130fcee00/0x48868a4e4394a994 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35018e expref: 11 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746129759.186908:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130fcee00/0x48868a4e4394a994 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35018e expref: 11 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746129759.186919:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129759.186920:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129759.186926:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a14c600/0x48868a4e4394aae4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35024b expref: 20 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.186933:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a14c600/0x48868a4e4394aae4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35024b expref: 20 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.186959:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a14c600/0x48868a4e4394aae4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35024b expref: 20 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129759.186970:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d634380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053388416:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129759.187090:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8e900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129759.188096:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.188153:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052407424 00000100:00100000:2.0:1746129759.188157:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052407424 00000100:00100000:2.0:1746129759.188186:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3961 00000100:00100000:2.0:1746129759.188192:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+17:28844:x1830949052407424:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129759.188341:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28844:x1830949052407424:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 149us (245us total) trans 8589943811 rc 0/0 00000100:00100000:2.0:1746129759.188347:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3961 00000100:00080000:2.0:1746129759.188362:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746129759.197696:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.197933:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.197954:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052407552 00000100:00100000:2.0:1746129759.197960:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052407552 00002000:00100000:2.0:1746129759.197998:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3485695) req@ffff88009468d880 x1830949052407552/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.198012:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468d880 with x1830949052407552 ext(3145728->3485695) 00010000:00010000:2.0:1746129759.198020:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e4394aacf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350236 expref: 11 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746129759.198033:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e4394aacf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350236 expref: 11 pid: 3624 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746129759.198152:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052407808 00000100:00100000:3.0:1746129759.198157:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052407808 00002000:00100000:3.0:1746129759.198210:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009468d500 x1830949052407808/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129759.198217:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468d500 with x1830949052407808 ext(1048576->2097151) 00002000:00010000:3.0:1746129759.198220:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468d500 00000100:00100000:3.0:1746129759.198237:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4332 00000100:00100000:3.0:1746129759.198243:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052407808:12345-192.168.204.31@tcp:3:cat.0 00002000:00010000:2.0:1746129759.199304:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009468d880 00000100:00100000:2.0:1746129759.199324:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 669 00000100:00100000:2.0:1746129759.199331:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1961:x1830949052407552:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129759.199752:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d634380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053388416:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129759.199766:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129759.199789:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949052407040:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 12955us (13052us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129759.199796:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5536 00000100:00100000:2.0:1746129759.212998:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949052407552:12345-192.168.204.31@tcp:4:cat.0 Request processed in 13660us (15301us total) trans 17179873278 rc 0/0 00000100:00100000:2.0:1746129759.213009:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 669 00002000:00100000:2.0:1746129759.213019:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3485695) req@ffff88009468d880 x1830949052407552/t17179873278(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/448 e 0 to 0 dl 1746129770 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.213028:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468d880 with x1830949052407552 ext(3145728->3485695) 00010000:00010000:2.0:1746129759.213037:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e4394aacf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350236 expref: 12 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746129759.213056:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e4394aacf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350236 expref: 12 pid: 3624 timeout: 805 lvb_type: 0 00002000:00010000:2.0:1746129759.213062:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009468d880 00000100:00100000:2.0:1746129759.215581:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.215602:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052407936 00000100:00100000:2.0:1746129759.215609:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052407936 00010000:00010000:2.0:1746129759.215636:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e4394aacf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350236 expref: 12 pid: 3624 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746129759.215658:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5537 00000100:00100000:2.0:1746129759.215665:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1963:x1830949052407936:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129759.215676:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129759.215692:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e4394aacf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350236 expref: 12 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746129759.215702:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e4394aacf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350236 expref: 12 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746129759.215719:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a1ef000/0x48868a4e4394aacf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350236 expref: 12 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746129759.215731:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129759.215732:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129759.215739:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800924f5200/0x48868a4e4394aaeb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350252 expref: 11 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.215751:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800924f5200/0x48868a4e4394aaeb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350252 expref: 11 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.215777:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800924f5200/0x48868a4e4394aaeb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350252 expref: 11 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129759.215788:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053388544:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129759.215835:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1aba840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129759.217323:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052407808:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19076us (19386us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129759.217333:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4332 00002000:00100000:3.0:1746129759.217340:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009468d500 x1830949052407808/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/440 e 0 to 0 dl 1746129770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129759.217348:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468d500 with x1830949052407808 ext(1048576->2097151) 00002000:00010000:3.0:1746129759.217352:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468d500 00000100:00100000:2.0:1746129759.221228:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053388544:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129759.221245:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129759.221287:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1963:x1830949052407936:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5621us (5711us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129759.221295:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5537 00000100:00100000:3.0:1746129759.226294:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129759.226434:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052408192 00000100:00100000:3.0:1746129759.226442:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052408192 00002000:00100000:3.0:1746129759.226473:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880130507480 x1830949052408192/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129759.226482:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130507480 with x1830949052408192 ext(4194304->4964351) 00002000:00010000:3.0:1746129759.226487:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130507480 00000100:00100000:3.0:1746129759.226510:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4333 00000100:00100000:3.0:1746129759.226517:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052408192:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129759.238317:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.238526:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129759.238969:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052408320 00000100:00100000:3.0:1746129759.238977:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052408320 00000100:00100000:3.0:1746129759.239010:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11457 00000100:00100000:3.0:1746129759.239017:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052408320:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129759.239037:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129759.239050:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05400/0x48868a4e4394aaf2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350259 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.239067:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129759.239069:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746129759.239121:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052408448 00000100:00100000:2.0:1746129759.239124:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052408448 00000100:00100000:1.0:1746129759.239151:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11458 00000100:00100000:1.0:1746129759.239160:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052408448:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129759.239168:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129759.239177:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d36a00/0x48868a4e4394aaf9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350260 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129759.239211:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053388672:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129759.239276:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4efdf00 going to sleep for 11 seconds 00010000:00010000:3.0:1746129759.239465:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05400/0x48868a4e4394aaf2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350259 expref: 22 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129759.239485:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05400/0x48868a4e4394aaf2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350259 expref: 22 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129759.239494:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e05400, rc 0) 00000100:00100000:3.0:1746129759.239745:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052408320:12345-192.168.204.31@tcp:101:cat.0 Request processed in 726us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129759.239750:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11457 00000100:00100000:3.0:1746129759.240297:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.240401:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052408704 00000100:00100000:0.0:1746129759.240405:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052408704 00000100:00100000:0.0:1746129759.240447:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10002 00000100:00100000:0.0:1746129759.240452:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:28852:x1830949052408704:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129759.240463:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129759.240473:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4ca00/0x48868a4e4394ab00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350267 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.240540:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4da00/0x48868a4e4394ab07 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129759.240551:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05600/0x48868a4e4394aa97 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350205 expref: 298 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.240557:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4da00/0x48868a4e4394ab07 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129759.240573:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05600/0x48868a4e4394aa97 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350205 expref: 298 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.240582:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05600/0x48868a4e4394aa97 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350205 expref: 298 pid: 16808 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746129759.240590:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d637800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053388800:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129759.240626:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8e6c0 going to sleep for 11 seconds 00000100:00080000:1.0:1746129759.240704:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129759.242683:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052408192:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16162us (16389us total) trans 0 rc 770048/770048 00000100:00100000:0.0:1746129759.242693:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4333 00002000:00100000:0.0:1746129759.242701:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880130507480 x1830949052408192/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/440 e 0 to 0 dl 1746129770 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129759.242709:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130507480 with x1830949052408192 ext(4194304->4964351) 00002000:00010000:0.0:1746129759.242713:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130507480 00002000:00010000:1.0:1746129759.242879:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime: 1746129758 -> 1746129759 00002000:00010000:1.0:1746129759.242892:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4139 00000100:00100000:1.0:1746129759.242897:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053388672:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129759.242918:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d36a00/0x48868a4e4394aaf9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350260 expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129759.242933:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d36a00/0x48868a4e4394aaf9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350260 expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129759.242942:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d36a00, rc 0) 00000100:00100000:1.0:1746129759.243671:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052408448:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4511us (5143us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129759.243677:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11458 00000100:00100000:1.0:1746129759.245749:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d637800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053388800:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129759.245767:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4da00/0x48868a4e4394ab07 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:0.0:1746129759.247593:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.247635:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052408832 00000100:00100000:2.0:1746129759.247641:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052408832 00000100:00100000:0.0:1746129759.247645:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129759.247665:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05600/0x48868a4e4394aa97 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350205 expref: 299 pid: 16808 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746129759.247687:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5538 00000100:00100000:2.0:1746129759.247693:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:1962:x1830949052408832:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129759.247704:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129759.247709:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05600/0x48868a4e4394aa97 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350205 expref: 299 pid: 16808 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746129759.247718:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05600/0x48868a4e4394aa97 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350205 expref: 299 pid: 16808 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746129759.247733:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e05600/0x48868a4e4394aa97 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350205 expref: 299 pid: 16808 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746129759.247747:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129759.247750:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4da00/0x48868a4e4394ab07 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.247757:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4da00/0x48868a4e4394ab07 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.247762:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4da00/0x48868a4e4394ab07 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.247776:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129759.247804:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:1962:x1830949052408832:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 110us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129759.247809:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5538 00010000:00010000:2.0:1746129759.247824:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4da00/0x48868a4e4394ab07 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.247830:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4da00/0x48868a4e4394ab07 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:2.0:1746129759.247842:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129759.247957:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4ca00/0x48868a4e4394ab00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350267 expref: 299 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.247972:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4da00/0x48868a4e4394ab07 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350267 expref: 298 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.247977:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129759.247980:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129759.247982:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a4da00, rc 0) 00000100:00100000:2.0:1746129759.248000:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:28852:x1830949052408704:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 7548us (7704us total) trans 8589943812 rc 0/0 00000100:00100000:2.0:1746129759.248006:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10002 00000100:00100000:1.0:1746129759.248093:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052408960 00000100:00100000:1.0:1746129759.248097:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052408960 00000100:00100000:1.0:1746129759.248116:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11459 00000100:00100000:1.0:1746129759.248121:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052408960:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129759.248131:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129759.248140:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c840c00/0x48868a4e4394ab15 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35026e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129759.248154:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129759.248155:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129759.248161:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c840c00/0x48868a4e4394ab15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35026e expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129759.248172:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c840c00/0x48868a4e4394ab15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35026e expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129759.248184:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c840c00, rc 0) 00000100:00100000:1.0:1746129759.248202:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052408960:12345-192.168.204.31@tcp:101:cat.0 Request processed in 80us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129759.248207:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11459 00000100:00100000:2.0:1746129759.256410:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.256501:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052409216 00000100:00100000:0.0:1746129759.256522:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052409216 00002000:00100000:0.0:1746129759.256575:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009468ca80 x1830949052409216/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129759.256584:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468ca80 with x1830949052409216 ext(2097152->3145727) 00002000:00010000:0.0:1746129759.256590:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468ca80 00000100:00100000:0.0:1746129759.256627:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4334 00000100:00100000:0.0:1746129759.256636:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052409216:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129759.276720:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052409216:12345-192.168.204.31@tcp:3:cat.0 Request processed in 20076us (20312us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129759.276731:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4334 00002000:00100000:0.0:1746129759.276744:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009468ca80 x1830949052409216/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/440 e 0 to 0 dl 1746129770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129759.276753:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468ca80 with x1830949052409216 ext(2097152->3145727) 00002000:00010000:0.0:1746129759.276759:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468ca80 00000100:00100000:1.0:1746129759.293609:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129759.295047:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052409344 00000100:00100000:3.0:1746129759.295055:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052409344 00000100:00100000:3.0:1746129759.295092:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11460 00000100:00100000:3.0:1746129759.295099:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:28847:x1830949052409344:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129759.295112:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129759.295126:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394ab1c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350275 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.295155:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05000/0x48868a4e4394aac8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2920448->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35022f expref: 19 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.295161:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129759.295163:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129759.295166:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394ab1c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350275 expref: 23 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.295190:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05000/0x48868a4e4394aac8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2920448->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35022f expref: 19 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.295199:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05000/0x48868a4e4394aac8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2920448->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35022f expref: 19 pid: 3624 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746129759.295209:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053388928:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129759.295273:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c10c0 going to sleep for 11 seconds 00000001:00080000:3.0:1746129759.297778:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840402 is committed 00000001:00080000:3.0:1746129759.297815:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840341 is committed 00000001:00080000:3.0:1746129759.297839:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840385 is committed 00000001:00080000:3.0:1746129759.297882:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840405 is committed 00000001:00080000:3.0:1746129759.297888:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840404 is committed 00000100:00100000:3.0:1746129759.302432:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053388928:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129759.302459:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394ab1c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350275 expref: 13 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.302474:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e05c00, rc 0) 00000100:00100000:3.0:1746129759.302713:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:28847:x1830949052409344:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7613us (9109us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129759.302721:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11460 00000100:00100000:0.0:1746129759.304910:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.305072:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052409472 00000100:00100000:2.0:1746129759.305079:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052409472 00002000:00100000:2.0:1746129759.305115:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2920448->3145727) req@ffff88012d636a00 x1830949052409472/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.305124:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d636a00 with x1830949052409472 ext(2920448->3145727) 00010000:00010000:2.0:1746129759.305131:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05000/0x48868a4e4394aac8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2920448->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35022f expref: 8 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746129759.305142:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05000/0x48868a4e4394aac8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2920448->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35022f expref: 8 pid: 3624 timeout: 805 lvb_type: 0 00002000:00010000:2.0:1746129759.305148:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d636a00 00000100:00100000:2.0:1746129759.305166:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 670 00000100:00100000:2.0:1746129759.305175:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1961:x1830949052409472:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129759.315547:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052409472:12345-192.168.204.31@tcp:4:cat.0 Request processed in 10361us (10629us total) trans 21474840406 rc 0/0 00000100:00100000:2.0:1746129759.315561:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 670 00002000:00100000:2.0:1746129759.315574:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2920448->3145727) req@ffff88012d636a00 x1830949052409472/t21474840406(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/448 e 0 to 0 dl 1746129770 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.315583:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d636a00 with x1830949052409472 ext(2920448->3145727) 00010000:00010000:2.0:1746129759.315593:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05000/0x48868a4e4394aac8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2920448->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35022f expref: 10 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746129759.315607:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05000/0x48868a4e4394aac8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2920448->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35022f expref: 10 pid: 3624 timeout: 805 lvb_type: 0 00002000:00010000:2.0:1746129759.315613:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d636a00 00000100:00100000:0.0:1746129759.324982:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129759.325041:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052409600 00000100:00100000:3.0:1746129759.325049:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052409600 00010000:00010000:3.0:1746129759.325078:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05000/0x48868a4e4394aac8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2920448->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35022f expref: 10 pid: 3624 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746129759.325113:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5539 00000100:00100000:3.0:1746129759.325121:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949052409600:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129759.325134:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129759.325154:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05000/0x48868a4e4394aac8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2920448->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35022f expref: 10 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746129759.325165:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05000/0x48868a4e4394aac8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2920448->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35022f expref: 10 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746129759.325185:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05000/0x48868a4e4394aac8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2920448->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35022f expref: 10 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746129759.325229:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129759.325231:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129759.325238:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394ab1c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350275 expref: 12 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.325247:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394ab1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350275 expref: 12 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.325296:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394ab1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350275 expref: 12 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129759.325309:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053389056:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129759.325416:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129759.330436:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053389056:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129759.330456:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129759.330500:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052409600:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5379us (5524us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129759.330509:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5539 00000100:00100000:0.0:1746129759.344245:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.344289:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.344334:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129759.344437:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052409856 00000100:00100000:1.0:1746129759.344493:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052409856 00000100:00100000:2.0:1746129759.344499:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052410112 00000100:00100000:2.0:1746129759.344502:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052410112 00002000:00100000:2.0:1746129759.344537:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012d637800 x1830949052410112/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129759.344543:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012d635880 x1830949052409856/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.344546:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d637800 with x1830949052410112 ext(3145728->4194303) 00002000:00100000:1.0:1746129759.344551:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d635880 with x1830949052409856 ext(2097152->3145727) 00002000:00010000:2.0:1746129759.344553:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d637800 00002000:00010000:1.0:1746129759.344553:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d635880 00000100:00100000:1.0:1746129759.344622:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052410368 00000100:00100000:1.0:1746129759.344625:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052410368 00002000:00100000:1.0:1746129759.344637:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012d637480 x1830949052410368/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129759.344643:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d637480 with x1830949052410368 ext(3145728->4194303) 00002000:00010000:1.0:1746129759.344646:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d637480 00000100:00100000:1.0:1746129759.344892:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4335 00000100:00100000:1.0:1746129759.344900:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1962:x1830949052410112:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129759.345422:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4336 00000100:00100000:2.0:1746129759.345429:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1962:x1830949052409856:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129759.345722:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4337 00000100:00100000:1.0:1746129759.345728:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052410368:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129759.360217:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949052409856:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14781us (15971us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129759.360228:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4336 00002000:00100000:2.0:1746129759.360238:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012d635880 x1830949052409856/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/440 e 0 to 0 dl 1746129770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.360251:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d635880 with x1830949052409856 ext(2097152->3145727) 00002000:00010000:2.0:1746129759.360265:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d635880 00000100:00100000:1.0:1746129759.378592:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949052410112:12345-192.168.204.31@tcp:3:cat.0 Request processed in 33684us (34293us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129759.378606:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4335 00002000:00100000:1.0:1746129759.378617:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012d637800 x1830949052410112/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/440 e 0 to 0 dl 1746129770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129759.378625:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d637800 with x1830949052410112 ext(3145728->4194303) 00002000:00010000:1.0:1746129759.378630:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d637800 00000100:00100000:2.0:1746129759.383232:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949052410368:12345-192.168.204.31@tcp:3:cat.0 Request processed in 37494us (38889us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129759.383243:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4337 00002000:00100000:2.0:1746129759.383252:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012d637480 x1830949052410368/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/440 e 0 to 0 dl 1746129770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.383272:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d637480 with x1830949052410368 ext(3145728->4194303) 00002000:00010000:2.0:1746129759.383276:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d637480 00000100:00100000:0.0:1746129759.385125:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129759.385221:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052410496 00000100:00100000:3.0:1746129759.385228:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052410496 00000100:00100000:3.0:1746129759.385965:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11461 00000100:00100000:3.0:1746129759.385973:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1961:x1830949052410496:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129759.385987:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129759.386001:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69e00/0x48868a4e4394ab23 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35027c expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.386117:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129759.386119:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129759.386126:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69e00/0x48868a4e4394ab23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35027c expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129759.386139:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69e00/0x48868a4e4394ab23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35027c expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129759.386152:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8f69e00, rc 0) 00000100:00100000:3.0:1746129759.386503:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052410496:12345-192.168.204.31@tcp:101:cat.0 Request processed in 530us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129759.386508:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11461 00000100:00100000:0.0:1746129759.392066:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129759.392156:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052410624 00000100:00100000:3.0:1746129759.392163:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052410624 00000100:00100000:3.0:1746129759.392197:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11462 00000100:00100000:3.0:1746129759.392204:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:28852:x1830949052410624:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129759.392218:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129759.392232:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68800/0x48868a4e4394ab2a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350283 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.392265:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800924f5200/0x48868a4e4394aaeb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350252 expref: 11 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.392273:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05400/0x48868a4e4394aaf2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350259 expref: 23 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129759.392279:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129759.392281:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129759.392284:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68800/0x48868a4e4394ab2a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3960832->4194303] (req 3960832->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350283 expref: 23 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.392308:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05400/0x48868a4e4394aaf2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350259 expref: 23 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129759.392322:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05400/0x48868a4e4394aaf2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350259 expref: 23 pid: 3624 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1746129759.392331:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053389184:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129759.395084:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.395460:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052411008 00000100:00100000:2.0:1746129759.395466:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052411008 00002000:00100000:2.0:1746129759.395501:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880131462680 x1830949052411008/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.395511:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131462680 with x1830949052411008 ext(1048576->2097151) 00002000:00010000:2.0:1746129759.395515:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131462680 00000100:00100000:2.0:1746129759.395542:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4338 00000100:00100000:2.0:1746129759.395549:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949052411008:12345-192.168.204.31@tcp:3:cat.0 00010000:00010000:3.0:1746129759.395738:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800924f5200/0x48868a4e4394aaeb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350252 expref: 11 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.395750:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800924f5200/0x48868a4e4394aaeb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350252 expref: 11 pid: 3624 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746129759.396026:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.396054:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129759.396116:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053389312:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129759.396178:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129759.396197:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053389184:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129759.396219:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052411136 00000100:00100000:1.0:1746129759.396222:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052411136 00002000:00100000:1.0:1746129759.396243:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880131463b80 x1830949052411136/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129759.396250:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131463b80 with x1830949052411136 ext(4194304->4964351) 00010000:00010000:1.0:1746129759.396265:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05400/0x48868a4e4394aaf2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350259 expref: 24 pid: 3624 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746129759.396273:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05400/0x48868a4e4394aaf2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350259 expref: 24 pid: 3624 timeout: 805 lvb_type: 1 00002000:00010000:1.0:1746129759.396278:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880131463b80 00000100:00100000:1.0:1746129759.396288:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052411392 00000100:00100000:1.0:1746129759.396290:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052411392 00002000:00100000:1.0:1746129759.396299:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880131462300 x1830949052411392/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129759.396306:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131462300 with x1830949052411392 ext(1048576->2097151) 00002000:00010000:1.0:1746129759.396308:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131462300 00000100:00100000:1.0:1746129759.396319:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 671 00000100:00100000:1.0:1746129759.396323:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949052411136:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129759.396437:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4339 00000100:00100000:0.0:1746129759.396442:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1964:x1830949052411392:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129759.398522:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053389312:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129759.398550:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68800/0x48868a4e4394ab2a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3960832->4194303] (req 3960832->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350283 expref: 25 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.398568:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8f68800, rc 0) 00000100:00100000:3.0:1746129759.398599:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:28852:x1830949052410624:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6394us (6539us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129759.398605:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11462 00000100:00100000:0.0:1746129759.402604:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129759.402658:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052411520 00000100:00100000:3.0:1746129759.402665:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052411520 00010000:00010000:3.0:1746129759.402693:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800924f5200/0x48868a4e4394aaeb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350252 expref: 14 pid: 3624 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746129759.402727:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5540 00000100:00100000:3.0:1746129759.402736:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1961:x1830949052411520:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129759.402747:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129759.402763:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800924f5200/0x48868a4e4394aaeb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350252 expref: 14 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746129759.402773:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800924f5200/0x48868a4e4394aaeb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350252 expref: 14 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746129759.402792:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800924f5200/0x48868a4e4394aaeb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350252 expref: 14 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746129759.402820:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129759.402864:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949052411520:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 128us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129759.402870:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5540 00000100:00100000:0.0:1746129759.409378:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.410379:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052411648 00000100:00100000:2.0:1746129759.410387:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052411648 00000100:00100000:2.0:1746129759.410437:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10003 00000100:00100000:2.0:1746129759.410446:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+10:28857:x1830949052411648:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129759.410466:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129759.410483:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c1f600/0x48868a4e4394ab31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35028a expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.410535:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bca9600/0x48868a4e4394ab38 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.410546:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bca9600/0x48868a4e4394ab38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.410556:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bca9600/0x48868a4e4394ab38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.410569:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bca9c00/0x48868a4e4394ab3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.410574:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bca9c00/0x48868a4e4394ab3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.410579:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bca9c00/0x48868a4e4394ab3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.411008:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770200/0x48868a4e4394ab46 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.411019:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4da00/0x48868a4e4394ab07 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350267 expref: 297 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.411024:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770200/0x48868a4e4394ab46 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.411049:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4da00/0x48868a4e4394ab07 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350267 expref: 297 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.411060:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4da00/0x48868a4e4394ab07 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350267 expref: 297 pid: 16808 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746129759.411074:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053389440:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129759.411591:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a4b600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129759.412203:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949052411008:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16651us (17121us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129759.412213:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4338 00002000:00100000:3.0:1746129759.412222:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880131462680 x1830949052411008/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/440 e 0 to 0 dl 1746129770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129759.412231:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131462680 with x1830949052411008 ext(1048576->2097151) 00002000:00010000:3.0:1746129759.412235:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131462680 00000100:00100000:2.0:1746129759.414680:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1964:x1830949052411392:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18231us (18618us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129759.414689:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4339 00002000:00100000:2.0:1746129759.414697:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880131462300 x1830949052411392/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/440 e 0 to 0 dl 1746129770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.414705:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131462300 with x1830949052411392 ext(1048576->2097151) 00002000:00010000:2.0:1746129759.414709:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131462300 00000100:00100000:0.0:1746129759.419430:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129759.419557:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052411776 00000100:00100000:3.0:1746129759.419564:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052411776 00010000:00010000:3.0:1746129759.419594:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4da00/0x48868a4e4394ab07 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350267 expref: 298 pid: 16808 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746129759.419618:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5541 00000100:00100000:3.0:1746129759.419624:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:1961:x1830949052411776:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129759.419636:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129759.419641:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4da00/0x48868a4e4394ab07 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350267 expref: 298 pid: 16808 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746129759.419650:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4da00/0x48868a4e4394ab07 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350267 expref: 298 pid: 16808 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746129759.419668:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129759.419672:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770200/0x48868a4e4394ab46 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129759.419680:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770200/0x48868a4e4394ab46 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129759.419686:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770200/0x48868a4e4394ab46 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129759.419699:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129759.419730:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:1961:x1830949052411776:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 106us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129759.419736:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5541 00000100:00100000:1.0:1746129759.420149:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949052411136:12345-192.168.204.31@tcp:3:cat.0 Request processed in 23823us (24121us total) trans 0 rc 770048/770048 00000100:00100000:1.0:1746129759.420156:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 671 00002000:00100000:1.0:1746129759.420163:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff880131463b80 x1830949052411136/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/440 e 0 to 0 dl 1746129770 ref 1 fl Complete:H/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129759.420171:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131463b80 with x1830949052411136 ext(4194304->4964351) 00010000:00010000:1.0:1746129759.420177:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05400/0x48868a4e4394aaf2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350259 expref: 23 pid: 3624 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746129759.420187:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05400/0x48868a4e4394aaf2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350259 expref: 23 pid: 3624 timeout: 805 lvb_type: 1 00002000:00010000:1.0:1746129759.420193:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880131463b80 00010000:00010000:2.0:1746129759.420531:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a4da00/0x48868a4e4394ab07 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350267 expref: 297 pid: 16808 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746129759.421091:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053389440:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129759.421108:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770200/0x48868a4e4394ab46 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.421115:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770200/0x48868a4e4394ab46 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.421119:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770200/0x48868a4e4394ab46 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:2.0:1746129759.421151:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:2.0:1746129759.421155:0:16808:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129759.421166:0:16808:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770200/0x48868a4e4394ab46 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.421180:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770200/0x48868a4e4394ab46 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.421188:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bca9600/0x48868a4e4394ab38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.421193:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bca9600/0x48868a4e4394ab38 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.421198:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bca9600/0x48868a4e4394ab38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.421203:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bca9600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129759.421206:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bca9600/0x48868a4e4394ab38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.421211:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bca9600/0x48868a4e4394ab38 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.421221:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:2.0:1746129759.421223:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129759.421226:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bca9600/0x48868a4e4394ab38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.421230:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bca9600/0x48868a4e4394ab38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.421238:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bca9c00/0x48868a4e4394ab3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.421243:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bca9c00/0x48868a4e4394ab3f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.421247:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bca9c00/0x48868a4e4394ab3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.421251:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bca9c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129759.421263:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bca9c00/0x48868a4e4394ab3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.421268:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bca9c00/0x48868a4e4394ab3f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.421273:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e2d8000) 00010000:00010000:2.0:1746129759.421275:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129759.421277:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bca9c00/0x48868a4e4394ab3f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.421281:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bca9c00/0x48868a4e4394ab3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.421310:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c1f600/0x48868a4e4394ab31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35028a expref: 12 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.421320:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770200/0x48868a4e4394ab46 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35028a expref: 11 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.421326:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129759.421327:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129759.421329:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b770200, rc 0) 00000100:00100000:2.0:1746129759.421367:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+11:28857:x1830949052411648:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 10922us (11996us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129759.421374:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10003 00000100:00100000:0.0:1746129759.422207:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.422367:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052412032 00000100:00100000:2.0:1746129759.422372:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052412032 00000100:00100000:2.0:1746129759.422393:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10004 00000100:00100000:2.0:1746129759.422397:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+18:28859:x1830949052412032:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129759.422412:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129759.422421:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b771a00/0x48868a4e4394ab4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350291 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.422472:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770400/0x48868a4e4394ab54 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.422481:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770200/0x48868a4e4394ab46 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35028a expref: 10 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.422486:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770400/0x48868a4e4394ab54 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.422504:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770200/0x48868a4e4394ab46 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35028a expref: 10 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.422512:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770200/0x48868a4e4394ab46 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35028a expref: 10 pid: 16808 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746129759.422521:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053389568:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129759.422584:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a4b600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129759.424922:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.425298:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.425444:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053389568:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129759.425463:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770400/0x48868a4e4394ab54 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:1.0:1746129759.425510:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052412288 00000100:00100000:1.0:1746129759.425515:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052412288 00000100:00100000:1.0:1746129759.425550:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052412160 00000100:00100000:1.0:1746129759.425552:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052412160 00000100:00100000:1.0:1746129759.425566:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11463 00000100:00100000:1.0:1746129759.425572:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+7:1964:x1830949052412288:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129759.425586:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129759.425598:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7200/0x48868a4e4394ab5b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35029f expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129759.425614:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129759.425615:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129759.425622:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7200/0x48868a4e4394ab5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35029f expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129759.425637:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7200/0x48868a4e4394ab5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35029f expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129759.425645:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fb7200, rc 0) 00000100:00100000:1.0:1746129759.425672:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:1964:x1830949052412288:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 100us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129759.425676:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11463 00000100:00100000:1.0:1746129759.425688:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11464 00000100:00100000:1.0:1746129759.425692:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28856:x1830949052412160:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129759.425698:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129759.425705:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7400/0x48868a4e4394ab62 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350298 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129759.425714:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129759.425716:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129759.425719:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7400/0x48868a4e4394ab62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350298 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129759.425727:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7400/0x48868a4e4394ab62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350298 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129759.425733:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fb7400, rc 0) 00000100:00100000:1.0:1746129759.425744:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28856:x1830949052412160:12345-192.168.204.31@tcp:101:cat.0 Request processed in 52us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129759.425748:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11464 00000100:00100000:0.0:1746129759.426528:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129759.426566:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052412672 00000100:00100000:3.0:1746129759.426569:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052412672 00000100:00100000:3.0:1746129759.426612:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11465 00000100:00100000:3.0:1746129759.426617:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+7:1963:x1830949052412672:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129759.426625:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129759.426636:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68200/0x48868a4e4394ab69 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3502ad expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.426648:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129759.426650:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129759.426654:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68200/0x48868a4e4394ab69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ad expref: 8 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129759.426663:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68200/0x48868a4e4394ab69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ad expref: 8 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129759.426669:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8f68200, rc 0) 00000100:00100000:3.0:1746129759.426699:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6141239f-0c60-480d-830c-e22ba61457b0+8:1963:x1830949052412672:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 82us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129759.426704:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11465 00000100:00080000:1.0:1746129759.426759:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129759.427323:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.427347:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129759.427361:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052412800 00000100:00100000:3.0:1746129759.427364:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052412800 00000100:00100000:0.0:1746129759.427371:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129759.427387:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052412928 00000100:00100000:3.0:1746129759.427389:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052412928 00000100:00100000:0.0:1746129759.427390:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129759.427402:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052412416 00000100:00100000:3.0:1746129759.427404:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052412416 00000100:00100000:3.0:1746129759.427416:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11466 00000100:00100000:3.0:1746129759.427421:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+8:1963:x1830949052412800:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129759.427427:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129759.427434:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68000/0x48868a4e4394ab70 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3502b4 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129759.427440:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11467 00010000:00010000:3.0:1746129759.427444:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746129759.427445:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+8:1963:x1830949052412928:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129759.427450:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68000/0x48868a4e4394ab70 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502b4 expref: 9 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129759.427451:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129759.427457:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68000/0x48868a4e4394ab70 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502b4 expref: 9 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129759.427458:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c12c600/0x48868a4e4394ab77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3502bb expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.427465:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129759.427467:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129759.427468:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8f68000, rc 0) 00010000:00010000:2.0:1746129759.427470:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c12c600/0x48868a4e4394ab77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502bb expref: 9 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129759.427479:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c12c600/0x48868a4e4394ab77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502bb expref: 9 pid: 3623 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129759.427483:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6141239f-0c60-480d-830c-e22ba61457b0+8:1963:x1830949052412800:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 63us (162us total) trans 0 rc 301/301 00010000:00010000:2.0:1746129759.427486:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c12c600, rc 0) 00000100:00100000:3.0:1746129759.427488:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11466 00000100:00100000:3.0:1746129759.427497:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11468 00000100:00100000:2.0:1746129759.427497:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6141239f-0c60-480d-830c-e22ba61457b0+9:1963:x1830949052412928:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 53us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129759.427501:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949052412416:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:2.0:1746129759.427502:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11467 00010000:00010000:3.0:1746129759.427506:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129759.427510:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8f69800/0x48868a4e4394ab7e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3502a6 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.427519:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746129759.427521:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052412544 00010000:00010000:3.0:1746129759.427523:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8f69800/0x48868a4e4394ab7e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502a6 expref: 24 pid: 8435 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129759.427524:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052412544 00010000:00010000:3.0:1746129759.427529:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8f69800/0x48868a4e4394ab7e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502a6 expref: 24 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129759.427535:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770200/0x48868a4e4394ab46 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35028a expref: 11 pid: 16808 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746129759.427536:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8f69800, rc 0) 00000100:00100000:3.0:1746129759.427548:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949052412416:12345-192.168.204.31@tcp:101:cat.0 Request processed in 47us (157us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129759.427549:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5542 00000100:00100000:3.0:1746129759.427552:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11468 00000100:00100000:2.0:1746129759.427553:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+11:1961:x1830949052412544:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129759.427560:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129759.427564:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770200/0x48868a4e4394ab46 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35028a expref: 11 pid: 16808 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746129759.427576:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770200/0x48868a4e4394ab46 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35028a expref: 11 pid: 16808 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746129759.427588:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770200/0x48868a4e4394ab46 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35028a expref: 11 pid: 16808 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746129759.427601:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129759.427606:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770400/0x48868a4e4394ab54 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.427613:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770400/0x48868a4e4394ab54 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.427618:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770400/0x48868a4e4394ab54 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129759.427640:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129759.427655:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+10:1961:x1830949052412544:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 101us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129759.427659:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5542 00010000:00010000:3.0:1746129759.428275:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770400/0x48868a4e4394ab54 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129759.428282:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770400/0x48868a4e4394ab54 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:3.0:1746129759.428295:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:3.0:1746129759.428397:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b771a00/0x48868a4e4394ab4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350291 expref: 21 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.428406:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770400/0x48868a4e4394ab54 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350291 expref: 20 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.428412:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129759.428414:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129759.428416:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b770400, rc 0) 00000100:00100000:3.0:1746129759.428972:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:28859:x1830949052412032:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6572us (6765us total) trans 8589943813 rc 0/0 00000100:00100000:3.0:1746129759.428979:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10004 00000100:00100000:0.0:1746129759.429530:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129759.429568:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052413056 00000100:00100000:1.0:1746129759.429572:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052413056 00000100:00100000:1.0:1746129759.429606:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11469 00000100:00100000:1.0:1746129759.429612:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:28847:x1830949052413056:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129759.429623:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129759.429631:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7000/0x48868a4e4394ab8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3502c2 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129759.429646:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129759.429647:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129759.429652:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7000/0x48868a4e4394ab8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502c2 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129759.429662:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7000/0x48868a4e4394ab8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502c2 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129759.429665:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129759.429670:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fb7000, rc 0) 00000100:00100000:1.0:1746129759.429690:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:28847:x1830949052413056:12345-192.168.204.31@tcp:101:cat.0 Request processed in 78us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129759.429694:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11469 00000100:00100000:3.0:1746129759.429843:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052413184 00000100:00100000:3.0:1746129759.429861:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052413184 00000100:00100000:3.0:1746129759.429882:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10005 00000100:00100000:3.0:1746129759.429887:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+10:28857:x1830949052413184:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129759.429894:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129759.429901:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f68600/0x48868a4e4394ab93 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3502c9 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.429939:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f68600/0x48868a4e4394ab93 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502c9 expref: 11 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.429948:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f68600/0x48868a4e4394ab93 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502c9 expref: 11 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.429961:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129759.429964:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129759.429965:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8f68600, rc 0) 00000100:00100000:3.0:1746129759.429996:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6141239f-0c60-480d-830c-e22ba61457b0+11:28857:x1830949052413184:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 108us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129759.430001:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10005 00000100:00100000:0.0:1746129759.431037:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.431173:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052413312 00000100:00100000:2.0:1746129759.431177:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052413312 00010000:00010000:2.0:1746129759.431195:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05400/0x48868a4e4394aaf2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350259 expref: 24 pid: 3624 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1746129759.431221:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5543 00000100:00100000:2.0:1746129759.431226:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052413312:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129759.431234:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129759.431248:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05400/0x48868a4e4394aaf2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350259 expref: 24 pid: 3624 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1746129759.431266:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05400/0x48868a4e4394aaf2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350259 expref: 24 pid: 3624 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1746129759.431283:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e05400/0x48868a4e4394aaf2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350259 expref: 24 pid: 3624 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1746129759.431297:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129759.431298:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129759.431303:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68800/0x48868a4e4394ab2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3960832->4194303] (req 3960832->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350283 expref: 23 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.431309:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68800/0x48868a4e4394ab2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3960832->4194303] (req 3960832->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350283 expref: 23 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.431335:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68800/0x48868a4e4394ab2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3960832->4194303] (req 3960832->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350283 expref: 23 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129759.431514:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.431560:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053389696:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129759.431612:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a4b600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129759.431919:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052413824 00000100:00100000:1.0:1746129759.431924:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052413824 00000100:00100000:1.0:1746129759.431955:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10006 00000100:00100000:1.0:1746129759.431961:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+11:28857:x1830949052413824:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129759.431970:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129759.431978:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb6a00/0x48868a4e4394ab9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3502d0 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129759.432054:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb6000/0x48868a4e4394aba1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129759.432062:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb6000/0x48868a4e4394aba1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129759.432070:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb6000/0x48868a4e4394aba1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129759.432079:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb7a00/0x48868a4e4394aba8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129759.432084:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb7a00/0x48868a4e4394aba8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129759.432088:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb7a00/0x48868a4e4394aba8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129759.432479:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb6c00/0x48868a4e4394abaf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129759.432487:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb6c00/0x48868a4e4394abaf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129759.432493:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb6c00/0x48868a4e4394abaf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:1.0:1746129759.432500:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129759.432563:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb6000/0x48868a4e4394aba1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129759.432569:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb6000/0x48868a4e4394aba1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129759.432577:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb6000/0x48868a4e4394aba1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129759.432582:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8fb6000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129759.432585:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb6000/0x48868a4e4394aba1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129759.432591:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb6000/0x48868a4e4394aba1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129759.432598:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:1.0:1746129759.432600:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129759.432603:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb6000/0x48868a4e4394aba1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129759.432607:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb6000/0x48868a4e4394aba1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129759.432626:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb7a00/0x48868a4e4394aba8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129759.432630:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb7a00/0x48868a4e4394aba8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129759.432634:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb7a00/0x48868a4e4394aba8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129759.432638:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8fb7a00 already unused, calling callback (ffffffffa1371690) 00000100:00100000:0.0:1746129759.432639:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129759.432640:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb7a00/0x48868a4e4394aba8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129759.432644:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb7a00/0x48868a4e4394aba8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129759.432654:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fa49d00) 00010000:00010000:1.0:1746129759.432655:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746129759.432656:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129759.432657:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb7a00/0x48868a4e4394aba8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129759.432662:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb7a00/0x48868a4e4394aba8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129759.432672:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129759.432687:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb6a00/0x48868a4e4394ab9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502d0 expref: 14 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129759.432696:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb6c00/0x48868a4e4394abaf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502d0 expref: 13 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129759.432702:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129759.432703:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129759.432705:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fb6c00, rc 0) 00000100:00100000:1.0:1746129759.432726:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+13:28857:x1830949052413824:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 765us (1211us total) trans 8589943814 rc 0/0 00000100:00100000:1.0:1746129759.432731:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10006 00000100:00100000:1.0:1746129759.432752:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052413952 00000100:00100000:1.0:1746129759.432755:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052413952 00000100:00100000:3.0:1746129759.432759:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052414080 00000100:00100000:3.0:1746129759.432761:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052414080 00000100:00100000:1.0:1746129759.432768:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11470 00000100:00100000:1.0:1746129759.432772:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949052413952:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129759.432777:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:3.0:1746129759.432781:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880094eb5880 x1830949052414080/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746129759.432784:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6200/0x48868a4e4394abbd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3502d7 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746129759.432789:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb5880 with x1830949052414080 ext(2097152->3145727) 00002000:00010000:3.0:1746129759.432792:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eb5880 00000100:00100000:3.0:1746129759.432801:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052414208 00010000:00010000:1.0:1746129759.432801:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6200/0x48868a4e4394abbd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502d7 expref: 25 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129759.432803:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052414208 00010000:00010000:1.0:1746129759.432808:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6200/0x48868a4e4394abbd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502d7 expref: 25 pid: 8437 timeout: 0 lvb_type: 1 00002000:00100000:3.0:1746129759.432811:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880094eb4a80 x1830949052414208/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746129759.432815:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fb6200, rc 0) 00002000:00100000:3.0:1746129759.432817:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb4a80 with x1830949052414208 ext(2097152->3145727) 00002000:00010000:3.0:1746129759.432819:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb4a80 00000100:00100000:3.0:1746129759.432827:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4340 00000100:00100000:1.0:1746129759.432830:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949052413952:12345-192.168.204.31@tcp:101:cat.0 Request processed in 57us (173us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129759.432832:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1963:x1830949052414080:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129759.432834:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11470 00000100:00100000:1.0:1746129759.432861:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4341 00000100:00100000:1.0:1746129759.432866:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1963:x1830949052414208:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129759.434303:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053389696:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129759.434317:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129759.434336:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949052413312:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3110us (3300us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129759.434343:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5543 00000100:00100000:0.0:1746129759.434733:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.434792:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129759.435158:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052414464 00000100:00100000:3.0:1746129759.435163:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052414464 00002000:00100000:3.0:1746129759.435186:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (4960256->4964351) req@ffff880094eb7b80 x1830949052414464/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129759.435194:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb7b80 with x1830949052414464 ext(4960256->4964351) 00002000:00010000:3.0:1746129759.435197:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb7b80 00000100:00100000:3.0:1746129759.435511:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052414720 00000100:00100000:3.0:1746129759.435517:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052414720 00002000:00100000:3.0:1746129759.435537:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (3960832->3964927) req@ffff88012ba3ad80 x1830949052414720/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129759.435545:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3ad80 with x1830949052414720 ext(3960832->3964927) 00002000:00010000:3.0:1746129759.435548:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba3ad80 00000100:00100000:0.0:1746129759.435779:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129759.435888:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4342 00000100:00100000:3.0:1746129759.435897:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949052414464:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129759.436051:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949052414464:12345-192.168.204.31@tcp:3:cat.0 Request processed in 153us (1316us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129759.436057:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4342 00002000:00100000:3.0:1746129759.436063:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (4960256->4964351) req@ffff880094eb7b80 x1830949052414464/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/4536 e 0 to 0 dl 1746129770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129759.436069:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb7b80 with x1830949052414464 ext(4960256->4964351) 00002000:00010000:3.0:1746129759.436072:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb7b80 00000100:00100000:3.0:1746129759.436093:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4343 00000100:00100000:3.0:1746129759.436099:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949052414720:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129759.436181:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949052414720:12345-192.168.204.31@tcp:3:cat.0 Request processed in 80us (1386us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129759.436186:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4343 00002000:00100000:3.0:1746129759.436192:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (3960832->3964927) req@ffff88012ba3ad80 x1830949052414720/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/4536 e 0 to 0 dl 1746129770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129759.436198:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3ad80 with x1830949052414720 ext(3960832->3964927) 00002000:00010000:3.0:1746129759.436200:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba3ad80 00000100:00100000:2.0:1746129759.436415:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052414848 00000100:00100000:2.0:1746129759.436418:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052414848 00000100:00100000:2.0:1746129759.436436:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11471 00000100:00100000:2.0:1746129759.436440:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+8:1963:x1830949052414848:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129759.436447:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129759.436458:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c12c400/0x48868a4e4394abc4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3502de expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.436477:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c12c400/0x48868a4e4394abc4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502de expref: 9 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129759.436485:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c12c400/0x48868a4e4394abc4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502de expref: 9 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129759.436492:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c12c400, rc 0) 00000100:00100000:2.0:1746129759.436508:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6141239f-0c60-480d-830c-e22ba61457b0+8:1963:x1830949052414848:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 67us (732us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129759.436513:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11471 00000100:00100000:2.0:1746129759.444478:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.444592:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052415104 00000100:00100000:0.0:1746129759.444600:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052415104 00000100:00100000:0.0:1746129759.444646:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10007 00000100:00100000:0.0:1746129759.444653:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+13:28857:x1830949052415104:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129759.444869:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129759.444885:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87200/0x48868a4e4394abcb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3502e5 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.445123:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87000/0x48868a4e4394abd2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129759.445135:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770400/0x48868a4e4394ab54 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350291 expref: 19 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.445141:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87000/0x48868a4e4394abd2 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129759.445168:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770400/0x48868a4e4394ab54 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350291 expref: 19 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.445179:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770400/0x48868a4e4394ab54 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350291 expref: 19 pid: 16808 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746129759.445192:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053389824:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129759.446367:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8e480 going to sleep for 11 seconds 00000100:00100000:2.0:1746129759.447537:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.447713:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052415232 00000100:00100000:0.0:1746129759.447718:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052415232 00000100:00100000:0.0:1746129759.447753:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11472 00000100:00100000:0.0:1746129759.447760:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:28852:x1830949052415232:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129759.447771:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129759.447783:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa86400/0x48868a4e4394abd9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3502ec expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.447803:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394ab1c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350275 expref: 14 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.447809:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c12c600/0x48868a4e4394ab77 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502bb expref: 8 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129759.447815:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69e00/0x48868a4e4394ab23 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35027c expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129759.447820:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129759.447821:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129759.447824:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa86400/0x48868a4e4394abd9 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->3665919] (req 3145728->3665919) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ec expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.447843:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69e00/0x48868a4e4394ab23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35027c expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129759.447872:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69e00/0x48868a4e4394ab23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35027c expref: 11 pid: 3624 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1746129759.447888:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053389952:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129759.447952:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c12c600/0x48868a4e4394ab77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502bb expref: 8 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129759.447960:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c12c600/0x48868a4e4394ab77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502bb expref: 8 pid: 3623 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1746129759.447967:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053390080:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129759.447987:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394ab1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350275 expref: 14 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129759.447994:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394ab1c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350275 expref: 14 pid: 3624 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746129759.448001:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053390208:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129759.448015:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129759.453921:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.453982:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053389952:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129759.453990:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053390080:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129759.454054:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053389824:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129759.454073:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87000/0x48868a4e4394abd2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:1.0:1746129759.454551:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1963:x1830949052414208:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21682us (21875us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129759.454560:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4341 00002000:00100000:1.0:1746129759.454569:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880094eb4a80 x1830949052414208/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/440 e 0 to 0 dl 1746129770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129759.454578:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb4a80 with x1830949052414208 ext(2097152->3145727) 00002000:00010000:1.0:1746129759.454582:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb4a80 00000100:00100000:3.0:1746129759.454733:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052415360 00000100:00100000:3.0:1746129759.454739:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052415360 00010000:00010000:3.0:1746129759.454760:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770400/0x48868a4e4394ab54 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350291 expref: 20 pid: 16808 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746129759.454779:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5544 00000100:00100000:3.0:1746129759.454785:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1963:x1830949052415360:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129759.454795:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129759.454800:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770400/0x48868a4e4394ab54 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350291 expref: 20 pid: 16808 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746129759.454808:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770400/0x48868a4e4394ab54 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350291 expref: 20 pid: 16808 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746129759.454824:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770400/0x48868a4e4394ab54 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350291 expref: 20 pid: 16808 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746129759.454838:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129759.454842:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87000/0x48868a4e4394abd2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129759.454869:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87000/0x48868a4e4394abd2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129759.454875:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87000/0x48868a4e4394abd2 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129759.454895:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129759.454912:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:1963:x1830949052415360:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 128us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129759.454917:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5544 00010000:00010000:2.0:1746129759.455031:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87000/0x48868a4e4394abd2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129759.455037:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87000/0x48868a4e4394abd2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129759.455052:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87000/0x48868a4e4394abd2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129759.455057:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87000/0x48868a4e4394abd2 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129759.455062:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87000/0x48868a4e4394abd2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129759.455068:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa87000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129759.455071:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87000/0x48868a4e4394abd2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129759.455076:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87000/0x48868a4e4394abd2 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129759.455084:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129759.455086:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129759.455088:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87000/0x48868a4e4394abd2 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129759.455093:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87000/0x48868a4e4394abd2 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129759.455137:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87200/0x48868a4e4394abcb lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502e5 expref: 14 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.455144:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87200/0x48868a4e4394abcb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502e5 expref: 14 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.455151:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa87200, rc 0) 00000100:00100000:2.0:1746129759.455168:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6141239f-0c60-480d-830c-e22ba61457b0+13:28857:x1830949052415104:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 10515us (10701us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129759.455174:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10007 00000100:00100000:2.0:1746129759.456251:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.456528:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052415488 00000100:00100000:0.0:1746129759.456534:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052415488 00010000:00010000:0.0:1746129759.456552:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c12c600/0x48868a4e4394ab77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502bb expref: 9 pid: 3623 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1746129759.457110:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1963:x1830949052414080:12345-192.168.204.31@tcp:3:cat.0 Request processed in 24272us (24465us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129759.457119:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4340 00002000:00100000:1.0:1746129759.457129:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880094eb5880 x1830949052414080/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/440 e 0 to 0 dl 1746129770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129759.457138:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb5880 with x1830949052414080 ext(2097152->3145727) 00010000:00010000:1.0:1746129759.457144:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69e00/0x48868a4e4394ab23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35027c expref: 10 pid: 3624 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746129759.457155:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69e00/0x48868a4e4394ab23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35027c expref: 10 pid: 3624 timeout: 805 lvb_type: 1 00002000:00010000:1.0:1746129759.457160:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094eb5880 00000100:00100000:0.0:1746129759.457248:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5545 00000100:00100000:0.0:1746129759.457264:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+9:1962:x1830949052415488:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129759.457274:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129759.457289:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c12c600/0x48868a4e4394ab77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502bb expref: 9 pid: 3623 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746129759.457298:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c12c600/0x48868a4e4394ab77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502bb expref: 9 pid: 3623 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746129759.457313:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c12c600/0x48868a4e4394ab77 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502bb expref: 9 pid: 3623 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746129759.457327:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129759.457344:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052415488:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 89us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129759.457348:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5545 00000100:00100000:2.0:1746129759.464151:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053390208:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129759.464188:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa86400/0x48868a4e4394abd9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->3665919] (req 3145728->3665919) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ec expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.464205:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa86400, rc 0) 00000100:00100000:2.0:1746129759.464274:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:28852:x1830949052415232:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 16513us (16739us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129759.464282:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11472 00000100:00100000:0.0:1746129759.465579:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.465649:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.467719:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129759.467807:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052415616 00000100:00100000:3.0:1746129759.467814:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052415616 00010000:00010000:3.0:1746129759.467842:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69e00/0x48868a4e4394ab23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35027c expref: 10 pid: 3624 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1746129759.468296:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052416000 00000100:00100000:2.0:1746129759.468301:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052416000 00000100:00100000:2.0:1746129759.468337:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3962 00000100:00100000:2.0:1746129759.468346:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6141239f-0c60-480d-830c-e22ba61457b0+13:28857:x1830949052416000:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:2.0:1746129759.468559:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6141239f-0c60-480d-830c-e22ba61457b0+14:28857:x1830949052416000:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 211us (840us total) trans 8589943815 rc 0/0 00000100:00100000:2.0:1746129759.468566:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3962 00000100:00100000:3.0:1746129759.468712:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052415744 00000100:00100000:3.0:1746129759.468718:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052415744 00010000:00010000:3.0:1746129759.468735:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394ab1c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350275 expref: 14 pid: 3624 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746129759.468922:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5546 00000100:00100000:1.0:1746129759.468931:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949052415616:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129759.468940:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129759.468957:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69e00/0x48868a4e4394ab23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35027c expref: 10 pid: 3624 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746129759.468966:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69e00/0x48868a4e4394ab23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35027c expref: 10 pid: 3624 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746129759.468983:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8f69e00/0x48868a4e4394ab23 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35027c expref: 10 pid: 3624 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746129759.469004:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129759.469024:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:1962:x1830949052415616:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 95us (3451us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129759.469030:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5546 00000100:00100000:1.0:1746129759.469044:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5547 00000100:00100000:1.0:1746129759.469049:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1964:x1830949052415744:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129759.469055:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129759.469062:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394ab1c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350275 expref: 14 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746129759.469069:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394ab1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350275 expref: 14 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746129759.469078:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05c00/0x48868a4e4394ab1c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350275 expref: 14 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746129759.469092:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129759.469094:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129759.469101:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa86400/0x48868a4e4394abd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ec expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129759.469109:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa86400/0x48868a4e4394abd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ec expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129759.469139:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa86400/0x48868a4e4394abd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ec expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129759.469152:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053390336:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129759.469211:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b51f5600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129759.470302:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.470378:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052416128 00000100:00100000:2.0:1746129759.470381:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052416128 00000100:00100000:2.0:1746129759.470401:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11473 00000100:00100000:2.0:1746129759.470405:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+9:28856:x1830949052416128:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129759.470414:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129759.470422:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4cef400/0x48868a4e4394abe0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3502f3 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.470440:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa86400/0x48868a4e4394abd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ec expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.470446:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129759.470448:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129759.470450:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4cef400/0x48868a4e4394abe0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502f3 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.470464:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa86400/0x48868a4e4394abd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ec expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.470473:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa86400/0x48868a4e4394abd9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ec expref: 13 pid: 8437 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746129759.470481:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053390464:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129759.471199:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a4b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129759.474878:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053390336:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129759.474897:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129759.474938:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1964:x1830949052415744:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5887us (9289us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129759.474947:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5547 00000100:00100000:2.0:1746129759.475140:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053390464:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129759.475160:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4cef400/0x48868a4e4394abe0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502f3 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.475174:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4cef400, rc 0) 00000100:00100000:2.0:1746129759.475205:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28856:x1830949052416128:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4799us (4905us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129759.475211:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11473 00000100:00100000:0.0:1746129759.481064:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129759.481217:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052416384 00000100:00100000:1.0:1746129759.481228:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052416384 00002000:00100000:1.0:1746129759.481285:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3661824->3665919) req@ffff88008fad0e00 x1830949052416384/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129759.481294:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad0e00 with x1830949052416384 ext(3661824->3665919) 00010000:00010000:1.0:1746129759.481304:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fa86400/0x48868a4e4394abd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ec expref: 13 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746129759.481317:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fa86400/0x48868a4e4394abd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ec expref: 13 pid: 8437 timeout: 805 lvb_type: 0 00002000:00010000:1.0:1746129759.481324:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fad0e00 00000100:00100000:1.0:1746129759.481367:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 672 00000100:00100000:1.0:1746129759.481374:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1963:x1830949052416384:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129759.481552:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1963:x1830949052416384:12345-192.168.204.31@tcp:3:cat.0 Request processed in 175us (495us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129759.481559:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 672 00002000:00100000:1.0:1746129759.481565:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3661824->3665919) req@ffff88008fad0e00 x1830949052416384/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/4536 e 0 to 0 dl 1746129770 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129759.481572:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad0e00 with x1830949052416384 ext(3661824->3665919) 00010000:00010000:1.0:1746129759.481577:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fa86400/0x48868a4e4394abd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ec expref: 13 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746129759.481592:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fa86400/0x48868a4e4394abd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ec expref: 13 pid: 8437 timeout: 805 lvb_type: 0 00002000:00010000:1.0:1746129759.481598:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fad0e00 00000100:00100000:0.0:1746129759.485626:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129759.485995:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052416640 00000100:00100000:1.0:1746129759.486003:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052416640 00002000:00100000:1.0:1746129759.486042:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->3665919) req@ffff88009328aa00 x1830949052416640/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129759.486050:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328aa00 with x1830949052416640 ext(3145728->3665919) 00010000:00010000:1.0:1746129759.486060:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fa86400/0x48868a4e4394abd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ec expref: 13 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746129759.486072:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fa86400/0x48868a4e4394abd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ec expref: 13 pid: 8437 timeout: 805 lvb_type: 0 00002000:00010000:1.0:1746129759.486078:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009328aa00 00000100:00100000:1.0:1746129759.486118:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 673 00000100:00100000:1.0:1746129759.486125:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1964:x1830949052416640:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129759.486209:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.486824:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052416896 00000100:00100000:2.0:1746129759.486829:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052416896 00000100:00100000:2.0:1746129759.486874:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3963 00000100:00100000:2.0:1746129759.486879:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:28852:x1830949052416896:12345-192.168.204.31@tcp:35:multiop.0 00000001:00080000:2.0:1746129759.487132:0:15740:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589943816 00000100:00100000:2.0:1746129759.487217:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:28852:x1830949052416896:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 336us (1009us total) trans 8589943817 rc 0/0 00000100:00100000:2.0:1746129759.487223:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3963 00000020:00080000:2.0:1746129759.487227:0:15740:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1746129759.499605:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949052416640:12345-192.168.204.31@tcp:4:cat.0 Request processed in 13470us (13977us total) trans 21474840407 rc 0/0 00000100:00100000:1.0:1746129759.499618:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 673 00002000:00100000:1.0:1746129759.499626:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->3665919) req@ffff88009328aa00 x1830949052416640/t21474840407(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/448 e 0 to 0 dl 1746129770 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129759.499635:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328aa00 with x1830949052416640 ext(3145728->3665919) 00010000:00010000:1.0:1746129759.499645:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fa86400/0x48868a4e4394abd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ec expref: 15 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746129759.499659:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fa86400/0x48868a4e4394abd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ec expref: 15 pid: 8437 timeout: 805 lvb_type: 0 00002000:00010000:1.0:1746129759.499667:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009328aa00 00000100:00100000:0.0:1746129759.501931:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129759.502029:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052417024 00000100:00100000:1.0:1746129759.502037:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052417024 00010000:00010000:1.0:1746129759.502072:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa86400/0x48868a4e4394abd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ec expref: 15 pid: 8437 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746129759.502352:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5548 00000100:00100000:1.0:1746129759.502363:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949052417024:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129759.502378:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746129759.502394:0:7109:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129759 -> 1746129760 00002000:00010000:1.0:1746129759.502397:0:7109:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129759 -> 1746129760 00010000:00010000:1.0:1746129759.502403:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa86400/0x48868a4e4394abd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ec expref: 15 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746129759.502414:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa86400/0x48868a4e4394abd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ec expref: 15 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746129759.502432:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa86400/0x48868a4e4394abd9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ec expref: 15 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746129759.502730:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129759.502734:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129759.502741:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4cef400/0x48868a4e4394abe0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502f3 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129759.502750:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4cef400/0x48868a4e4394abe0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502f3 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129759.502786:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4cef400/0x48868a4e4394abe0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502f3 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129759.502799:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053390592:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129759.507515:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b51f5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129759.511576:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129759.511716:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053390592:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129759.511737:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129759.511788:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949052417024:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 9425us (9861us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129759.511798:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5548 00000100:00100000:2.0:1746129759.512103:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052417280 00000100:00100000:2.0:1746129759.512111:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052417280 00002000:00100000:2.0:1746129759.512153:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009be66680 x1830949052417280/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.512162:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be66680 with x1830949052417280 ext(2097152->3145727) 00002000:00010000:2.0:1746129759.512167:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009be66680 00000100:00100000:2.0:1746129759.512190:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4344 00000100:00100000:2.0:1746129759.512199:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052417280:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129759.520827:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052417280:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8618us (9249us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129759.520841:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4344 00002000:00100000:2.0:1746129759.520895:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009be66680 x1830949052417280/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/440 e 0 to 0 dl 1746129770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.520905:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be66680 with x1830949052417280 ext(2097152->3145727) 00002000:00010000:2.0:1746129759.520911:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009be66680 00000100:00100000:0.0:1746129759.528826:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.530642:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052417408 00000100:00100000:2.0:1746129759.530652:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052417408 00000100:00100000:2.0:1746129759.532004:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11474 00000100:00100000:2.0:1746129759.532018:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:28856:x1830949052417408:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129759.532038:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129759.532057:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef200/0x48868a4e4394abe7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3502fa expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.532087:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68800/0x48868a4e4394ab2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3960832->4194303] (req 3960832->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350283 expref: 22 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.532095:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129759.532096:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129759.532099:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef200/0x48868a4e4394abe7 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502fa expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.532133:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68800/0x48868a4e4394ab2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3960832->4194303] (req 3960832->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350283 expref: 22 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.532145:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68800/0x48868a4e4394ab2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3960832->4194303] (req 3960832->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350283 expref: 22 pid: 3624 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746129759.532157:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053390720:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129759.532300:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a4b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129759.535766:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.535878:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053390720:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129759.535901:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef200/0x48868a4e4394abe7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502fa expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.535915:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4cef200, rc 0) 00000100:00100000:2.0:1746129759.535962:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28856:x1830949052417408:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3948us (7145us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129759.535969:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11474 00000100:00100000:3.0:1746129759.536042:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052417536 00000100:00100000:3.0:1746129759.536048:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052417536 00002000:00100000:3.0:1746129759.536079:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3960832->4194303) req@ffff880095240380 x1830949052417536/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129759.536087:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095240380 with x1830949052417536 ext(3960832->4194303) 00010000:00010000:3.0:1746129759.536093:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68800/0x48868a4e4394ab2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3960832->4194303] (req 3960832->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350283 expref: 23 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746129759.536108:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68800/0x48868a4e4394ab2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3960832->4194303] (req 3960832->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350283 expref: 23 pid: 3624 timeout: 805 lvb_type: 0 00002000:00010000:3.0:1746129759.536113:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095240380 00000100:00100000:3.0:1746129759.536126:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 674 00000100:00100000:3.0:1746129759.536132:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949052417536:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129759.541953:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949052417536:12345-192.168.204.31@tcp:4:cat.0 Request processed in 5813us (6186us total) trans 17179873279 rc 0/0 00000100:00100000:3.0:1746129759.541963:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 674 00002000:00100000:3.0:1746129759.541972:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3960832->4194303) req@ffff880095240380 x1830949052417536/t17179873279(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/448 e 0 to 0 dl 1746129770 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129759.541980:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095240380 with x1830949052417536 ext(3960832->4194303) 00010000:00010000:3.0:1746129759.541988:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68800/0x48868a4e4394ab2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3960832->4194303] (req 3960832->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350283 expref: 25 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746129759.542000:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68800/0x48868a4e4394ab2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3960832->4194303] (req 3960832->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350283 expref: 25 pid: 3624 timeout: 805 lvb_type: 0 00002000:00010000:3.0:1746129759.542007:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095240380 00000100:00100000:0.0:1746129759.545572:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129759.545699:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052417664 00000100:00100000:1.0:1746129759.545708:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052417664 00010000:00010000:1.0:1746129759.545745:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68800/0x48868a4e4394ab2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3960832->4194303] (req 3960832->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350283 expref: 25 pid: 3624 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746129759.545797:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5549 00000100:00100000:1.0:1746129759.545807:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1963:x1830949052417664:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129759.545822:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746129759.545840:0:7109:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129759 -> 1746129760 00002000:00010000:1.0:1746129759.545843:0:7109:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129758 -> 1746129760 00002000:00010000:1.0:1746129759.545887:0:7109:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129759 -> 1746129760 00010000:00010000:1.0:1746129759.545894:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68800/0x48868a4e4394ab2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3960832->4194303] (req 3960832->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350283 expref: 25 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746129759.545905:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68800/0x48868a4e4394ab2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3960832->4194303] (req 3960832->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350283 expref: 25 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746129759.545927:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68800/0x48868a4e4394ab2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3960832->4194303] (req 3960832->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350283 expref: 25 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746129759.545966:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129759.545969:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129759.545976:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef200/0x48868a4e4394abe7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502fa expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129759.545985:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef200/0x48868a4e4394abe7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502fa expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129759.546020:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef200/0x48868a4e4394abe7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502fa expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129759.546033:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053390848:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129759.546119:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b51f5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129759.550915:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.550956:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.550975:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052417920 00000100:00100000:0.0:1746129759.550982:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052417920 00002000:00100000:0.0:1746129759.551015:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880095243480 x1830949052417920/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129759.551024:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095243480 with x1830949052417920 ext(3145728->4194303) 00002000:00010000:0.0:1746129759.551029:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095243480 00000100:00100000:0.0:1746129759.551042:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052418176 00000100:00100000:0.0:1746129759.551044:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052418176 00002000:00100000:0.0:1746129759.551055:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880095242a00 x1830949052418176/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129759.551061:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095242a00 with x1830949052418176 ext(3145728->4194303) 00002000:00010000:0.0:1746129759.551064:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095242a00 00000100:00100000:0.0:1746129759.551073:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4345 00000100:00100000:0.0:1746129759.551080:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1964:x1830949052417920:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129759.552821:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4346 00000100:00100000:0.0:1746129759.552830:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949052418176:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129759.558211:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053390848:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129759.558236:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129759.558335:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949052417664:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 12527us (12769us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129759.558349:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5549 00000100:00100000:2.0:1746129759.574488:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1964:x1830949052417920:12345-192.168.204.31@tcp:3:cat.0 Request processed in 23400us (23571us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129759.574499:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4345 00002000:00100000:2.0:1746129759.574508:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880095243480 x1830949052417920/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/440 e 0 to 0 dl 1746129770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.574516:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095243480 with x1830949052417920 ext(3145728->4194303) 00002000:00010000:2.0:1746129759.574521:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095243480 00000100:00100000:1.0:1746129759.580425:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1964:x1830949052418176:12345-192.168.204.31@tcp:3:cat.0 Request processed in 27588us (29460us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129759.580435:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4346 00002000:00100000:1.0:1746129759.580445:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880095242a00 x1830949052418176/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/440 e 0 to 0 dl 1746129770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129759.580453:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095242a00 with x1830949052418176 ext(3145728->4194303) 00002000:00010000:1.0:1746129759.580458:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095242a00 00000100:00100000:2.0:1746129759.593512:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.593605:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129759.595359:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052418432 00000100:00100000:1.0:1746129759.595367:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052418432 00002000:00100000:1.0:1746129759.595408:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009468d180 x1830949052418432/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129759.595416:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468d180 with x1830949052418432 ext(4194304->4964351) 00002000:00010000:1.0:1746129759.595421:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468d180 00000100:00100000:3.0:1746129759.596095:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052418560 00000100:00100000:3.0:1746129759.596100:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052418560 00000100:00100000:3.0:1746129759.596132:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11475 00000100:00100000:3.0:1746129759.596139:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:28859:x1830949052418560:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129759.596149:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129759.596166:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8f68800/0x48868a4e4394abee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350301 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.596191:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05800/0x48868a4e4394aac1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350228 expref: 13 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.596199:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7200/0x48868a4e4394ab5b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35029f expref: 7 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129759.596205:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d37800/0x48868a4e4394aad6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35023d expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129759.596211:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129759.596212:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129759.596215:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8f68800/0x48868a4e4394abee lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1990656->2097151] (req 1990656->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350301 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.596243:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d37800/0x48868a4e4394aad6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35023d expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129759.596262:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d37800/0x48868a4e4394aad6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35023d expref: 11 pid: 10930 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1746129759.596273:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053390976:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129759.596455:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4347 00000100:00100000:1.0:1746129759.596464:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1963:x1830949052418432:12345-192.168.204.31@tcp:3:cat.0 00010000:00010000:3.0:1746129759.598075:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7200/0x48868a4e4394ab5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35029f expref: 7 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129759.598087:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7200/0x48868a4e4394ab5b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35029f expref: 7 pid: 8437 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1746129759.598097:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053391104:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129759.598124:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05800/0x48868a4e4394aac1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350228 expref: 13 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.598131:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05800/0x48868a4e4394aac1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350228 expref: 13 pid: 3624 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746129759.598137:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130506300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053391232:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129759.598150:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129759.603687:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053390976:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129759.603698:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053391104:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129759.603705:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130506300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053391232:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129759.603729:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8f68800/0x48868a4e4394abee lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1990656->2097151] (req 1990656->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350301 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.603743:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8f68800, rc 0) 00000100:00100000:3.0:1746129759.603790:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:28859:x1830949052418560:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 7652us (10184us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129759.603797:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11475 00000100:00100000:0.0:1746129759.605216:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129759.606121:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052418816 00000100:00100000:1.0:1746129759.606129:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052418816 00010000:00010000:1.0:1746129759.606158:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d37800/0x48868a4e4394aad6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35023d expref: 11 pid: 10930 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1746129759.606190:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5550 00000100:00100000:1.0:1746129759.606196:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1963:x1830949052418816:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129759.606207:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746129759.606224:0:7109:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2079 -> 2081 00010000:00010000:1.0:1746129759.606229:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d37800/0x48868a4e4394aad6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35023d expref: 11 pid: 10930 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746129759.606238:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d37800/0x48868a4e4394aad6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35023d expref: 11 pid: 10930 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746129759.606266:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d37800/0x48868a4e4394aad6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35023d expref: 11 pid: 10930 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746129759.606288:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129759.607060:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1963:x1830949052418816:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 861us (1845us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129759.607067:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5550 00000100:00100000:0.0:1746129759.607220:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129759.609075:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052418688 00000100:00100000:1.0:1746129759.609086:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052418688 00010000:00010000:1.0:1746129759.609314:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7200/0x48868a4e4394ab5b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35029f expref: 8 pid: 8437 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1746129759.609360:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5551 00000100:00100000:1.0:1746129759.609368:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052418688:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129759.609379:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129759.609399:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7200/0x48868a4e4394ab5b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35029f expref: 8 pid: 8437 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746129759.609409:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7200/0x48868a4e4394ab5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35029f expref: 8 pid: 8437 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746129759.609434:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7200/0x48868a4e4394ab5b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35029f expref: 8 pid: 8437 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746129759.609447:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129759.609527:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6141239f-0c60-480d-830c-e22ba61457b0+7:1962:x1830949052418688:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 160us (2308us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129759.609533:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5551 00000100:00100000:2.0:1746129759.611893:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1963:x1830949052418432:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15422us (18379us total) trans 0 rc 770048/770048 00000100:00100000:2.0:1746129759.611905:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4347 00002000:00100000:2.0:1746129759.611916:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4964351) req@ffff88009468d180 x1830949052418432/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/440 e 0 to 0 dl 1746129770 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.611924:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468d180 with x1830949052418432 ext(4194304->4964351) 00002000:00010000:2.0:1746129759.611929:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468d180 00000100:00100000:3.0:1746129759.612086:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.612144:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052418944 00000100:00100000:2.0:1746129759.612150:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052418944 00010000:00010000:2.0:1746129759.612174:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05800/0x48868a4e4394aac1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350228 expref: 14 pid: 3624 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746129759.612206:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5552 00000100:00100000:2.0:1746129759.612213:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949052418944:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129759.612226:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129759.612433:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05800/0x48868a4e4394aac1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350228 expref: 14 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746129759.612445:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05800/0x48868a4e4394aac1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350228 expref: 14 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746129759.612463:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e05800/0x48868a4e4394aac1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350228 expref: 14 pid: 3624 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746129759.612481:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129759.612483:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129759.612489:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8f68800/0x48868a4e4394abee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350301 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.612497:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8f68800/0x48868a4e4394abee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350301 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.612523:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8f68800/0x48868a4e4394abee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350301 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129759.612533:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053391360:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129759.612593:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a4b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129759.618028:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053391360:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129759.618046:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129759.618088:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1961:x1830949052418944:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5874us (6002us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129759.618097:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5552 00000100:00100000:0.0:1746129759.621692:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.621906:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052419200 00000100:00100000:2.0:1746129759.621913:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052419200 00002000:00100000:2.0:1746129759.621951:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e7:0x0] (1990656->1994751) req@ffff880095243b80 x1830949052419200/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.621961:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095243b80 with x1830949052419200 ext(1990656->1994751) 00002000:00010000:2.0:1746129759.621965:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095243b80 00000100:00100000:2.0:1746129759.621982:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4348 00000100:00100000:2.0:1746129759.621988:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052419200:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129759.622272:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052419200:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 282us (585us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129759.622279:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4348 00002000:00100000:2.0:1746129759.622284:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e7:0x0] (1990656->1994751) req@ffff880095243b80 x1830949052419200/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/4536 e 0 to 0 dl 1746129770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.622290:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095243b80 with x1830949052419200 ext(1990656->1994751) 00002000:00010000:2.0:1746129759.622293:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095243b80 00000100:00100000:0.0:1746129759.624264:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.624822:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052419456 00000100:00100000:2.0:1746129759.624829:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052419456 00000100:00100000:2.0:1746129759.624996:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10008 00000100:00100000:2.0:1746129759.625003:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:28865:x1830949052419456:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129759.625021:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129759.625035:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86000/0x48868a4e4394abf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350308 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.625114:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86800/0x48868a4e4394abfc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129759.625126:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86800/0x48868a4e4394abfc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129759.625135:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86800/0x48868a4e4394abfc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129759.625144:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:2.0:1746129759.625230:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86000/0x48868a4e4394abf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350308 expref: 302 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.625266:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86800/0x48868a4e4394abfc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350308 expref: 301 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129759.625273:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129759.625276:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129759.625279:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa86800, rc 0) 00000100:00100000:2.0:1746129759.625330:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+301:28865:x1830949052419456:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 326us (1079us total) trans 8589943818 rc 0/0 00000100:00100000:2.0:1746129759.625335:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10008 00000100:00100000:0.0:1746129759.627586:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129759.628493:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052419584 00000100:00100000:3.0:1746129759.628502:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052419584 00000100:00100000:3.0:1746129759.628540:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11476 00000100:00100000:3.0:1746129759.628547:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:28859:x1830949052419584:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129759.628561:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129759.628574:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dae6e00/0x48868a4e4394ac0a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35030f expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.628598:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a14c600/0x48868a4e4394aae4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35024b expref: 23 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.628605:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68200/0x48868a4e4394ab69 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ad expref: 7 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129759.628611:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c840c00/0x48868a4e4394ab15 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35026e expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129759.628616:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129759.628617:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129759.628620:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dae6e00/0x48868a4e4394ac0a lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->1875967] (req 1048576->1875967) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35030f expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.628641:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c840c00/0x48868a4e4394ab15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35026e expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129759.628650:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c840c00/0x48868a4e4394ab15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35026e expref: 14 pid: 8437 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1746129759.628659:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053391488:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129759.629237:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68200/0x48868a4e4394ab69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ad expref: 7 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129759.629247:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68200/0x48868a4e4394ab69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ad expref: 7 pid: 3624 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1746129759.629267:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053391616:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129759.629313:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a14c600/0x48868a4e4394aae4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35024b expref: 23 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.629321:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a14c600/0x48868a4e4394aae4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35024b expref: 23 pid: 3623 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746129759.629328:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130506a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053391744:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129759.629344:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129759.631884:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053391488:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129759.631893:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053391616:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129759.632248:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129759.632351:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130506a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053391744:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129759.632379:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dae6e00/0x48868a4e4394ac0a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->1875967] (req 1048576->1875967) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35030f expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.632394:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dae6e00, rc 0) 00000100:00100000:3.0:1746129759.632606:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:28859:x1830949052419584:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3900us (4867us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129759.632615:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11476 00000100:00100000:2.0:1746129759.632875:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052419712 00000100:00100000:2.0:1746129759.632881:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052419712 00010000:00010000:2.0:1746129759.632904:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68200/0x48868a4e4394ab69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ad expref: 8 pid: 3624 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1746129759.633047:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5553 00000100:00100000:2.0:1746129759.633054:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+8:1962:x1830949052419712:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129759.633063:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129759.633081:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68200/0x48868a4e4394ab69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ad expref: 8 pid: 3624 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1746129759.633089:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68200/0x48868a4e4394ab69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ad expref: 8 pid: 3624 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1746129759.633107:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8f68200/0x48868a4e4394ab69 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502ad expref: 8 pid: 3624 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1746129759.633125:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129759.633145:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6141239f-0c60-480d-830c-e22ba61457b0+7:1962:x1830949052419712:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 92us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129759.633150:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5553 00000100:00100000:0.0:1746129759.633555:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129759.633612:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129759.633675:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052419840 00000100:00100000:1.0:1746129759.633680:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052419840 00010000:00010000:1.0:1746129759.633694:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c840c00/0x48868a4e4394ab15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35026e expref: 14 pid: 8437 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1746129759.633710:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052419968 00000100:00100000:1.0:1746129759.633712:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052419968 00010000:00010000:1.0:1746129759.633720:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a14c600/0x48868a4e4394aae4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35024b expref: 24 pid: 3623 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746129759.633734:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5554 00000100:00100000:1.0:1746129759.633738:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052419840:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129759.633745:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129759.633754:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c840c00/0x48868a4e4394ab15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35026e expref: 14 pid: 8437 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746129759.633762:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c840c00/0x48868a4e4394ab15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35026e expref: 14 pid: 8437 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746129759.633778:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c840c00/0x48868a4e4394ab15 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35026e expref: 14 pid: 8437 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746129759.633795:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129759.633816:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949052419840:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 78us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129759.633822:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5554 00000100:00100000:1.0:1746129759.633834:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5555 00000100:00100000:1.0:1746129759.633838:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949052419968:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129759.633844:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129759.633871:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a14c600/0x48868a4e4394aae4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35024b expref: 24 pid: 3623 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746129759.633879:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a14c600/0x48868a4e4394aae4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35024b expref: 24 pid: 3623 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746129759.633893:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a14c600/0x48868a4e4394aae4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35024b expref: 24 pid: 3623 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746129759.633900:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129759.633902:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129759.633907:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dae6e00/0x48868a4e4394ac0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1875967) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35030f expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129759.633914:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dae6e00/0x48868a4e4394ac0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1875967) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35030f expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129759.633938:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dae6e00/0x48868a4e4394ac0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1875967) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35030f expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129759.633948:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053391872:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129759.633990:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b51f5780 going to sleep for 11 seconds 00000100:00100000:1.0:1746129759.640194:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053391872:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129759.640213:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129759.640270:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949052419968:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6429us (6655us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129759.640280:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5555 00000100:00100000:0.0:1746129759.647438:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.647521:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052420224 00000100:00100000:2.0:1746129759.647528:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052420224 00002000:00100000:2.0:1746129759.647562:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3ea:0x0] (1871872->1875967) req@ffff8800934d6680 x1830949052420224/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.647571:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d6680 with x1830949052420224 ext(1871872->1875967) 00002000:00010000:2.0:1746129759.647575:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800934d6680 00000100:00100000:2.0:1746129759.647588:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4349 00000100:00100000:2.0:1746129759.647593:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949052420224:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129759.647734:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1962:x1830949052420224:12345-192.168.204.31@tcp:3:cat.0 Request processed in 139us (302us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129759.647740:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4349 00002000:00100000:2.0:1746129759.647746:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3ea:0x0] (1871872->1875967) req@ffff8800934d6680 x1830949052420224/t0(0) o3->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/4536 e 0 to 0 dl 1746129770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.647752:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d6680 with x1830949052420224 ext(1871872->1875967) 00002000:00010000:2.0:1746129759.647754:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800934d6680 00000100:00100000:0.0:1746129759.649456:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129759.649538:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052420480 00000100:00100000:3.0:1746129759.649544:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052420480 00000100:00100000:3.0:1746129759.649578:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3964 00000100:00100000:3.0:1746129759.649583:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+19:28859:x1830949052420480:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129759.649807:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:28859:x1830949052420480:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 223us (356us total) trans 8589943819 rc 0/0 00000100:00100000:3.0:1746129759.649812:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3964 00000100:00100000:2.0:1746129759.669731:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746129759.669748:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053392000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746129759.669798:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129759.669997:0:4345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053392000 00000100:00100000:0.0:1746129759.670004:0:4345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053392000 00000100:00100000:0.0:1746129759.670045:0:4345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1746129759.670052:0:4345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1830949053392000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746129759.670070:0:4345:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 342163456 pending 3407872 free 3853516800 avail 3839885312 00000100:00100000:0.0:1746129759.670103:0:4345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1830949053392000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129759.670108:0:4345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1746129759.670236:0:3299:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840402 gen 2 00000004:00080000:2.0:1746129759.670241:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936ddc00, transno 21474840331 00000004:00080000:2.0:1746129759.670246:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d4e00, transno 21474840332 00000004:00080000:2.0:1746129759.670248:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936df480, transno 21474840333 00000004:00080000:2.0:1746129759.670259:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936de680, transno 21474840334 00000004:00080000:2.0:1746129759.670261:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936ded80, transno 21474840335 00000004:00080000:2.0:1746129759.670263:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936dca80, transno 21474840336 00000004:00080000:2.0:1746129759.670265:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936dd880, transno 21474840337 00000004:00080000:2.0:1746129759.670266:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d7100, transno 21474840338 00000004:00080000:2.0:1746129759.670269:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013631b100, transno 21474840342 00000004:00080000:2.0:1746129759.670270:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136318380, transno 21474840343 00000004:00080000:2.0:1746129759.670272:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136319180, transno 21474840344 00000004:00080000:2.0:1746129759.670274:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136319c00, transno 21474840345 00000004:00080000:2.0:1746129759.670275:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013631ad80, transno 21474840346 00000004:00080000:2.0:1746129759.670278:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013631bb80, transno 21474840347 00000004:00080000:2.0:1746129759.670279:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136319f80, transno 21474840348 00000004:00080000:2.0:1746129759.670281:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136319500, transno 21474840349 00000004:00080000:2.0:1746129759.670283:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423d880, transno 21474840350 00000004:00080000:2.0:1746129759.670285:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d636680, transno 21474840351 00000004:00080000:2.0:1746129759.670287:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d636300, transno 21474840352 00000004:00080000:2.0:1746129759.670289:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423d180, transno 21474840353 00000004:00080000:2.0:1746129759.670291:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d635c00, transno 21474840354 00000004:00080000:2.0:1746129759.670293:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423d500, transno 21474840355 00000004:00080000:2.0:1746129759.670295:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d634e00, transno 21474840356 00000004:00080000:2.0:1746129759.670297:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423c380, transno 21474840357 00000004:00080000:2.0:1746129759.670298:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d7800, transno 21474840358 00000004:00080000:2.0:1746129759.670300:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936dd180, transno 21474840359 00000004:00080000:2.0:1746129759.670302:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f4df480, transno 21474840360 00000004:00080000:2.0:1746129759.670303:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f4de680, transno 21474840361 00000004:00080000:2.0:1746129759.670305:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f4df800, transno 21474840362 00000004:00080000:2.0:1746129759.670307:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936ddf80, transno 21474840363 00000004:00080000:2.0:1746129759.670309:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f4de300, transno 21474840364 00000004:00080000:2.0:1746129759.670310:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f4df100, transno 21474840365 00000004:00080000:2.0:1746129759.670312:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5490e00, transno 21474840367 00000004:00080000:2.0:1746129759.670314:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5492680, transno 21474840368 00000004:00080000:2.0:1746129759.670315:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5493480, transno 21474840369 00000004:00080000:2.0:1746129759.670317:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5492a00, transno 21474840370 00000004:00080000:2.0:1746129759.670318:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5493800, transno 21474840371 00000004:00080000:2.0:1746129759.670320:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5491c00, transno 21474840372 00000004:00080000:2.0:1746129759.670321:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5492d80, transno 21474840373 00000004:00080000:2.0:1746129759.670323:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423c000, transno 21474840374 00000004:00080000:2.0:1746129759.670325:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c08bb80, transno 21474840375 00000004:00080000:2.0:1746129759.670327:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c089f80, transno 21474840376 00000004:00080000:2.0:1746129759.670328:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c088380, transno 21474840377 00000004:00080000:2.0:1746129759.670330:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c089500, transno 21474840378 00000004:00080000:2.0:1746129759.670332:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c088e00, transno 21474840379 00000004:00080000:2.0:1746129759.670333:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c08a300, transno 21474840380 00000004:00080000:2.0:1746129759.670335:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c089180, transno 21474840381 00000004:00080000:2.0:1746129759.670337:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c089880, transno 21474840382 00000004:00080000:2.0:1746129759.670338:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba38700, transno 21474840387 00000004:00080000:2.0:1746129759.670340:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba3bb80, transno 21474840388 00000004:00080000:2.0:1746129759.670342:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba39500, transno 21474840389 00000004:00080000:2.0:1746129759.670344:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba38a80, transno 21474840390 00000004:00080000:2.0:1746129759.670345:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba39880, transno 21474840391 00000004:00080000:2.0:1746129759.670347:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba38000, transno 21474840392 00000004:00080000:2.0:1746129759.670349:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba39c00, transno 21474840393 00000004:00080000:2.0:1746129759.670351:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba3b480, transno 21474840394 00000004:00080000:2.0:1746129759.670353:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284f480, transno 21474840395 00000004:00080000:2.0:1746129759.670355:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284f100, transno 21474840396 00000004:00080000:2.0:1746129759.670357:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284ca80, transno 21474840397 00000004:00080000:2.0:1746129759.670359:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284c700, transno 21474840398 00000004:00080000:2.0:1746129759.670361:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284c380, transno 21474840399 00000004:00080000:2.0:1746129759.670363:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284d180, transno 21474840400 00000004:00080000:2.0:1746129759.670365:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284fb80, transno 21474840401 00000004:00080000:2.0:1746129759.670367:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284f800, transno 21474840402 00000100:00100000:2.0:1746129759.670375:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053392000:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1746129759.670770:0:14357:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 64 done 00000100:00100000:3.0:1746129759.720408:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053392128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746129759.720461:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129759.720520:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053392128 00000100:00100000:3.0:1746129759.720525:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053392128 00000100:00100000:3.0:1746129759.720553:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1746129759.720560:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1830949053392128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746129759.720579:0:8438:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 384630784 pending 6815744 free 3852468224 avail 3824156672 00000100:00100000:3.0:1746129759.720608:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1830949053392128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129759.720614:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1746129759.720644:0:3299:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873270 gen 2 00000004:00080000:3.0:1746129759.720648:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d4000, transno 17179873183 00000004:00080000:3.0:1746129759.720654:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d5c00, transno 17179873184 00000004:00080000:3.0:1746129759.720656:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d4380, transno 17179873185 00000004:00080000:3.0:1746129759.720658:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d7b80, transno 17179873186 00000004:00080000:3.0:1746129759.720660:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d6a00, transno 17179873187 00000004:00080000:3.0:1746129759.720662:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d4a80, transno 17179873188 00000004:00080000:3.0:1746129759.720664:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d5880, transno 17179873189 00000004:00080000:3.0:1746129759.720665:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d6d80, transno 17179873190 00000004:00080000:3.0:1746129759.720667:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb6d80, transno 17179873191 00000004:00080000:3.0:1746129759.720670:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c1c4000, transno 17179873195 00000004:00080000:3.0:1746129759.720672:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c1c7b80, transno 17179873196 00000004:00080000:3.0:1746129759.720674:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c1c4380, transno 17179873197 00000004:00080000:3.0:1746129759.720675:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c1c4700, transno 17179873198 00000004:00080000:3.0:1746129759.720677:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c1c7480, transno 17179873199 00000004:00080000:3.0:1746129759.720679:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c1c4a80, transno 17179873200 00000004:00080000:3.0:1746129759.720681:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c1c5880, transno 17179873201 00000004:00080000:3.0:1746129759.720683:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c1c5180, transno 17179873202 00000004:00080000:3.0:1746129759.720685:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b025c00, transno 17179873203 00000004:00080000:3.0:1746129759.720688:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131463800, transno 17179873204 00000004:00080000:3.0:1746129759.720690:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131462d80, transno 17179873205 00000004:00080000:3.0:1746129759.720692:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131461500, transno 17179873206 00000004:00080000:3.0:1746129759.720694:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131461c00, transno 17179873207 00000004:00080000:3.0:1746129759.720695:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131463480, transno 17179873208 00000004:00080000:3.0:1746129759.720697:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131461f80, transno 17179873209 00000004:00080000:3.0:1746129759.720700:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131460000, transno 17179873210 00000004:00080000:3.0:1746129759.720701:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131461180, transno 17179873211 00000004:00080000:3.0:1746129759.720703:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130505180, transno 17179873212 00000004:00080000:3.0:1746129759.720705:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a02fd500, transno 17179873213 00000004:00080000:3.0:1746129759.720707:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d8ed80, transno 17179873214 00000004:00080000:3.0:1746129759.720709:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a02ffb80, transno 17179873215 00000004:00080000:3.0:1746129759.720711:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a02fc000, transno 17179873216 00000004:00080000:3.0:1746129759.720713:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d8f480, transno 17179873217 00000004:00080000:3.0:1746129759.720715:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d8df80, transno 17179873218 00000004:00080000:3.0:1746129759.720717:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a02fd180, transno 17179873219 00000004:00080000:3.0:1746129759.720719:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd44380, transno 17179873220 00000004:00080000:3.0:1746129759.720721:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d8ca80, transno 17179873221 00000004:00080000:3.0:1746129759.720723:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c089c00, transno 17179873228 00000004:00080000:3.0:1746129759.720725:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936de300, transno 17179873229 00000004:00080000:3.0:1746129759.720727:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c08b800, transno 17179873230 00000004:00080000:3.0:1746129759.720730:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba1b480, transno 17179873231 00000004:00080000:3.0:1746129759.720731:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c08b100, transno 17179873232 00000004:00080000:3.0:1746129759.720733:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c1c5c00, transno 17179873233 00000004:00080000:3.0:1746129759.720735:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c08ad80, transno 17179873234 00000004:00080000:3.0:1746129759.720737:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c088700, transno 17179873235 00000004:00080000:3.0:1746129759.720739:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c08b480, transno 17179873236 00000004:00080000:3.0:1746129759.720741:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009be65c00, transno 17179873237 00000004:00080000:3.0:1746129759.720743:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c08a680, transno 17179873238 00000004:00080000:3.0:1746129759.720745:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009be64380, transno 17179873239 00000004:00080000:3.0:1746129759.720747:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009be64700, transno 17179873240 00000004:00080000:3.0:1746129759.720748:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009be64e00, transno 17179873241 00000004:00080000:3.0:1746129759.720751:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c088a80, transno 17179873242 00000004:00080000:3.0:1746129759.720753:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009be65180, transno 17179873243 00000004:00080000:3.0:1746129759.720755:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba19c00, transno 17179873244 00000004:00080000:3.0:1746129759.720757:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009be66a00, transno 17179873245 00000004:00080000:3.0:1746129759.720759:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8fd0e00, transno 17179873253 00000004:00080000:3.0:1746129759.720761:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8fd1180, transno 17179873254 00000004:00080000:3.0:1746129759.720762:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8fd1c00, transno 17179873255 00000004:00080000:3.0:1746129759.720764:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8fd2a00, transno 17179873256 00000004:00080000:3.0:1746129759.720766:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8fd0000, transno 17179873257 00000004:00080000:3.0:1746129759.720768:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095241880, transno 17179873258 00000004:00080000:3.0:1746129759.720769:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8fd2300, transno 17179873259 00000004:00080000:3.0:1746129759.720771:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095242300, transno 17179873260 00000004:00080000:3.0:1746129759.720773:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095243800, transno 17179873261 00000004:00080000:3.0:1746129759.720775:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284dc00, transno 17179873262 00000004:00080000:3.0:1746129759.720777:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284e680, transno 17179873263 00000004:00080000:3.0:1746129759.720779:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009468c000, transno 17179873264 00000004:00080000:3.0:1746129759.720781:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284d880, transno 17179873265 00000004:00080000:3.0:1746129759.720783:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284df80, transno 17179873266 00000004:00080000:3.0:1746129759.720785:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8e6680, transno 17179873267 00000004:00080000:3.0:1746129759.720787:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284e300, transno 17179873268 00000004:00080000:3.0:1746129759.720789:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284c000, transno 17179873269 00000004:00080000:3.0:1746129759.720791:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009468e680, transno 17179873270 00000100:00100000:3.0:1746129759.720799:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053392128:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1746129759.721334:0:14359:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 72 done 00000100:00100000:2.0:1746129759.721887:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ea7f7eb-2f74-477e-bfed-16dc08365411:3296:1830949053392256:0@lo:400:kworker.0 00000100:00100000:2.0:1746129759.721919:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129759.721947:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746129759.721952:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3296:1830949053392384:0@lo:400:kworker.0 00000100:00100000:2.0:1746129759.721970:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129759.721993:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053392384 00000100:00100000:2.0:1746129759.721996:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053392384 00000100:00100000:2.0:1746129759.722023:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1746129759.722028:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830949053392384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746129759.722053:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830949053392384:12345-0@lo:400:kworker.0 Request processed in 25us (82us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129759.722058:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1746129759.722079:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3296:1830949053392384:0@lo:400:kworker.0 00000100:00100000:2.0:1746129759.722098:0:14312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053392256 00000100:00100000:2.0:1746129759.722100:0:14312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053392256 00000100:00100000:2.0:1746129759.722115:0:14312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1746129759.722119:0:14312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008edff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ea7f7eb-2f74-477e-bfed-16dc08365411+18:3296:x1830949053392256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746129759.722140:0:14312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008edff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ea7f7eb-2f74-477e-bfed-16dc08365411+18:3296:x1830949053392256:12345-0@lo:400:kworker.0 Request processed in 21us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129759.722145:0:14312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1746129759.722166:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ea7f7eb-2f74-477e-bfed-16dc08365411:3296:1830949053392256:0@lo:400:kworker.0 00000100:00080000:2.0:1746129759.722180:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746129759.722230:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3299:1830949053392640:0@lo:400:kworker.0 00000100:00100000:3.0:1746129759.722259:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129759.722273:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746129759.722277:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3299:1830949053392512:0@lo:400:kworker.0 00000100:00100000:3.0:1746129759.722291:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129759.722497:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053392640 00000100:00100000:2.0:1746129759.722500:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053392640 00000100:00100000:2.0:1746129759.722524:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053392512 00000100:00100000:2.0:1746129759.722526:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053392512 00000100:00100000:2.0:1746129759.722550:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1746129759.722555:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1830949053392640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746129759.722579:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1830949053392640:12345-0@lo:400:kworker.0 Request processed in 25us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129759.722583:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1746129759.722590:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1746129759.722594:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1830949053392512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746129759.722610:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1830949053392512:12345-0@lo:400:kworker.0 Request processed in 16us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129759.722615:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:2.0:1746129759.722628:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746129759.722683:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3299:1830949053392512:0@lo:400:kworker.0 00000100:00100000:3.0:1746129759.722691:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3299:1830949053392640:0@lo:400:kworker.0 00000100:00100000:0.0:1746129759.778501:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129759.778596:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052420608 00000100:00100000:3.0:1746129759.778604:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052420608 00000100:00100000:3.0:1746129759.778638:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11477 00000100:00100000:3.0:1746129759.778646:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:28865:x1830949052420608:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129759.778661:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129759.778675:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dae7600/0x48868a4e4394ac11 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350316 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.778698:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dae6e00/0x48868a4e4394ac0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1875967) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35030f expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.778705:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129759.778707:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129759.778710:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dae7600/0x48868a4e4394ac11 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1507328->2097151] (req 1507328->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350316 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.778738:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dae6e00/0x48868a4e4394ac0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1875967) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35030f expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.778748:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dae6e00/0x48868a4e4394ac0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1875967) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35030f expref: 12 pid: 8437 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746129759.778759:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053392768:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129759.778833:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129759.783051:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053392768:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129759.783079:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dae7600/0x48868a4e4394ac11 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1507328->2097151] (req 1507328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350316 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.783094:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dae7600, rc 0) 00000100:00100000:3.0:1746129759.783130:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:28865:x1830949052420608:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4485us (4640us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129759.783326:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11477 00000100:00100000:0.0:1746129759.786087:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.786179:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052420736 00000100:00100000:2.0:1746129759.786187:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052420736 00002000:00100000:2.0:1746129759.786227:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1875967) req@ffff8800934d5c00 x1830949052420736/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.786236:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d5c00 with x1830949052420736 ext(1048576->1875967) 00010000:00010000:2.0:1746129759.786243:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dae6e00/0x48868a4e4394ac0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1875967) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35030f expref: 13 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746129759.786264:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dae6e00/0x48868a4e4394ac0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1875967) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35030f expref: 13 pid: 8437 timeout: 805 lvb_type: 0 00002000:00010000:2.0:1746129759.786271:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800934d5c00 00000100:00100000:2.0:1746129759.786289:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 675 00000100:00100000:2.0:1746129759.786297:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949052420736:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129759.797096:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1961:x1830949052420736:12345-192.168.204.31@tcp:4:cat.0 Request processed in 10792us (11005us total) trans 17179873280 rc 0/0 00000100:00100000:2.0:1746129759.797106:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 675 00002000:00100000:2.0:1746129759.797116:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1875967) req@ffff8800934d5c00 x1830949052420736/t17179873280(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:500/0 lens 488/448 e 0 to 0 dl 1746129770 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.797124:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d5c00 with x1830949052420736 ext(1048576->1875967) 00010000:00010000:2.0:1746129759.797133:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dae6e00/0x48868a4e4394ac0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1875967) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35030f expref: 15 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746129759.797147:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dae6e00/0x48868a4e4394ac0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1875967) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35030f expref: 15 pid: 8437 timeout: 805 lvb_type: 0 00002000:00010000:2.0:1746129759.797154:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800934d5c00 00000100:00100000:0.0:1746129759.801019:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129759.802717:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052420864 00000100:00100000:1.0:1746129759.802728:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052420864 00010000:00010000:1.0:1746129759.802763:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dae6e00/0x48868a4e4394ac0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1875967) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35030f expref: 15 pid: 8437 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746129759.802804:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5556 00000100:00100000:1.0:1746129759.802811:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+15:1962:x1830949052420864:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129759.802822:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746129759.802837:0:7109:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129759 -> 1746129760 00002000:00010000:1.0:1746129759.802840:0:7109:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129759 -> 1746129760 00010000:00010000:1.0:1746129759.802845:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dae6e00/0x48868a4e4394ac0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1875967) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35030f expref: 15 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746129759.802869:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dae6e00/0x48868a4e4394ac0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1875967) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35030f expref: 15 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746129759.802890:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dae6e00/0x48868a4e4394ac0a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1875967) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35030f expref: 15 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746129759.802917:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129759.802919:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129759.802925:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dae7600/0x48868a4e4394ac11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350316 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129759.802931:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dae7600/0x48868a4e4394ac11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350316 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129759.802960:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dae7600/0x48868a4e4394ac11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350316 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129759.802971:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053392896:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129759.803040:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b51f5780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129759.807413:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129759.807974:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053392896:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129759.807989:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129759.808023:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1962:x1830949052420864:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5212us (7011us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129759.808031:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5556 00000100:00100000:2.0:1746129759.809514:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052421120 00000100:00100000:2.0:1746129759.809523:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052421120 00002000:00100000:2.0:1746129759.809558:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3ea:0x0] (1507328->1511423) req@ffff8800934d7b80 x1830949052421120/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.809566:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d7b80 with x1830949052421120 ext(1507328->1511423) 00002000:00010000:2.0:1746129759.809570:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800934d7b80 00000100:00100000:2.0:1746129759.809602:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4350 00000100:00100000:2.0:1746129759.809609:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052421120:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129759.809745:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052421120:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 136us (2337us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129759.809750:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4350 00002000:00100000:2.0:1746129759.809755:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3ea:0x0] (1507328->1511423) req@ffff8800934d7b80 x1830949052421120/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/4536 e 0 to 0 dl 1746129770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129759.809762:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d7b80 with x1830949052421120 ext(1507328->1511423) 00002000:00010000:2.0:1746129759.809764:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800934d7b80 00000100:00100000:0.0:1746129759.816601:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129759.817270:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052421248 00000100:00100000:3.0:1746129759.817278:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052421248 00000100:00100000:3.0:1746129759.817327:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11478 00000100:00100000:3.0:1746129759.817335:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:28865:x1830949052421248:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129759.817352:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129759.817367:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dae7000/0x48868a4e4394ac18 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35031d expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.817395:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7400/0x48868a4e4394ab62 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350298 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.817401:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef200/0x48868a4e4394abe7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502fa expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.817406:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129759.817408:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129759.817410:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dae7000/0x48868a4e4394ac18 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->2457599] (req 2097152->2457599) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35031d expref: 25 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.817432:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef200/0x48868a4e4394abe7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502fa expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.817442:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef200/0x48868a4e4394abe7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502fa expref: 13 pid: 8437 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746129759.817452:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053393024:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129759.817533:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7400/0x48868a4e4394ab62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350298 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.817541:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7400/0x48868a4e4394ab62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350298 expref: 13 pid: 8437 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746129759.817548:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130507100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053393152:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129759.817570:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129759.820803:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053393024:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129759.820813:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130507100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053393152:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129759.820835:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dae7000/0x48868a4e4394ac18 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->2457599] (req 2097152->2457599) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35031d expref: 25 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129759.820863:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dae7000, rc 0) 00000100:00100000:3.0:1746129759.820911:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:28865:x1830949052421248:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3576us (4315us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129759.820918:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11478 00000100:00100000:0.0:1746129759.824527:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129759.824880:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052421376 00000100:00100000:1.0:1746129759.824888:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052421376 00010000:00010000:1.0:1746129759.824921:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7400/0x48868a4e4394ab62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350298 expref: 14 pid: 8437 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746129759.824964:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5557 00000100:00100000:1.0:1746129759.824970:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1963:x1830949052421376:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129759.824982:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129759.825001:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7400/0x48868a4e4394ab62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350298 expref: 14 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746129759.825009:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7400/0x48868a4e4394ab62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350298 expref: 14 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746129759.825028:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7400/0x48868a4e4394ab62 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350298 expref: 14 pid: 8437 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746129759.825633:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129759.825699:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052421504 00000100:00100000:2.0:1746129759.825703:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052421504 00010000:00010000:2.0:1746129759.825718:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef200/0x48868a4e4394abe7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502fa expref: 14 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746129759.825907:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129759.825947:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+14:1963:x1830949052421376:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 977us (1427us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129759.825953:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5557 00000100:00100000:1.0:1746129759.825968:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5558 00000100:00100000:1.0:1746129759.825974:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1963:x1830949052421504:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129759.825980:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129759.825989:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef200/0x48868a4e4394abe7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502fa expref: 13 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746129759.825997:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef200/0x48868a4e4394abe7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502fa expref: 13 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746129759.826012:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4cef200/0x48868a4e4394abe7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502fa expref: 13 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746129759.826021:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129759.826023:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129759.826028:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dae7000/0x48868a4e4394ac18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2457599) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35031d expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129759.826035:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dae7000/0x48868a4e4394ac18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2457599) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35031d expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129759.826059:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dae7000/0x48868a4e4394ac18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2457599) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35031d expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129759.826069:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053393280:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129759.826121:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b51f5780 going to sleep for 11 seconds 00000100:00100000:1.0:1746129759.834271:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053393280:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129759.834287:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129759.834337:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1963:x1830949052421504:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8363us (8704us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129759.834347:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5558 00000100:00100000:0.0:1746129759.834429:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129759.834736:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052421760 00000100:00100000:1.0:1746129759.834742:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052421760 00002000:00100000:1.0:1746129759.834772:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (2453504->2457599) req@ffff8800934d5880 x1830949052421760/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/0 e 0 to 0 dl 1746129770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129759.834785:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d5880 with x1830949052421760 ext(2453504->2457599) 00002000:00010000:1.0:1746129759.834789:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800934d5880 00000100:00100000:1.0:1746129759.834819:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4351 00000100:00100000:1.0:1746129759.834825:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949052421760:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129759.835298:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949052421760:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 471us (868us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129759.835304:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4351 00002000:00100000:1.0:1746129759.835309:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (2453504->2457599) req@ffff8800934d5880 x1830949052421760/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:500/0 lens 488/4536 e 0 to 0 dl 1746129770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129759.835316:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d5880 with x1830949052421760 ext(2453504->2457599) 00002000:00010000:1.0:1746129759.835319:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800934d5880 00010000:00010000:3.0:1746129760.056843:0:12137:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129760.587411:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129760.587610:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129760.587717:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129760.587750:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129760.587766:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129760.588176:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052422016 00000100:00100000:3.0:1746129760.588184:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052422016 00000100:00100000:3.0:1746129760.588212:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052421888 00000100:00100000:3.0:1746129760.588214:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052421888 00000100:00100000:3.0:1746129760.588222:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052422272 00000100:00100000:3.0:1746129760.588224:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052422272 00000100:00100000:3.0:1746129760.588231:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052422528 00000100:00100000:3.0:1746129760.588243:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052422528 00000100:00100000:3.0:1746129760.588255:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11479 00000100:00100000:3.0:1746129760.588261:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052422016:12345-192.168.204.31@tcp:16:kworker.0 00000100:00100000:3.0:1746129760.588342:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+11:1962:x1830949052422016:12345-192.168.204.31@tcp:16:kworker.0 Request processed in 82us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129760.588348:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11479 00000100:00100000:3.0:1746129760.588362:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11480 00000100:00100000:3.0:1746129760.588366:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949052421888:12345-192.168.204.31@tcp:16:kworker.0 00000100:00100000:3.0:1746129760.588402:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949052421888:12345-192.168.204.31@tcp:16:kworker.0 Request processed in 35us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129760.588407:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11480 00000100:00100000:3.0:1746129760.588514:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11481 00000100:00100000:3.0:1746129760.588519:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949052422272:12345-192.168.204.31@tcp:16:kworker.0 00000100:00100000:3.0:1746129760.588544:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1962:x1830949052422272:12345-192.168.204.31@tcp:16:kworker.0 Request processed in 26us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129760.588548:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11481 00000100:00100000:3.0:1746129760.588557:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11482 00000100:00100000:3.0:1746129760.588560:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1962:x1830949052422528:12345-192.168.204.31@tcp:16:kworker.0 00000100:00100000:1.0:1746129760.589277:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052422144 00000100:00100000:1.0:1746129760.589285:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052422144 00002000:00100000:1.0:1746129760.589306:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e7:0x0] (1990656->2097151) req@ffff8800934d7800 x1830949052422144/t0(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:501/0 lens 488/0 e 0 to 0 dl 1746129771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129760.589314:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d7800 with x1830949052422144 ext(1990656->2097151) 00002000:00010000:1.0:1746129760.589318:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800934d7800 00000100:00100000:1.0:1746129760.589332:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4352 00000100:00100000:1.0:1746129760.589336:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052422144:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129760.589505:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129760.589570:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129760.591534:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052422400 00000100:00100000:2.0:1746129760.591541:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052422400 00000100:00100000:2.0:1746129760.591567:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052422656 00000100:00100000:2.0:1746129760.591568:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052422656 00000100:00100000:2.0:1746129760.591583:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11483 00000100:00100000:2.0:1746129760.591589:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949052422400:12345-192.168.204.31@tcp:16:kworker.0 00000100:00100000:2.0:1746129760.591630:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11484 00000100:00100000:2.0:1746129760.591635:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+12:1961:x1830949052422656:12345-192.168.204.31@tcp:16:kworker.0 00000100:00100000:1.0:1746129760.610920:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb1e141-b927-4935-8f31-e7c2026fce6e+13:1961:x1830949052422144:12345-192.168.204.31@tcp:4:cat.0 Request processed in 21574us (23143us total) trans 21474840408 rc 0/0 00000100:00100000:1.0:1746129760.611452:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4352 00002000:00100000:1.0:1746129760.611462:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e7:0x0] (1990656->2097151) req@ffff8800934d7800 x1830949052422144/t21474840408(0) o4->eeb1e141-b927-4935-8f31-e7c2026fce6e@192.168.204.31@tcp:501/0 lens 488/448 e 0 to 0 dl 1746129771 ref 1 fl Complete:/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129760.611473:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d7800 with x1830949052422144 ext(1990656->2097151) 00002000:00010000:1.0:1746129760.611477:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800934d7800 00000001:00080000:3.0:1746129760.697844:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840407 is committed 00000001:00080000:3.0:1746129760.697882:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840406 is committed 00000100:00100000:3.0:1746129760.697980:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1961:x1830949052422656:12345-192.168.204.31@tcp:16:kworker.0 Request processed in 106339us (108405us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129760.697990:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11484 00000001:00080000:2.0:1746129760.707465:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873280 is committed 00000001:00080000:2.0:1746129760.707482:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873276 is committed 00000001:00080000:2.0:1746129760.707489:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873279 is committed 00000100:00100000:0.0:1746129760.707718:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+7:1961:x1830949052422400:12345-192.168.204.31@tcp:16:kworker.0 Request processed in 116125us (118209us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129760.707727:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11483 00000100:00100000:3.0:1746129760.708062:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+6:1962:x1830949052422528:12345-192.168.204.31@tcp:16:kworker.0 Request processed in 118952us (119762us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129760.708068:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11482 00000100:00100000:0.0:1746129760.722147:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129760.722187:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052422912 00000100:00100000:2.0:1746129760.722194:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052422912 00000100:00100000:2.0:1746129760.722247:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3965 00000100:00100000:2.0:1746129760.722255:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:28888:x1830949052422912:12345-192.168.204.31@tcp:35:umount.0 00000100:00100000:2.0:1746129760.722464:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:28888:x1830949052422912:12345-192.168.204.31@tcp:35:umount.0 Request processed in 209us (323us total) trans 8589943820 rc 0/0 00000100:00100000:2.0:1746129760.722469:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3965 00000100:00100000:0.0:1746129760.729340:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129760.730783:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129760.731203:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052423168 00000100:00100000:3.0:1746129760.731210:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052423168 00000100:00100000:3.0:1746129760.731254:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11485 00000100:00100000:3.0:1746129760.731261:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+6:1960:x1830949052423168:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:3.0:1746129760.731287:0:1877:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x48868a4e43941c44 00000020:00010000:3.0:1746129760.731292:0:1877:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88012b12a000: total 0 00000100:00080000:3.0:1746129760.731296:0:1877:0:(import.c:66:import_set_state_nolock()) ffff88012b12e000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1746129760.731350:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129760.731553:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000001:00000004:3.0:1746129760.731799:0:1877:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179873280 00000100:00100000:3.0:1746129760.732005:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eeb1e141-b927-4935-8f31-e7c2026fce6e+4:1960:x1830949052423168:12345-192.168.204.31@tcp:9:umount.0 Request processed in 743us (2672us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129760.732011:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11485 00000100:00100000:1.0:1746129760.732759:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052423296 00000100:00100000:1.0:1746129760.732764:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052423296 00000100:00100000:1.0:1746129760.732793:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052423552 00000100:00100000:1.0:1746129760.732795:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052423552 00000100:00100000:1.0:1746129760.732806:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052423424 00000100:00100000:1.0:1746129760.732808:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052423424 00000100:00100000:1.0:1746129760.732819:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 585 00000100:00100000:1.0:1746129760.732825:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5278c6ae-40e3-4880-9941-e4a223d3f965+17:1963:x1830949052423296:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129760.732833:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129760.732860:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880093a7ca00/0x48868a4e43941c28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34aef3 expref: 17 pid: 14311 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129760.732871:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129760.732904:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5278c6ae-40e3-4880-9941-e4a223d3f965+16:1963:x1830949052423296:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 78us (2123us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129760.732909:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 585 00000100:00100000:1.0:1746129760.732923:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 586 00000100:00100000:1.0:1746129760.732927:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5278c6ae-40e3-4880-9941-e4a223d3f965+15:1963:x1830949052423552:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129760.732933:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129760.732940:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009fa7aa00/0x48868a4e43941c36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34af24 expref: 15 pid: 14312 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129760.732950:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129760.732964:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5278c6ae-40e3-4880-9941-e4a223d3f965+14:1963:x1830949052423552:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 36us (1614us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129760.732968:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 586 00000100:00100000:1.0:1746129760.732978:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 587 00000100:00100000:1.0:1746129760.732983:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5278c6ae-40e3-4880-9941-e4a223d3f965+13:1964:x1830949052423424:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129760.732988:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129760.732994:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009fa01e00/0x48868a4e43941c2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34af1d expref: 13 pid: 14311 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129760.733000:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129760.733010:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5278c6ae-40e3-4880-9941-e4a223d3f965+12:1964:x1830949052423424:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 28us (1458us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129760.733014:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 587 00000020:00010000:1.0:1746129760.733025:0:20054:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88012b12a000: total 0 00010000:00010000:1.0:1746129760.733048:0:20054:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88012b12a000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1746129760.733080:0:20054:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6371600/0x48868a4e4394a74f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fff1 expref: 3 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129760.733089:0:20054:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88012b12a000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1746129760.733097:0:20054:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746129760.733099:0:20054:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746129760.733101:0:20054:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129760.745752:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129760.745832:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052424064 00000100:00100000:2.0:1746129760.745839:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052424064 00000100:00100000:2.0:1746129760.745909:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11486 00000100:00100000:2.0:1746129760.745917:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+10:1960:x1830949052424064:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:2.0:1746129760.745943:0:3624:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x48868a4e43941c4b 00000020:00010000:2.0:1746129760.745948:0:3624:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800b20ff800: total 0 00000100:00080000:2.0:1746129760.745952:0:3624:0:(import.c:66:import_set_state_nolock()) ffff8800b20fb000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746129760.745981:0:3624:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474840408 00000100:00100000:2.0:1746129760.746145:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eeb1e141-b927-4935-8f31-e7c2026fce6e+8:1960:x1830949052424064:12345-192.168.204.31@tcp:9:umount.0 Request processed in 228us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129760.746150:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11486 00000020:00010000:0.0:1746129760.746199:0:7110:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800b20ff800: total 0 00010000:00010000:0.0:1746129760.746221:0:7110:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800b20ff800, canceled 0 locks, left on hash table 3. 00010000:00010000:0.0:1746129760.746267:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e4394a756 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34fff8 expref: 7 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129760.746289:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4cef400/0x48868a4e4394abe0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502f3 expref: 6 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129760.746303:0:7110:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129759 -> 1746129760 00002000:00010000:0.0:1746129760.746306:0:7110:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129759 -> 1746129760 00010000:00010000:0.0:1746129760.746311:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8f68800/0x48868a4e4394abee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350301 expref: 5 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129760.746322:0:7110:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800b20ff800, canceled 3 locks, left on hash table 0. 00010000:00010000:0.0:1746129760.746330:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746129760.746331:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746129760.746334:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129760.752433:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129760.754815:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052424448 00000100:00100000:2.0:1746129760.754825:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052424448 00000100:00100000:2.0:1746129760.754894:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10009 00000100:00100000:2.0:1746129760.754902:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+21:1960:x1830949052424448:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:2.0:1746129760.754932:0:14314:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x48868a4e43941c3d 00000020:00010000:2.0:1746129760.754944:0:14314:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88008ec8f800: total 0 00000100:00080000:2.0:1746129760.754947:0:14314:0:(import.c:66:import_set_state_nolock()) ffff88008ec88000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746129760.754973:0:14314:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589943820 00000100:00100000:2.0:1746129760.755246:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb1e141-b927-4935-8f31-e7c2026fce6e+20:1960:x1830949052424448:12345-192.168.204.31@tcp:39:umount.0 Request processed in 344us (2819us total) trans 8589943821 rc 0/0 00000100:00100000:2.0:1746129760.755252:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10009 00000020:00010000:3.0:1746129760.755360:0:7111:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88008ec8f800: total 0 00010000:00010000:3.0:1746129760.755364:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746129760.755392:0:7111:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88008ec8f800, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1746129760.755415:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129760.755418:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129760.755423:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e054e00/0x48868a4e43943549 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34bd2b expref: 19 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129760.755440:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129760.755442:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746129760.755445:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800924f4400/0x48868a4e43941d1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34afcc expref: 18 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129760.755455:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129760.755457:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129760.755460:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c841400/0x48868a4e4394a78e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350029 expref: 17 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129760.755471:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129760.755473:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129760.755475:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6371400/0x48868a4e4394a95c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35015d expref: 16 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129760.755482:0:7111:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88008ec8f800, canceled 4 locks, left on hash table 0. 00010000:00010000:3.0:1746129760.755492:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746129760.755493:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746129760.755495:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746129761.057046:0:12137:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129761.265649:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129761.267089:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129761.267123:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129761.267195:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129761.267368:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052424576 00000100:00100000:3.0:1746129761.267376:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052424576 00000100:00100000:2.0:1746129761.267409:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052424704 00000100:00100000:2.0:1746129761.267413:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052424704 00000100:00100000:3.0:1746129761.267419:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052424832 00000100:00100000:3.0:1746129761.267421:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052424832 00000100:00100000:2.0:1746129761.267438:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 588 00000100:00100000:2.0:1746129761.267444:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5278c6ae-40e3-4880-9941-e4a223d3f965+14:1961:x1830949052424576:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129761.267459:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129761.267474:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800929d1800/0x48868a4e43941c52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34af4e expref: 14 pid: 14312 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129761.267719:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 589 00000100:00100000:3.0:1746129761.267725:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5278c6ae-40e3-4880-9941-e4a223d3f965+14:1964:x1830949052424704:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129761.267734:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129761.267742:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800929d0a00/0x48868a4e43941c59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34af78 expref: 14 pid: 14312 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.267759:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129761.267762:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 590 00000100:00100000:1.0:1746129761.267769:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5278c6ae-40e3-4880-9941-e4a223d3f965+13:1964:x1830949052424832:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129761.267777:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129761.267784:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800929d1c00/0x48868a4e43941c60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34af7f expref: 13 pid: 14311 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129761.267793:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5278c6ae-40e3-4880-9941-e4a223d3f965+12:1964:x1830949052424704:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 68us (707us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129761.267794:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129761.267798:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 589 00000100:00100000:1.0:1746129761.267807:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5278c6ae-40e3-4880-9941-e4a223d3f965+11:1964:x1830949052424832:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 39us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129761.267811:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 590 00010000:00010000:2.0:1746129761.268014:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129761.268040:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5278c6ae-40e3-4880-9941-e4a223d3f965+9:1961:x1830949052424576:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 595us (2397us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129761.268045:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 588 00000100:00100000:3.0:1746129761.268099:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052425216 00000100:00100000:3.0:1746129761.268103:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052425216 00000100:00100000:3.0:1746129761.268137:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11487 00000100:00100000:3.0:1746129761.268142:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+7:1960:x1830949052425216:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:3.0:1746129761.268163:0:1877:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x48868a4e43941c75 00000100:00080000:2.0:1746129761.268763:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:3.0:1746129761.268888:0:1877:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88008ec8c000: total 0 00000100:00080000:3.0:1746129761.268892:0:1877:0:(import.c:66:import_set_state_nolock()) ffff88008ec8e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746129761.268928:0:1877:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179873280 00000100:00100000:3.0:1746129761.269063:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+5:1960:x1830949052425216:12345-192.168.204.31@tcp:9:umount.0 Request processed in 919us (1867us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129761.269068:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11487 00000020:00010000:1.0:1746129761.269159:0:20054:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88008ec8c000: total 0 00010000:00010000:1.0:1746129761.269183:0:20054:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88008ec8c000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1746129761.269215:0:20054:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801305a7400/0x48868a4e43941ec8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34b0ac expref: 4 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.269251:0:20054:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f897200/0x48868a4e4394a821 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350084 expref: 3 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129761.269259:0:20054:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88008ec8c000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1746129761.269268:0:20054:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746129761.269270:0:20054:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746129761.269272:0:20054:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129761.274308:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129761.274388:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052425600 00000100:00100000:3.0:1746129761.274394:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052425600 00000100:00080000:2.0:1746129761.275043:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746129761.275801:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11488 00000100:00100000:3.0:1746129761.275811:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+7:1960:x1830949052425600:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:3.0:1746129761.275836:0:1877:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x48868a4e43941c6e 00000020:00010000:3.0:1746129761.275842:0:1877:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88008ec8a000: total 0 00000100:00080000:3.0:1746129761.275865:0:1877:0:(import.c:66:import_set_state_nolock()) ffff88008ec89000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746129761.275901:0:1877:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474840408 00000100:00100000:3.0:1746129761.276041:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6141239f-0c60-480d-830c-e22ba61457b0+5:1960:x1830949052425600:12345-192.168.204.31@tcp:9:umount.0 Request processed in 233us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129761.276047:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11488 00000020:00010000:0.0:1746129761.276121:0:7110:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88008ec8a000: total 0 00010000:00010000:0.0:1746129761.276143:0:7110:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88008ec8a000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1746129761.276185:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800924f5a00/0x48868a4e43941ec1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34b0a5 expref: 4 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129761.276237:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f897e00/0x48868a4e4394a805 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35008b expref: 3 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129761.276245:0:7110:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88008ec8a000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1746129761.276254:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746129761.276255:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746129761.276257:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129761.282372:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129761.282434:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052425984 00000100:00100000:1.0:1746129761.282988:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052425984 00000100:00100000:1.0:1746129761.283164:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10010 00000100:00100000:1.0:1746129761.283172:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+14:1960:x1830949052425984:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:1.0:1746129761.283198:0:14315:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x48868a4e43941c67 00000020:00010000:1.0:1746129761.283204:0:14315:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800b20f8000: total 0 00000100:00080000:1.0:1746129761.283207:0:14315:0:(import.c:66:import_set_state_nolock()) ffff8800b20f8800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746129761.283229:0:14315:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589943821 00000020:00010000:3.0:1746129761.283476:0:7111:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800b20f8000: total 0 00010000:00010000:3.0:1746129761.283507:0:7111:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800b20f8000, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1746129761.283531:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129761.283534:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129761.283539:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb6c00/0x48868a4e4394abaf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502d0 expref: 13 pid: 1851 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1746129761.283682:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746129761.284764:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6141239f-0c60-480d-830c-e22ba61457b0+12:1960:x1830949052425984:12345-192.168.204.31@tcp:39:umount.0 Request processed in 1591us (2398us total) trans 8589943822 rc 0/0 00000100:00100000:1.0:1746129761.284770:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10010 00010000:00010000:3.0:1746129761.285258:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e2d8800) 00010000:00010000:3.0:1746129761.285262:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746129761.285267:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6400/0x48868a4e43941c83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34afa9 expref: 11 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.285280:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129761.285282:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129761.285284:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f68600/0x48868a4e4394ab93 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502c9 expref: 10 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.285292:0:7111:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800b20f8000, canceled 3 locks, left on hash table 0. 00010000:00010000:3.0:1746129761.285308:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746129761.285309:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746129761.285311:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129761.326372:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129761.327004:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129761.327071:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052426112 00000100:00100000:2.0:1746129761.327079:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052426112 00000100:00080000:2.0:1746129761.327102:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746129761.327128:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052426240 00000100:00100000:2.0:1746129761.327131:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052426240 00000100:00080000:2.0:1746129761.327140:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746129761.327157:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11489 00000100:00100000:2.0:1746129761.327164:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+11:1962:x1830949052426112:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129761.327178:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129761.327193:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2c00/0x48868a4e4394ac1f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350324 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129761.327207:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129761.327597:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052426368 00000100:00100000:3.0:1746129761.327601:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052426368 00000100:00100000:3.0:1746129761.327620:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11490 00000100:00100000:3.0:1746129761.327626:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052426240:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:1.0:1746129761.327626:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11491 00010000:00010000:3.0:1746129761.327634:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129761.327634:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+12:1962:x1830949052426368:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129761.327641:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129761.327644:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e4394ac26 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35032b expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.327650:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5283000/0x48868a4e4394ac2d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350332 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.327669:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e4394ac26 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35032b expref: 22 pid: 3623 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746129761.327669:0:7976:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e8:0x0] initial LVB size: 4194304, mtime: 0x6813d360, atime: 0x6813d35f, ctime: 0x6813d360, blocks: 0x1029 00010000:00010000:3.0:1746129761.327677:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e4394ac26 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35032b expref: 22 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129761.327679:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.327681:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.327688:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5283000/0x48868a4e4394ac2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350332 expref: 13 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129761.327690:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ea1000, rc 0) 00010000:00010000:1.0:1746129761.327700:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5283000/0x48868a4e4394ac2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350332 expref: 13 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129761.327708:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5283000, rc 0) 00002000:00010000:2.0:1746129761.327756:0:10930:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e7:0x0] initial LVB size: 2097152, mtime: 0x6813d360, atime: 0x6813d35f, ctime: 0x6813d360, blocks: 0x821 00010000:00010000:2.0:1746129761.327766:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129761.327768:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129761.327775:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2c00/0x48868a4e4394ac1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350324 expref: 14 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129761.327785:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2c00/0x48868a4e4394ac1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350324 expref: 14 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129761.327791:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c2c00, rc 0) 00000100:00100000:3.0:1746129761.327974:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949052426240:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 347us (969us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129761.327975:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1962:x1830949052426368:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 341us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129761.327979:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11490 00000100:00100000:1.0:1746129761.327983:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11491 00000100:00100000:2.0:1746129761.328051:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949052426112:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 886us (1685us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129761.328056:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11489 00000100:00100000:0.0:1746129761.331921:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129761.332015:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052426496 00000100:00100000:2.0:1746129761.332022:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052426496 00000100:00100000:2.0:1746129761.332061:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11492 00000100:00100000:2.0:1746129761.332068:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052426496:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129761.332137:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129761.332153:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3000/0x48868a4e4394ac34 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350339 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.332180:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3000/0x48868a4e4394ac34 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350339 expref: 22 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129761.332189:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3000/0x48868a4e4394ac34 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350339 expref: 22 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129761.332210:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c3000, rc 0) 00000100:00100000:2.0:1746129761.332269:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052426496:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 200us (355us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129761.332275:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11492 00000100:00100000:0.0:1746129761.335943:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129761.336767:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052426752 00000100:00100000:2.0:1746129761.336775:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052426752 00000100:00100000:2.0:1746129761.336832:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3966 00000100:00100000:2.0:1746129761.336840:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+301:28910:x1830949052426752:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:2.0:1746129761.337041:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+302:28910:x1830949052426752:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 200us (1104us total) trans 8589943823 rc 0/0 00000100:00100000:2.0:1746129761.337047:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3966 00000100:00080000:0.0:1746129761.337079:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129761.339353:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129761.339601:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052427008 00000100:00100000:1.0:1746129761.339609:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052427008 00000100:00100000:1.0:1746129761.339651:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10011 00000100:00100000:1.0:1746129761.339658:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+302:28910:x1830949052427008:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129761.339678:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129761.339681:0:14315:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1746129761.339702:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86800/0x48868a4e4394abfc lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350308 expref: 302 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.339734:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e04a00/0x48868a4e4394a8c2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3500ed expref: 301 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.339743:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129761.339747:0:14315:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129761.339756:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282200/0x48868a4e4394ac3b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350340 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.339824:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283200/0x48868a4e4394ac42 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129761.339833:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283200/0x48868a4e4394ac42 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129761.339841:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283200/0x48868a4e4394ac42 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:1.0:1746129761.339869:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00010000:00010000:1.0:1746129761.339969:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282200/0x48868a4e4394ac3b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350340 expref: 303 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.339981:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283200/0x48868a4e4394ac42 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350340 expref: 302 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.339987:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129761.339989:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746129761.339991:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5283200, rc 0) 00000100:00100000:1.0:1746129761.340027:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+302:28910:x1830949052427008:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 368us (678us total) trans 8589943824 rc 0/0 00000100:00100000:1.0:1746129761.340032:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10011 00000100:00100000:0.0:1746129761.342753:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129761.342789:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129761.342817:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129761.342844:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129761.342869:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052427392 00000100:00100000:1.0:1746129761.342869:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052427136 00000100:00100000:0.0:1746129761.342873:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129761.342876:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052427392 00000100:00100000:1.0:1746129761.342876:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052427136 00000100:00100000:3.0:1746129761.342883:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052427648 00000100:00100000:0.0:1746129761.342885:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052427264 00000100:00100000:3.0:1746129761.342887:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052427648 00000100:00100000:0.0:1746129761.342887:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052427264 00000100:00100000:1.0:1746129761.342901:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052427520 00000100:00100000:1.0:1746129761.342903:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052427520 00000100:00100000:2.0:1746129761.342911:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11493 00000100:00100000:0.0:1746129761.342916:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11494 00000100:00100000:2.0:1746129761.342919:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949052427136:12345-192.168.204.31@tcp:1:lfs.0 00000100:00100000:3.0:1746129761.342921:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11495 00000100:00100000:0.0:1746129761.342922:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949052427392:12345-192.168.204.31@tcp:1:lfs.0 00000100:00100000:3.0:1746129761.342927:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949052427264:12345-192.168.204.31@tcp:1:lfs.0 00000100:00100000:1.0:1746129761.342927:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11496 00000100:00100000:1.0:1746129761.342932:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949052427648:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:3.0:1746129761.342948:0:3624:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094ea0200/0x48868a4e4394ac65 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.342948:0:10930:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e4394ac50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.342948:0:7976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5282600/0x48868a4e4394ac5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129761.342948:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb4800/0x48868a4e4394ac57 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.342960:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131819400/0x48868a4e4394a6ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffab expref: 14 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129761.342961:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6371200/0x48868a4e4394a6a7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffa4 expref: 23 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129761.342961:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2c00/0x48868a4e4394ac1f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350324 expref: 14 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129761.342965:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129761.342966:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129761.342967:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129761.342967:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129761.342968:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094ea0200/0x48868a4e4394ac65 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129761.342968:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129761.342969:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129761.342970:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb4800/0x48868a4e4394ac57 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.342971:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e4394ac50 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.342986:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131819400/0x48868a4e4394a6ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffab expref: 14 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129761.342987:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6371200/0x48868a4e4394a6a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffa4 expref: 23 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129761.342988:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2c00/0x48868a4e4394ac1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350324 expref: 14 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129761.342994:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131819400/0x48868a4e4394a6ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffab expref: 14 pid: 20441 timeout: 807 lvb_type: 1 00010000:00010000:2.0:1746129761.342995:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6371200/0x48868a4e4394a6a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffa4 expref: 23 pid: 8435 timeout: 807 lvb_type: 1 00010000:00010000:0.0:1746129761.342996:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2c00/0x48868a4e4394ac1f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350324 expref: 14 pid: 10930 timeout: 807 lvb_type: 1 00000100:00100000:3.0:1746129761.343005:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130507100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053393408:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129761.343005:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053393536:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129761.343005:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053393664:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129761.343057:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11497 00000100:00100000:3.0:1746129761.343063:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949052427520:12345-192.168.204.31@tcp:1:lfs.0 00000100:00100000:0.0:1746129761.343076:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942000 going to sleep for 11 seconds 00010000:00010000:3.0:1746129761.343078:0:8435:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094ea0000/0x48868a4e4394ac6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129761.343084:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8540 going to sleep for 11 seconds 00010000:00010000:3.0:1746129761.343087:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dae7600/0x48868a4e4394ac11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350316 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129761.343091:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1240 going to sleep for 11 seconds 00010000:00010000:3.0:1746129761.343093:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129761.343094:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129761.343096:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094ea0000/0x48868a4e4394ac6c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.343109:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dae7600/0x48868a4e4394ac11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350316 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129761.343112:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129761.343114:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dae7600/0x48868a4e4394ac11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350316 expref: 23 pid: 8437 timeout: 807 lvb_type: 0 00000100:00100000:3.0:1746129761.343119:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053393792:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129761.343135:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129761.343150:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052427776 00000100:00100000:2.0:1746129761.343154:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052427776 00000100:00100000:2.0:1746129761.343180:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11498 00000100:00100000:2.0:1746129761.343185:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949052427776:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:2.0:1746129761.343199:0:1877:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fa87c00/0x48868a4e4394ac73 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.343208:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5283000/0x48868a4e4394ac2d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350332 expref: 15 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129761.343213:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129761.343214:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129761.343217:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa87c00/0x48868a4e4394ac73 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.343244:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5283000/0x48868a4e4394ac2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350332 expref: 15 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129761.343252:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5283000/0x48868a4e4394ac2d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350332 expref: 15 pid: 7976 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746129761.343255:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dae7000/0x48868a4e4394ac18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2457599) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35031d expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129761.343259:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053393920:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129761.343262:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7000/0x48868a4e4394ab8c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502c2 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.343268:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746129761.343269:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746129761.343271:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5282600/0x48868a4e4394ac5e lrc: 5/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129761.343289:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8300 going to sleep for 11 seconds 00010000:00010000:1.0:1746129761.343351:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7000/0x48868a4e4394ab8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502c2 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.343359:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7000/0x48868a4e4394ab8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502c2 expref: 23 pid: 8437 timeout: 807 lvb_type: 0 00000100:00100000:1.0:1746129761.343367:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053394048:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129761.343398:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dae7000/0x48868a4e4394ac18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2457599) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35031d expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.343410:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dae7000/0x48868a4e4394ac18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2457599) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35031d expref: 23 pid: 8437 timeout: 807 lvb_type: 0 00000100:00100000:1.0:1746129761.343418:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053394176:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129761.343440:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8c4d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129761.348083:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053393536:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129761.348106:0:10930:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e4394ac50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129761.348205:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129761.348230:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052428032 00000100:00100000:0.0:1746129761.348235:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052428032 00002000:00100000:0.0:1746129761.348267:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3ea:0x0] (1507328->2097151) req@ffff88009284df80 x1830949052428032/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:502/0 lens 488/0 e 0 to 0 dl 1746129772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129761.348276:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284df80 with x1830949052428032 ext(1507328->2097151) 00010000:00010000:0.0:1746129761.348282:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dae7600/0x48868a4e4394ac11 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350316 expref: 24 pid: 8437 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746129761.348290:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dae7600/0x48868a4e4394ac11 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350316 expref: 24 pid: 8437 timeout: 807 lvb_type: 0 00002000:00010000:0.0:1746129761.348296:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009284df80 00000100:00100000:0.0:1746129761.348310:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 676 00000100:00100000:0.0:1746129761.348315:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949052428032:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:0.0:1746129761.348752:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129761.348828:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129761.348870:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129761.348937:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052428288 00000100:00100000:1.0:1746129761.348940:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052428288 00002000:00100000:1.0:1746129761.348956:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->2457599) req@ffff88009284c000 x1830949052428288/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:502/0 lens 488/0 e 0 to 0 dl 1746129772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129761.348964:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284c000 with x1830949052428288 ext(2097152->2457599) 00010000:00010000:1.0:1746129761.348969:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dae7000/0x48868a4e4394ac18 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35031d expref: 26 pid: 8437 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746129761.348976:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dae7000/0x48868a4e4394ac18 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35031d expref: 26 pid: 8437 timeout: 807 lvb_type: 0 00002000:00010000:1.0:1746129761.348982:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009284c000 00000100:00100000:1.0:1746129761.348993:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 677 00000100:00100000:1.0:1746129761.348998:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1964:x1830949052428288:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:1.0:1746129761.349255:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053393664:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129761.349266:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb4800/0x48868a4e4394ac57 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129761.349282:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053394048:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129761.349287:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053394176:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129761.349296:0:7976:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5282600/0x48868a4e4394ac5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129761.349319:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052428160 00000100:00100000:1.0:1746129761.349321:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052428160 00010000:00010000:1.0:1746129761.349332:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7000/0x48868a4e4394ab8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502c2 expref: 28 pid: 8437 timeout: 807 lvb_type: 0 00000100:00100000:1.0:1746129761.349344:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052428416 00000100:00100000:1.0:1746129761.349346:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052428416 00010000:00010000:1.0:1746129761.349352:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5283000/0x48868a4e4394ac2d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350332 expref: 16 pid: 7976 timeout: 807 lvb_type: 1 00000100:00100000:1.0:1746129761.349361:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5559 00000100:00100000:1.0:1746129761.349364:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1964:x1830949052428160:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129761.349372:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129761.349382:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7000/0x48868a4e4394ab8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502c2 expref: 28 pid: 8437 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746129761.349389:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7000/0x48868a4e4394ab8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502c2 expref: 28 pid: 8437 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746129761.349409:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7000/0x48868a4e4394ab8c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4960256->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3502c2 expref: 28 pid: 8437 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746129761.349424:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129761.349443:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949052428160:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 77us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129761.349448:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5559 00000100:00100000:1.0:1746129761.349478:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5560 00000100:00100000:1.0:1746129761.349483:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1963:x1830949052428416:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129761.349489:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129761.349501:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5283000/0x48868a4e4394ac2d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350332 expref: 16 pid: 7976 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746129761.349508:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5283000/0x48868a4e4394ac2d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350332 expref: 16 pid: 7976 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746129761.349519:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.349520:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.349524:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa87c00/0x48868a4e4394ac73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.349531:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa87c00/0x48868a4e4394ac73 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.349543:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129761.349558:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1963:x1830949052428416:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 75us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129761.349564:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5560 00000100:00100000:1.0:1746129761.349624:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053393792:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129761.349633:0:8435:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094ea0000/0x48868a4e4394ac6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.349806:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5283000/0x48868a4e4394ac2d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350332 expref: 15 pid: 7976 timeout: 807 lvb_type: 1 00000100:00100000:2.0:1746129761.349818:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053393920:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129761.349829:0:1877:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fa87c00/0x48868a4e4394ac73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.349835:0:1877:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fa87c00/0x48868a4e4394ac73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.349840:0:1877:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa87c00/0x48868a4e4394ac73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.349872:0:1877:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fa87c00/0x48868a4e4394ac73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.349878:0:1877:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa87c00/0x48868a4e4394ac73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.349884:0:1877:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fa87c00/0x48868a4e4394ac73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.349890:0:1877:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa87c00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129761.349893:0:1877:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fa87c00/0x48868a4e4394ac73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.349899:0:1877:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fa87c00/0x48868a4e4394ac73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.349908:0:1877:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fa87c00/0x48868a4e4394ac73 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.349912:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa87c00/0x48868a4e4394ac73 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129761.349949:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949052427776:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 6763us (6836us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129761.349955:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11498 00000100:00100000:3.0:1746129761.350321:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130507100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053393408:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129761.350332:0:3624:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094ea0200/0x48868a4e4394ac65 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129761.350492:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129761.350515:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129761.350538:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129761.350549:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052427904 00000100:00100000:0.0:1746129761.350553:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052427904 00010000:00010000:0.0:1746129761.350564:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2c00/0x48868a4e4394ac1f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350324 expref: 15 pid: 10930 timeout: 807 lvb_type: 1 00000100:00100000:0.0:1746129761.350574:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052428544 00000100:00100000:0.0:1746129761.350576:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052428544 00010000:00010000:0.0:1746129761.350583:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6371200/0x48868a4e4394a6a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffa4 expref: 27 pid: 8435 timeout: 807 lvb_type: 1 00000100:00100000:0.0:1746129761.351657:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052428672 00000100:00100000:0.0:1746129761.351661:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052428672 00010000:00010000:0.0:1746129761.351674:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131819400/0x48868a4e4394a6ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffab expref: 15 pid: 20441 timeout: 807 lvb_type: 1 00000100:00100000:1.0:1746129761.351780:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5561 00000100:00100000:1.0:1746129761.351787:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949052427904:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129761.351795:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129761.351807:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2c00/0x48868a4e4394ac1f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350324 expref: 15 pid: 10930 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746129761.351815:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2c00/0x48868a4e4394ac1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350324 expref: 15 pid: 10930 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746129761.351826:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2c00/0x48868a4e4394ac1f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350324 expref: 15 pid: 10930 timeout: 807 lvb_type: 1 00000100:00100000:3.0:1746129761.352166:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5562 00000100:00100000:3.0:1746129761.352172:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949052428544:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129761.352179:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129761.352190:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6371200/0x48868a4e4394a6a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffa4 expref: 27 pid: 8435 timeout: 807 lvb_type: 1 00010000:00010000:3.0:1746129761.352197:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6371200/0x48868a4e4394a6a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffa4 expref: 27 pid: 8435 timeout: 807 lvb_type: 1 00010000:00010000:3.0:1746129761.352207:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6371200/0x48868a4e4394a6a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffa4 expref: 27 pid: 8435 timeout: 807 lvb_type: 1 00000100:00100000:0.0:1746129761.352280:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5563 00000100:00100000:0.0:1746129761.352285:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949052428672:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129761.352296:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129761.352306:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131819400/0x48868a4e4394a6ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffab expref: 15 pid: 20441 timeout: 807 lvb_type: 1 00010000:00010000:0.0:1746129761.352313:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131819400/0x48868a4e4394a6ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffab expref: 15 pid: 20441 timeout: 807 lvb_type: 1 00010000:00010000:0.0:1746129761.352323:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131819400/0x48868a4e4394a6ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf34ffab expref: 15 pid: 20441 timeout: 807 lvb_type: 1 00010000:00010000:3.0:1746129761.352863:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129761.352865:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129761.352869:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e4394ac50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.352877:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e4394ac50 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129761.353331:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129761.353333:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129761.353335:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094ea0200/0x48868a4e4394ac65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129761.353341:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094ea0200/0x48868a4e4394ac65 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129761.353360:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129761.353396:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949052428672:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1109us (2855us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129761.353402:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5563 00010000:00010000:3.0:1746129761.353614:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129761.353636:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949052428544:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1464us (3119us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129761.353641:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5562 00010000:00010000:3.0:1746129761.353660:0:3624:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094ea0200/0x48868a4e4394ac65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.353668:0:3624:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094ea0200/0x48868a4e4394ac65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.353686:0:3624:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094ea0200/0x48868a4e4394ac65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.353693:0:3624:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094ea0200/0x48868a4e4394ac65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.353698:0:3624:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094ea0200/0x48868a4e4394ac65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.353707:0:3624:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094ea0200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129761.353710:0:3624:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094ea0200/0x48868a4e4394ac65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.353903:0:3624:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094ea0200/0x48868a4e4394ac65 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.353916:0:3624:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094ea0200/0x48868a4e4394ac65 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.353922:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094ea0200/0x48868a4e4394ac65 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129761.353958:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1961:x1830949052427264:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 11031us (11113us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129761.353965:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11495 00010000:00010000:3.0:1746129761.353987:0:10930:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e4394ac50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.353994:0:10930:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e4394ac50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.354007:0:10930:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e4394ac50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.354013:0:10930:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e4394ac50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.354020:0:10930:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e4394ac50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.354024:0:10930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d6c3800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129761.354026:0:10930:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e4394ac50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.354031:0:10930:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e4394ac50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.354040:0:10930:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e4394ac50 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.354045:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e4394ac50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129761.354078:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949052427136:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 11160us (11331us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129761.354083:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11493 00010000:00010000:1.0:1746129761.354195:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.354197:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.354200:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb4800/0x48868a4e4394ac57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.354206:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb4800/0x48868a4e4394ac57 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.354231:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129761.354249:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+11:1961:x1830949052427904:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2464us (3758us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129761.354255:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5561 00010000:00010000:1.0:1746129761.354272:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb4800/0x48868a4e4394ac57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.354278:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb4800/0x48868a4e4394ac57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.354291:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb4800/0x48868a4e4394ac57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.354297:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb4800/0x48868a4e4394ac57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.354302:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb4800/0x48868a4e4394ac57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.354307:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8fb4800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129761.354310:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb4800/0x48868a4e4394ac57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.354315:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb4800/0x48868a4e4394ac57 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.354324:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb4800/0x48868a4e4394ac57 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.354334:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb4800/0x48868a4e4394ac57 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129761.354363:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+10:1961:x1830949052427392:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 11441us (11573us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129761.354367:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11494 00000100:00100000:1.0:1746129761.362473:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1964:x1830949052428288:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 13465us (13592us total) trans 17179873281 rc 0/0 00000100:00100000:1.0:1746129761.362485:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 677 00002000:00100000:1.0:1746129761.362494:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->2457599) req@ffff88009284c000 x1830949052428288/t17179873281(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:502/0 lens 488/448 e 0 to 0 dl 1746129772 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129761.362507:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284c000 with x1830949052428288 ext(2097152->2457599) 00010000:00010000:1.0:1746129761.362515:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dae7000/0x48868a4e4394ac18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35031d expref: 25 pid: 8437 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746129761.362525:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dae7000/0x48868a4e4394ac18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35031d expref: 25 pid: 8437 timeout: 807 lvb_type: 0 00002000:00010000:1.0:1746129761.362531:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009284c000 00000100:00100000:2.0:1746129761.366238:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1963:x1830949052428032:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 17899us (18010us total) trans 17179873282 rc 0/0 00000100:00100000:2.0:1746129761.366249:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 676 00002000:00100000:2.0:1746129761.366257:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3ea:0x0] (1507328->2097151) req@ffff88009284df80 x1830949052428032/t17179873282(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:502/0 lens 488/448 e 0 to 0 dl 1746129772 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129761.366264:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284df80 with x1830949052428032 ext(1507328->2097151) 00010000:00010000:2.0:1746129761.366273:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dae7600/0x48868a4e4394ac11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350316 expref: 25 pid: 8437 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746129761.366282:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dae7600/0x48868a4e4394ac11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350316 expref: 25 pid: 8437 timeout: 807 lvb_type: 0 00002000:00010000:2.0:1746129761.366287:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009284df80 00000100:00100000:0.0:1746129761.366988:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129761.367105:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052428800 00000100:00100000:1.0:1746129761.367112:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052428800 00010000:00010000:1.0:1746129761.367133:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dae7000/0x48868a4e4394ac18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35031d expref: 25 pid: 8437 timeout: 807 lvb_type: 0 00000100:00100000:1.0:1746129761.367151:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5564 00000100:00100000:1.0:1746129761.367157:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1963:x1830949052428800:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129761.367167:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129761.367180:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dae7000/0x48868a4e4394ac18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35031d expref: 25 pid: 8437 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746129761.367189:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dae7000/0x48868a4e4394ac18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2457599) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35031d expref: 25 pid: 8437 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746129761.367206:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dae7000/0x48868a4e4394ac18 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->2457599) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35031d expref: 25 pid: 8437 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746129761.367217:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.367228:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.367231:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5282600/0x48868a4e4394ac5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.367239:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5282600/0x48868a4e4394ac5e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.367256:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129761.367274:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949052428800:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 117us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129761.367280:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5564 00010000:00010000:1.0:1746129761.367296:0:7976:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5282600/0x48868a4e4394ac5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.367303:0:7976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5282600/0x48868a4e4394ac5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.367322:0:7976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5282600/0x48868a4e4394ac5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.367328:0:7976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5282600/0x48868a4e4394ac5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.367335:0:7976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5282600/0x48868a4e4394ac5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.367340:0:7976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5282600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129761.367343:0:7976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5282600/0x48868a4e4394ac5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.367350:0:7976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5282600/0x48868a4e4394ac5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.367357:0:7976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5282600/0x48868a4e4394ac5e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.367363:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5282600/0x48868a4e4394ac5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129761.367392:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949052427648:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 24459us (24574us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129761.367397:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11496 00000100:00100000:0.0:1746129761.370431:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129761.370522:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052428928 00000100:00100000:2.0:1746129761.370530:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052428928 00010000:00010000:2.0:1746129761.370555:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dae7600/0x48868a4e4394ac11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350316 expref: 23 pid: 8437 timeout: 807 lvb_type: 0 00000100:00100000:2.0:1746129761.370595:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5565 00000100:00100000:2.0:1746129761.370602:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949052428928:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129761.370613:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129761.370630:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dae7600/0x48868a4e4394ac11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350316 expref: 23 pid: 8437 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746129761.370641:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dae7600/0x48868a4e4394ac11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350316 expref: 23 pid: 8437 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746129761.370664:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dae7600/0x48868a4e4394ac11 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350316 expref: 23 pid: 8437 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746129761.370680:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129761.370682:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129761.370686:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094ea0000/0x48868a4e4394ac6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.370693:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094ea0000/0x48868a4e4394ac6c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.370711:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129761.370744:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1964:x1830949052428928:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 142us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129761.370750:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5565 00010000:00010000:1.0:1746129761.370980:0:8435:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094ea0000/0x48868a4e4394ac6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.370988:0:8435:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094ea0000/0x48868a4e4394ac6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.371007:0:8435:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094ea0000/0x48868a4e4394ac6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.371013:0:8435:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094ea0000/0x48868a4e4394ac6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.371019:0:8435:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094ea0000/0x48868a4e4394ac6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.371027:0:8435:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094ea0000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129761.371030:0:8435:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094ea0000/0x48868a4e4394ac6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.371036:0:8435:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094ea0000/0x48868a4e4394ac6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.371045:0:8435:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094ea0000/0x48868a4e4394ac6c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.371050:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094ea0000/0x48868a4e4394ac6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129761.371093:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949052427520:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 28030us (28219us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129761.371101:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11497 00000100:00100000:0.0:1746129761.374915:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129761.375165:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052429184 00000100:00100000:2.0:1746129761.375173:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052429184 00000100:00100000:2.0:1746129761.375214:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10012 00000100:00100000:2.0:1746129761.375234:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+302:28910:x1830949052429184:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:2.0:1746129761.375277:0:14314:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1746129761.375299:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130fcea00/0x48868a4e4394a9da lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3501aa expref: 302 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.375333:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b96aa00/0x48868a4e4394a787 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35001b expref: 301 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.375348:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cee00/0x48868a4e4394a779 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350022 expref: 300 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.375358:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129761.375362:0:14314:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129761.375390:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f000/0x48868a4e4394ac7a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129761.375399:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f000/0x48868a4e4394ac7a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129761.375406:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f000/0x48868a4e4394ac7a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000040:00080000:2.0:1746129761.375810:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2914, 88 off243288 00000004:00080000:2.0:1746129761.375816:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707433967955ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129761.375865:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2838, 88 off236680 00000004:00080000:2.0:1746129761.375871:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707434022767ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129761.375894:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2839, 88 off236768 00000004:00080000:2.0:1746129761.375897:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707434049390ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129761.375904:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2915, 88 off243376 00000004:00080000:2.0:1746129761.375907:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707434058695ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129761.375919:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2916, 88 off243464 00000004:00080000:2.0:1746129761.375921:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707434073618ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129761.375929:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2840, 88 off236856 00000004:00080000:2.0:1746129761.375933:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707434084658ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129761.375940:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2841, 88 off236944 00000004:00080000:2.0:1746129761.375943:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707434094830ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129761.376620:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2842, 88 off237032 00000004:00080000:2.0:1746129761.376626:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707434778292ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129761.376712:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2917, 88 off243552 00000004:00080000:2.0:1746129761.376717:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707434868985ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129761.376736:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2843, 88 off237120 00000004:00080000:2.0:1746129761.376739:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707434891085ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129761.376746:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2918, 88 off243640 00000004:00080000:2.0:1746129761.376748:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707434900658ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129761.376755:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2844, 88 off237208 00000004:00080000:2.0:1746129761.376757:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707434908968ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129761.376763:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2919, 88 off243728 00000004:00080000:2.0:1746129761.376765:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707434917332ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129761.376774:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2920, 88 off243816 00000004:00080000:2.0:1746129761.376776:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707434928347ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129761.376784:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2921, 88 off243904 00000004:00080000:2.0:1746129761.376787:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707434939098ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129761.376795:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2922, 88 off243992 00000004:00080000:2.0:1746129761.376797:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707434949547ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129761.376806:0:14314:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2845, 88 off237296 00000004:00080000:2.0:1746129761.376809:0:14314:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707434960932ns, next at 641623252291ns, rc = 0 00000004:00010000:0.0:1746129761.395254:0:14314:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009284d180 reply state ffff88009bb2ac00 transno 8589943825 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f000/0x48868a4e4394ac7a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000100:00100000:0.0:1746129761.395267:0:14314:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746129761.395359:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+301:28910:x1830949052429184:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 20122us (20445us total) trans 8589943825 rc 0/0 00000100:00100000:0.0:1746129761.395367:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10012 00000001:00080000:1.0:1746129761.395368:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943807 is committed 00000001:00080000:1.0:1746129761.395374:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943797 is committed 00000001:00080000:1.0:1746129761.395378:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943791 is committed 00000001:00080000:1.0:1746129761.395385:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943824 is committed 00000001:00100000:1.0:1746129761.395389:0:14399:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6141239f-0c60-480d-830c-e22ba61457b0 00000001:00080000:1.0:1746129761.395391:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943822 is committed 00000001:00080000:1.0:1746129761.395396:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943806 is committed 00000001:00080000:1.0:1746129761.395411:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943825 is committed 00000004:00080000:1.0:1746129761.395415:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2030 committed 00000004:00080000:1.0:1746129761.395419:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2103 committed 00000004:00080000:1.0:1746129761.395423:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2102 committed 00000004:00080000:1.0:1746129761.395425:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2101 committed 00000004:00080000:1.0:1746129761.395426:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2100 committed 00000004:00080000:1.0:1746129761.395427:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2029 committed 00000004:00080000:1.0:1746129761.395429:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2099 committed 00000004:00080000:1.0:1746129761.395430:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2028 committed 00000004:00080000:1.0:1746129761.395431:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2098 committed 00000004:00080000:1.0:1746129761.395432:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2027 committed 00000004:00080000:1.0:1746129761.395434:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2026 committed 00000004:00080000:1.0:1746129761.395435:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2025 committed 00000004:00080000:1.0:1746129761.395436:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2097 committed 00000004:00080000:1.0:1746129761.395438:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2096 committed 00000004:00080000:1.0:1746129761.395439:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2024 committed 00000004:00080000:1.0:1746129761.395440:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2023 committed 00000004:00080000:1.0:1746129761.395442:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2095 committed 00000001:00100000:1.0:1746129761.395446:0:14399:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of eeb1e141-b927-4935-8f31-e7c2026fce6e 00000001:00080000:1.0:1746129761.395449:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943821 is committed 00000020:00000080:1.0:1746129761.395492:0:14399:0:(genops.c:904:class_export_put()) final put ffff8800b20f8000/6141239f-0c60-480d-830c-e22ba61457b0 00000020:00000080:1.0:1746129761.395506:0:14399:0:(genops.c:904:class_export_put()) final put ffff88008ec8f800/eeb1e141-b927-4935-8f31-e7c2026fce6e 00010000:00010000:3.0:1746129761.395549:0:3283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f000/0x48868a4e4394ac7a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129761.395557:0:3283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f000/0x48868a4e4394ac7a lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129761.395563:0:3283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f000/0x48868a4e4394ac7a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129761.395572:0:3283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f98f000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129761.395576:0:3283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f000/0x48868a4e4394ac7a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129761.395581:0:3283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f000/0x48868a4e4394ac7a lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00000100:00100000:0.0:1746129761.395587:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053394432:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746129761.395594:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129761.395596:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129761.395599:0:3283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f000/0x48868a4e4394ac7a lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129761.395603:0:3283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f000/0x48868a4e4394ac7a lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00000100:00100000:3.0:1746129761.395617:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053394688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129761.395622:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129761.395641:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129761.395660:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c088700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053395200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129761.395660:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c08b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053394944:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129761.395673:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129761.395676:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053394560:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129761.395685:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c08bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053395712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129761.395689:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129761.395697:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129761.395698:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c08ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053395072:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129761.395706:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053396224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129761.395709:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129761.395718:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053395584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129761.395730:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129761.395740:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053396096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129761.395752:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129761.395773:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053394432 00000100:00100000:0.0:1746129761.395777:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053394432 00000100:00100000:0.0:1746129761.395804:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053394688 00000100:00100000:0.0:1746129761.395807:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053394688 00000100:00100000:0.0:1746129761.395816:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053395200 00000100:00100000:0.0:1746129761.395817:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053395200 00000100:00100000:0.0:1746129761.395824:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053394560 00000100:00100000:0.0:1746129761.395826:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053394560 00000100:00100000:0.0:1746129761.395832:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053395712 00000100:00100000:0.0:1746129761.395834:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053395712 00000100:00100000:0.0:1746129761.395841:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053395072 00000100:00100000:0.0:1746129761.395842:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053395072 00000100:00100000:0.0:1746129761.395860:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053395584 00000100:00100000:0.0:1746129761.395862:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053395584 00000100:00100000:0.0:1746129761.395869:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053396096 00000100:00100000:2.0:1746129761.395870:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053394304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129761.395870:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053396096 00000100:00100000:2.0:1746129761.395889:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129761.395901:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c08b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053394816:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129761.395913:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129761.395919:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c08b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053395328:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129761.395930:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129761.395936:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053395840:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129761.395947:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1746129761.395962:0:32713:0:(genops.c:863:class_export_destroy()) destroying export ffff8800b20f8000/6141239f-0c60-480d-830c-e22ba61457b0 for lustre-MDT0000 00000020:00000080:2.0:1746129761.395996:0:32713:0:(genops.c:863:class_export_destroy()) destroying export ffff88008ec8f800/eeb1e141-b927-4935-8f31-e7c2026fce6e for lustre-MDT0000 00000020:00000080:2.0:1746129761.396014:0:32713:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff8800b20f8800 for lustre-MDT0000 00000020:00000080:2.0:1746129761.396018:0:32713:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff88008ec88000 for lustre-MDT0000 00000100:00100000:0.0:1746129761.396228:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11499 00000100:00100000:0.0:1746129761.396236:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3297:x1830949053394432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129761.396303:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129761.396321:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053394304 00000100:00100000:3.0:1746129761.396323:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053394304 00000100:00100000:3.0:1746129761.396335:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053394816 00000100:00100000:3.0:1746129761.396336:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053394816 00000100:00100000:3.0:1746129761.396341:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053395328 00000100:00100000:3.0:1746129761.396342:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053395328 00000100:00100000:3.0:1746129761.396348:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053395840 00000100:00100000:3.0:1746129761.396350:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053395840 00000100:00100000:3.0:1746129761.396355:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053396224 00000100:00100000:3.0:1746129761.396356:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053396224 00000100:00100000:3.0:1746129761.396362:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11500 00000100:00100000:3.0:1746129761.396366:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3299:x1830949053394688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129761.396381:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3297:x1830949053394432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 146us (758us total) trans 21474840409 rc 0/0 00000100:00100000:0.0:1746129761.396386:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11499 00000100:00100000:0.0:1746129761.396396:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11501 00000100:00100000:0.0:1746129761.396400:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3299:x1830949053395200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129761.396455:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3299:x1830949053394688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (812us total) trans 21474840410 rc 0/0 00000100:00100000:0.0:1746129761.396459:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3299:x1830949053395200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (785us total) trans 21474840411 rc 0/0 00000100:00100000:3.0:1746129761.396460:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11500 00000100:00100000:0.0:1746129761.396463:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11501 00000100:00100000:3.0:1746129761.396469:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11502 00000100:00100000:3.0:1746129761.396472:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c089180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3298:x1830949053394560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129761.396480:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11503 00000100:00100000:0.0:1746129761.396485:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3299:x1830949053395712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129761.396574:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3299:x1830949053395712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (875us total) trans 17179873283 rc 0/0 00000100:00100000:0.0:1746129761.396579:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11503 00000100:00100000:0.0:1746129761.396587:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11504 00000100:00100000:0.0:1746129761.396591:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3298:x1830949053395072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129761.396634:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11505 00000100:00100000:1.0:1746129761.396640:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3298:x1830949053395584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129761.396680:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3298:x1830949053395072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (969us total) trans 21474840412 rc 0/0 00000100:00100000:0.0:1746129761.396685:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11504 00000100:00100000:0.0:1746129761.396694:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11506 00000100:00100000:0.0:1746129761.396697:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3298:x1830949053396096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129761.396725:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3298:x1830949053395584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (994us total) trans 17179873284 rc 0/0 00000100:00100000:1.0:1746129761.396730:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11505 00000100:00100000:1.0:1746129761.396738:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11507 00000100:00100000:1.0:1746129761.396742:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3296:x1830949053394304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129761.396765:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3298:x1830949053396096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (1011us total) trans 17179873285 rc 0/0 00000100:00100000:0.0:1746129761.396770:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11506 00000100:00100000:0.0:1746129761.396778:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11508 00000100:00100000:0.0:1746129761.396781:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3296:x1830949053394816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129761.396828:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11509 00000100:00100000:0.0:1746129761.396832:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3296:x1830949053395328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129761.396867:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949053394304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 124us (976us total) trans 21474840413 rc 0/0 00000100:00100000:1.0:1746129761.396877:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11507 00000100:00100000:1.0:1746129761.396889:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11510 00000100:00100000:1.0:1746129761.396893:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3296:x1830949053395840:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1746129761.396917:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746129761.396920:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129761.397292:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11511 00000100:00100000:0.0:1746129761.397298:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3299:x1830949053396224:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129761.397442:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284fb80/2, rc 0, transno 21474840413 00000100:00100000:2.0:1746129761.397447:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053394304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129761.397529:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3296:x1830949053395840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 635us (1580us total) trans 17179873286 rc 0/0 00000100:00100000:1.0:1746129761.397534:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11510 00000100:00100000:1.0:1746129761.397590:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949053394816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 807us (1675us total) trans 21474840414 rc 0/0 00000100:00100000:1.0:1746129761.397594:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11508 00000100:00100000:3.0:1746129761.397631:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c089180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3298:x1830949053394560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1158us (1940us total) trans 21474840415 rc 0/0 00000100:00100000:3.0:1746129761.397636:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11502 00000004:00080000:3.0:1746129761.397698:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c089c00/2, rc 0, transno 21474840410 00000100:00100000:3.0:1746129761.397702:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053394688:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129761.397709:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c088700/2, rc 0, transno 21474840411 00000100:00100000:3.0:1746129761.397711:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c088700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053395200:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129761.397719:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c08bb80/2, rc 0, transno 17179873283 00000100:00100000:3.0:1746129761.397725:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c08bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053395712:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129761.397794:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053396352:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129761.397815:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129761.397820:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3299:x1830949053396224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 523us (1517us total) trans 17179873287 rc 0/0 00000100:00100000:0.0:1746129761.397825:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11511 00000100:00100000:0.0:1746129761.397833:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053396352 00000004:00080000:2.0:1746129761.397835:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c08b800/2, rc 0, transno 21474840414 00000100:00100000:0.0:1746129761.397836:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053396352 00000100:00100000:2.0:1746129761.397838:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c08b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053394816:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129761.397844:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c089f80/2, rc 0, transno 17179873286 00000100:00100000:0.0:1746129761.397865:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11512 00000100:00100000:0.0:1746129761.397869:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3296:x1830949053396352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129761.397877:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053395840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129761.397950:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3296:x1830949053396352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (133us total) trans 17179873288 rc 0/0 00000100:00100000:0.0:1746129761.397955:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11512 00000004:00080000:3.0:1746129761.398085:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c088e00/2, rc 0, transno 17179873287 00000100:00100000:3.0:1746129761.398088:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053396224:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129761.398284:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130505f80/2, rc 0, transno 17179873288 00000100:00100000:2.0:1746129761.398287:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053396352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129761.398560:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3296:x1830949053395328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1726us (2628us total) trans 17179873289 rc 0/0 00000100:00100000:0.0:1746129761.398565:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11509 00000004:00080000:0.0:1746129761.398586:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284e680/2, rc 0, transno 21474840415 00000100:00100000:0.0:1746129761.398590:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053394560:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129761.398603:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c08ad80/2, rc 0, transno 21474840412 00000100:00100000:0.0:1746129761.398605:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c08ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053395072:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129761.398612:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c088a80/2, rc 0, transno 17179873284 00000100:00100000:0.0:1746129761.398614:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053395584:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129761.398621:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c089500/2, rc 0, transno 17179873285 00000004:00080000:2.0:1746129761.398623:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c08b480/2, rc 0, transno 17179873289 00000100:00100000:0.0:1746129761.398623:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053396096:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129761.398626:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c08b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053395328:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129761.398635:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129761.398647:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053394944 00000100:00100000:2.0:1746129761.398649:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053394944 00000100:00100000:2.0:1746129761.398665:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11513 00000100:00100000:2.0:1746129761.398670:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3297:x1830949053394944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129761.398741:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c08a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053395456:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129761.398759:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129761.398766:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3297:x1830949053394944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (130us total) trans 21474840416 rc 0/0 00000100:00100000:0.0:1746129761.398769:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053395968:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129761.398771:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11513 00000100:00100000:0.0:1746129761.398781:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746129761.398798:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284f800/2, rc 0, transno 21474840409 00000100:00100000:0.0:1746129761.398801:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053394432:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129761.398806:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c08b100/2, rc 0, transno 21474840416 00000100:00100000:0.0:1746129761.398809:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c08b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053394944:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129761.398819:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053395456 00000100:00100000:0.0:1746129761.398822:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053395456 00000100:00100000:0.0:1746129761.398833:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053395968 00000100:00100000:0.0:1746129761.398835:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053395968 00000100:00100000:0.0:1746129761.398842:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11514 00000100:00100000:0.0:1746129761.398863:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3297:x1830949053395456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129761.398950:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3297:x1830949053395456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (189us total) trans 17179873290 rc 0/0 00000100:00100000:0.0:1746129761.398955:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11514 00000100:00100000:0.0:1746129761.398963:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11515 00000100:00100000:0.0:1746129761.398967:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3297:x1830949053395968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129761.399047:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3297:x1830949053395968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (265us total) trans 17179873291 rc 0/0 00000100:00100000:0.0:1746129761.399052:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11515 00000004:00080000:0.0:1746129761.399070:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c08a680/2, rc 0, transno 17179873290 00000100:00100000:0.0:1746129761.399073:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c08a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053395456:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129761.399080:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c088380/2, rc 0, transno 17179873291 00000100:00100000:0.0:1746129761.399082:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053395968:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129761.400818:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129761.400893:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052429312 00000100:00100000:2.0:1746129761.400899:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052429312 00000100:00100000:2.0:1746129761.401443:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10013 00000100:00100000:2.0:1746129761.401450:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:28910:x1830949052429312:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129761.401466:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129761.401479:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0a00/0x48868a4e4394ac81 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350347 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.401518:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0a00/0x48868a4e4394ac81 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350347 expref: 283 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.401529:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0a00/0x48868a4e4394ac81 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350347 expref: 283 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.401540:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:2.0:1746129761.401542:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129761.401545:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b7f0a00, rc 0) 00000100:00100000:2.0:1746129761.401585:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28910:x1830949052429312:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 135us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129761.401590:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10013 00000100:00100000:0.0:1746129761.405529:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129761.405602:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052429440 00000100:00100000:1.0:1746129761.405610:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052429440 00000100:00100000:1.0:1746129761.407324:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10014 00000100:00100000:1.0:1746129761.407334:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28910:x1830949052429440:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129761.407349:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129761.407363:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e4394ac88 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35034e expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.407439:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4394ac8f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129761.407451:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4394ac8f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129761.407460:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4394ac8f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:1.0:1746129761.407480:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9155232 00000004:00200000:1.0:1746129761.407483:0:14315:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746129761.407494:0:14315:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4394ac8f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129761.407513:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e4394ac88 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35034e expref: 285 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.407525:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4394ac8f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35034e expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.407532:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129761.407534:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129761.407536:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff2c00, rc 0) 00000100:00100000:1.0:1746129761.407584:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28910:x1830949052429440:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 252us (2061us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129761.407589:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10014 00000100:00100000:3.0:1746129761.411232:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129761.411265:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129761.411288:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129761.411307:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129761.411317:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129761.411338:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052429568 00000100:00100000:0.0:1746129761.411346:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052429568 00000100:00100000:3.0:1746129761.411368:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129761.411388:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052429696 00000100:00100000:0.0:1746129761.411390:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052429696 00000100:00100000:0.0:1746129761.412041:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052429824 00000100:00100000:0.0:1746129761.412045:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052429824 00000100:00100000:2.0:1746129761.412055:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052429952 00000100:00100000:2.0:1746129761.412060:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052429952 00000100:00100000:0.0:1746129761.412060:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052430080 00000100:00100000:0.0:1746129761.412062:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052430080 00000100:00100000:0.0:1746129761.412074:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052430208 00000100:00100000:0.0:1746129761.412075:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052430208 00000100:00100000:2.0:1746129761.412084:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11516 00000100:00100000:0.0:1746129761.412089:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11517 00000100:00100000:2.0:1746129761.412090:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949052429568:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:0.0:1746129761.412095:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+12:1963:x1830949052429696:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129761.412105:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129761.412105:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129761.412119:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0800/0x48868a4e4394ac9d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350355 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129761.412119:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800ace23000/0x48868a4e4394ac96 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35035c expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129761.412139:0:3624:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e8:0x0] initial LVB size: 1048576, mtime: 0x6813d35b, atime: 0x6813d35b, ctime: 0x6813d35b, blocks: 0x809 00002000:00010000:0.0:1746129761.412139:0:4589:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e6:0x0] initial LVB size: 2097152, mtime: 0x6813d35d, atime: 0x6813d35d, ctime: 0x6813d35d, blocks: 0x81f 00010000:00010000:2.0:1746129761.412153:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129761.412153:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129761.412156:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129761.412156:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129761.412163:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0800/0x48868a4e4394ac9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350355 expref: 24 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129761.412163:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800ace23000/0x48868a4e4394ac96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35035c expref: 13 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129761.412176:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0800/0x48868a4e4394ac9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350355 expref: 24 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129761.412176:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800ace23000/0x48868a4e4394ac96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35035c expref: 13 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129761.412184:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b7f0800, rc 0) 00010000:00010000:0.0:1746129761.412184:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ace23000, rc 0) 00000100:00100000:3.0:1746129761.412249:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11518 00000100:00100000:3.0:1746129761.412255:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1963:x1830949052429824:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129761.412261:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129761.412276:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b770200/0x48868a4e4394aca4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350363 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129761.412287:0:10930:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e7:0x0] initial LVB size: 2097152, mtime: 0x6813d360, atime: 0x6813d35f, ctime: 0x6813d360, blocks: 0x821 00010000:00010000:3.0:1746129761.412295:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129761.412296:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129761.412300:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b770200/0x48868a4e4394aca4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350363 expref: 14 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129761.412309:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b770200/0x48868a4e4394aca4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350363 expref: 14 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129761.412315:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b770200, rc 0) 00000100:00100000:0.0:1746129761.412404:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1963:x1830949052429696:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 308us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129761.412411:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11517 00000100:00100000:1.0:1746129761.412421:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11519 00000100:00100000:0.0:1746129761.412426:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11520 00000100:00100000:1.0:1746129761.412428:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949052430080:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:0.0:1746129761.412431:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949052429952:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129761.412434:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129761.412437:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129761.412445:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f87d400/0x48868a4e4394acb2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35036a expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.412448:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e4394acab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350371 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129761.412455:0:4589:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3ea:0x0] initial LVB size: 2097152, mtime: 0x6813d360, atime: 0x6813d35f, ctime: 0x6813d360, blocks: 0x821 00002000:00010000:1.0:1746129761.412459:0:7975:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3eb:0x0] initial LVB size: 4960928, mtime: 0x6813d360, atime: 0x6813d360, ctime: 0x6813d360, blocks: 0x1629 00010000:00010000:0.0:1746129761.412462:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129761.412463:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129761.412467:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87d400/0x48868a4e4394acb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35036a expref: 26 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129761.412471:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.412472:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129761.412476:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f87d400/0x48868a4e4394acb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35036a expref: 26 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129761.412477:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e4394acab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350371 expref: 26 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129761.412482:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f87d400, rc 0) 00010000:00010000:1.0:1746129761.412489:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e4394acab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350371 expref: 26 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129761.412495:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff2400, rc 0) 00000100:00100000:0.0:1746129761.412497:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949052429952:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 66us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129761.412501:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11520 00000100:00100000:0.0:1746129761.412516:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11521 00000100:00100000:1.0:1746129761.412518:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1963:x1830949052430080:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 91us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129761.412520:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1963:x1830949052430208:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:1.0:1746129761.412523:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11519 00010000:00010000:0.0:1746129761.412525:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129761.412532:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4a00/0x48868a4e4394acb9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350378 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129761.412540:0:4589:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e8:0x0] initial LVB size: 4194304, mtime: 0x6813d360, atime: 0x6813d35f, ctime: 0x6813d360, blocks: 0x1029 00010000:00010000:0.0:1746129761.412546:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129761.412547:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129761.412550:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4a00/0x48868a4e4394acb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350378 expref: 14 pid: 4589 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129761.412561:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1963:x1830949052429824:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 306us (1271us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129761.412562:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4a00/0x48868a4e4394acb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350378 expref: 14 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129761.412568:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a51c4a00, rc 0) 00000100:00100000:0.0:1746129761.412581:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1963:x1830949052430208:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 61us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129761.412585:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11521 00000100:00100000:3.0:1746129761.412599:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11518 00000100:00100000:2.0:1746129761.412670:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949052429568:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 128us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129761.412675:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11516 00000100:00100000:0.0:1746129761.427140:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129761.427202:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052430464 00000100:00100000:2.0:1746129761.427211:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052430464 00000100:00100000:2.0:1746129761.427279:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4353 00000100:00100000:2.0:1746129761.427286:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052430464:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:2.0:1746129761.427314:0:21599:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0600/0x48868a4e4394acc0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.427326:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129761.427327:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129761.427331:0:21599:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0600/0x48868a4e4394acc0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.427343:0:21599:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0600/0x48868a4e4394acc0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129761.429638:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129761.429805:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052430720 00000100:00100000:1.0:1746129761.429812:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052430720 00000100:00100000:1.0:1746129761.429867:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4354 00000100:00100000:1.0:1746129761.429875:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1961:x1830949052430720:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:1.0:1746129761.429900:0:21604:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2000/0x48868a4e4394acc7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.429911:0:21604:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.429912:0:21604:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.429916:0:21604:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2000/0x48868a4e4394acc7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.429926:0:21604:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2000/0x48868a4e4394acc7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129761.439132:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129761.439149:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129761.439159:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129761.439184:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129761.439195:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129761.439226:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052431104 00000100:00100000:3.0:1746129761.439234:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052431104 00000100:00100000:0.0:1746129761.439241:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129761.439274:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052431360 00000100:00100000:3.0:1746129761.439276:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052431360 00000100:00100000:3.0:1746129761.439288:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052431232 00000100:00100000:3.0:1746129761.439290:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052431232 00000100:00100000:3.0:1746129761.439300:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052431616 00000100:00100000:3.0:1746129761.439302:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052431616 00000100:00100000:3.0:1746129761.439312:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052431872 00000100:00100000:3.0:1746129761.439314:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052431872 00000100:00100000:3.0:1746129761.439321:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052431744 00000100:00100000:3.0:1746129761.439324:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052431744 00000100:00100000:3.0:1746129761.439335:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4355 00000100:00100000:3.0:1746129761.439341:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949052431104:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129761.439370:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a12bc00/0x48868a4e4394acce lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.439381:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129761.439383:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129761.439388:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a12bc00/0x48868a4e4394acce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.439398:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a12bc00/0x48868a4e4394acce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129761.439505:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4356 00000100:00100000:0.0:1746129761.439512:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949052431360:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:0.0:1746129761.439532:0:21603:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f9bc800/0x48868a4e4394acd5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129761.439541:0:21603:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129761.439542:0:21603:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129761.439545:0:21603:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9bc800/0x48868a4e4394acd5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129761.439556:0:21603:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f9bc800/0x48868a4e4394acd5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129761.439712:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4357 00000100:00100000:3.0:1746129761.439718:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949052431232:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129761.439730:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e4394acdc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.439737:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129761.439738:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129761.439741:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e4394acdc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.439748:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e4394acdc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129761.439838:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4358 00000100:00100000:0.0:1746129761.439843:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949052431616:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:0.0:1746129761.439874:0:21602:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fa78e00/0x48868a4e4394ace3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129761.439881:0:21602:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129761.439882:0:21602:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129761.439884:0:21602:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa78e00/0x48868a4e4394ace3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129761.439892:0:21602:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa78e00/0x48868a4e4394ace3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129761.440069:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4359 00000100:00100000:3.0:1746129761.440075:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949052431872:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129761.440089:0:21600:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a12ba00/0x48868a4e4394acea lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.440096:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129761.440097:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129761.440100:0:21600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a12ba00/0x48868a4e4394acea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.440107:0:21600:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a12ba00/0x48868a4e4394acea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129761.442513:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4360 00000100:00100000:1.0:1746129761.442525:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949052431744:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:1.0:1746129761.442558:0:2677:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3200/0x48868a4e4394acf1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.442568:0:2677:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.442570:0:2677:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.442574:0:2677:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3200/0x48868a4e4394acf1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.442585:0:2677:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3200/0x48868a4e4394acf1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.458230:0:21604:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2000/0x48868a4e4394acc7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.458245:0:21604:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2000/0x48868a4e4394acc7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.458252:0:21604:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2000/0x48868a4e4394acc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.458259:0:21604:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4ff2000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129761.458262:0:21604:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2000/0x48868a4e4394acc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.458269:0:21604:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2000/0x48868a4e4394acc7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.458286:0:21604:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2000/0x48868a4e4394acc7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.458292:0:21604:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2000/0x48868a4e4394acc7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129761.458368:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949052430720:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 28489us (28731us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129761.458378:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4354 00010000:00010000:2.0:1746129761.461749:0:21602:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fa78e00/0x48868a4e4394ace3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.461763:0:21602:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa78e00/0x48868a4e4394ace3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.461769:0:21602:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fa78e00/0x48868a4e4394ace3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.461775:0:21602:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa78e00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129761.461779:0:21602:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fa78e00/0x48868a4e4394ace3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.461785:0:21602:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fa78e00/0x48868a4e4394ace3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.461801:0:21602:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fa78e00/0x48868a4e4394ace3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.461806:0:21602:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa78e00/0x48868a4e4394ace3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129761.461918:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949052431616:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 22070us (22728us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129761.461927:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4358 00010000:00010000:3.0:1746129761.465834:0:21600:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a12ba00/0x48868a4e4394acea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.465872:0:21600:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a12ba00/0x48868a4e4394acea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.465879:0:21600:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a12ba00/0x48868a4e4394acea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.465884:0:21600:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a12ba00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129761.465887:0:21600:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a12ba00/0x48868a4e4394acea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.465894:0:21600:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a12ba00/0x48868a4e4394acea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.465910:0:21600:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a12ba00/0x48868a4e4394acea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.465915:0:21600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a12ba00/0x48868a4e4394acea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129761.465974:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949052431872:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 25896us (26775us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129761.465983:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4359 00010000:00010000:3.0:1746129761.472967:0:21599:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0600/0x48868a4e4394acc0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.472982:0:21599:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0600/0x48868a4e4394acc0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.472989:0:21599:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0600/0x48868a4e4394acc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.472995:0:21599:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b7f0600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129761.472998:0:21599:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0600/0x48868a4e4394acc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.473004:0:21599:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0600/0x48868a4e4394acc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.473020:0:21599:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0600/0x48868a4e4394acc0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.473030:0:21599:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0600/0x48868a4e4394acc0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129761.473101:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949052430464:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 45811us (45963us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129761.473110:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4353 00010000:00010000:1.0:1746129761.475509:0:2677:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3200/0x48868a4e4394acf1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.475523:0:2677:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3200/0x48868a4e4394acf1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.475530:0:2677:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3200/0x48868a4e4394acf1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.475536:0:2677:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4ff3200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129761.475540:0:2677:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3200/0x48868a4e4394acf1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.475547:0:2677:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3200/0x48868a4e4394acf1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.475560:0:2677:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3200/0x48868a4e4394acf1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.475570:0:2677:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3200/0x48868a4e4394acf1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129761.475655:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052431744:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 33129us (36409us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129761.475663:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4360 00010000:00010000:3.0:1746129761.480767:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a12bc00/0x48868a4e4394acce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.480782:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a12bc00/0x48868a4e4394acce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.480789:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a12bc00/0x48868a4e4394acce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.480794:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a12bc00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129761.480797:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a12bc00/0x48868a4e4394acce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.480803:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a12bc00/0x48868a4e4394acce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.480816:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a12bc00/0x48868a4e4394acce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.480821:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a12bc00/0x48868a4e4394acce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129761.480900:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949052431104:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 41555us (41770us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129761.480908:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4355 00010000:00010000:3.0:1746129761.484646:0:21603:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f9bc800/0x48868a4e4394acd5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.484660:0:21603:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9bc800/0x48868a4e4394acd5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.484668:0:21603:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f9bc800/0x48868a4e4394acd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.484674:0:21603:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f9bc800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129761.484678:0:21603:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f9bc800/0x48868a4e4394acd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.484684:0:21603:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f9bc800/0x48868a4e4394acd5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.484703:0:21603:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f9bc800/0x48868a4e4394acd5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.484708:0:21603:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9bc800/0x48868a4e4394acd5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129761.484782:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949052431360:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 45265us (45626us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129761.484975:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4356 00010000:00010000:2.0:1746129761.487837:0:8441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e4394acdc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.488106:0:8441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e4394acdc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.488119:0:8441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e4394acdc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.488124:0:8441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a12aa00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129761.488127:0:8441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e4394acdc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.488134:0:8441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e4394acdc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.488149:0:8441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e4394acdc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.488154:0:8441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e4394acdc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129761.488233:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949052431232:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 48500us (49057us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129761.488242:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4357 00000100:00100000:0.0:1746129761.492057:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129761.492308:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052432256 00000100:00100000:1.0:1746129761.492316:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052432256 00000100:00100000:1.0:1746129761.492359:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10015 00000100:00100000:1.0:1746129761.492367:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28910:x1830949052432256:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:1.0:1746129761.492408:0:14315:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129761.492438:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4394ac8f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35034e expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.492463:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129761.492468:0:14315:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129761.492631:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3c00/0x48868a4e4394acf8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129761.492641:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3c00/0x48868a4e4394acf8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129761.492650:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3c00/0x48868a4e4394acf8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00010000:1.0:1746129761.492788:0:14315:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800936dea00 reply state ffff88009b659000 transno 8589943826 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3c00/0x48868a4e4394acf8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:1.0:1746129761.492795:0:14315:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746129761.492879:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:28910:x1830949052432256:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 513us (828us total) trans 8589943826 rc 0/0 00000100:00100000:1.0:1746129761.492885:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10015 00000100:00100000:0.0:1746129761.494603:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129761.494673:0:3283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3c00/0x48868a4e4394acf8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129761.494679:0:3283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3c00/0x48868a4e4394acf8 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129761.494684:0:3283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3c00/0x48868a4e4394acf8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129761.494689:0:3283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4ff3c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129761.494692:0:3283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3c00/0x48868a4e4394acf8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129761.494698:0:3283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3c00/0x48868a4e4394acf8 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129761.494707:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129761.494709:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129761.494712:0:3283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3c00/0x48868a4e4394acf8 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129761.494715:0:3283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3c00/0x48868a4e4394acf8 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00000100:00100000:1.0:1746129761.494780:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052432384 00000100:00100000:1.0:1746129761.494785:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052432384 00000100:00100000:1.0:1746129761.494811:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11522 00000100:00100000:1.0:1746129761.494817:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:28910:x1830949052432384:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129761.494829:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129761.494839:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094ea0000/0x48868a4e4394acff lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35037f expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.494882:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0800/0x48868a4e4394ac9d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350355 expref: 25 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129761.494889:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.494891:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.494893:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094ea0000/0x48868a4e4394acff lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35037f expref: 25 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.494916:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0800/0x48868a4e4394ac9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350355 expref: 25 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129761.494926:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0800/0x48868a4e4394ac9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350355 expref: 25 pid: 3624 timeout: 807 lvb_type: 1 00000100:00100000:1.0:1746129761.494936:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053396480:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129761.494993:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366780 going to sleep for 11 seconds 00000100:00100000:1.0:1746129761.498436:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053396480:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129761.498462:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094ea0000/0x48868a4e4394acff lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35037f expref: 25 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.498476:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ea0000, rc 0) 00000100:00100000:1.0:1746129761.498512:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:28910:x1830949052432384:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3695us (3912us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129761.498519:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11522 00000100:00100000:0.0:1746129761.499429:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129761.499689:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052432512 00000100:00100000:1.0:1746129761.499695:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052432512 00010000:00010000:1.0:1746129761.499716:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0800/0x48868a4e4394ac9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350355 expref: 25 pid: 3624 timeout: 807 lvb_type: 1 00000100:00100000:1.0:1746129761.499749:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5566 00000100:00100000:1.0:1746129761.499756:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949052432512:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129761.499766:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129761.499784:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0800/0x48868a4e4394ac9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350355 expref: 25 pid: 3624 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746129761.499794:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0800/0x48868a4e4394ac9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350355 expref: 25 pid: 3624 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746129761.499811:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0800/0x48868a4e4394ac9d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350355 expref: 25 pid: 3624 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746129761.499839:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.499841:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.499870:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094ea0000/0x48868a4e4394acff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35037f expref: 24 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.500240:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094ea0000/0x48868a4e4394acff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35037f expref: 24 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.500268:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094ea0000/0x48868a4e4394acff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35037f expref: 24 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129761.500280:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053396608:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129761.500529:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366780 going to sleep for 11 seconds 00000100:00100000:1.0:1746129761.503504:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053396608:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129761.503523:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129761.503573:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052432512:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3816us (4146us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129761.503582:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5566 00000100:00100000:0.0:1746129761.504045:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129761.504106:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052432640 00000100:00100000:1.0:1746129761.504111:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052432640 00000100:00100000:1.0:1746129761.504232:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11523 00000100:00100000:1.0:1746129761.504239:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:28910:x1830949052432640:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129761.504254:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129761.504267:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3400/0x48868a4e4394ad06 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350386 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.504294:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800ace23000/0x48868a4e4394ac96 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35035c expref: 14 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129761.504300:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.504302:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.504305:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3400/0x48868a4e4394ad06 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350386 expref: 14 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.504327:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800ace23000/0x48868a4e4394ac96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35035c expref: 14 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129761.504336:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800ace23000/0x48868a4e4394ac96 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35035c expref: 14 pid: 4589 timeout: 807 lvb_type: 1 00000100:00100000:1.0:1746129761.504347:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053396736:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129761.504738:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129761.505662:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053396736:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129761.505679:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3400/0x48868a4e4394ad06 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350386 expref: 14 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.505694:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff3400, rc 0) 00000100:00100000:1.0:1746129761.505719:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:28910:x1830949052432640:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1479us (1675us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129761.505725:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11523 00000100:00100000:0.0:1746129761.506053:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129761.506113:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052432768 00000100:00100000:1.0:1746129761.506118:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052432768 00010000:00010000:1.0:1746129761.506132:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800ace23000/0x48868a4e4394ac96 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35035c expref: 14 pid: 4589 timeout: 807 lvb_type: 1 00000100:00100000:1.0:1746129761.506159:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5567 00000100:00100000:1.0:1746129761.506168:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949052432768:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129761.506176:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129761.506194:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800ace23000/0x48868a4e4394ac96 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35035c expref: 14 pid: 4589 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746129761.506203:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800ace23000/0x48868a4e4394ac96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35035c expref: 14 pid: 4589 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746129761.506232:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800ace23000/0x48868a4e4394ac96 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35035c expref: 14 pid: 4589 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746129761.506243:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.506244:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.506249:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3400/0x48868a4e4394ad06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350386 expref: 13 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.506256:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3400/0x48868a4e4394ad06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350386 expref: 13 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.506276:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3400/0x48868a4e4394ad06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350386 expref: 13 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129761.506284:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053396864:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129761.506330:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129761.507491:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053396864:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129761.507504:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129761.507531:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1961:x1830949052432768:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1365us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129761.507538:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5567 00000100:00100000:0.0:1746129761.507644:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129761.507729:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052432896 00000100:00100000:1.0:1746129761.507734:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052432896 00000100:00100000:1.0:1746129761.507872:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11524 00000100:00100000:1.0:1746129761.507879:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:28910:x1830949052432896:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129761.507890:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129761.507905:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4394ad0d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35038d expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.507923:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b770200/0x48868a4e4394aca4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350363 expref: 14 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129761.507929:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.507931:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.507933:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4394ad0d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35038d expref: 14 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.507949:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b770200/0x48868a4e4394aca4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350363 expref: 14 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129761.507958:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b770200/0x48868a4e4394aca4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350363 expref: 14 pid: 10930 timeout: 807 lvb_type: 1 00000100:00100000:1.0:1746129761.507975:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053396992:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129761.508102:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129761.509019:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053396992:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129761.509033:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4394ad0d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35038d expref: 14 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.509043:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff2c00, rc 0) 00000100:00100000:1.0:1746129761.509074:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:28910:x1830949052432896:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1195us (1429us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129761.509079:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11524 00000100:00100000:0.0:1746129761.509792:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129761.509825:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052433024 00000100:00100000:1.0:1746129761.509829:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052433024 00010000:00010000:1.0:1746129761.509845:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b770200/0x48868a4e4394aca4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350363 expref: 14 pid: 10930 timeout: 807 lvb_type: 1 00000100:00100000:1.0:1746129761.509897:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5568 00000100:00100000:1.0:1746129761.509903:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949052433024:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129761.509911:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129761.509926:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b770200/0x48868a4e4394aca4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350363 expref: 14 pid: 10930 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746129761.509939:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b770200/0x48868a4e4394aca4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350363 expref: 14 pid: 10930 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746129761.509960:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b770200/0x48868a4e4394aca4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350363 expref: 14 pid: 10930 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746129761.509970:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.509971:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.509976:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4394ad0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35038d expref: 13 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.510008:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4394ad0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35038d expref: 13 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.510032:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4394ad0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35038d expref: 13 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129761.510040:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053397120:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129761.510094:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129761.511052:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053397120:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129761.511062:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129761.511093:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1961:x1830949052433024:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1189us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129761.511099:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5568 00000100:00100000:0.0:1746129761.511440:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129761.511720:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052433152 00000100:00100000:1.0:1746129761.511724:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052433152 00000100:00100000:1.0:1746129761.511758:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11525 00000100:00100000:1.0:1746129761.511765:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:28910:x1830949052433152:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129761.511779:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129761.511790:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3c00/0x48868a4e4394ad14 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf350394 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.512073:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f87d400/0x48868a4e4394acb2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35036a expref: 25 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129761.512089:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.512091:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.512094:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3c00/0x48868a4e4394ad14 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350394 expref: 25 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.512114:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f87d400/0x48868a4e4394acb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35036a expref: 25 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129761.512123:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f87d400/0x48868a4e4394acb2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35036a expref: 25 pid: 4589 timeout: 807 lvb_type: 1 00000100:00100000:1.0:1746129761.512132:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053397248:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129761.512179:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129761.514529:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053397248:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129761.514553:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3c00/0x48868a4e4394ad14 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350394 expref: 25 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.514567:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff3c00, rc 0) 00000100:00100000:1.0:1746129761.514605:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:28910:x1830949052433152:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 2840us (3165us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129761.514613:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11525 00000100:00100000:0.0:1746129761.514789:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129761.515030:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052433280 00000100:00100000:1.0:1746129761.515036:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052433280 00010000:00010000:1.0:1746129761.515055:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87d400/0x48868a4e4394acb2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35036a expref: 25 pid: 4589 timeout: 807 lvb_type: 1 00000100:00100000:1.0:1746129761.515087:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5569 00000100:00100000:1.0:1746129761.515093:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949052433280:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129761.515102:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129761.515119:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f87d400/0x48868a4e4394acb2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35036a expref: 25 pid: 4589 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746129761.515128:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f87d400/0x48868a4e4394acb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35036a expref: 25 pid: 4589 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746129761.515283:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f87d400/0x48868a4e4394acb2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35036a expref: 25 pid: 4589 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746129761.515295:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.515297:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.515303:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3c00/0x48868a4e4394ad14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350394 expref: 24 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.515309:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3c00/0x48868a4e4394ad14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350394 expref: 24 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.515333:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3c00/0x48868a4e4394ad14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350394 expref: 24 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129761.515342:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053397376:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129761.515561:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129761.518086:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129761.518177:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053397376:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129761.518193:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129761.518249:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949052433280:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3155us (3460us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129761.518259:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5569 00000100:00100000:2.0:1746129761.518387:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052433408 00000100:00100000:2.0:1746129761.518393:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052433408 00000100:00100000:2.0:1746129761.518426:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11526 00000100:00100000:2.0:1746129761.518432:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:28910:x1830949052433408:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129761.518446:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129761.518459:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ffbc000/0x48868a4e4394ad1b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35039b expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.518483:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e4394acab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350371 expref: 25 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129761.518489:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129761.518490:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129761.518493:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffbc000/0x48868a4e4394ad1b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35039b expref: 25 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.518514:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e4394acab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350371 expref: 25 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129761.518524:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e4394acab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350371 expref: 25 pid: 7975 timeout: 807 lvb_type: 1 00000100:00100000:2.0:1746129761.518533:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053397504:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129761.518745:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129761.520920:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129761.521013:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053397504:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129761.521036:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ffbc000/0x48868a4e4394ad1b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35039b expref: 25 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.521047:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffbc000, rc 0) 00000100:00100000:2.0:1746129761.521091:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:28910:x1830949052433408:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 2658us (3009us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129761.521098:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11526 00000100:00100000:1.0:1746129761.521165:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052433536 00000100:00100000:1.0:1746129761.521169:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052433536 00010000:00010000:1.0:1746129761.521188:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e4394acab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350371 expref: 25 pid: 7975 timeout: 807 lvb_type: 1 00000100:00100000:1.0:1746129761.521233:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5570 00000100:00100000:1.0:1746129761.521239:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949052433536:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129761.521250:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129761.521354:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e4394acab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350371 expref: 25 pid: 7975 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746129761.521365:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e4394acab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350371 expref: 25 pid: 7975 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746129761.521382:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e4394acab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350371 expref: 25 pid: 7975 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746129761.521399:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.521400:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.521406:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ffbc000/0x48868a4e4394ad1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35039b expref: 24 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.521413:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffbc000/0x48868a4e4394ad1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35039b expref: 24 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.521436:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ffbc000/0x48868a4e4394ad1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35039b expref: 24 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129761.521445:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053397632:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129761.521491:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129761.522977:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129761.523025:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052433664 00000100:00100000:2.0:1746129761.523034:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052433664 00000100:00100000:2.0:1746129761.523072:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11527 00000100:00100000:2.0:1746129761.523078:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:28910:x1830949052433664:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129761.523089:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129761.523102:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ffbca00/0x48868a4e4394ad22 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3503a2 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.523120:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4a00/0x48868a4e4394acb9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350378 expref: 14 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129761.523126:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129761.523128:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129761.523130:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffbca00/0x48868a4e4394ad22 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3503a2 expref: 14 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.523148:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4a00/0x48868a4e4394acb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350378 expref: 14 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129761.523158:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4a00/0x48868a4e4394acb9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350378 expref: 14 pid: 4589 timeout: 807 lvb_type: 1 00000100:00100000:2.0:1746129761.523172:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053397760:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129761.523238:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129761.523344:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053397632:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129761.523355:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129761.523372:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949052433536:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2134us (2458us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129761.523378:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5570 00000100:00100000:2.0:1746129761.525482:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053397760:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129761.525503:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ffbca00/0x48868a4e4394ad22 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3503a2 expref: 14 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.525522:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffbca00, rc 0) 00000100:00100000:2.0:1746129761.525552:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:28910:x1830949052433664:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 2474us (2578us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129761.525559:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11527 00000100:00100000:0.0:1746129761.526086:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129761.526477:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052433792 00000100:00100000:1.0:1746129761.526483:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052433792 00010000:00010000:1.0:1746129761.526503:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4a00/0x48868a4e4394acb9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350378 expref: 14 pid: 4589 timeout: 807 lvb_type: 1 00000100:00100000:1.0:1746129761.526727:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5571 00000100:00100000:1.0:1746129761.526735:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1962:x1830949052433792:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129761.526746:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129761.526764:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4a00/0x48868a4e4394acb9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350378 expref: 14 pid: 4589 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746129761.526782:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4a00/0x48868a4e4394acb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350378 expref: 14 pid: 4589 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746129761.526800:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4a00/0x48868a4e4394acb9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350378 expref: 14 pid: 4589 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746129761.526823:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.526825:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129761.526831:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ffbca00/0x48868a4e4394ad22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3503a2 expref: 13 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.526837:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffbca00/0x48868a4e4394ad22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3503a2 expref: 13 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129761.526881:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ffbca00/0x48868a4e4394ad22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3503a2 expref: 13 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129761.526891:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053397888:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129761.526952:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129761.530118:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129761.530179:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052433920 00000100:00100000:2.0:1746129761.530186:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052433920 00000100:00100000:1.0:1746129761.530480:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053397888:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129761.530496:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129761.530533:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949052433792:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3799us (4448us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129761.530542:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5571 00000100:00100000:2.0:1746129761.530803:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11528 00000100:00100000:2.0:1746129761.530810:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949052433920:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:2.0:1746129761.530985:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746129761.530988:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129755 -> 1746129760 00002000:00010000:2.0:1746129761.530990:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129755 -> 1746129760 00002000:00010000:2.0:1746129761.530991:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129755 -> 1746129762 00002000:00010000:2.0:1746129761.530993:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:2.0:1746129761.531012:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949052433920:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 203us (900us total) trans 17179873292 rc 0/0 00000100:00100000:2.0:1746129761.531018:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11528 00000100:00100000:0.0:1746129761.531815:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129761.532663:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052434048 00000100:00100000:3.0:1746129761.532670:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052434048 00000100:00100000:3.0:1746129761.532707:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11529 00000100:00100000:3.0:1746129761.532713:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1961:x1830949052434048:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:3.0:1746129761.532841:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129761.532843:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129757 -> 1746129760 00002000:00010000:3.0:1746129761.532869:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129757 -> 1746129760 00002000:00010000:3.0:1746129761.532871:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129757 -> 1746129762 00002000:00010000:3.0:1746129761.532873:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746129761.532915:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949052434048:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 201us (1101us total) trans 21474840417 rc 0/0 00000100:00100000:3.0:1746129761.532920:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11529 00000100:00100000:0.0:1746129761.533075:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129761.533140:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129761.533154:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129761.533176:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129761.533189:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052434304 00000100:00100000:0.0:1746129761.533192:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052434304 00000100:00100000:0.0:1746129761.534309:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052434560 00000100:00100000:0.0:1746129761.534316:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052434560 00000100:00100000:2.0:1746129761.534645:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052434176 00000100:00100000:2.0:1746129761.534649:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052434176 00000100:00100000:2.0:1746129761.534673:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052434432 00000100:00100000:2.0:1746129761.534676:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052434432 00000100:00100000:2.0:1746129761.534693:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11530 00000100:00100000:2.0:1746129761.534698:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949052434304:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:2.0:1746129761.534834:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129761.534837:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129760 -> 1746129760 00002000:00010000:2.0:1746129761.534839:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746129759 -> 1746129760 00002000:00010000:2.0:1746129761.534841:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129760 -> 1746129762 00002000:00010000:2.0:1746129761.534843:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746129761.534895:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949052434304:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 196us (1819us total) trans 17179873293 rc 0/0 00000100:00100000:2.0:1746129761.534900:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11530 00000100:00100000:2.0:1746129761.534914:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11531 00000100:00100000:2.0:1746129761.534919:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949052434560:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:2.0:1746129761.534997:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746129761.534999:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129760 -> 1746129760 00002000:00010000:2.0:1746129761.535001:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129759 -> 1746129760 00002000:00010000:2.0:1746129761.535003:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129760 -> 1746129762 00002000:00010000:2.0:1746129761.535004:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746129761.535021:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1961:x1830949052434560:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 102us (1880us total) trans 21474840418 rc 0/0 00000100:00100000:2.0:1746129761.535026:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11531 00000100:00100000:2.0:1746129761.535036:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11532 00000100:00100000:2.0:1746129761.535040:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949052434176:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:2.0:1746129761.535096:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129761.535098:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129760 -> 1746129760 00002000:00010000:2.0:1746129761.535100:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129759 -> 1746129760 00002000:00010000:2.0:1746129761.535101:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129760 -> 1746129762 00002000:00010000:2.0:1746129761.535103:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746129761.535119:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1961:x1830949052434176:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 78us (1963us total) trans 21474840419 rc 0/0 00000100:00100000:2.0:1746129761.535124:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11532 00000100:00100000:2.0:1746129761.535135:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11533 00000100:00100000:2.0:1746129761.535140:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949052434432:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:2.0:1746129761.535203:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:2.0:1746129761.535205:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129760 -> 1746129760 00002000:00010000:2.0:1746129761.535207:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129760 -> 1746129760 00002000:00010000:2.0:1746129761.535208:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129760 -> 1746129762 00002000:00010000:2.0:1746129761.535210:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5673 -> 5673 00000100:00100000:2.0:1746129761.535242:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949052434432:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 101us (2065us total) trans 17179873294 rc 0/0 00000100:00100000:2.0:1746129761.535247:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11533 00000100:00100000:0.0:1746129761.538406:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129761.539141:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052434816 00000100:00100000:1.0:1746129761.539148:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052434816 00000100:00100000:1.0:1746129761.539738:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10016 00000100:00100000:1.0:1746129761.539747:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28910:x1830949052434816:12345-192.168.204.31@tcp:55:lfs.0 00010000:00010000:1.0:1746129761.539800:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e4394ad29 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129761.539811:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e4394ad29 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129761.539818:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e4394ad29 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129761.539835:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e4394ad29 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129761.539841:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e4394ad29 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129761.539897:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e4394ad29 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129761.539902:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4ff3a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129761.539905:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e4394ad29 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129761.539911:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e4394ad29 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129761.539920:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129761.539923:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1746129761.539926:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e4394ad29 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129761.539930:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e4394ad29 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00000100:00100000:1.0:1746129761.539982:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28910:x1830949052434816:12345-192.168.204.31@tcp:55:lfs.0 Request processed in 236us (1581us total) trans 0 rc -22/-22 00000100:00100000:1.0:1746129761.539988:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10016 00000100:00100000:0.0:1746129761.544293:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129761.544382:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052435072 00000100:00100000:3.0:1746129761.544390:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052435072 00000100:00100000:3.0:1746129761.544436:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3967 00000100:00100000:3.0:1746129761.544443:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:28910:x1830949052435072:12345-192.168.204.31@tcp:35:lfs.0 00000004:00010000:3.0:1746129761.544486:0:14316:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x368:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283200/0x48868a4e4394ac42 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350340 expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.544526:0:14316:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b400/0x48868a4e4394ad30 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 00010000:00010000:3.0:1746129761.544536:0:14316:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0a00/0x48868a4e4394ac81 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350347 expref: 284 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.544541:0:14316:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b400/0x48868a4e4394ad30 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 00010000:00010000:3.0:1746129761.544566:0:14316:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0a00/0x48868a4e4394ac81 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350347 expref: 284 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129761.544575:0:14316:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0a00/0x48868a4e4394ac81 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350347 expref: 284 pid: 14314 timeout: 807 lvb_type: 0 00000100:00100000:3.0:1746129761.544584:0:14316:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14316:1830949053398016:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129761.544660:0:14316:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129761.546403:0:14316:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14316:1830949053398016:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129761.546421:0:14316:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b400/0x48868a4e4394ad30 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 00000100:00100000:0.0:1746129761.546882:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129761.546981:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052435200 00000100:00100000:1.0:1746129761.546986:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052435200 00010000:00010000:1.0:1746129761.547011:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0a00/0x48868a4e4394ac81 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350347 expref: 285 pid: 14314 timeout: 807 lvb_type: 0 00000100:00100000:1.0:1746129761.547037:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5572 00000100:00100000:1.0:1746129761.547043:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:1961:x1830949052435200:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129761.547054:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129761.547059:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0a00/0x48868a4e4394ac81 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350347 expref: 285 pid: 14314 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746129761.547068:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0a00/0x48868a4e4394ac81 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350347 expref: 285 pid: 14314 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746129761.547083:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f0a00/0x48868a4e4394ac81 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350347 expref: 285 pid: 14314 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746129761.547094:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:1.0:1746129761.547098:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b400/0x48868a4e4394ad30 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 00010000:00010000:1.0:1746129761.547105:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b400/0x48868a4e4394ad30 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14316 initiator: MDT0 00010000:00010000:1.0:1746129761.547111:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b400/0x48868a4e4394ad30 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14316 initiator: MDT0 00010000:00010000:1.0:1746129761.547810:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129761.547864:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:1961:x1830949052435200:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 801us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129761.547871:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5572 00010000:00010000:2.0:1746129761.548242:0:14316:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b400/0x48868a4e4394ad30 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 00010000:00010000:2.0:1746129761.548249:0:14316:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b400/0x48868a4e4394ad30 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 00000040:00080000:2.0:1746129761.548880:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2923, 88 off244080 00000004:00080000:2.0:1746129761.548885:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707607037010ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129761.548932:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2846, 88 off237384 00000004:00080000:2.0:1746129761.548937:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707607088522ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129761.548954:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2847, 88 off237472 00000004:00080000:2.0:1746129761.548957:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707607108795ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129761.548964:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2924, 88 off244168 00000004:00080000:2.0:1746129761.548967:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707607118957ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129761.548973:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2925, 88 off244256 00000004:00080000:2.0:1746129761.548976:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707607127992ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129761.549010:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2849, 88 off237656 00000004:00080000:2.0:1746129761.549013:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707607165438ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129761.549022:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2850, 88 off237744 00000004:00080000:2.0:1746129761.549024:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707607176130ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129761.549029:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2851, 88 off237832 00000004:00080000:2.0:1746129761.549031:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707607183178ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129761.549037:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2926, 88 off244344 00000004:00080000:2.0:1746129761.549040:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707607191695ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129761.549046:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2852, 88 off237920 00000004:00080000:2.0:1746129761.549048:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707607200090ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129761.549053:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2927, 88 off244432 00000004:00080000:2.0:1746129761.549056:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707607207767ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129761.549062:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2853, 88 off238008 00000004:00080000:2.0:1746129761.549064:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707607215890ns, next at 641623252291ns, rc = 0 00000040:00080000:2.0:1746129761.549070:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2928, 88 off244520 00000004:00080000:2.0:1746129761.549072:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707607224292ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129761.549078:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2929, 88 off244608 00000004:00080000:2.0:1746129761.549080:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707607231878ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129761.549086:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2930, 88 off244696 00000004:00080000:2.0:1746129761.549088:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707607240540ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129761.549094:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2931, 88 off244784 00000004:00080000:2.0:1746129761.549096:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707607248290ns, next at 641639930618ns, rc = 0 00000040:00080000:2.0:1746129761.549102:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2854, 88 off238096 00000004:00080000:2.0:1746129761.549105:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707607256910ns, next at 641623252291ns, rc = 0 00000001:00080000:1.0:1746129761.574821:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943826 is committed 00000001:00080000:1.0:1746129761.574906:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943827 is committed 00000004:00080000:1.0:1746129761.574914:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2038 committed 00000004:00080000:1.0:1746129761.574920:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2112 committed 00000004:00010000:3.0:1746129761.574933:0:14316:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012baa3850 reply state ffff88008e0c8c00 transno 8589943827 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b400/0x48868a4e4394ad30 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 00000100:00100000:3.0:1746129761.574946:0:14316:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746129761.574952:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00010000:00010000:3.0:1746129761.574954:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129761.574961:0:14316:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283200/0x48868a4e4394ac42 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350340 expref: 282 pid: 14315 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746129761.574977:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2111 committed 00000004:00080000:1.0:1746129761.574979:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2110 committed 00000004:00080000:1.0:1746129761.574980:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2109 committed 00000004:00080000:1.0:1746129761.574981:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2037 committed 00000004:00080000:1.0:1746129761.574983:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2108 committed 00000004:00080000:1.0:1746129761.574984:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2036 committed 00000004:00080000:1.0:1746129761.574985:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2107 committed 00000004:00080000:1.0:1746129761.574987:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2035 committed 00000004:00080000:1.0:1746129761.574988:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2034 committed 00000004:00080000:1.0:1746129761.574989:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2033 committed 00000004:00080000:1.0:1746129761.574990:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2106 committed 00010000:00080000:3.0:1746129761.575048:0:14316:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746129761.575058:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:28910:x1830949052435072:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 30615us (30771us total) trans 8589943827 rc 0/0 00000100:00100000:2.0:1746129761.575058:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053398528:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129761.575066:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3967 00000100:00100000:2.0:1746129761.575094:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129761.575097:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053398144:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129761.575106:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053398400:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129761.575113:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053399040:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129761.575122:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746129761.575129:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b400/0x48868a4e4394ad30 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 00010000:00010000:2.0:1746129761.575135:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b400/0x48868a4e4394ad30 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 00010000:00010000:2.0:1746129761.575140:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b400/0x48868a4e4394ad30 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 00000100:00100000:0.0:1746129761.575140:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053398656:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746129761.575144:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a12b400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129761.575147:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b400/0x48868a4e4394ad30 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 00010000:00010000:2.0:1746129761.575152:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b400/0x48868a4e4394ad30 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 00000100:00100000:0.0:1746129761.575153:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746129761.575163:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012e2d8700) 00000100:00100000:0.0:1746129761.575163:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053399168:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746129761.575165:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129761.575167:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b400/0x48868a4e4394ad30 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 00010000:00010000:2.0:1746129761.575171:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b400/0x48868a4e4394ad30 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 00000100:00100000:0.0:1746129761.575174:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129761.575183:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053399680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129761.575196:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129761.575207:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053398528 00000100:00100000:0.0:1746129761.575209:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000004:00080000:1.0:1746129761.575210:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2105 committed 00000004:00080000:1.0:1746129761.575212:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2032 committed 00000100:00100000:3.0:1746129761.575213:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053398528 00000100:00100000:0.0:1746129761.575213:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053399552:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129761.575225:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2031 committed 00000004:00080000:1.0:1746129761.575229:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2104 committed 00000100:00100000:3.0:1746129761.575242:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053398144 00000100:00100000:1.0:1746129761.575243:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053398656 00000100:00100000:0.0:1746129761.575243:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129761.575244:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053398144 00000100:00100000:1.0:1746129761.575245:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053398656 00000100:00100000:3.0:1746129761.575255:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053399168 00000100:00100000:3.0:1746129761.575256:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053399168 00000100:00100000:0.0:1746129761.575262:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a56fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053400064:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129761.575265:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053399680 00000100:00100000:3.0:1746129761.575266:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053399552 00000100:00100000:3.0:1746129761.575267:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053399552 00000100:00100000:1.0:1746129761.575267:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053399680 00000100:00100000:0.0:1746129761.575275:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129761.575276:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11534 00000100:00100000:1.0:1746129761.575279:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11535 00000100:00100000:3.0:1746129761.575281:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3296:x1830949053398528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129761.575283:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3297:x1830949053398144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129761.575292:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053398272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129761.575305:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129761.575312:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053398784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129761.575323:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129761.575328:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053399296:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129761.575340:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129761.575346:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053399808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129761.575358:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129761.575374:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053400064 00000100:00100000:0.0:1746129761.575377:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053400064 00000100:00100000:0.0:1746129761.575388:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053398272 00000100:00100000:0.0:1746129761.575389:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053398272 00000100:00100000:0.0:1746129761.575395:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053398784 00000100:00100000:0.0:1746129761.575397:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053398784 00000100:00100000:0.0:1746129761.575402:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053399296 00000100:00100000:0.0:1746129761.575403:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053399296 00002000:00010000:3.0:1746129761.575408:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129761.575408:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:0.0:1746129761.575408:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053399808 00000100:00100000:0.0:1746129761.575409:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053399808 00002000:00010000:3.0:1746129761.575411:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746129760 -> 1746129760 00002000:00010000:1.0:1746129761.575411:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746129760 -> 1746129760 00002000:00010000:3.0:1746129761.575413:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746129760 -> 1746129760 00002000:00010000:1.0:1746129761.575413:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746129760 -> 1746129760 00002000:00010000:3.0:1746129761.575414:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746129762 -> 1746129762 00002000:00010000:1.0:1746129761.575414:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746129762 -> 1746129762 00002000:00010000:3.0:1746129761.575416:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:1.0:1746129761.575416:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746129761.575416:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11536 00000100:00100000:0.0:1746129761.575420:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3297:x1830949053398656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129761.575436:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3296:x1830949053398528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 155us (341us total) trans 17179873295 rc 0/0 00000100:00100000:1.0:1746129761.575437:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+18:3297:x1830949053398144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 154us (315us total) trans 21474840420 rc 0/0 00000100:00100000:3.0:1746129761.575441:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11534 00000100:00100000:1.0:1746129761.575443:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11535 00000100:00100000:1.0:1746129761.575451:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11537 00000100:00100000:3.0:1746129761.575453:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11538 00000100:00100000:1.0:1746129761.575454:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+19:3297:x1830949053399168:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129761.575456:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3297:x1830949053399552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129761.575502:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4960928 -> 4960928 00002000:00010000:0.0:1746129761.575505:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746129760 -> 1746129760 00002000:00010000:0.0:1746129761.575507:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746129760 -> 1746129760 00002000:00010000:0.0:1746129761.575508:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746129762 -> 1746129762 00002000:00010000:0.0:1746129761.575510:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5673 -> 5673 00000100:00100000:3.0:1746129761.575526:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3297:x1830949053399552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (282us total) trans 21474840421 rc 0/0 00000100:00100000:1.0:1746129761.575526:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3297:x1830949053399168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (350us total) trans 17179873297 rc 0/0 00000100:00100000:1.0:1746129761.575531:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11537 00000100:00100000:0.0:1746129761.575531:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3297:x1830949053398656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (376us total) trans 17179873296 rc 0/0 00000100:00100000:3.0:1746129761.575533:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11538 00000100:00100000:0.0:1746129761.575537:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11536 00000100:00100000:3.0:1746129761.575540:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11539 00000100:00100000:1.0:1746129761.575542:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11540 00000100:00100000:3.0:1746129761.575543:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3297:x1830949053399680:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129761.575545:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+17:3297:x1830949053400064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129761.575552:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11541 00000100:00100000:0.0:1746129761.575556:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3298:x1830949053398272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129761.575565:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11542 00000100:00100000:3.0:1746129761.575569:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a56c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3298:x1830949053398784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129761.575616:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+18:3297:x1830949053400064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (339us total) trans 21474840422 rc 0/0 00000100:00100000:3.0:1746129761.575618:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11543 00000100:00100000:1.0:1746129761.575621:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11540 00000100:00100000:3.0:1746129761.575622:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949053399296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129761.575625:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746129761.575628:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746129760 -> 1746129760 00000100:00100000:1.0:1746129761.575629:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11544 00002000:00010000:0.0:1746129761.575629:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746129760 -> 1746129760 00002000:00010000:0.0:1746129761.575631:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746129762 -> 1746129762 00002000:00010000:0.0:1746129761.575632:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:1.0:1746129761.575633:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+17:3298:x1830949053399808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129761.575653:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949053398272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (346us total) trans 17179873298 rc 0/0 00000100:00100000:0.0:1746129761.575658:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11541 00000004:00080000:0.0:1746129761.575689:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fbed500/2, rc 0, transno 17179873298 00000100:00100000:3.0:1746129761.575694:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949053399296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (352us total) trans 17179873300 rc 0/0 00000100:00100000:1.0:1746129761.575694:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+18:3298:x1830949053399808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (334us total) trans 21474840423 rc 0/0 00000100:00100000:0.0:1746129761.575694:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053398272:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129761.575698:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11543 00000100:00100000:1.0:1746129761.575700:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11544 00000004:00080000:0.0:1746129761.575701:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fbeca80/2, rc 0, transno 17179873300 00000100:00100000:0.0:1746129761.575704:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053399296:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129761.575711:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02fed80/2, rc 0, transno 21474840423 00000100:00100000:3.0:1746129761.575712:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129761.575715:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053399808:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129761.575724:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053398912:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129761.575726:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02fdf80/2, rc 0, transno 21474840421 00000100:00100000:0.0:1746129761.575729:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053399552:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129761.575730:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053398400 00000100:00100000:1.0:1746129761.575733:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053398400 00000004:00080000:0.0:1746129761.575734:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a56fb80/2, rc 0, transno 21474840422 00000100:00100000:0.0:1746129761.575736:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a56fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053400064:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129761.575739:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746129761.575742:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02fea00/2, rc 0, transno 21474840420 00000100:00100000:1.0:1746129761.575743:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053398912 00000100:00100000:0.0:1746129761.575744:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053398144:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129761.575745:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053398912 00000100:00100000:3.0:1746129761.575749:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053399424:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129761.575750:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fbec000/2, rc 0, transno 17179873296 00000100:00100000:0.0:1746129761.575752:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053398656:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129761.575753:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11545 00000100:00100000:1.0:1746129761.575757:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3299:x1830949053398400:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129761.575759:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fbee680/2, rc 0, transno 17179873297 00000100:00100000:3.0:1746129761.575760:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129761.575761:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053399168:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129761.575768:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053400192:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129761.575769:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053399936:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129761.575786:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129761.575806:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053399424 00000100:00100000:0.0:1746129761.575809:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053399424 00000100:00100000:3.0:1746129761.575815:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949053398784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 245us (491us total) trans 17179873299 rc 0/0 00000100:00100000:3.0:1746129761.575820:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11542 00000100:00100000:0.0:1746129761.575820:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053400192 00002000:00010000:1.0:1746129761.575822:0:20441:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:0.0:1746129761.575822:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053400192 00002000:00010000:1.0:1746129761.575824:0:20441:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746129760 -> 1746129760 00002000:00010000:1.0:1746129761.575826:0:20441:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746129760 -> 1746129760 00002000:00010000:1.0:1746129761.575827:0:20441:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746129762 -> 1746129762 00000100:00100000:3.0:1746129761.575828:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11546 00002000:00010000:1.0:1746129761.575829:0:20441:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129761.575831:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11547 00000100:00100000:3.0:1746129761.575832:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3299:x1830949053398912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129761.575836:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3299:x1830949053399424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129761.575861:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3299:x1830949053398400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (133us total) trans 21474840424 rc 0/0 00000100:00100000:1.0:1746129761.575866:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11545 00000100:00100000:1.0:1746129761.575875:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11548 00000100:00100000:1.0:1746129761.575879:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3297:x1830949053400192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129761.575916:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3299:x1830949053398912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (176us total) trans 17179873301 rc 0/0 00000100:00100000:3.0:1746129761.575921:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11546 00002000:00010000:0.0:1746129761.575931:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746129761.575934:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746129760 -> 1746129760 00002000:00010000:0.0:1746129761.575936:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746129760 -> 1746129760 00002000:00010000:0.0:1746129761.575938:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746129762 -> 1746129762 00002000:00010000:0.0:1746129761.575939:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746129761.575944:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3297:x1830949053400192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (157us total) trans 17179873302 rc 0/0 00000100:00100000:1.0:1746129761.575948:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11548 00000100:00100000:0.0:1746129761.575959:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3299:x1830949053399424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 123us (197us total) trans 21474840425 rc 0/0 00000100:00100000:0.0:1746129761.575965:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11547 00000100:00100000:0.0:1746129761.575981:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129761.575989:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a56df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3297:x1830949053399680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 445us (792us total) trans 21474840426 rc 0/0 00000100:00100000:3.0:1746129761.575994:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11539 00000100:00100000:3.0:1746129761.576002:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053399936 00000004:00080000:0.0:1746129761.576002:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02fc700/2, rc 0, transno 21474840424 00000100:00100000:3.0:1746129761.576005:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053399936 00000100:00100000:0.0:1746129761.576005:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053398400:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129761.576012:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fbedc00/2, rc 0, transno 17179873301 00000100:00100000:0.0:1746129761.576014:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053398912:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129761.576016:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11549 00000004:00080000:0.0:1746129761.576019:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02fce00/2, rc 0, transno 21474840425 00000100:00100000:3.0:1746129761.576020:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3299:x1830949053399936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129761.576022:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053399424:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129761.576035:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fbeea00/2, rc 0, transno 17179873299 00000100:00100000:0.0:1746129761.576037:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053398784:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129761.576047:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba1ad80/2, rc 0, transno 17179873302 00000100:00100000:0.0:1746129761.576050:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053400192:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129761.576055:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02ff800/2, rc 0, transno 21474840426 00000100:00100000:0.0:1746129761.576057:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053399680:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129761.576091:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3299:x1830949053399936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (109us total) trans 21474840427 rc 0/0 00000100:00100000:3.0:1746129761.576096:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11549 00000004:00080000:0.0:1746129761.576100:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02fe300/2, rc 0, transno 21474840427 00000100:00100000:0.0:1746129761.576104:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053399936:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129761.576199:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129761.576209:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053399040 00000100:00100000:1.0:1746129761.576212:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053399040 00000004:00080000:2.0:1746129761.576231:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fbed880/2, rc 0, transno 17179873295 00000100:00100000:2.0:1746129761.576235:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053398528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129761.576248:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11550 00000100:00100000:1.0:1746129761.576253:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3296:x1830949053399040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129761.576469:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3296:x1830949053399040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 215us (268us total) trans 17179873303 rc 0/0 00000100:00100000:1.0:1746129761.576476:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11550 00000004:00080000:2.0:1746129761.576526:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fbeed80/2, rc 0, transno 17179873303 00000100:00100000:2.0:1746129761.576529:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053399040:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129761.577212:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129761.577299:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052435328 00000100:00100000:2.0:1746129761.577303:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052435328 00000100:00100000:2.0:1746129761.577431:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10017 00000100:00100000:2.0:1746129761.577437:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+281:28910:x1830949052435328:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129761.577450:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129761.577462:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa7a000/0x48868a4e4394ad37 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3503a9 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.577501:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa7a000/0x48868a4e4394ad37 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3503a9 expref: 282 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.577511:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa7a000/0x48868a4e4394ad37 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3503a9 expref: 282 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129761.577522:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88012bfcac00) 00010000:00010000:2.0:1746129761.577525:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129761.577527:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa7a000, rc 0) 00000100:00100000:2.0:1746129761.577661:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:28910:x1830949052435328:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 223us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129761.577666:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10017 00000100:00100000:0.0:1746129761.579615:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129761.579882:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949052435584 00000100:00100000:3.0:1746129761.579888:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949052435584 00000100:00100000:3.0:1746129761.579914:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3968 00000100:00100000:3.0:1746129761.579920:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:28910:x1830949052435584:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1746129761.580522:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:28910:x1830949052435584:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 516us (937us total) trans 8589943828 rc 0/0 00000100:00100000:3.0:1746129761.580528:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3968 00010000:00010000:2.0:1746129762.059158:0:12137:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1746129762.254677:0:3128:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200a: @@@@@@ FAIL: final resync failed Debug log: 69618 lines, 69618 kept, 0 dropped, 0 bad.